Scale Dependent Data Duplication
规模依赖的数据复制
机构 * Department of Statistics, Stanford University ; AI4Science, EPFL ; Department of Computer Science, Stanford University ; ServiceNow Research ; Department of XXX, University of YYY, Location, Country ; School of ZZZ, Institute of WWW, Location, Country ; École Polytechnique F\'ed\'erale de Lausanne (EPFL), CH-1015 Lausanne, Switzerland
AI总结 研究发现数据复制在不同规模下表现不同,模型能力提升导致语义相似性梯度一致,大规模下语义碰撞加速,提出明确的规模定律以提高预测准确性。