机构
*
School of Remote Sensing and Information Engineering, Wuhan University(武汉大学遥感与信息工程学院)
;
First Surveying and Mapping Institute of Hunan Province(湖南省第一测绘院)
PC Layer: Polynomial Weight Preconditioning for Improving LLM Pre-Training
PC层:通过多项式权重预处理改进大语言模型预训练
Senmiao Wang, Tiantian Fang, Haoran Zhang, Yushun Zhang, Kunxiang Zhao, Alex Schwing, Ruoyu Sun
机构
*
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
;
Google LLC(谷歌公司)
;
Shenzhen International Center for Industrial and Applied Mathematics(深圳国际工业与应用数学中心)
;
Shenzhen Research Institute of Big Data(深圳大数据研究院)
;
University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)