The Curse and Blessing of Mean Bias in FP4-Quantized LLM Training
FP4量化LLM训练中均值偏差的诅咒与祝福
Hengjie Cao, Zhendong Huang, Mengyi Chen, Yifeng Yang, Fang Dong, Anrui Chen, Ruijun Huang, Xin Zhang, Mingzhi Dong, Yujiang Wang, Jinlong Hou, Qin Lv, Robert P. Dick, Yuan Cheng, Tun Lu, Fan Yang, Yixuan Chen, Li Shang
机构
*
Fudan University(复旦大学)
;
University of Bath(巴斯大学)
;
Shanghai Innovation Institute(上海创新研究院)
;
University of Oxford(牛津大学)
;
Oxford Suzhou Centre for Advanced Research(牛津苏浙研究中心)
;
University of Colorado Boulder(科罗拉多大学波德格分校)
;
University of Michigan(密歇根大学)
;
Shenzhen Loop Area Institute(深圳河套学院)
机构
*
Robotics program at Oregon State University(俄勒冈州立大学机器人项目)
;
Department of Electrical Engineering and Computer Science at the University of Michigan(密歇根大学电气工程与计算机科学系)
From Small to Large: A Graph Convolutional Network Approach for Solving Assortment Optimization Problems
从小到大:一种用于解决分类优化问题的图卷积网络方法
Guokai Li, Pin Gao, Stefanus Jasin, Zizhuo Wang
机构
*
Smith School of Business, Queen’s University(女王大学商学院)
;
School of Data Science, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)数据科学学院)
;
Stephen M. Ross School of Business, University of Michigan(密歇根大学罗斯商学院)
MASLab: A Unified and Comprehensive Codebase for LLM-based Multi-Agent Systems
MASLab:基于LLM的多智能体系统的统一全面代码库
Rui Ye, Keduan Huang, Qimin Wu, Yuzhu Cai, Tian Jin, Xianghe Pang, Xiangrui Liu, Jiaqi Su, Chen Qian, Bohan Tang, Kaiqu Liang, Jiaao Chen, Yue Hu, Zhenfei Yin, Rongye Shi, Bo An, Yang Gao, Wenjun Wu, Lei Bai, Siheng Chen
机构
*
Shanghai Jiao Tong University(上海交通大学)
;
Shanghai AI Laboratory(上海人工智能实验室)
;
University of Oxford(牛津大学)
;
Princeton University(普林斯顿大学)
;
Meta
;
University of Michigan(密歇根大学)
;
The University of Sydney(悉尼大学)
;
Beihang University(北航)
;
Nanyang Technological University(南洋理工大学)
;
Nanjing University(南京大学)