PRAC: Principal-Random Subspace for LLM Activation Compression and Memory-Efficient Training
PRAC: 用于LLM激活压缩和内存高效训练的主成分随机子空间
Yanyi Li, Yimu Zhang, Cong Fang
机构
*
School of Intelligence Science and Technology, Peking University(北京大学智能科学与技术学院)
;
Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院)
Towards Better RL Training Data Utilization via Second-Order Rollout
通过二次回滚实现更好的RL训练数据利用
Zhe Yang, Yudong Wang, Rang Li, Zhifang Sui
机构
*
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University(多媒体信息处理国家重点实验室,计算机学院,北京大学)
;
ByteDance BandAI(字节跳动BandAI)
机构
*
School of Computer Science, Peking University, Beijing 100871, China(北京大学计算机科学学院)
;
Key Lab of High Confidence Software Technologies (Peking University), Ministry of Education(高可信软件技术重点实验室(北京大学))
pQuant: Towards Effective Low-Bit Language Models via Decoupled Linear Quantization-Aware Training
pQuant:通过解耦线性量化感知训练实现有效的低比特语言模型
Wenzheng Zhang, Bingzheng Liu, Yang Hu, Xiaoying Bai, Wentao Zhang, Bin Cui
机构
*
School of Computer Science, Peking University(北京大学计算机学院)
;
College of Future Information Technology, Fudan University(复旦大学未来信息技术学院)
;
Center for Information Research, Academy of Military Sciences(军事科学院信息研究所)
;
Advanced Institute of Big Data(大数据高级研究所)
;
Center of Machine Learning Research, Peking University(北京大学机器学习研究中心)
DICArt: Advancing Category-level Articulated Object Pose Estimation in Discrete State-Spaces
DICArt: 在离散状态空间中推进类别级拟合物体姿态估计
Li Zhang, Mingyu Mei, Ailing Wang, Xianhui Meng, Yan Zhong, Xinyuan Song, Liu Liu, Rujing Wang, Zaixing He, Cewu Lu
机构
*
University of Science and Technology of China(中国科学技术大学)
;
Shanghai Jiao Tong University(上海交通大学)
;
Zhejiang University(浙江大学)
;
East China Normal University(华东师范大学)
;
Peking University(北京大学)
;
Emory University(埃默里大学)
;
Hefei University of Technology(合肥工业大学)
;
Jianghuai Advance Technology Center(江淮先进技术中心)
;
Anhui Provincial Key Laboratory of Humanoid Robots(安徽省人形机器人重点实验室)