Sign-Based Optimizers Are Effective Under Heavy-Tailed Noise
基于符号的优化器在重尾噪声下表现有效
Dingzhi Yu, Hongyi Tao, Yuanyu Wan, Luo Luo, Lijun Zhang
机构
*
State Key Laboratory of Novel Software Technology, Nanjing University(南京大学新型软件技术国家重点实验室)
;
School of Artificial Intelligence, Nanjing University(南京大学人工智能学院)
;
School of Software Technology, Zhejiang University(浙江大学软件学院)
;
School of Data Science, Fudan University(复旦大学数据科学学院)
机构
*
Westlake University(西湖大学)
;
Zhejiang University(浙江大学)
;
Tiangong University(天工大学)
;
Hunan University(湖南大学)
;
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
ForgeVLA: Federated Vision-Language-Action Learning without Language Annotations
ForgeVLA:无需语言标注的联邦视觉-语言-动作学习
Yuhao Zhou, Yunpeng Zhu, Yang Zhou, Jindi Lyu, Jian Lan, Zhangyuan Wang, Dan Si, Thomas Seidl, Qing Ye, Jiancheng Lyu
机构
*
Sichuan University(四川大学)
;
Zhejiang University(浙江大学)
;
Ludwig-Maximilians-Universität München(慕尼黑路德维希-马克西米利安大学)
;
Lenovo Group Limited(联想集团有限公司)
;
Engineering Research Center of Machine Learning and Industry Intelligence, Ministry of Education(教育部机器学习与工业智能工程研究中心)
机构
*
Zhejiang University(浙江大学)
;
Xi’an Jiaotong University(西安交通大学)
;
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
;
University of Science and Technology Beijing(北京科技大学)
Implicit Compression Regularization: Concise Reasoning via Internal Shorter Distributions in RL Post-Training
隐式压缩正则化:通过内部更短分布实现简洁推理(在强化学习后训练)
Chen Wang, Hexuan Deng, Yining Zhang, Yuchen Zhang, Jionghao Bai, Zhaochun Li, Ge Lan, Yue Wang
机构
*
College of Software, Nankai University(南开大学软件学院)
;
Zhongguancun Academy(中关村学院)
;
Harbin Institute of Technology(哈尔滨工业大学)
;
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
;
East China Normal University(华东师范大学)
;
Zhejiang University(浙江大学)
;
Beijing Institute of Technology(北京理工大学)
机构
*
Zhejiang University(浙江大学)
;
Harbin Institute of Technology(哈尔滨工业大学)
;
Harbin Institute of Technology Suzhou Research Institute(哈尔滨工业大学苏州研究院)
;
North China University of Water Resources and Electric Power(华北水利水电大学)
;
University of Auckland(奥克兰大学)
机构
*
Department of Computer Science and Engineering(计算机科学与工程系)
;
The Chinese University of Hong Kong(香港中文大学)
;
School of Software(软件学院)
;
Tsinghua University(清华大学)
;
ZJU-UIUC Institute(浙大-UIUC研究院)
;
Zhejiang University(浙江大学)
;
School of Data Science(数据科学学院)
;
The Chinese University of Hong Kong, Shenzhen(深圳香港中文大学)
Yuqi Pan, Yupeng Feng, Jinghao Zhuang, Siyu Ding, Han Xu, Zehao Liu, Bohan Sun, Yuhong Chou, Xuerui Qiu, Anlin Deng, Anjie Hu, Shurong Wang, Peng Zhou, Man Yao, Jibin Wu, Jian Yang, Guoliang Sun, Bo Xu, Guoqi Li
机构
*
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
;
Beijing Key Laboratory of Brain-Inspired General Intelligence Large Model(北京脑启发通用智能大模型重点实验室)
;
Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology(脑认知与脑启发智能技术重点实验室)
;
Beijing Academy of Artificial Intelligence(北京人工智能研究院)
;
The Hong Kong Polytechnic University(香港理工大学)
;
Zhongguancun Academy(中关村学院)
;
Beihang University(北航)
;
Zhejiang University(浙江大学)
;
LuxiTech
;
MetaX Integrated Circuit Co., Ltd(MetaX集成电路有限公司)