Every Coin Has Two Sides: On the Dual Nature of Generalization in On-Policy Distillation of Large Language Models
硬币皆有两面:关于大型语言模型的策略内蒸馏中泛化的双重性质
Zhaoyi Li, Deyang Kong, Yuan Wei, Evan Yang, Ranran Shen, Mahardika Krisna Ihsani, Ming Yang, Wei Zhang, Chuan Hao, Jian Yang, Ran Tao, Bryan Dai, Shikun Zhang, Wei Ye, Ying Wei, Defu Lian
机构
*
University of Science and Technology of China(中国科学技术大学)
;
Peking University(北京大学)
;
IQuest Research(IQuest研究院)
;
MBZUAI(穆罕默德·本·扎耶德人工智能大学)
;
Zhejiang University(浙江大学)
机构
*
Huzhou Institute of Zhejiang University(浙江大学湖州研究院)
;
University of Electronic Science and Technology of China(电子科技大学)
;
Institute of Cyber-Systems and Control, College of Control Science and Engineering, Zhejiang University(浙江大学控制科学与工程学院 cyber系统与控制研究所)
;
Differential Robotics Technology Company(差分机器人技术公司)
RetroMPA: A Molecular Property-Aware Auxiliary Framework for Enhancing Retrosynthesis Prediction
RetroMPA:一种用于增强逆合成预测的分子属性感知辅助框架
Mianzhi Liu, Fan Xiao, Zhiliang Yu, Huayang Huang, Yuke Li, Yi Yang, Wenbo Liu, Yu Wu
机构
*
School of Cyber Science and Engineering, Wuhan University(武汉大学网络安全学院)
;
School of Computer Science, Wuhan University(武汉大学计算机学院)
;
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)
;
College of Chemistry and Molecular Sciences, Wuhan University(武汉大学化学与分子科学学院)
From Generalist to Specialist: A Context-Fusion Framework for Endoscopic Polyp Reporting with a Frozen VLM
从通用到专用:基于冻结视觉语言模型(VLM)的内窥镜息肉报告上下文融合框架
Ruijie Yang, Yan Zhu, Peiyao Fu, Siyuan Li, Te Luo, Zhihua Wang, Quanlin Li, Pinghong Zhou, Xian Yang, Shuo Wang
机构
*
Zhejiang University(浙江大学)
;
Shanghai Institute for Advanced Study, Zhejiang University(浙江大学上海高等研究院)
;
Shanghai Key Laboratory of MICCAI(上海市MICCAI重点实验室)
;
Digital Medical Research Center, School of Basic Medical Sciences, Fudan University(复旦大学基础医学院数字医学研究中心)
;
Endoscopy Center and Endoscopy Research Institute, Zhongshan Hospital, Fudan University(复旦大学附属中山医院内镜中心及内镜研究所)
;
Shanghai Collaborative Innovation Center of Endoscopy(上海市内镜协同创新中心)
;
Alliance Manchester Business School, The University of Manchester(曼彻斯特大学联盟曼彻斯特商学院)
机构
*
IROOTECH TECHNOLOGY
;
Wolf 1069 b Lab, Sany Group(三一集团Wolf 1069 b实验室)
;
Zhejiang University(浙江大学)
;
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院)
;
BPIT, Sany Group(三一集团BPIT)
机构
*
College of Information Science and Electronic Engineering, Zhejiang University(信息科学与电子工程学院,浙江大学)
;
Zhejiang Lab(浙江实验室)
;
Macau University of Science and Technology, China(澳门科学理工学院,中国)
机构
*
Xi’an Jiaotong Univeristy(西安交通大学)
;
Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
;
Chinese Academy of Sciences(中国科学院)
;
Westlake University(西湖大学)
;
Zhejiang University(浙江大学)
;
University of Sydney(悉尼大学)
;
BAAI(百度人工智能研究院)
;
Peking University(北京大学)
CommentsThis work is a re-architected core derived from the full survey ( arXiv:2510.10903 (https://arxiv.org/abs/2510.10903) ), refined to highlight the most central themes and representative studies