Every Coin Has Two Sides: On the Dual Nature of Generalization in On-Policy Distillation of Large Language Models
硬币皆有两面:关于大型语言模型的策略内蒸馏中泛化的双重性质
Zhaoyi Li, Deyang Kong, Yuan Wei, Evan Yang, Ranran Shen, Mahardika Krisna Ihsani, Ming Yang, Wei Zhang, Chuan Hao, Jian Yang, Ran Tao, Bryan Dai, Shikun Zhang, Wei Ye, Ying Wei, Defu Lian
机构
*
University of Science and Technology of China(中国科学技术大学)
;
Peking University(北京大学)
;
IQuest Research(IQuest研究院)
;
MBZUAI(穆罕默德·本·扎耶德人工智能大学)
;
Zhejiang University(浙江大学)
HaReCAP: Habitual-action Grounding for Recursive Large Language Model Agents
HaReCAP:面向递归大语言模型智能体的习惯性动作 grounding 方法
Shen Liu, Zhenguo Xu, Shaopu Wang, Yike Gao, Chunlei Wang
机构
*
North China Institute of Computer System Engineering(华北计算机系统工程研究所)
;
University of Science and Technology of China(中国科学技术大学)
;
China Information Security Research Institute Co., Ltd.(中国信息安全研究院有限公司)
Conditional Evaluation of Language Models with Cheap Auxiliary Signals
基于廉价辅助信号的语言模型条件评估
Zhi Zhang, Lingfeng Lyu, Yue Kang, Doudou Zhou
机构
*
University of California, Los Angeles(加利福尼亚大学洛杉矶分校)
;
University of Science and Technology of China(中国科学技术大学)
;
Microsoft(微软公司)
;
National University of Singapore(新加坡国立大学)
机构
*
Shanghai Jiao Tong University(上海交通大学)
;
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
;
Shanghai Innovation Institute(上海创新研究院)
;
Huazhong University of Science and Technology(华中科技大学)
;
University of Science and Technology of China(中国科学技术大学)
Towards Reasonable Molecular Structure Elucidation from Infrared Spectroscopy with Chemical Feedback
基于化学反馈的红外光谱合理分子结构解析研究
Yusen Tan, Hongyu Zhan, Hai-tao Yu, Changxi Chi, Wenjie Du, Jun Xia
机构
*
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
;
Westlake University(西湖大学)
;
University of Science and Technology of China(中国科学技术大学)
Temporal Logic Guided Universal Task Representations for Reinforcement Learning
用于强化学习的时序逻辑引导通用任务表示
Hao Zhang, Zhangli Zhou, Zhen Kan
机构
*
University of Science and Technology of China(中国科学技术大学)
;
Anhui Provincial Key Laboratory of Humanoid Robots(安徽省人形机器人重点实验室)
;
Chinese Academy of Sciences(中国科学院)
CommentsAccepted by IEEE Transactions on Neural Networks and Learning Systems (Early Access). Project page: this https URL (https://lotus-website.github.io/)
TERRA: A Hierarchical Parallel Training and Memory Orchestration Framework for High-Resolution AI-based Earth Modeling
TERRA:面向高分辨率AI地球建模的分层并行训练与内存编排框架
Ruohan Wu, Ziqi Zhu, Yang Zhao, Jiarui Tang, Yingzhe Cui, Junshi Chen, Zhao Jing, Jun Shi, Hong An
机构
*
School of Computer Science and Technology, University of Science and Technology of China(中国科学技术大学计算机科学与技术学院)
;
School of Artificial Intelligence and Data Science, University of Science and Technology of China(中国科学技术大学人工智能与数据科学学院)
;
Laoshan Laboratory(崂山实验室)
;
Ocean University of China(中国海洋大学)
Comments15 pages, 16 figures, 6 tables, and 2 algorithms. Submitted to IEEE Transactions on Parallel and Distributed Systems (TPDS). Code is available at this https URL (https://github.com/ruohan12345/TERRA)
机构
*
The University of Hong Kong(香港大学)
;
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
;
Fudan University(复旦大学)
;
Tongji University(同济大学)
;
University of Science and Technology of China(中国科学技术大学)
;
Shanghai Jiao Tong University(上海交通大学)
Decision-Driven Regularization: A Blended Model for Learning and Optimization
决策驱动正则化:一种用于学习与优化的混合模型
Gar Goei Loke, Qinshen Tang, Yangge Xiao, Xun Zhang
机构
*
Durham University Business School(杜伦大学商学院)
;
Nanyang Business School, Nanyang Technological University(南洋理工大学南洋商学院)
;
Faculty of Business and Economics, The University of Melbourne(墨尔本大学商学院与经济学院)
;
International Institute of Finance, School of Management, University of Science and Technology of China(中国科学技术大学管理学院国际金融研究所)
机构
*
Fuzhou University(福州大学)
;
Chinese Academy of Sciences(中国科学院)
;
Peking University(北京大学)
;
Alibaba Group(阿里巴巴集团)
;
University of Science and Technology of China(中国科学技术大学)
;
Fullive Innovation (Beijing) AI Technology Co., Ltd.(福莱创新(北京)人工智能科技有限公司)
;
Baidu(百度)
;
Wuhan University(武汉大学)
Empowering Polymeric Materials Discovery by Artificial Intelligence
人工智能赋能高分子材料发现
Chenyao Ma, Linda Zhang, Yuheng Chen, Wei Du, Shangwen Fang, Zihao Jiang, Chuanyu Liu, Xinyu Ma, Rui Su, Gang Wang, Muyao Yu, Dong Zhong, Jie Zhu, Weibo Gong, Huan Gu, Limin Li, Chen Shen, Rui Wu, Zhenghao Wu, Kan Xu, Min Zhou, Donglin He, Xiayun Huang, Shan Jiang, Pengfei Ou, Jiayu Peng, Yuwei Zhang, Jie Zhao, Di Zhang, Piao Ma, Zhenghao Li, Hao Li
机构
*
Suzhou MatSource Technology Co., Ltd.(苏州MatSource科技有限公司)
;
Gusu Laboratory of Materials(材料Gusu实验室)
;
Advanced Institute for Materials Research (WPI-AIMR)(先进材料研究所(WPI-AIMR))
;
Frontier Research Institute for Interdisciplinary Sciences (FRIS)(交叉学科前沿研究所(FRIS))
;
State Key Laboratory of Advanced Environmental Technology, Department of Environmental Science and Engineering, University of Science and Technology of China(先进技术国家实验室,环境科学与工程系,中国科学技术大学)
;
Jiangsu Key Laboratory of New Power Batteries, Jiangsu Collaborative Innovation Centre of Biomedical Functional Materials, School of Chemistry and Materials Science, Nanjing Normal University(新型动力电池江苏省重点实验室,生物医学功能材料协同创新中心,化学与材料科学学院,南京师范大学)
;
Department of Chemistry, National University of Singapore(新加坡国立大学化学系)
;
Thrust of Sustainable Energy and Environment, The Hong Kong University of Science and Technology (Guangzhou)(可持续能源与环境方向,香港科技大学(广州))
;
Department of Materials Design and Innovation, University at Buffalo(材料设计与创新系,布法罗大学)
;
College of Smart Materials and Future Energy, State Key Laboratory of Molecular Engineering of Polymers, Fudan University(智能材料与未来能源学院,聚合物分子工程国家重点实验室,复旦大学)
;
School of Physical Science and Technology, Shanghai tech University(物理科学与技术学院,上海科技大学)
;
The State Key Laboratory of Molecular Engineering of Polymers and Department of Macromolecular Science, Fudan University(聚合物分子工程国家重点实验室和大分子科学系,复旦大学)
;
Department of Chemistry and Materials Science, Xi'an J Liverpool University(化学与材料科学系,西安J Liverpool大学)
机构
*
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
;
Shanghai Jiao Tong University(上海交通大学)
;
University of Science and Technology of China(中国科学技术大学)
机构
*
University of Pennsylvania(宾夕法尼亚大学)
;
University of Michigan(密歇根大学)
;
The Ohio State University(俄亥俄州立大学)
;
USTC(中国科学技术大学)
;
City University of Hong Kong(香港城市大学)
;
University of Wisconsin(威斯康星大学)
;
UCSB(加州大学圣塔芭芭拉分校)
;
University of Hong Kong(香港大学)
;
Peking University(北京大学)
;
Carnegie Mellon University(卡内基梅隆大学)
OODBench: Out-of-Distribution Benchmark for Large Vision-Language Models
OODBench: 用于大型视觉-语言模型的分布外基准
Ling Lin, Yang Bai, Heng Su, Congcong Zhu, Yaoxing Wang, Yang Zhou, Huazhu Fu, Jingrun Chen
机构
*
University of Science and Technology of China
;
Suzhou Institute for Advanced Research, USTC
;
Key Laboratory of the Ministry of Education for Mathematical Foundations
;
Unmanned System Research Institute, Northwestern Polytechnical University