Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning
大规模进化策略:超越强化学习的LLM微调
Xin Qiu, Yulu Gan, Conor F. Hayes, Qiyao Liang, Yinggan Xu, Roberto Dailey, Elliot Meyerson, Babak Hodjat, Risto Miikkulainen
机构
*
University of California, Los Angeles, Los Angeles, CA, USA(加州大学洛杉矶分校)
;
Cognizant AI Lab, San Francisco, CA, USA(Cognizant AI实验室)
;
The University of Texas at Austin, Austin, TX, USA(德克萨斯大学奥斯汀分校)
;
Massachusetts Institute of Technology, Cambridge, MA, USA(麻省理工学院)
专题命中
指令微调
:LLM(title,title_cn);large language model(abstract);language model(abstract);post-training(abstract)
机构
*
City University of Hong Kong(香港城市大学)
;
The Hong Kong University of Science and Technology(香港科学与技术大学)
;
The Chinese University of Hong Kong(香港中文大学)
MBTI: A Multi-Branch Efficient Fine-Tuning Framework for Hyperspectral Image Classification with Foundation Models
MBTI:一种用于基于基础模型的高光谱图像分类的多分支高效微调框架
Mingzhen Xu, Haonan Guo, Di Wang, Yinghua Qu, Zhiliang Zhou, Lei Zhang, Huiwen Yao, Rui Zhao, Fengxiang Wang, Gang Wan, Bo Du, Liangpei Zhang
机构
*
School of Computer Science, Wuhan University(武汉大学计算机科学学院)
;
State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University(武汉大学测绘遥感信息工程国家重点实验室)
;
China Petroleum Pipeline Engineering Corporation(中国石油管道局工程有限公司)
;
Hebei Key Laboratory of Underground Energy Storage Technology(河北省地下储能技术重点实验室)
;
No. 7 Oil Production Plant, Changqing Oilfield Branch, PetroChina Company Limited(中国石油天然气股份有限公司长庆油田分公司第七采油厂)
;
Faculty of Electrical Engineering and Computer Science, Ningbo University(宁波大学电气工程与计算机科学学院)
;
College of Computer Science and Technology, National University of Defense Technology(国防科技大学计算机科学与技术学院)
;
School of Aerospace Information, Space Engineering University(航天工程大学航天信息学院)
;
Key Laboratory of Intelligent Processing and Applicati(智能处理与应用重点实验室)
机构
*
School of Biomedical Engineering, Tsinghua University(清华大学生物医学工程学院)
;
School of Biomedical Engineering, Shanghai Jiao Tong University(上海交通大学生物医学工程学院)
;
DAMO Academy, Alibaba Group(阿里云达摩院)
;
Hupan Laboratory(壶辰实验室)
;
Department of Biomedical Engineering, National University of Singapore(新加坡国立大学生物医学工程系)
;
Department of Radiology, Guizhou Provincial People’s Hospital(贵州省级人民医院放射科)
;
Department of Radiology, The First Affiliated Hospital, Zhejiang University School of Medicine(浙江大学医学院附属第一医院放射科)
;
Department of Radiology, Shanghai Sixth People’s Hospital Affiliated to Shanghai Jiao Tong University School of Medicine(上海交通大学医学院附属第六人民医院放射科)
;
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)
Continual Learning with Elastic Regularization and Synthetic Replay for Federated MLLM Fine-Tuning
用于联邦多模态大语言模型微调的弹性正则化和合成重放持续学习
Jing Liu, Chenxuanyin Zou, Jiayang Ren, Gaoyun Fang, Chengfang Li, Yan Wang, Zhenchao Ma, Bo Hu
机构
*
The University of British Columbia(英属哥伦比亚大学)
;
Fudan University(复旦大学)
;
Royal College of Science, Imperial College London(伦敦帝国理工学院皇家科学学院)
;
Dyson School of Design Engineering(戴森设计工程学院)
;
Suzhou Institute of Biomedical Engineering and Technology (SIBET), Chinese Academy of Sciences(中国科学院苏州生物医学工程技术研究所)
;
East China Normal University(华东师范大学)
专题命中
指令微调
:large language model(abstract);language model(abstract);分类 cs.AI、cs.LG
PFAdapter: Hierarchical LoRA Decomposition for Personalized Federated MLLMs
PFAdapter:用于个性化联邦多模态大语言模型的分层LoRA分解
Jing Liu, Kun Yang, Yan Wang, Dingkang Yang, Xiaoshuai Hao, Wei Zhang, Yang Liu, Wei Zhou
机构
*
College of Future Information Technology, Fudan University(复旦大学未来信息技术学院)
;
Division of Natural and Applied Sciences, Duke Kunshan University(昆山杜克大学自然科学与应用科学部)
;
Department of Electrical and Computer Engineering, The University of British Columbia(英属哥伦比亚大学电气与计算机工程系)
;
Ant Group(蚂蚁集团)
;
College of Information Science and Electronic Engineering, Zhejiang University(浙江大学信息科学与电子工程学院)
;
School of Data Science and Engineering, East China Normal University(华东师范大学数据科学与工程学院)
;
College of Intelligent Robotics and Advanced Manufacturing, Fudan University & Fysics AI(复旦大学智能机器人与先进制造学院及复肆智能科技(上海)有限公司)
;
Xiaomi EV, Xiaomi Campus(小米汽车、小米园区)
;
Information and Communications Technology Cluster, Singapore Institute of Technology (SIT)(新加坡理工学院信息通信技术集群)
;
College of Electronic and Information Engineering, Tongji University(同济大学电子与信息工程学院)
;
School of Computer Science and Informatics, Cardiff University(卡迪夫大学计算机科学与信息学院)
专题命中
指令微调
:large language model(abstract);language model(abstract);分类 cs.AI、cs.LG