Assessing the Macro and Micro Effects of Random Seeds on Fine-Tuning Large Language Models
Nghia Bui, Guergana Savova, Lijing Wang
机构
*
New Jersey Institute of Technology(新泽西理工学院)
;
Boston Children’s Hospital and Harvard Medical School(波士顿儿童医院和哈佛医学院)
专题命中
指令微调
:large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG
Comments7 pages, 5 tables, 3 figures. Accepted at IJCNLP 2025. This is the final, peer-reviewed version of the work, which supersedes and extends the unauthorized draft previously posted as arXiv:2503.07329
Fine-tuning Large Language Models with Limited Data: A Survey and Practical Guide
Marton Szep, Daniel Rueckert, Rüdiger von Eisenhart-Rothe, Florian Hinterwimmer
机构
*
Chair for AI in Healthcare and Medicine, Technical University of Munich (TUM) and TUM University Hospital(人工智能在医疗与医学中的chair,技术大学慕尼黑(TUM)和慕尼黑技术大学医院)
;
Department of Orthopaedics and Sports Orthopaedics, TUM University Hospital(骨科与运动骨科,慕尼黑技术大学医院)
;
Munich Center for Machine Learning (MCML), Munich, Germany(慕尼黑机器学习中心(MCML))
;
Department of Computing, Imperial College London, UK(计算系,帝国理工学院伦敦)
专题命中
指令微调
:large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG
CommentsAccepted to TACL. Pre-MIT Press version. Major restructuring; added preference alignment section and additional tables. 36 pages
机构
*
School of Computer Science and Engineering, Northeastern University(东北大学计算机科学与工程学院)
;
Huawei Translation Services Center(华为翻译服务中心)
;
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
;
College of Computer Science and Technology, Harbin Engineering University(哈尔滨工程大学计算机科学与技术学院)
;
NiuTrans Research(NiuTrans研究院)
专题命中
指令微调
:large language model(title,abstract);language model(title,abstract);LLM(abstract)
Comments16 pages,5 figures, 13 tables, to be published in EMNLP 2025 main conference