语言大模型 / LLM

APE: Selective Fine-tuning with Acceptance Criteria for Language Model Adaptation

Javier Marín

专题命中 指令微调 ：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Outlier-weighed Layerwise Sampling for LLM Fine-tuning

Pengxiang Li, Lu Yin, Xiaowei Gao, Shiwei Liu

机构 * Dalian University of Technology（大连理工大学） ； University of Surrey（Surrey大学） ； Eindhoven University of Technology（埃因霍温理工大学） ； University College London（伦敦大学学院） ； University of Oxford（牛津大学） 纠错

专题命中 指令微调 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Robust Anti-Backdoor Instruction Tuning in LVLMs

Yuan Xun, Siyuan Liang, Xiaojun Jia, Xinwei Liu, Xiaochun Cao

机构 * Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所） ； Nanyang Technological University（南洋理工大学） ； Sun Yat-sen University-Shenzhen（中山大学深圳校区） 纠错

专题命中 指令微调 ：instruction tuning(title,abstract)；LLM(abstract)；language model(abstract)

Memory-Efficient Split Federated Learning for LLM Fine-Tuning on Heterogeneous Mobile Devices

Xiaopei Chen, Liang Li, Fei Ji, Wen Wu

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Comments IEEE INFOCOM IEILM 2025

VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understanding

Boqiang Zhang, Kehan Li, Zesen Cheng, Zhiqiang Hu, Yuqian Yuan, Guanzheng Chen, Sicong Leng, Yuming Jiang, Hang Zhang, Xin Li, Peng Jin, Wenqi Zhang, Fan Wang, Lidong Bing, Deli Zhao

机构 * DAMO Academy, Alibaba Group（达摩院，阿里巴巴集团） ； Hupan Lab（虎派实验室） 纠错

专题命中 指令微调 ：foundation model(title,abstract)；LLM(abstract)；SFT(abstract)

Comments BZ, KL, ZC, ZH, YY, GC, SL, YJ, HZ, and XL contributed equally to this project. Code: https://github.com/DAMO-NLP-SG/VideoLLaMA3

Veritas: Deterministic Verilog Code Synthesis from LLM-Generated Conjunctive Normal Form

Prithwish Basu Roy, Akashdeep Saha, Manaar Alam, Johann Knechtel, Michail Maniatakos, Ozgur Sinanoglu, Ramesh Karri

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Corrupted but Not Broken: Understanding and Mitigating the Negative Impacts of Corrupted Data in Visual Instruction Tuning

Yunhao Gou, Hansi Yang, Zhili Liu, Kai Chen, Yihan Zeng, Lanqing Hong, Zhenguo Li, Qun Liu, Bo Han, James T. Kwok, Yu Zhang

机构 * Southern University of Science and Technology（南方科技大学） ； The Hong Kong University of Science and Technology（香港科技大学） ； Huawei Noah’s Ark Lab（华为诺亚实验室） ； Hong Kong Baptist University（香港 Baptist 大学） 纠错

专题命中 指令微调 ：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)

IP-Prompter: Training-Free Theme-Specific Image Generation via Dynamic Visual Prompting

Yuxin Zhang, Minyan Luo, Weiming Dong, Xiao Yang, Haibin Huang, Chongyang Ma, Oliver Deussen, Tong-Yee Lee, Changsheng Xu

机构 * MAIS, Institute of Automation, CAS（MAIS，自动化研究所，中国科学院） ； China School of Artificial Intelligence, UCAS（中国人工智能学院，UCAS） ； ByteDance Inc.（字节跳动公司） ； University of Konstanz（康斯坦茨大学） ； National Cheng-Kung University（国立成功大学） 纠错

专题命中 指令微调 ：prompting(title,abstract)；large language model(abstract)；language model(abstract)

Comments Accepted by ACM SIGGRAPH 2025. Project page: https://ip-prompter.github.io/

CALM: Co-evolution of Algorithms and Language Model for Automatic Heuristic Design

Ziyao Huang, Weiwei Wu, Kui Wu, Jianping Wang, Wei-Bin Lee

专题命中 指令微调 ：language model(title,abstract)；LLM(abstract)；large language model(abstract)

Visual Instruction Tuning with Chain of Region-of-Interest

Yixin Chen, Shuai Zhang, Boran Han, Bernie Wang

机构 * Amazon Web Services（亚马逊网络服务） 纠错

专题命中 指令微调 ：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)

Comments N/A

Alleviating the Fear of Losing Alignment in LLM Fine-tuning

Kang Yang, Guanhong Tao, Xun Chen, Jun Xu

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Improving Instruction-Following in Language Models through Activation Steering

Alessandro Stolfo, Vidhisha Balachandran, Safoora Yousefi, Eric Horvitz, Besmira Nushi

专题命中 指令微调 ：language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICLR 2025

Themes of Building LLM-based Applications for Production: A Practitioner's View

Alina Mailach, Sebastian Simon, Johannes Dorn, Norbert Siegmund

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

MLLM-Selector: Necessity and Diversity-driven High-Value Data Selection for Enhanced Visual Instruction Tuning

Yiwei Ma, Guohai Xu, Xiaoshuai Sun, Jiayi Ji, Jie Lou, Debing Zhang, Rongrong Ji

专题命中 指令微调 ：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)

Comments Tech Report

SituationalLLM: Proactive language models with scene awareness for dynamic, contextual task guidance

Muhammad Saif Ullah Khan, Muhammad Zeshan Afzal, Didier Stricker

专题命中 指令微调 ：language model(title,abstract)；LLM(abstract)；large language model(abstract)

Comments Revised Submission to Open Research Europe

Journal ref Open Research Europe, 5 (2025) 1-14

SAIF: A Sparse Autoencoder Framework for Interpreting and Steering Instruction Following of Language Models

Zirui He, Haiyan Zhao, Yiran Qiao, Fan Yang, Ali Payani, Jing Ma, Mengnan Du

专题命中 指令微调 ：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 21 pages, 11 figures, 6 tables

Enhancing Visual-Language Modality Alignment in Large Vision Language Models via Self-Improvement

Xiyao Wang, Jiuhai Chen, Zhaoyang Wang, Yuhang Zhou, Yiyang Zhou, Huaxiu Yao, Tianyi Zhou, Tom Goldstein, Parminder Bhatia, Furong Huang, Cao Xiao

专题命中 指令微调 ：language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments NAACL 2025 Findings

LLM4WM: Adapting LLM for Wireless Multi-Tasking

Xuanyu Liu, Shijian Gao, Boxun Liu, Xiang Cheng, Liuqing Yang

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Eliciting Language Model Behaviors with Investigator Agents

Xiang Lisa Li, Neil Chowdhury, Daniel D. Johnson, Tatsunori Hashimoto, Percy Liang, Sarah Schwettmann, Jacob Steinhardt

专题命中 指令微调 ：language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 20 pages, 7 figures

An Empirical Study on LLM-based Classification of Requirements-related Provisions in Food-safety Regulations

Shabnam Hassani, Mehrdad Sabetzadeh, Daniel Amyot

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Divergences between Language Models and Human Brains

Yuchen Zhou, Emmy Liu, Graham Neubig, Michael J. Tarr, Leila Wehbe

专题命中 指令微调 ：language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

I Can't Share Code, but I need Translation -- An Empirical Study on Code Translation through Federated LLM

Jahnavi Kumar, Venkata Lakshmana Sasaank Janapati, Mokshith Reddy Tanguturi, Sridhar Chimalakonda

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Comments 10 pages

Harnessing Large Language and Vision-Language Models for Robust Out-of-Distribution Detection

Pei-Kang Lee, Jun-Cheng Chen, Ja-Ling Wu

专题命中 指令微调 ：language model(title,abstract)；LLM(abstract)；large language model(abstract)

Comments 9 pages, 4 figures

DLCRec: A Novel Approach for Managing Diversity in LLM-Based Recommender Systems

Jiaju Chen, Chongming Gao, Shuai Yuan, Shuchang Liu, Qingpeng Cai, Peng Jiang

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Comments Accepted by WSDM 2025

Reconstructive Visual Instruction Tuning

Haochen Wang, Anlin Zheng, Yucheng Zhao, Tiancai Wang, Zheng Ge, Xiangyu Zhang, Zhaoxiang Zhang

专题命中 指令微调 ：instruction tuning(title,abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

MetaMorph: Multimodal Understanding and Generation via Instruction Tuning

Shengbang Tong, David Fan, Jiachen Zhu, Yunyang Xiong, Xinlei Chen, Koustuv Sinha, Michael Rabbat, Yann LeCun, Saining Xie, Zhuang Liu

专题命中 指令微调 ：instruction tuning(title,abstract)；LLM(abstract)；pretraining(abstract)

Comments Project page at tsb0601.github.io/metamorph

MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Diversity

Yangzhou Liu, Yue Cao, Zhangwei Gao, Weiyun Wang, Zhe Chen, Wenhai Wang, Hao Tian, Lewei Lu, Xizhou Zhu, Tong Lu, Yu Qiao, Jifeng Dai

专题命中 指令微调 ：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)

Comments 18 pages, 8 figures, technical report

Journal ref Sci China Inf Sci, 2024

EasyRef: Omni-Generalized Group Image Reference for Diffusion Models via Multimodal LLM

Zhuofan Zong, Dongzhi Jiang, Bingqi Ma, Guanglu Song, Hao Shao, Dazhong Shen, Yu Liu, Hongsheng Li

专题命中 指令微调 ：LLM(title)；large language model(abstract)；language model(abstract)；prompting(abstract)

Comments Tech report

Investigating Bias in LLM-Based Bias Detection: Disparities between LLMs and Human Perception

Luyang Lin, Lingzhi Wang, Jinsong Guo, Kam-Fai Wong

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Comments COLING 2025

Multimodal Instruction Tuning with Conditional Mixture of LoRA

Ying Shen, Zhiyang Xu, Qifan Wang, Yu Cheng, Wenpeng Yin, Lifu Huang

专题命中 指令微调 ：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)

Comments 12 pages, 7 figures, ACL 2024