语言大模型 / LLM - arXivDaily 专题

2412.15151 2025-02-14 cs.CL cs.AI 86%

Language Models as Continuous Self-Evolving Data Engineers

Peidong Wang, Ming Wang, Zhiming Ma, Xiaocui Yang, Shi Feng, Daling Wang, Yifei Zhang, Kaisong Song

专题命中指令微调：language model(title,abstract)；large language model(abstract)；post-training(abstract)；分类 cs.CL、cs.AI

2502.03793 2025-02-11 cs.CL cs.AI 86%

It's All in The [MASK]: Simple Instruction-Tuning Enables BERT-like Masked Language Models As Generative Classifiers

Benjamin Clavié, Nathan Cooper, Benjamin Warner

专题命中指令微调：language model(title,abstract)；large language model(abstract)；prompting(abstract)；分类 cs.CL、cs.AI

2501.11877 2025-01-22 cs.CL cs.AI 86%

From Drafts to Answers: Unlocking LLM Potential via Aggregation Fine-Tuning

Yafu Li, Zhilin Wang, Tingchen Fu, Ganqu Cui, Sen Yang, Yu Cheng

专题命中指令微调：LLM(title)；large language model(abstract)；language model(abstract)；SFT(abstract)

Comments 20 pages; work in progress

2310.02842 2025-01-22 cs.CL cs.AI 86%

Sweeping Heterogeneity with Smart MoPs: Mixture of Prompts for LLM Task Adaptation

Chen Dun, Mirian Hipolito Garcia, Guoqing Zheng, Ahmed Hassan Awadallah, Anastasios Kyrillidis, Robert Sim

专题命中指令微调：LLM(title)；large language model(abstract)；language model(abstract)；instruction tuning(abstract)

2501.07853 2025-01-15 cs.CL cs.AI 86%

Optimizing Language Models for Grammatical Acceptability: A Comparative Study of Fine-Tuning Techniques

Shobhit Ratan, Farley Knight, Ghada Jerfel, Sze Chung Ho

专题命中指令微调：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.AI

2501.04315 2025-01-14 cs.LG cs.AI 86%

RoRA: Efficient Fine-Tuning of LLM with Reliability Optimization for Rank Adaptation

Jun Liu, Zhenglun Kong, Peiyan Dong, Changdi Yang, Xuan Shen, Pu Zhao, Hao Tang, Geng Yuan, Wei Niu, Wenbin Zhang, Xue Lin, Dong Huang, Yanzhi Wang

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

2410.12236 2025-01-14 cs.LG cs.AI 86%

Enhancing LLM Agents for Code Generation with Possibility and Pass-rate Prioritized Experience Replay

Yuyang Chen, Kaiyan Zhao, Yiming Wang, Ming Yang, Jian Zhang, Xiaoguang Niu

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

2404.11932 2025-01-07 cs.CL cs.AI 86%

CrossIn: An Efficient Instruction Tuning Approach for Cross-Lingual Knowledge Alignment

Geyu Lin, Bin Wang, Zhengyuan Liu, Nancy F. Chen

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments 11 pages

2311.08662 2025-01-03 cs.CL cs.AI cs.IR 86%

Evaluating Concurrent Robustness of Language Models Across Diverse Challenge Sets

Vatsal Gupta, Pranshu Pandya, Tushar Kataria, Vivek Gupta, Dan Roth

专题命中指令微调：language model(title,abstract)；large language model(abstract)；prompting(abstract)；分类 cs.CL、cs.AI

Comments 23 pages, 16 Figure, 10 Tables

2411.00852 2024-12-25 cs.LG cs.AI 86%

EF-LLM: Energy Forecasting LLM with AI-assisted Automation, Enhanced Sparse Prediction, Hallucination Detection

Zihang Qiu, Chaojie Li, Zhongyang Wang, Renyou Xie, Borui Zhang, Huadong Mo, Guo Chen, Zhaoyang Dong

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

2407.11780 2024-12-19 cs.CL cs.AI 86%

SwitchCIT: Switching for Continual Instruction Tuning

Xinbo Wu, Max Hartman, Vidhata Arjun Jayaraman, Lav R. Varshney

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2402.04049 2024-12-18 cs.CL cs.AI 86%

Systematic Biases in LLM Simulations of Debates

Amir Taubenfeld, Yaniv Dover, Roi Reichart, Ariel Goldstein

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Published as a conference paper at EMNLP 2024

2412.10689 2024-12-17 cs.CL cs.AI 86%

Learning to Verify Summary Facts with Fine-Grained LLM Feedback

Jihwan Oh, Jeonghwan Choi, Nicole Hee-Yeon Kim, Taewon Yun, Hwanjun Song

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted at COLING 2025

2405.19732 2024-12-05 cs.CV cs.CL cs.LG 86%

LLM as a Complementary Optimizer to Gradient Descent: A Case Study in Prompt Tuning

Zixian Guo, Ming Liu, Zhilong Ji, Jinfeng Bai, Yiwen Guo, Wangmeng Zuo

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

2410.12361 2024-12-04 cs.AI cs.CL 86%

Proactive Agent: Shifting LLM Agents from Reactive Responses to Active Assistance

Yaxi Lu, Shenzhi Yang, Cheng Qian, Guirong Chen, Qinyu Luo, Yesai Wu, Huadong Wang, Xin Cong, Zhong Zhang, Yankai Lin, Weiwen Liu, Yasheng Wang, Zhiyuan Liu, Fangming Liu, Maosong Sun

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments 9 pages, 4 figures

2411.13405 2024-11-21 cs.CL cs.LG 86%

On the Way to LLM Personalization: Learning to Remember User Conversations

Lucie Charlotte Magister, Katherine Metcalf, Yizhe Zhang, Maartje ter Hoeve

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

Comments 16 pages, 6 tables, 3 figures

2411.10696 2024-11-19 cs.LG cs.AI 86%

HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization

Huaqin Zhao, Jiaxi Li, Yi Pan, Shizhe Liang, Xiaofeng Yang, Wei Liu, Xiang Li, Fei Dou, Tianming Liu, Jin Lu

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

2411.07070 2024-11-13 cs.CL cs.AI 86%

On Active Privacy Auditing in Supervised Fine-tuning for White-Box Language Models

Qian Sun, Hanpeng Wu, Xi Sheryl Zhang

专题命中指令微调：language model(title,abstract)；pretraining(abstract)；SFT(abstract)；分类 cs.CL、cs.AI

2411.00686 2024-11-04 cs.CL cs.AI 86%

Latent Paraphrasing: Perturbation on Layers Improves Knowledge Injection in Language Models

Minki Kang, Sung Ju Hwang, Gibbeum Lee, Jaewoong Cho

专题命中指令微调：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.AI

Comments NeurIPS 2024

2410.08048 2024-10-11 cs.LG cs.CL 86%

VerifierQ: Enhancing LLM Test Time Compute with Q-Learning-based Verifiers

Jianing Qi, Hao Tang, Zhigang Zhu

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

2410.05434 2024-10-10 cs.LG cs.AI 86%

Better than Your Teacher: LLM Agents that learn from Privileged AI Feedback

Sanjiban Choudhury, Paloma Sodhi

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments 34 pages, 6 figures, 5 tables

2409.17972 2024-10-01 cs.CL cs.LG 86%

BEATS: Optimizing LLM Mathematical Capabilities with BackVerify and Adaptive Disambiguate based Efficient Tree Search

Linzhuang Sun, Hao Liang, Jingxuan Wei, Bihui Yu, Conghui He, Zenan Zhou, Wentao Zhang

专题命中指令微调：LLM(title)；large language model(abstract)；language model(abstract)；SFT(abstract)

2402.18334 2024-09-12 cs.CL cs.LG 86%

Learning to Generate Instruction Tuning Datasets for Zero-Shot Task Adaptation

Nihal V. Nayak, Yiyang Nan, Avi Trost, Stephen H. Bach

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

Comments ACL Findings 2024

2409.03346 2024-09-06 cs.CL cs.AI 86%

Sketch: A Toolkit for Streamlining LLM Operations

Xin Jiang, Xiang Li, Wenjia Ma, Xuezhi Fang, Yiqun Yao, Naitong Yu, Xuying Meng, Peng Han, Jing Li, Aixin Sun, Yequan Wang

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2309.04565 2024-09-04 cs.LG cs.AI 86%

A Versatile Graph Learning Approach through LLM-based Agent

Lanning Wei, Huan Zhao, Xiaohan Zheng, Zhiqiang He, Quanming Yao

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

2408.10174 2024-08-27 cs.LG cs.AI 86%

SMILE: Zero-Shot Sparse Mixture of Low-Rank Experts Construction From Pre-Trained Foundation Models

Anke Tang, Li Shen, Yong Luo, Shuai Xie, Han Hu, Lefei Zhang, Bo Du, Dacheng Tao

专题命中指令微调：foundation model(title)；large language model(abstract)；language model(abstract)；prompting(abstract)

Comments Code is available at https://github.com/tanganke/fusion_bench

2408.12779 2024-08-26 cs.CL cs.AI 86%

Investigating LLM Applications in E-Commerce

Chester Palen-Michel, Ruixiang Wang, Yipeng Zhang, David Yu, Canran Xu, Zhe Wu

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2406.14322 2024-08-19 cs.CL cs.CR cs.LG 86%

Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuning

Lynn Chua, Badih Ghazi, Yangsibo Huang, Pritish Kamath, Ravi Kumar, Daogao Liu, Pasin Manurangsi, Amer Sinha, Chiyuan Zhang

专题命中指令微调：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.LG

Comments Published as a conference paper at COLM 2024

2401.05799 2024-08-15 cs.CL cs.AI cs.MA q-fin.GN 86%

Designing Heterogeneous LLM Agents for Financial Sentiment Analysis

Frank Xing

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments 15 pages

2401.10660 2024-08-07 cs.CL cs.AI 86%

Accelerating Multilingual Language Model for Excessively Tokenized Languages

Jimin Hong, Gibbeum Lee, Jaewoong Cho

专题命中指令微调：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted to ACL 2024 Findings

1. 指令微调 11585 篇

Language Models as Continuous Self-Evolving Data Engineers

It's All in The [MASK]: Simple Instruction-Tuning Enables BERT-like Masked Language Models As Generative Classifiers

From Drafts to Answers: Unlocking LLM Potential via Aggregation Fine-Tuning

Sweeping Heterogeneity with Smart MoPs: Mixture of Prompts for LLM Task Adaptation

Optimizing Language Models for Grammatical Acceptability: A Comparative Study of Fine-Tuning Techniques

RoRA: Efficient Fine-Tuning of LLM with Reliability Optimization for Rank Adaptation

Enhancing LLM Agents for Code Generation with Possibility and Pass-rate Prioritized Experience Replay

CrossIn: An Efficient Instruction Tuning Approach for Cross-Lingual Knowledge Alignment

Evaluating Concurrent Robustness of Language Models Across Diverse Challenge Sets

EF-LLM: Energy Forecasting LLM with AI-assisted Automation, Enhanced Sparse Prediction, Hallucination Detection

SwitchCIT: Switching for Continual Instruction Tuning

Systematic Biases in LLM Simulations of Debates

Learning to Verify Summary Facts with Fine-Grained LLM Feedback

LLM as a Complementary Optimizer to Gradient Descent: A Case Study in Prompt Tuning

Proactive Agent: Shifting LLM Agents from Reactive Responses to Active Assistance

On the Way to LLM Personalization: Learning to Remember User Conversations

HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization

On Active Privacy Auditing in Supervised Fine-tuning for White-Box Language Models

Latent Paraphrasing: Perturbation on Layers Improves Knowledge Injection in Language Models

VerifierQ: Enhancing LLM Test Time Compute with Q-Learning-based Verifiers

Better than Your Teacher: LLM Agents that learn from Privileged AI Feedback

BEATS: Optimizing LLM Mathematical Capabilities with BackVerify and Adaptive Disambiguate based Efficient Tree Search

Learning to Generate Instruction Tuning Datasets for Zero-Shot Task Adaptation

Sketch: A Toolkit for Streamlining LLM Operations

A Versatile Graph Learning Approach through LLM-based Agent

SMILE: Zero-Shot Sparse Mixture of Low-Rank Experts Construction From Pre-Trained Foundation Models

Investigating LLM Applications in E-Commerce

Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuning

Designing Heterogeneous LLM Agents for Financial Sentiment Analysis

Accelerating Multilingual Language Model for Excessively Tokenized Languages