语言大模型 / LLM - arXivDaily 专题

2505.11615 2025-05-20 cs.CL cs.AI 90%

Steering Risk Preferences in Large Language Models by Aligning Behavioral and Neural Representations

Jian-Qiao Zhu, Haijiang Yan, Thomas L. Griffiths

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2406.10785 2025-05-20 cs.CL cs.AI 90%

ShareLoRA: Parameter Efficient and Robust Large Language Model Fine-tuning via Shared Low-Rank Adaptation

Yurun Song, Junchen Zhao, Ian G. Harris, Sangeetha Abdu Jyothi

机构 * UC Irvine（uci大学）； VMware Research（vmware研究院）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 17 pages, 7 figures

2406.17692 2025-05-13 cs.CL cs.LG 90%

From Distributional to Overton Pluralism: Investigating Large Language Model Alignment

Thom Lake, Eunsol Choi, Greg Durrett

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments NAACL 2025 (Main Conference)

2412.08587 2025-05-13 cs.CL cs.AI 90%

Advancing Single and Multi-task Text Classification through Large Language Model Fine-tuning

Hang Zhao, Qile P. Chen, Yijing Barry Zhang, Gang Yang

机构 * Meta Platforms, Inc.（Meta平台公司）； Anthropic PBC（Anthropic公司）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 9 pages, 3 tables

2505.05616 2025-05-12 cs.AI cs.LG q-bio.BM 90%

Leveraging Large Language Models for enzymatic reaction prediction and characterization

Lorenzo Di Fruscia, Jana Marie Weber

机构 * Delft University of Technology（代尔夫特理工大学）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2505.02795 2025-05-06 cs.LG cs.AI cs.DC 90%

HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models

Zheng Lin, Yuxin Zhang, Zhe Chen, Zihan Fang, Xianhao Chen, Praneeth Vepakomma, Wei Ni, Jun Luo, Yue Gao

机构 * Institute of Space Internet, Fudan University（复旦大学空间互联网研究所）； School of Computer Science, Fudan University（复旦大学计算机科学学院）； Department of Electrical and Electronic Engineering, University of Hong Kong（香港大学电子与电气工程系）； Mohamed bin Zayed University of Artificial Intelligence（莫扎伊德人工智能大学）； Massachusetts Institute of Technology（麻省理工学院）； Data61, CSIRO（CSIRO Data61）； School of Computer Engineering, Nanyang Technological University（南洋理工大学计算机工程学院）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments 16 pages, 22 figures

2410.24175 2025-04-30 cs.CL cs.AI 90%

Constraint Back-translation Improves Complex Instruction Following of Large Language Models

Yunjia Qi, Hao Peng, Xiaozhi Wang, Bin Xu, Lei Hou, Juanzi Li

机构 * Department of Computer Science and Technology, BNRist, Tsinghua University（计算机科学与技术系，BNRist，清华大学）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.CL、cs.AI

Comments 14 pages, 6 figures

2504.05411 2025-04-09 cs.CL cs.LG 90%

Less but Better: Parameter-Efficient Fine-Tuning of Large Language Models for Personality Detection

Lingzhi Shen, Yunfei Long, Xiaohao Cai, Guanming Chen, Imran Razzak, Shoaib Jameel

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2408.16673 2025-04-08 cs.LG cs.AI 90%

Preserving Diversity in Supervised Fine-Tuning of Large Language Models

Ziniu Li, Congliang Chen, Tian Xu, Zeyu Qin, Jiancong Xiao, Zhi-Quan Luo, Ruoyu Sun

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.AI、cs.LG

Comments accepted by ICLR 2025

2409.08596 2025-04-03 cs.CL cs.AI cs.SD eess.AS 90%

Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructions

Lingwei Meng, Shujie Hu, Jiawen Kang, Zhaoqing Li, Yuejiao Wang, Wenxuan Wu, Xixin Wu, Xunying Liu, Helen Meng

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted to IEEE ICASSP 2025. Update code link

2503.17932 2025-03-25 cs.CL cs.AI cs.CR 90%

STShield: Single-Token Sentinel for Real-Time Jailbreak Detection in Large Language Models

Xunguang Wang, Wenxuan Wang, Zhenlan Ji, Zongjie Li, Pingchuan Ma, Daoyuan Wu, Shuai Wang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 11 pages

2410.16801 2025-03-24 cs.CL cs.AI 90%

Controlled Low-Rank Adaptation with Subspace Regularization for Continued Training on Large Language Models

Yuheng Lu, Bingshuo Qian, Caixia Yuan, Huixing Jiang, Xiaojie Wang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2503.08681 2025-03-12 cs.CL cs.LG 90%

Self-Taught Self-Correction for Small Language Models

Viktor Moskvoretskii, Chris Biemann, Irina Nikishina

专题命中指令微调：language model(title,abstract)；small language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.LG

Comments Code is available at https://github.com/VityaVitalich/STASC

2503.07693 2025-03-12 cs.AI cs.LG cs.NE cs.SE 90%

Fully Autonomous Programming using Iterative Multi-Agent Debugging with Large Language Models

Anastasiia Grishina, Vadim Liventsev, Aki Härmä, Leon Moonen

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments Accepted for publication in ACM Trans. Evol. Learn. Optim., February 2025. arXiv admin note: text overlap with arXiv:2304.10423

2503.07682 2025-03-12 cs.LG cs.AI 90%

A Time Series Multitask Framework Integrating a Large Language Model, Pre-Trained Time Series Model, and Knowledge Graph

Shule Hao, Junpeng Bao, Chuncheng Lu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2503.01419 2025-03-04 cs.CL cs.AI 90%

Parameter-Efficient Fine-Tuning of Large Language Models via Deconvolution in Subspace

Jia-Chen Zhang, Yu-Jie Xiong, Chun-Ming Xia, Dong-Hai Zhu, Xi-He Qiu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments COLING 2025 main conference

2410.20724 2025-03-04 cs.CL cs.IR cs.LG 90%

Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generation

Mufei Li, Siqi Miao, Pan Li

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments Accepted by ICLR 2025; Code available at https://github.com/Graph-COM/SubgraphRAG

2405.18540 2025-03-03 cs.CL cs.CR cs.LG 90%

Learning diverse attacks on large language models for robust red-teaming and safety tuning

Seanie Lee, Minsu Kim, Lynn Cherif, David Dobre, Juho Lee, Sung Ju Hwang, Kenji Kawaguchi, Gauthier Gidel, Yoshua Bengio, Nikolay Malkin, Moksh Jain

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments ICLR 2025

2502.18980 2025-02-27 cs.CL cs.AI 90%

PEToolLLM: Towards Personalized Tool Learning in Large Language Models

Qiancheng Xu, Yongqi Li, Heming Xia, Fan Liu, Min Yang, Wenjie Li

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；preference optimization(abstract)；分类 cs.CL、cs.AI

2407.17866 2025-02-24 q-fin.ST cs.AI cs.CL q-fin.GN q-fin.PM 90%

Financial Statement Analysis with Large Language Models

Alex Kim, Maximilian Muhn, Valeri Nikolaev

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments A co-author identified inconsistencies in the data and analyses while attempting to replicate past analyses from the working paper. Accordingly, we have temporarily withdrawn the working paper from circulation while we review the research findings.

2410.16458 2025-02-21 cs.IR cs.AI cs.LG 90%

STAR: A Simple Training-free Approach for Recommendations using Large Language Models

Dong-Ho Lee, Adam Kraft, Long Jin, Nikhil Mehta, Taibai Xu, Lichan Hong, Ed H. Chi, Xinyang Yi

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2502.13562 2025-02-20 cs.LG cs.AI 90%

Are Large Language Models In-Context Graph Learners?

Jintang Li, Ruofan Wu, Yuchang Zhu, Huizhe Zhang, Liang Chen, Zibin Zheng

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments Preprint, under review

2502.12411 2025-02-19 cs.CL cs.AI 90%

Gradient Co-occurrence Analysis for Detecting Unsafe Prompts in Large Language Models

Jingyuan Yang, Bowen Yan, Rongjun Li, Ziyu Zhou, Xin Chen, Zhiyong Feng, Wei Peng

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2502.11513 2025-02-18 cs.LG cs.AI 90%

MaZO: Masked Zeroth-Order Optimization for Multi-Task Fine-Tuning of Large Language Models

Zhen Zhang, Yifan Yang, Kai Zhen, Nathan Susanj, Athanasios Mouchtaris, Siegfried Kunzmann, Zheng Zhang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments 17 pages

2502.09690 2025-02-17 cs.CL cs.AI 90%

Trust at Your Own Peril: A Mixed Methods Exploration of the Ability of Large Language Models to Generate Expert-Like Systems Engineering Artifacts and a Characterization of Failure Modes

Taylan G. Topcu, Mohammed Husain, Max Ofsa, Paul Wach

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 41 pages, 10 figures

2308.13916 2025-02-14 cs.CL cs.AI 90%

Exploring Large Language Models for Knowledge Graph Completion

Liang Yao, Jiazhen Peng, Chengsheng Mao, Yuan Luo

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted by the 2025 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2025)

2502.07286 2025-02-12 cs.CL cs.AI 90%

Small Language Model Makes an Effective Long Text Extractor

Yelin Chen, Fanjin Zhang, Jie Tang

专题命中指令微调：language model(title,abstract)；small language model(title)；large language model(abstract)；prompting(abstract)

Comments AAAI'25, 9 pages, 1 appendix pages

2502.07237 2025-02-12 cs.LG cs.CL q-bio.BM stat.ML 90%

DrugImproverGPT: A Large Language Model for Drug Optimization with Fine-Tuning via Structured Policy Optimization

Xuefeng Liu, Songhao Jiang, Siyu Chen, Zhuoran Yang, Yuxin Chen, Ian Foster, Rick Stevens

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2406.18449 2025-02-11 cs.CL cs.AI 90%

Cascading Large Language Models for Salient Event Graph Generation

Xingwei Tan, Yuxiang Zhou, Gabriele Pergola, Yulan He

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI

Comments NAACL 2025 Camera-ready (9 + 14 pages)

2401.04343 2025-02-03 cs.LG cs.CL cs.CR 90%

Private Fine-tuning of Large Language Models with Zeroth-order Optimization

Xinyu Tang, Ashwinee Panda, Milad Nasr, Saeed Mahloujifar, Prateek Mittal

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；foundation model(abstract)；分类 cs.CL、cs.LG

1. 指令微调 11547 篇

Steering Risk Preferences in Large Language Models by Aligning Behavioral and Neural Representations

ShareLoRA: Parameter Efficient and Robust Large Language Model Fine-tuning via Shared Low-Rank Adaptation

From Distributional to Overton Pluralism: Investigating Large Language Model Alignment

Advancing Single and Multi-task Text Classification through Large Language Model Fine-tuning

Leveraging Large Language Models for enzymatic reaction prediction and characterization

HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models

Constraint Back-translation Improves Complex Instruction Following of Large Language Models

Less but Better: Parameter-Efficient Fine-Tuning of Large Language Models for Personality Detection

Preserving Diversity in Supervised Fine-Tuning of Large Language Models

Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructions

STShield: Single-Token Sentinel for Real-Time Jailbreak Detection in Large Language Models

Controlled Low-Rank Adaptation with Subspace Regularization for Continued Training on Large Language Models

Self-Taught Self-Correction for Small Language Models

Fully Autonomous Programming using Iterative Multi-Agent Debugging with Large Language Models

A Time Series Multitask Framework Integrating a Large Language Model, Pre-Trained Time Series Model, and Knowledge Graph

Parameter-Efficient Fine-Tuning of Large Language Models via Deconvolution in Subspace

Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generation

Learning diverse attacks on large language models for robust red-teaming and safety tuning

PEToolLLM: Towards Personalized Tool Learning in Large Language Models

Financial Statement Analysis with Large Language Models

STAR: A Simple Training-free Approach for Recommendations using Large Language Models

Are Large Language Models In-Context Graph Learners?

Gradient Co-occurrence Analysis for Detecting Unsafe Prompts in Large Language Models

MaZO: Masked Zeroth-Order Optimization for Multi-Task Fine-Tuning of Large Language Models

Trust at Your Own Peril: A Mixed Methods Exploration of the Ability of Large Language Models to Generate Expert-Like Systems Engineering Artifacts and a Characterization of Failure Modes

Exploring Large Language Models for Knowledge Graph Completion

Small Language Model Makes an Effective Long Text Extractor

DrugImproverGPT: A Large Language Model for Drug Optimization with Fine-Tuning via Structured Policy Optimization

Cascading Large Language Models for Salient Event Graph Generation

Private Fine-tuning of Large Language Models with Zeroth-order Optimization