arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

语言大模型 / LLM

大语言模型、预训练、指令微调、后训练和语言模型应用。

共收录 11547 信号源:cs.CL, cs.AI, cs.LG

1. 指令微调 11547 篇

2308.10252 2023-08-22 cs.CL cs.AI 90%

LMTuner: An user-friendly and highly-integrable Training Framework for fine-tuning Large Language Models

Yixuan Weng, Zhiqi Wang, Huanxuan Liao, Shizhu He, Shengping Liu, Kang Liu, Jun Zhao

专题命中 指令微调 :large language model(title,abstract);language model(title,abstract);LLM(abstract);分类 cs.CL、cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.02499 2023-07-07 cs.CL cs.AI 90%

mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding

Jiabo Ye, Anwen Hu, Haiyang Xu, Qinghao Ye, Ming Yan, Yuhao Dan, Chenlin Zhao, Guohai Xu, Chenliang Li, Junfeng Tian, Qian Qi, Ji Zhang, Fei Huang

专题命中 指令微调 :large language model(title,abstract);language model(title,abstract);instruction tuning(abstract);分类 cs.CL、cs.AI

Comments 10 pages, 8 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.07933 2023-06-14 cs.CL cs.AI 90%

Understanding Telecom Language Through Large Language Models

Lina Bariah, Hang Zou, Qiyang Zhao, Belkacem Mouhouche, Faouzi Bader, Merouane Debbah

专题命中 指令微调 :large language model(title,abstract);language model(title,abstract);LLM(abstract);分类 cs.CL、cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.18620 2023-05-31 cs.CL cs.AI cs.HC 90%

CONA: A novel CONtext-Aware instruction paradigm for communication using large language model

Nan Zhou, Xinghui Tao, Xi Chen

专题命中 指令微调 :large language model(title,abstract);language model(title,abstract);LLM(abstract);分类 cs.CL、cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.11598 2023-05-22 cs.AI cs.CL 90%

Introspective Tips: Large Language Model for In-Context Decision Making

Liting Chen, Lu Wang, Hang Dong, Yali Du, Jie Yan, Fangkai Yang, Shuang Li, Pu Zhao, Si Qin, Saravan Rajmohan, Qingwei Lin, Dongmei Zhang

专题命中 指令微调 :large language model(title,abstract);language model(title,abstract);LLM(abstract);分类 cs.CL、cs.AI

Comments 22 pages, 4 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2304.10548 2023-04-24 cs.CL cs.AI cs.HC 90%

Supporting Qualitative Analysis with Large Language Models: Combining Codebook with GPT-3 for Deductive Coding

Ziang Xiao, Xingdi Yuan, Q. Vera Liao, Rania Abdelghani, Pierre-Yves Oudeyer

专题命中 指令微调 :large language model(title,abstract);language model(title,abstract);LLM(abstract);分类 cs.CL、cs.AI

Comments 28th International Conference on Intelligent User Interfaces (IUI '23 Companion), March 27--31, 2023, Sydney, NSW, Australia

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.05903 2024-03-20 cs.IR cs.AI 90%

Establishing Performance Baselines in Fine-Tuning, Retrieval-Augmented Generation and Soft-Prompting for Non-Specialist LLM Users

Jennifer Dodgson, Lin Nanzheng, Julian Peh, Akira Rafhael Janson Pattirane, Alfath Daryl Alhajir, Eko Ridho Dinarto, Joseph Lim, Syed Danyal Ahmad

专题命中 指令微调 :prompting(title,abstract);LLM(title);large language model(abstract);language model(abstract)

Comments 10 pages, LaTeX; typos corrected, using the correct term 'system prompting' instead of 'soft prompting'

详情

展开后加载摘要…

URL PDF HTML 收藏
2608.02687 2026-08-07 cs.CR cs.SE 版本更新 89%

PolicyGuard: Prompt-Configurable Semantic DLP for LLM Coding Agents

PolicyGuard:面向LLM编码智能体的可配置提示语义数据防泄漏方案

Kyutae Park, Jungwon Kim, Daeyeol Shim

专题命中 指令微调 :LLM(title,title_cn)

AI总结 针对LLM编码智能体的PolicyGuard框架,以自然语言策略文件引导LLM分类用户提示,在冻结测试集和隐藏保留集上表现优异,泛化与跨模型能力突出。

Comments This paper is being withdrawn because it was submitted prior to completion of a required institutional review process. The authors intend to resubmit after the review is complete

详情

展开后加载摘要…

URL PDF HTML 收藏
2607.28997 2026-08-03 cs.IR 新提交 89%

Think2Go: Generative Next POI Recommendation with LLM Reasoning

Think2Go:基于大语言模型推理的生成式下一个兴趣点(POI)推荐

Zhuang Zhuang, Shanshan Feng, Hangwei Qian, Mingqi Yang, Heng Qi, Yanming Shen, Baocai Yin

专题命中 指令微调 :SFT(summary_cn,abstract);LLM(title);large language model(abstract);language model(abstract)

AI总结 Think2Go框架统一SFT与RL推理,通过优势加权机制校准策略优化,解决现有POI推荐模型的意图捕捉不足问题,提升推荐性能与稳健性。

Comments Accepted by KDD 2026 Research Track Cycle 1 (Oral presentation)

详情

展开后加载摘要…

URL PDF HTML 收藏
2607.17456 2026-07-21 cs.CV 新提交 89%

Bio-SFT: Asymmetric Cortical Guidance and Retinal Adaptation for Robust HDR Reconstruction

Bio-SFT:用于稳健 HDR 重建的不对称皮层引导和视网膜适应

Tingyu Cheng, Ting Zhang, Chongyi Li, Zhaoqing Pan, Tiesong Zhao

机构 * College of Physics and Information Engineering, Fuzhou University(福州大学物理与信息工程学院) School of Computer Science, Nankai University(南开大学计算机科学学院) School of Electrical and Information Engineering, Tianjin University(天津大学电气与信息工程学院)

专题命中 指令微调 :SFT(title,title_cn)

AI总结 研究针对单图像 HDR 重建难题,提出 Bio-SFT 方法,它包含可学习的视网膜适应前端、小细胞 - 大细胞分裂引导及事件驱动的 SNN 硬门控模块,经训练能有效抑制暗区噪声,提高感知质量,减少伪影传播。

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.10125 2026-07-15 cs.CR cs.SE 版本更新 89%

D-LiFT: Improving LLM-based Decompiler Backend via Code Quality-driven Fine-tuning

D-LiFT:通过代码质量驱动的微调改进基于大语言模型的反编译器后端

Muqi Zou, Hongyu Cai, Hongwei Wu, Zion Leonahenahe Basque, Arslan Khan, Berkay Celik, Dave, Tian, Antonio Bianchi, Ruoyu, Wang, Dongyan Xu

专题命中 指令微调 :LLM(title,summary_cn);large language model(abstract);language model(abstract)

AI总结 研究针对反编译器输出质量问题,提出D-LIFT方法。通过代码质量感知强化学习微调LLM,利用D-Score综合评估系统指导,在保持准确性的同时提升可读性,实验证明该方法有效提高了反编译代码质量。

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.05386 2026-06-30 cs.LG cs.AI cs.CL 89%

Reinforcement Fine-Tuning Naturally Mitigates Forgetting in Continual Post-Training

强化微调自然缓解持续训练中的遗忘

Song Lai, Haohan Zhao, Rong Feng, Changyi Ma, Wenzhuo Liu, Hongbo Zhao, Xi Lin, Dong Yi, Qingfu Zhang, Hongbin Liu, Gaofeng Meng, Fei Zhu

专题命中 指令微调 :post-training(title,abstract);large language model(abstract);language model(abstract);foundation model(abstract)

AI总结 本文比较了监督微调与强化微调在持续训练中的影响,发现强化微调能有效保留先验知识,优于监督微调和多任务训练,且在标准基准上提升模型通用知识。

详情

展开后加载摘要…

URL PDF HTML 收藏
2606.27511 2026-06-29 cs.CR 新提交 89%

When the Aggregator Cheats: Data-Free Backdoors in Federated LLM-based QA Systems

当聚合者作弊:联邦LLM问答系统中的无数据后门

Chenqing Zhu, Yanbo Dai, Yulong Tian, Qingming Li, Songze Li

专题命中 指令微调 :LLM(title,title_cn);large language model(abstract);language model(abstract)

AI总结 针对联邦学习问答系统中恶意聚合者植入广告后门的问题,提出利用客户端梯度恢复样本并构造中毒数据集的两阶段攻击方法,实现高攻击成功率且几乎不影响正常性能。

Comments Accepted at the 35th USENIX Security Symposium (USENIX Security 2026)

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.09777 2026-06-23 cs.NE cs.AI cs.CL cs.LG 版本更新 89%

EvoPref: Multi-Objective Evolutionary Optimization Discovers Diverse LLM Alignments Beyond Gradient Descent

EvoPref:多目标进化优化发现超越梯度下降的多样化大语言模型对齐

Dongxin Guo, Jikun Wu, Siu Ming Yiu

机构 * The University of Hong Kong(香港大学) Stellaris AI Limited(Stellaris AI有限公司)

专题命中 指令微调 :LLM(title,abstract);large language model(abstract);language model(abstract);preference optimization(abstract)

AI总结 EvoPref通过多目标进化算法在帮助性、无害性和诚实性目标上优化LoRA适配器,发现比梯度下降更丰富的对齐方式,实验显示其在偏好覆盖和崩溃率上均有显著提升。

Comments 10 pages, 2 figures, 6 tables, 1 algorithm. Accepted to GECCO 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2606.14154 2026-06-15 cs.CR 新提交 89%

SkillMutator: Benchmarking and Defending Language-and-Code Cross-modal Attacks on LLM Agent Skills

SkillMutator: 基准测试与防御针对LLM代理技能的语言与代码跨模态攻击

Youngduk Kim, Minkyoo Song, Seungwon Shin

专题命中 指令微调 :LLM(title,title_cn);large language model(abstract);language model(abstract)

AI总结 提出SkillMutator基准,模拟13类跨模态攻击,并设计四阶段推理轨迹蒸馏框架,将检测率从17.1%提升至88.2%,超越GPT-4o-mini。

详情

展开后加载摘要…

URL PDF HTML 收藏
2606.06063 2026-06-05 cs.DC 89%

LLM-Based Porting of Optimized C++ to CUDA Through Deoptimization and Reoptimization

基于LLM的通过去优化和再优化将优化C++移植到CUDA

Daichi Mukunoki, Ryo Mikasa, Shunichiro Hayashi, Tetsuya Hoshino, Takahiro Katagiri

专题命中 指令微调 :LLM(title,title_cn)

AI总结 提出Deopt-Reopt工作流,通过先简化CPU优化代码再重新翻译优化为CUDA,利用LLM提升移植性能,实验表明该方法在部分内核上有效但非普遍适用。

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.31530 2026-06-03 eess.AS cs.SD 89%

UNISON: A Unified Sound Generation and Editing Framework via Deep LLM Fusion

UNISON: 通过深度LLM融合的统一声音生成与编辑框架

Zhaoqing Li, Haoning Xu, Jingran Su, Yaofang Liu, Zhefan Rao, Huimeng Wang, Jiajun Deng, Tianzi Wang, Zengrui Jin, Rui Liu, Haoxuan Che, Xunying Liu

机构 * The Chinese University of Hong Kong(香港中文大学) The Hong Kong Polytechnic University(香港理工大学) City University of Hong Kong(香港城市大学) The Hong Kong University of Science and Technology(香港科学与技术大学) Tsinghua University(清华大学) Huawei Research Hong Kong(华为香港研究)

专题命中 指令微调 :LLM(title,title_cn)

AI总结 提出UNISON,一个基于潜在扩散的统一框架,通过层间深度LLM融合和多任务架构,实现语音生成、声音生成和音频编辑,在多个任务上达到或超越专业模型性能,且参数量减少约4倍。

详情

展开后加载摘要…

URL PDF HTML 收藏
2604.18901 2026-05-12 cs.LG cs.AI cs.CL 89%

Harmful Intent as a Geometrically Recoverable Feature of LLM Residual Streams

有害意图作为LLM残差流中的几何可恢复特征

Isaac Llorente-Saguer

机构 * Independent Researcher(独立研究员)

专题命中 指令微调 :LLM(title,title_cn);language model(abstract);分类 cs.CL、cs.AI、cs.LG

AI总结 研究通过几何方法识别LLM残差流中有害意图的特征,发现其在不同模型架构中线性可分离,并通过优化策略实现高检测性能。

Comments 26 pages, 1(+6) figures, 4(+14) tables. Code at https://github.com/isaac-6/harm-directions

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.06443 2026-05-08 cs.MA 89%

AgenticPrecoding: LLM-Empowered Multi-Agent System for Precoding Optimization

代理预编码:基于LLM的多智能体系统用于预编码优化

Zijiu Yang, Zixiang Zhang, Shunpu Tang, Qianqian Yang, Zhiguo Shi

专题命中 指令微调 :LLM(title,title_cn);large language model(abstract);language model(abstract)

AI总结 本文提出AgenticPrecoding框架,通过多智能体系统自动推导端到端预编码,提升未来6G网络中异构场景的适应性。

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.16737 2026-04-24 cs.LG cs.AI cs.CL cs.CR math.OC 89%

Secure LLM Fine-Tuning via Safety-Aware Probing

通过安全感知探测实现安全的大语言模型微调

Chengcan Wu, Zhixin Zhang, Zeming Wei, Yihao Zhang, Xiaokun Luan, Meng Sun

机构 * School of Mathematical Sciences, Peking University(北京大学数学科学学院)

专题命中 指令微调 :LLM(title,abstract);large language model(abstract);language model(abstract);post-training(abstract)

AI总结 本文探讨了非有害数据微调为何可能降低安全性,提出安全感知探测框架,通过对比安全信号定位安全相关方向,优化轻量级探针以引导参数更新远离有害轨迹,提升安全与性能的平衡。

详情

展开后加载摘要…

URL PDF HTML 收藏
2601.07248 2026-04-15 cs.MA cs.HC 89%

DarwinTOD: LLM-driven Lifelong Self-evolution for Task-oriented Dialog Systems

DarwinTOD: 基于LLM的持续自我进化任务导向对话系统

Shuyu Zhang, Yujie Liu, Xinru Wang, Cheng Zhang, Yanmin Zhu, Bin Li

专题命中 指令微调 :LLM(title,title_cn)

AI总结 DarwinTOD通过整合进化计算与LLM驱动的自我改进,提出一种持续自我进化对话框架,实现零样本基础下的持续策略优化,无需任务特定微调。

Comments Accepted in ACL2026 main

详情

展开后加载摘要…

URL PDF HTML 收藏
2601.22169 2026-02-02 cs.CL cs.AI cs.CR cs.LG 89%

In Vino Veritas and Vulnerabilities: Examining LLM Safety via Drunk Language Inducement

葡萄酒中的真理与漏洞:通过醉酒语言诱导检验LLM安全性

Anudeex Shetty, Aditya Joshi, Salil S. Kanhere

机构 * School of Computer Science and Engineering, UNSW Sydney(计算机科学与工程学院,新南威尔士大学悉尼分校) School of Computing and Information System, the University of Melbourne(计算与信息系统学院,墨尔本大学)

专题命中 指令微调 :LLM(title,abstract);large language model(abstract);language model(abstract);post-training(abstract)

AI总结 本文通过诱导LLM产生醉酒语言,研究其安全漏洞,发现其易受劫持攻击和隐私泄露,揭示了LLM安全性的潜在风险。

Comments WIP

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.15805 2025-08-25 cs.CL cs.AI cs.LG 89%

ALAS: Autonomous Learning Agent for Self-Updating Language Models

Dhruv Atreja

机构 * Dhruv Atreja(独立研究者)

专题命中 指令微调 :language model(title,abstract);LLM(abstract);large language model(abstract);SFT(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.10616 2025-07-28 cs.LG cs.AI cs.CL 89%

Scalpel vs. Hammer: GRPO Amplifies Existing Capabilities, SFT Replaces Them

Neel Rajani, Aryo Pradipta Gema, Seraphina Goldfarb-Tarrant, Ivan Titov

机构 * Institute for Language, Cognition and Computation (ILCC), University of Edinburgh, United Kingdom(语言、认知与计算研究所(ILCC),爱丁堡大学,英国) Institute for Logic, Language and Computation (ILLC), University of Amsterdam, Netherlands(逻辑、语言与计算研究所(ILLC),阿姆斯特丹大学,荷兰)

专题命中 指令微调 :SFT(title,abstract);LLM(abstract);large language model(abstract);language model(abstract)

Journal ref Actionable Interpretability Workshop ICML 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2502.04350 2025-05-30 cs.CL cs.AI cs.LG cs.SC cs.SE 89%

CodeSteer: Symbolic-Augmented Language Models via Code/Text Guidance

Yongchao Chen, Yilun Hao, Yueying Liu, Yang Zhang, Chuchu Fan

机构 * Massachusetts Institute of Technology, Boston, MA, USA(麻省理工学院) Harvard University, Boston, MA, USA(哈佛大学) MIT-IBM Watson AI Lab, Boston, MA, USA(MIT-IBM Watson AI实验室) University of Illinois Urbana-Champaign, Urbana, IL, USA(伊利诺伊大学厄巴纳-香槟分校)

专题命中 指令微调 :language model(title,abstract);LLM(abstract);large language model(abstract);SFT(abstract)

Comments 28 pages, 12 figures

Journal ref International Conference on Machine Learning (ICML'2025)

详情

展开后加载摘要…

URL PDF HTML 收藏
2504.13125 2025-04-18 cs.CL cs.AI cs.LG 89%

LLMs Meet Finance: Fine-Tuning Foundation Models for the Open FinLLM Leaderboard

Varun Rao, Youran Sun, Mahendra Kumar, Tejas Mutneja, Agastya Mukherjee, Haizhao Yang

专题命中 指令微调 :foundation model(title,abstract);large language model(abstract);language model(abstract);SFT(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.16705 2025-01-16 cs.CL cs.AI cs.LG 89%

SelectIT: Selective Instruction Tuning for LLMs via Uncertainty-Aware Self-Reflection

Liangxin Liu, Xuebo Liu, Derek F. Wong, Dongfang Li, Ziyi Wang, Baotian Hu, Min Zhang

专题命中 指令微调 :instruction tuning(title,abstract);LLM(abstract);large language model(abstract);language model(abstract)

Comments Accepted to NeurIPS 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.12519 2024-10-17 cs.IR 89%

RosePO: Aligning LLM-based Recommenders with Human Values

Jiayi Liao, Xiangnan He, Ruobing Xie, Jiancan Wu, Yancheng Yuan, Xingwu Sun, Zhanhui Kang, Xiang Wang

专题命中 指令微调 :LLM(title,abstract);large language model(abstract);language model(abstract);post-training(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2312.00374 2024-09-12 cs.CR 89%

The Philosopher's Stone: Trojaning Plugins of Large Language Models

Tian Dong, Minhui Xue, Guoxing Chen, Rayne Holland, Yan Meng, Shaofeng Li, Zhen Liu, Haojin Zhu

专题命中 指令微调 :large language model(title,abstract);language model(title,abstract);LLM(abstract)

Comments Accepted by NDSS Symposium 2025. Please cite this paper as "Tian Dong, Minhui Xue, Guoxing Chen, Rayne Holland, Yan Meng, Shaofeng Li, Zhen Liu, Haojin Zhu. The Philosopher's Stone: Trojaning Plugins of Large Language Models. In the 32nd Annual Network and Distributed System Security Symposium (NDSS 2025)."

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.11324 2024-07-03 cs.CL cs.AI cs.LG 89%

Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting

Melanie Sclar, Yejin Choi, Yulia Tsvetkov, Alane Suhr

专题命中 指令微调 :language model(title,abstract);LLM(abstract);large language model(abstract);instruction tuning(abstract)

Comments ICLR 2024 Camera Ready version. With respect to the original submission, we added text generation experiments, plots of entire accuracy distributions for each task + stdev computations, and prompt length correlation with spread analysis

详情

展开后加载摘要…

URL PDF HTML 收藏