语言大模型 / LLM - arXivDaily 专题

2403.16393 2025-09-17 cs.AI cs.CL cs.LG 90%

Concurrent Linguistic Error Detection (CLED): a New Methodology for Error Detection in Large Language Models

Jinhua Zhu, Javier Conde, Zhen Gao, Pedro Reviriego, Shanshan Liu, Fabrizio Lombardi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 11 pages, 6 figures, 30 references

Journal ref IEEE Transactions on Computers 2025

2509.09675 2025-09-12 cs.CL cs.AI cs.LG 90%

CDE: Curiosity-Driven Exploration for Efficient Reinforcement Learning in Large Language Models

Runpeng Dai, Linfeng Song, Haolin Liu, Zhenwen Liang, Dian Yu, Haitao Mi, Zhaopeng Tu, Rui Liu, Tong Zheng, Hongtu Zhu, Dong Yu

机构 * Tencent AI Lab（腾讯AI实验室）； Tencent Multimodal Department（腾讯多模态部门）； University of North Carolina at Chapel Hill（北卡罗来纳大学夏洛特分校）； University of Virginia（弗吉尼亚大学）； University of Maryland, College Park（马里兰大学学院公园分校）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 21 pages

2404.18311 2025-09-03 cs.LG cs.AI cs.CL 90%

Towards Incremental Learning in Large Language Models: A Critical Review

Mladjan Jovanovic, Peter Voss

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2508.21377 2025-09-01 cs.CL cs.AI cs.LG 90%

Challenges and Applications of Large Language Models: A Comparison of GPT and DeepSeek family of models

Shubham Sharma, Sneha Tuli, Narendra Badam

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 18 pages, 7 figures

2503.03182 2025-08-26 cs.DC 90%

Enhancing Memory Efficiency in Large Language Model Training Through Chronos-aware Pipeline Parallelism

Xinyuan Lin, Chenlu Li, Zongle Huang, Chunyu Wang, Bo Xiao, Huazhong Yang, Shishi Duan, Yongpan Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；pretraining(abstract)

2508.05239 2025-08-08 cs.CL cs.AI cs.LG 90%

Pruning Large Language Models by Identifying and Preserving Functional Networks

Yiheng Liu, Junhao Ning, Sichen Xia, Xiaohui Gao, Ning Qiang, Bao Ge, Junwei Han, Xintao Hu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 9 pages, 5 figures

2507.14204 2025-07-22 cs.LG cs.AI cs.CL 90%

LaCache: Ladder-Shaped KV Caching for Efficient Long-Context Modeling of Large Language Models

Dachuan Shi, Yonggan Fu, Xiangchi Yuan, Zhongzhi Yu, Haoran You, Sixu Li, Xin Dong, Jan Kautz, Pavlo Molchanov, Yingyan, Lin

机构 * NVIDIA

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICML 2025. Code: https://github.com/GATECH-EIC/LaCache

2507.07147 2025-07-11 cs.LG cs.AI cs.CL cs.CV 90%

Weighted Multi-Prompt Learning with Description-free Large Language Model Distillation

Sua Lee, Kyubum Shin, Jung Ho Park

机构 * Seoul National University（首尔国立大学）； Naver AI

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Published as a conference paper at ICLR 2025

2502.20589 2025-07-09 cs.CR cs.AI cs.CL cs.LG 90%

LLMs Have Rhythm: Fingerprinting Large Language Models Using Inter-Token Times and Network Traffic Analysis

Saeif Alhazbi, Ahmed Mohamed Hussain, Gabriele Oligeri, Panos Papadimitratos

机构 * College of Science and Engineering (CSE), Hamad Bin Khalifa University (HBKU)（哈马德·本·卡伊夫大学科学与工程学院）； Networked Systems Security Group, KTH Royal Institute of Technology -- Stockholm, Sweden（瑞典皇家理工学院网络系统安全组）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；small language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2410.17711 2025-07-01 cs.CL cs.AI cs.LG 90%

Beware of Calibration Data for Pruning Large Language Models

Yixin Ji, Yang Xiang, Juntao Li, Qingrong Xia, Ping Li, Xinyu Duan, Zhefeng Wang, Min Zhang

机构 * School of Computer Science and Technology, Soochow University（苏州大学计算机科学与技术学院）； Key Laboratory of Data Intelligence and Advanced Computing, Soochow University（苏州大学数据智能与先进计算重点实验室）； Huawei Cloud, China（华为云（中国））

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Published as a conference paper at ICLR 2025

2506.21408 2025-06-27 cs.LG cs.AI cs.CL 90%

Scalable Bayesian Low-Rank Adaptation of Large Language Models via Stochastic Variational Subspace Inference

Colin Samplawski, Adam D. Cobb, Manoj Acharya, Ramneet Kaur, Susmit Jha

机构 * Neuro-Symbolic Computing and Intelligence Research Group（神经符号计算与智能研究组）； Computer Science Laboratory（计算机科学实验室）； SRI International（SRI国际）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted at UAI 2025

2506.19697 2025-06-25 cs.LG cs.AI cs.CL 90%

Outlier-Safe Pre-Training for Robust 4-Bit Quantization of Large Language Models

Jungwoo Park, Taewhoo Lee, Chanwoong Yoon, Hyeon Hwang, Jaewoo Kang

机构 * Korea University（韩国大学）； AIGEN Sciences（AIGEN公司）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2506.15704 2025-06-23 cs.LG cs.AI cs.CL 90%

Learn from the Past: Fast Sparse Indexing for Large Language Model Decoding

Feiyu Yao, Qian Wang

机构 * Beijing University of Technology（北京理工大学）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2501.09223 2025-06-17 cs.CL cs.AI cs.LG 90%

Foundations of Large Language Models

Tong Xiao, Jingbo Zhu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI、cs.LG

2505.12627 2025-06-12 cs.NE 90%

Efficient Heuristics Generation for Solving Combinatorial Optimization Problems Using Large Language Models

Xuan Wu, Di Wang, Chunguo Wu, Lijie Wen, Chunyan Miao, Yubin Xiao, You Zhou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments Accepted by SIGKDD 2025

2412.12094 2025-06-03 cs.CL cs.AI cs.LG 90%

SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separator

Guoxuan Chen, Han Shi, Jiawei Li, Yihang Gao, Xiaozhe Ren, Yimeng Chen, Xin Jiang, Zhenguo Li, Weiyang Liu, Chao Huang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to ICML 2025

2401.14109 2025-06-03 cs.CL cs.AI cs.LG quant-ph 90%

CompactifAI: Extreme Compression of Large Language Models using Quantum-Inspired Tensor Networks

Andrei Tomut, Saeed S. Jahromi, Abhijoy Sarkar, Uygar Kurt, Sukhbinder Singh, Faysal Ishtiaq, Cesar Muñoz, Prabdeep Singh Bajaj, Ali Elborady, Gianni del Bimbo, Mehrazin Alizadeh, David Montero, Pablo Martin-Ramiro, Muhammad Ibrahim, Oussama Tahiri Alaoui, John Malcolm, Samuel Mugel, Roman Orus

机构 * Multiverse Computing（多维计算公司）； Catalan Institute of Nanoscience and Nanotechnology (ICN2)（加泰罗尼亚纳米科学与纳米技术研究所）； The Barcelona Institute of Science and Technology（巴塞罗那科学技术研究院）； Donostia International Physics Center（多斯蒂亚国际物理中心）； Centre for Social Innovation（社会创新中心）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 5 pages, 4 figures, 2 tables, and supplementary information of 2 pages and 1 figure. Revised version with new benchmarks for LlaMA2-7B

Journal ref Proceedings of the 33rd European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN 2025), Bruges, Belgium, pp. 531-537, April 2025. ISBN: 9782875870926

2505.18754 2025-06-02 cs.CL cs.AI cs.LG 90%

Few-Shot Optimization for Sensor Data Using Large Language Models: A Case Study on Fatigue Detection

Elsen Ronando, Sozo Inoue

机构 * Graduate School of Life Science and Systems Engineering, Kyushu Institute of Technology（九州工学院生命科学与系统工程研究生院）； Department of Informatics, Universitas 17 Agustus 1945 Surabaya（Surabaya 17 August 1945 大学信息系）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 43 pages, 18 figures. Accepted for publication in MDPI Sensors (2025). Final version before journal publication

Journal ref Sensors 2025, 25, 3324

2502.01662 2025-05-30 cs.CL cs.AI cs.LG 90%

Fast Large Language Model Collaborative Decoding via Speculation

Jiale Fu, Yuchu Jiang, Junkai Chen, Jiaming Fan, Xin Geng, Xu Yang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2505.12065 2025-05-20 cs.AI cs.CL cs.IR cs.LG 90%

Demystifying and Enhancing the Efficiency of Large Language Model Based Search Agents

Tiannuo Yang, Zebin Yao, Bowen Jin, Lixiao Cui, Yusen Li, Gang Wang, Xiaoguang Liu

机构 * Nankai University（南开大学）； University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2504.14126 2025-04-22 cs.AI cs.CL cs.LG 90%

Large Language Model Enhanced Particle Swarm Optimization for Hyperparameter Tuning for Deep Learning Models

Saad Hameed, Basheer Qolomany, Samir Brahim Belhaouari, Mohamed Abdallah, Junaid Qadir, Ala Al-Fuqaha

机构 * Division of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University（哈马德·本·卡西姆大学信息与计算技术学院）； College of Medicine, Howard University（霍华德大学医学院）； Department of Computer Science and Engineering, Qatar University（卡塔尔大学计算机科学与工程系）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2504.10536 2025-04-16 cs.LG cs.AI cs.CL 90%

Federated Learning with Layer Skipping: Efficient Training of Large Language Models for Healthcare NLP

Lihong Zhang, Yue Li

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2504.00882 2025-04-02 cs.DB cs.AI cs.CL cs.IR cs.LG 90%

CrackSQL: A Hybrid SQL Dialect Translation System Powered by Large Language Models

Wei Zhou, Yuyang Gao, Xuanhe Zhou, Guoliang Li

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Extension of our SIGMOD 2025 paper. Please refer to source code available at: https://github.com/weAIDB/CrackSQL

2412.08099 2025-03-14 cs.LG cs.AI cs.CL cs.CR 90%

Adversarial Vulnerabilities in Large Language Models for Time Series Forecasting

Fuqiang Liu, Sicong Jiang, Luis Miranda-Moreno, Seongjin Choi, Lijun Sun

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments AISTATS 2025

2410.05331 2025-03-12 cs.CR cs.AI cs.CL cs.LG 90%

Taylor Unswift: Secured Weight Release for Large Language Models via Taylor Expansion

Guanchu Wang, Yu-Neng Chuang, Ruixiang Tang, Shaochen Zhong, Jiayi Yuan, Hongye Jin, Zirui Liu, Vipin Chaudhary, Shuai Xu, James Caverlee, Xia Hu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2503.05920 2025-03-11 cs.CL cs.AI cs.LG 90%

IDEA Prune: An Integrated Enlarge-and-Prune Pipeline in Generative Language Model Pretraining

Yixiao Li, Xianzhi Du, Ajay Jaiswal, Tao Lei, Tuo Zhao, Chong Wang, Jianyu Wang

专题命中效率与部署：language model(title,abstract)；pretraining(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2308.14352 2025-03-10 cs.LG cs.AI cs.CL 90%

EdgeMoE: Empowering Sparse Large Language Models on Mobile Devices

Rongjie Yi, Liwei Guo, Shiyun Wei, Ao Zhou, Shangguang Wang, Mengwei Xu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2407.12296 2025-03-04 q-bio.BM 90%

Discovery of novel antimicrobial peptides with notable antibacterial potency by a LLM-based foundation model

Jike Wang, Jianwen Feng, Yu Kang, Peichen Pan, Jingxuan Ge, Yan Wang, Mingyang Wang, Zhenxing Wu, Xingcai Zhang, Jiameng Yu, Xujun Zhang, Tianyue Wang, Lirong Wen, Guangning Yan, Yafeng Deng, Hui Shi, Chang-Yu Hsieh, Zhihui Jiang, Tingjun Hou

专题命中效率与部署：LLM(title,abstract)；foundation model(title,abstract)；large language model(abstract)；language model(abstract)

Comments 43 pages, 6 figures, 5 tables. Due to the limitation "The abstract field cannot be longer than 1,920 characters", the abstract appearing here is slightly shorter than that in the PDF file

2311.14324 2025-02-25 cs.AI cs.CL cs.LG 90%

Large Language Models as Topological Structure Enhancers for Text-Attributed Graphs

Shengyin Sun, Yuxiang Ren, Jiehao Chen, Chen Ma

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 10 pages

2410.23918 2025-02-18 cs.CL cs.AI cs.CV cs.LG 90%

BitStack: Any-Size Compression of Large Language Models in Variable Memory Environments

Xinghao Wang, Pengyu Wang, Bo Wang, Dong Zhang, Yunhua Zhou, Xipeng Qiu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICLR 2025

1. 效率与部署 22188 篇

Concurrent Linguistic Error Detection (CLED): a New Methodology for Error Detection in Large Language Models

CDE: Curiosity-Driven Exploration for Efficient Reinforcement Learning in Large Language Models

Towards Incremental Learning in Large Language Models: A Critical Review

Challenges and Applications of Large Language Models: A Comparison of GPT and DeepSeek family of models

Enhancing Memory Efficiency in Large Language Model Training Through Chronos-aware Pipeline Parallelism

Pruning Large Language Models by Identifying and Preserving Functional Networks

LaCache: Ladder-Shaped KV Caching for Efficient Long-Context Modeling of Large Language Models

Weighted Multi-Prompt Learning with Description-free Large Language Model Distillation

LLMs Have Rhythm: Fingerprinting Large Language Models Using Inter-Token Times and Network Traffic Analysis

Beware of Calibration Data for Pruning Large Language Models

Scalable Bayesian Low-Rank Adaptation of Large Language Models via Stochastic Variational Subspace Inference

Outlier-Safe Pre-Training for Robust 4-Bit Quantization of Large Language Models

Learn from the Past: Fast Sparse Indexing for Large Language Model Decoding

Foundations of Large Language Models

Efficient Heuristics Generation for Solving Combinatorial Optimization Problems Using Large Language Models

SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separator

CompactifAI: Extreme Compression of Large Language Models using Quantum-Inspired Tensor Networks

Few-Shot Optimization for Sensor Data Using Large Language Models: A Case Study on Fatigue Detection

Fast Large Language Model Collaborative Decoding via Speculation

Demystifying and Enhancing the Efficiency of Large Language Model Based Search Agents

Large Language Model Enhanced Particle Swarm Optimization for Hyperparameter Tuning for Deep Learning Models

Federated Learning with Layer Skipping: Efficient Training of Large Language Models for Healthcare NLP

CrackSQL: A Hybrid SQL Dialect Translation System Powered by Large Language Models

Adversarial Vulnerabilities in Large Language Models for Time Series Forecasting

Taylor Unswift: Secured Weight Release for Large Language Models via Taylor Expansion

IDEA Prune: An Integrated Enlarge-and-Prune Pipeline in Generative Language Model Pretraining

EdgeMoE: Empowering Sparse Large Language Models on Mobile Devices

Discovery of novel antimicrobial peptides with notable antibacterial potency by a LLM-based foundation model

Large Language Models as Topological Structure Enhancers for Text-Attributed Graphs

BitStack: Any-Size Compression of Large Language Models in Variable Memory Environments