语言大模型 / LLM - arXivDaily 专题

2402.13516 2025-01-08 cs.LG cs.AI cs.CL 89%

ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models

Chenyang Song, Xu Han, Zhengyan Zhang, Shengding Hu, Xiyu Shi, Kuai Li, Chen Chen, Zhiyuan Liu, Guangli Li, Tao Yang, Maosong Sun

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 19 pages, 4 figures, 9 tables

2501.00786 2025-01-03 cs.CR 89%

Shifting-Merging: Secure, High-Capacity and Efficient Steganography via Large Language Models

Minhao Bai, Jinshuai Yang, Kaiyi Pang, Yongfeng Huang, Yue Gao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2412.18511 2024-12-25 cs.RO 89%

Large Language Model guided Deep Reinforcement Learning for Decision Making in Autonomous Driving

Hao Pang, Zhenpo Wang, Guoqiang Li

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2412.17249 2024-12-24 cs.RO cs.CR 89%

EM-MIAs: Enhancing Membership Inference Attacks in Large Language Models through Ensemble Modeling

Zichen Song, Sitan Huang, Zhongfeng Kang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments Accepted by ICASSP 2025 Main

2412.07207 2024-12-23 cs.LG cs.AI cs.CL 89%

MAPLE: A Framework for Active Preference Learning Guided by Large Language Models

Saaduddin Mahmud, Mason Nakamura, Shlomo Zilberstein

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments AAAI 2025 AI Alignment Track

2412.10978 2024-12-17 cs.CR 89%

Labeling NIDS Rules with MITRE ATT&CK Techniques: Machine Learning vs. Large Language Models

Nir Daniel, Florian Klaus Kaiser, Shay Giladi, Sapir Sharabi, Raz Moyal, Shalev Shpolyansky, Andres Murillo, Aviad Elyashar, Rami Puzis

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2409.17481 2024-12-10 cs.AI cs.CL cs.LG 89%

MaskLLM: Learnable Semi-Structured Sparsity for Large Language Models

Gongfan Fang, Hongxu Yin, Saurav Muralidharan, Greg Heinrich, Jeff Pool, Jan Kautz, Pavlo Molchanov, Xinchao Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments NeurIPS 2024 Spotlight

2412.03250 2024-12-05 cs.NE 89%

Controlling the Mutation in Large Language Models for the Efficient Evolution of Algorithms

Haoran Yin, Anna V. Kononova, Thomas Bäck, Niki van Stein

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2404.04566 2024-12-05 cs.SE 89%

Efficient and Green Large Language Models for Software Engineering: Literature Review, Vision, and the Road Ahead

Jieke Shi, Zhou Yang, David Lo

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments Accepted by ACM Transactions on Software Engineering and Methodology (TOSEM), 23 pages

2407.05784 2024-11-28 cs.AR 89%

Hecaton: Training Large Language Models with Scalable Chiplet Systems

Zongle Huang, Shupei Fan, Chen Tang, Xinyuan Lin, Shuwen Deng, Yongpan Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2410.05062 2024-11-27 cs.IT eess.SP math.IT 89%

Large Language Model Based Multi-Objective Optimization for Integrated Sensing and Communications in UAV Networks

Haoyun Li, Ming Xiao, Kezhi Wang, Dong In Kim, Merouane Debbah

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2411.15766 2024-11-26 cs.IR 89%

ScalingNote: Scaling up Retrievers with Large Language Models for Real-World Dense Retrieval

Suyuan Huang, Chao Zhang, Yuanyuan Wu, Haoxin Zhang, Yuan Wang, Maolin Wang, Shaosheng Cao, Tong Xu, Xiangyu Zhao, Zengchang Qin, Yan Gao, Yunhan Bai, Jun Fan, Yao Hu, Enhong Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2411.15715 2024-11-26 cs.CE 89%

Task Scheduling for Efficient Inference of Large Language Models on Single Moderate GPU Systems

Wenxiang Lin, Xinglin Pan, Shaohuai Shi, Xuan Wang, Xiaowen Chu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2407.02079 2024-11-25 cs.AR 89%

Theseus: Exploring Efficient Wafer-Scale Chip Design for Large Language Models

Jingchen Zhu, Chenhao Xue, Yiqi Chen, Zhao Wang, Chen Zhang, Yu Shen, Yifan Chen, Zekang Cheng, Yu Jiang, Tianqi Wang, Yibo Lin, Wei Hu, Bin Cui, Runsheng Wang, Yun Liang, Guangyu Sun

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2411.13676 2024-11-22 cs.CL cs.AI cs.LG 89%

Hymba: A Hybrid-head Architecture for Small Language Models

Xin Dong, Yonggan Fu, Shizhe Diao, Wonmin Byeon, Zijia Chen, Ameya Sunil Mahabaleshwarkar, Shih-Yang Liu, Matthijs Van Keirsbilck, Min-Hung Chen, Yoshi Suhara, Yingyan Lin, Jan Kautz, Pavlo Molchanov

专题命中效率与部署：language model(title,abstract)；small language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 20 pages, models are available on huggingface

2406.03488 2024-11-12 cs.DC 89%

Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training

Ao Sun, Weilin Zhao, Xu Han, Cheng Yang, Xinrong Zhang, Zhiyuan Liu, Chuan Shi, Maosong Sun

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 12 pages, 4 figures, 6 tables

2411.05903 2024-11-12 cs.LG cs.AI cs.CL cs.CV cs.SD eess.AS 89%

Towards Multi-Modal Mastery: A 4.5B Parameter Truly Multi-Modal Small Language Model

Ben Koska, Mojmír Horváth

专题命中效率与部署：language model(title,abstract)；small language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2411.03881 2024-11-07 cs.IR 89%

Data Fusion of Synthetic Query Variants With Generative Large Language Models

Timo Breuer

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)

Comments The definitive version of record was published in SIGIR-AP '24

2411.03357 2024-11-07 cs.CR cs.DC 89%

PipeLLM: Fast and Confidential Large Language Model Services with Speculative Pipelined Encryption

Yifan Tan, Cheng Tan, Zeyu Mi, Haibo Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments To appear in ASPLOS 2025

2404.14824 2024-11-07 cs.SE 89%

Automated Commit Message Generation with Large Language Models: An Empirical Study and Beyond

Pengyu Xue, Linhao Wu, Zhongxing Yu, Zhi Jin, Zhen Yang, Xinyi Li, Zhenyu Yang, Yue Tan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2411.02530 2024-11-06 cs.LG cs.AI cs.CL 89%

A Comprehensive Study on Quantization Techniques for Large Language Models

Jiedong Lang, Zhehao Guo, Shuyu Huang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2411.02063 2024-11-05 cs.CL cs.AI cs.LG 89%

Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention

Xingtai Lv, Ning Ding, Kaiyan Zhang, Ermo Hua, Ganqu Cui, Bowen Zhou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to EMNLP 2024 (Main Conference)

2410.22282 2024-11-05 cs.CY 89%

Whose ChatGPT? Unveiling Real-World Educational Inequalities Introduced by Large Language Models

Renzhe Yu, Zhen Xu, Sky CH-Wang, Richard Arum

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2405.09719 2024-11-05 cs.CL cs.AI cs.LG 89%

Spectral Editing of Activations for Large Language Model Alignment

Yifu Qiu, Zheng Zhao, Yftah Ziser, Anna Korhonen, Edoardo M. Ponti, Shay B. Cohen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 24 pages, NeurIPS 2024

2411.00473 2024-11-04 cs.NI physics.optics 89%

Synergistic Interplay of Large Language Model and Digital Twin for Autonomous Optical Networks: Field Demonstrations

Yuchen Song, Yao Zhang, Anni Zhou, Yan Shi, Shikui Shen, Xiongyan Tang, Jin Li, Min Zhang, Danshi Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 7 pages,6 figures; Accepted by IEEE Communications Magazine, Open call

2402.15678 2024-10-31 cs.DC 89%

Minions: Accelerating Large Language Model Inference with Aggregated Speculative Execution

Siqi Wang, Hailong Yang, Xuezhu Wang, Tongxuan Liu, Pengbo Wang, Xuning Liang, Kejie Ma, Tianyu Feng, Xin You, Yongjun Bao, Yi Liu, Zhongzhi Luan, Depei Qian

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2406.09041 2024-10-29 cs.CL cs.AI cs.LG 89%

ME-Switch: A Memory-Efficient Expert Switching Framework for Large Language Models

Jing Liu, Ruihao Gong, Mingyang Zhang, Yefei He, Jianfei Cai, Bohan Zhuang

专题命中效率与部署：large language model(title)；language model(title)；LLM(abstract)；foundation model(abstract)

Comments Tech report

2410.19160 2024-10-28 cs.LG cs.AI cs.CL cs.CR 89%

Adversarial Attacks on Large Language Models Using Regularized Relaxation

Samuel Jacob Chacko, Sajib Biswas, Chashi Mahiul Islam, Fatema Tabassum Liza, Xiuwen Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 8 pages, 6 figures

2410.17145 2024-10-23 cs.CL cs.AI cs.LG 89%

Can General-Purpose Large Language Models Generalize to English-Thai Machine Translation ?

Jirat Chiaranaipanich, Naiyarat Hanmatheekuna, Jitkapat Sawatphol, Krittamate Tiankanon, Jiramet Kinchagawat, Amrest Chinkamol, Parinthapat Pengpun, Piyalitt Ittichaiwong, Peerat Limkonchotiwat

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted in GenBench EMNLP 2024

2410.16804 2024-10-23 cs.RO 89%

Combining Ontological Knowledge and Large Language Model for User-Friendly Service Robots

Haru Nakajima, Jun Miura

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；foundation model(abstract)

Comments Accepted to IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2024)

1. 效率与部署 22280 篇

ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models

Shifting-Merging: Secure, High-Capacity and Efficient Steganography via Large Language Models

Large Language Model guided Deep Reinforcement Learning for Decision Making in Autonomous Driving

EM-MIAs: Enhancing Membership Inference Attacks in Large Language Models through Ensemble Modeling

MAPLE: A Framework for Active Preference Learning Guided by Large Language Models

Labeling NIDS Rules with MITRE ATT&CK Techniques: Machine Learning vs. Large Language Models

MaskLLM: Learnable Semi-Structured Sparsity for Large Language Models

Controlling the Mutation in Large Language Models for the Efficient Evolution of Algorithms

Efficient and Green Large Language Models for Software Engineering: Literature Review, Vision, and the Road Ahead

Hecaton: Training Large Language Models with Scalable Chiplet Systems

Large Language Model Based Multi-Objective Optimization for Integrated Sensing and Communications in UAV Networks

ScalingNote: Scaling up Retrievers with Large Language Models for Real-World Dense Retrieval

Task Scheduling for Efficient Inference of Large Language Models on Single Moderate GPU Systems

Theseus: Exploring Efficient Wafer-Scale Chip Design for Large Language Models

Hymba: A Hybrid-head Architecture for Small Language Models

Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training

Towards Multi-Modal Mastery: A 4.5B Parameter Truly Multi-Modal Small Language Model

Data Fusion of Synthetic Query Variants With Generative Large Language Models

PipeLLM: Fast and Confidential Large Language Model Services with Speculative Pipelined Encryption

Automated Commit Message Generation with Large Language Models: An Empirical Study and Beyond

A Comprehensive Study on Quantization Techniques for Large Language Models

Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention

Whose ChatGPT? Unveiling Real-World Educational Inequalities Introduced by Large Language Models

Spectral Editing of Activations for Large Language Model Alignment

Synergistic Interplay of Large Language Model and Digital Twin for Autonomous Optical Networks: Field Demonstrations

Minions: Accelerating Large Language Model Inference with Aggregated Speculative Execution

ME-Switch: A Memory-Efficient Expert Switching Framework for Large Language Models

Adversarial Attacks on Large Language Models Using Regularized Relaxation

Can General-Purpose Large Language Models Generalize to English-Thai Machine Translation ?

Combining Ontological Knowledge and Large Language Model for User-Friendly Service Robots