语言大模型 / LLM - arXivDaily 专题

2404.02657 2024-12-10 cs.CL cs.AI 90%

Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models

Taiqiang Wu, Chaofan Tao, Jiahao Wang, Runming Yang, Zhe Zhao, Ngai Wong

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments COLING 2025

2404.06448 2024-12-09 cs.LG cs.AI 90%

Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Models

Zihan Fang, Zheng Lin, Zhe Chen, Xianhao Chen, Yue Gao, Yuguang Fang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments 15 pages, 16 figures

2412.01709 2024-12-03 cs.DB cs.CL cs.LG 90%

Query Performance Explanation through Large Language Model for HTAP Systems

Haibo Xiu, Li Zhang, Tieying Zhang, Jun Yang, Jianjun Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments Submitted to ICDE 2025

2402.04838 2024-11-22 cs.CL cs.AI 90%

PaDeLLM-NER: Parallel Decoding in Large Language Models for Named Entity Recognition

Jinghui Lu, Ziwei Yang, Yanjie Wang, Xuejing Liu, Brian Mac Namee, Can Huang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted to Neurips2024

2402.13098 2024-11-21 cs.CL cs.AI 90%

ELAD: Explanation-Guided Large Language Models Active Distillation

Yifei Zhang, Bo Pan, Chen Ling, Yuntong Hu, Liang Zhao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2411.12357 2024-11-20 cs.SE cs.AI cs.CL cs.MA 90%

A Layered Architecture for Developing and Enhancing Capabilities in Large Language Model-based Software Systems

Dawen Zhang, Xiwei Xu, Chen Wang, Zhenchang Xing, Robert Mao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2411.10606 2024-11-19 cs.LG cs.AI 90%

AmoebaLLM: Constructing Any-Shape Large Language Models for Efficient and Instant Deployment

Yonggan Fu, Zhongzhi Yu, Junwei Li, Jiayi Qian, Yongan Zhang, Xiangchi Yuan, Dachuan Shi, Roman Yakunin, Yingyan Celine Lin

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments Accepted at NeurIPS 2024

2411.06681 2024-11-12 cs.LG cs.AI cs.DC cs.IT math.IT 90%

WDMoE: Wireless Distributed Mixture of Experts for Large Language Models

Nan Xue, Yaping Sun, Zhiyong Chen, Meixia Tao, Xiaodong Xu, Liang Qian, Shuguang Cui, Wenjun Zhang, Ping Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2411.03519 2024-11-07 cs.DC cs.AI cs.LG cs.MA 90%

AI Metropolis: Scaling Large Language Model-based Multi-Agent Simulation with Out-of-order Execution

Zhiqiang Xie, Hao Kang, Ying Sheng, Tushar Krishna, Kayvon Fatahalian, Christos Kozyrakis

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2406.14319 2024-11-07 cs.AI cs.CL 90%

LiveMind: Low-latency Large Language Models with Simultaneous Inference

Chuangtao Chen, Grace Li Zhang, Xunzhao Yin, Cheng Zhuo, Ulf Schlichtmann, Bing Li

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2407.11019 2024-11-06 cs.SE cs.AI cs.CL 90%

Efficacy of Various Large Language Models in Generating Smart Contracts

Siddhartha Chatterjee, Bina Ramamurthy

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI

Comments 18 pages, accepted for presentation at 8th annual Future of Information and Communication Conference

2410.21352 2024-11-01 cs.CL cs.AI 90%

LLMCBench: Benchmarking Large Language Model Compression for Efficient Deployment

Ge Yang, Changyi He, Jinyang Guo, Jianyu Wu, Yifu Ding, Aishan Liu, Haotong Qin, Pengliang Ji, Xianglong Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted by NeurIPS 2024 Datasets and Benchmarks Track

2410.08970 2024-10-30 cs.CL cs.AI 90%

NoVo: Norm Voting off Hallucinations with Attention Heads in Large Language Models

Zheng Yi Ho, Siyuan Liang, Sen Zhang, Yibing Zhan, Dacheng Tao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2410.18248 2024-10-29 cs.LG cs.AI 90%

Fast Inference for Augmented Large Language Models

Rana Shahout, Cong Liang, Shiji Xin, Qianru Lao, Yong Cui, Minlan Yu, Michael Mitzenmacher

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2410.18351 2024-10-25 cs.CL cs.LG 90%

AdaEDL: Early Draft Stopping for Speculative Decoding of Large Language Models via an Entropy-based Lower Bound on Token Acceptance Probability

Sudhanshu Agrawal, Wonseok Jeon, Mingu Lee

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments Workshop on Efficient Natural Language and Signal Processing at NeurIPS 2024

2409.13761 2024-10-22 cs.CL cs.AI 90%

Do Large Language Models Need a Content Delivery Network?

Yihua Cheng, Kuntai Du, Jiayi Yao, Junchen Jiang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2410.10850 2024-10-18 cs.CL cs.AI cs.CY cs.HC 90%

On the Reliability of Large Language Models to Misinformed and Demographically-Informed Prompts

Toluwani Aremu, Oluwakemi Akinwehinmi, Chukwuemeka Nwagu, Syed Ishtiaque Ahmed, Rita Orji, Pedro Arnau Del Amo, Abdulmotaleb El Saddik

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Study conducted between August and December 2023. Under review at AAAI-AI Magazine. Submitted for archival purposes only

2410.12153 2024-10-17 cs.CL cs.AI 90%

Layer-of-Thoughts Prompting (LoT): Leveraging LLM-Based Retrieval with Constraint Hierarchies

Wachara Fungwacharakorn, Nguyen Ha Thanh, May Myo Zin, Ken Satoh

专题命中效率与部署：prompting(title,abstract)；LLM(title)；large language model(abstract)；language model(abstract)

Comments Presented at NeLaMKRR@KR, 2024 (arXiv:2410.05339)

2402.10052 2024-10-17 cs.CL cs.AI 90%

UNDIAL: Self-Distillation with Adjusted Logits for Robust Unlearning in Large Language Models

Yijiang River Dong, Hongzhou Lin, Mikhail Belkin, Ramon Huerta, Ivan Vulić

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；preference optimization(abstract)；分类 cs.CL、cs.AI

2402.11187 2024-10-16 cs.CL cs.AI 90%

LaCo: Large Language Model Pruning via Layer Collapse

Yifei Yang, Zouying Cao, Hai Zhao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.CL、cs.AI

Comments Accepted as Findings of EMNLP2024

2410.09428 2024-10-15 cs.AI cs.CL 90%

Declarative Knowledge Distillation from Large Language Models for Visual Question Answering Datasets

Thomas Eiter, Jan Hadl, Nelson Higuera, Johannes Oetsch

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Presented at NeLaMKRR@KR, 2024 (arXiv:2410.05339)

2405.10853 2024-10-15 cs.LG cs.AI cs.DC 90%

The Future of Large Language Model Pre-training is Federated

Lorenzo Sani, Alex Iacob, Zeyu Cao, Bill Marino, Yan Gao, Tomas Paulik, Wanru Zhao, William F. Shen, Preslav Aleksandrov, Xinchi Qiu, Nicholas D. Lane

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments 24 pages, 15 figures, pre-print

2410.06392 2024-10-10 cs.CL cs.LG 90%

Counterfactual Causal Inference in Natural Language with Large Language Models

Gaël Gendron, Jože M. Rožanec, Michael Witbrock, Gillian Dobbie

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments 22 pages, 10 pages for the main paper, 12 pages for the references and appendix, 5 figures

2405.08755 2024-10-10 cs.CR cs.AI cs.LG 90%

Distributed Threat Intelligence at the Edge Devices: A Large Language Model-Driven Approach

Syed Mhamudul Hasan, Alaa M. Alotaibi, Sajedul Talukder, Abdur R. Shahid

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Journal ref 2024 IEEE 48th Annual Computers, Software, and Applications Conference (COMPSAC)

2410.01174 2024-10-03 cs.CL cs.AI 90%

Towards Inference-time Category-wise Safety Steering for Large Language Models

Amrita Bhattacharjee, Shaona Ghosh, Traian Rebedea, Christopher Parisien

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2410.00387 2024-10-02 cs.CL cs.AI 90%

Boosting the Capabilities of Compact Models in Low-Data Contexts with Large Language Models and Retrieval-Augmented Generation

Bhargav Shandilya, Alexis Palmer

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 13 pages, 1 figure, 5 tables, submitted to COLING 2025

2403.19181 2024-09-30 cs.IR cs.CL cs.LG 90%

Make Large Language Model a Better Ranker

Wen-Shuo Chao, Zhi Zheng, Hengshu Zhu, Hao Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments 12 pages, 5 figures

2409.05902 2024-09-25 cs.LG cs.AR cs.CL 90%

OPAL: Outlier-Preserved Microscaling Quantization Accelerator for Generative Large Language Models

Jahyun Koo, Dahoon Park, Sangwoo Jung, Jaeha Kung

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments 7 pages, 8 figures, DAC2024 accepted

2409.14381 2024-09-24 cs.CL cs.LG 90%

Investigating Layer Importance in Large Language Models

Yang Zhang, Yanfei Dong, Kenji Kawaguchi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2409.13693 2024-09-24 cs.FL cs.AI cs.CL cs.ET cs.HC 90%

Declarative Integration and Management of Large Language Models through Finite Automata: Application to Automation, Communication, and Ethics

Thierry Petit, Arnault Pachot, Claire Conan-Vrinat, Alexandre Dubarry

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Submitted to IAAI-2025, Philadelphia, PA

1. 效率与部署 22210 篇

Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models

Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Models

Query Performance Explanation through Large Language Model for HTAP Systems

PaDeLLM-NER: Parallel Decoding in Large Language Models for Named Entity Recognition

ELAD: Explanation-Guided Large Language Models Active Distillation

A Layered Architecture for Developing and Enhancing Capabilities in Large Language Model-based Software Systems

AmoebaLLM: Constructing Any-Shape Large Language Models for Efficient and Instant Deployment

WDMoE: Wireless Distributed Mixture of Experts for Large Language Models

AI Metropolis: Scaling Large Language Model-based Multi-Agent Simulation with Out-of-order Execution

LiveMind: Low-latency Large Language Models with Simultaneous Inference

Efficacy of Various Large Language Models in Generating Smart Contracts

LLMCBench: Benchmarking Large Language Model Compression for Efficient Deployment

NoVo: Norm Voting off Hallucinations with Attention Heads in Large Language Models

Fast Inference for Augmented Large Language Models

AdaEDL: Early Draft Stopping for Speculative Decoding of Large Language Models via an Entropy-based Lower Bound on Token Acceptance Probability

Do Large Language Models Need a Content Delivery Network?

On the Reliability of Large Language Models to Misinformed and Demographically-Informed Prompts

Layer-of-Thoughts Prompting (LoT): Leveraging LLM-Based Retrieval with Constraint Hierarchies

UNDIAL: Self-Distillation with Adjusted Logits for Robust Unlearning in Large Language Models

LaCo: Large Language Model Pruning via Layer Collapse

Declarative Knowledge Distillation from Large Language Models for Visual Question Answering Datasets

The Future of Large Language Model Pre-training is Federated

Counterfactual Causal Inference in Natural Language with Large Language Models

Distributed Threat Intelligence at the Edge Devices: A Large Language Model-Driven Approach

Towards Inference-time Category-wise Safety Steering for Large Language Models

Boosting the Capabilities of Compact Models in Low-Data Contexts with Large Language Models and Retrieval-Augmented Generation

Make Large Language Model a Better Ranker

OPAL: Outlier-Preserved Microscaling Quantization Accelerator for Generative Large Language Models

Investigating Layer Importance in Large Language Models

Declarative Integration and Management of Large Language Models through Finite Automata: Application to Automation, Communication, and Ethics