语言大模型 / LLM - arXivDaily 专题

2407.04581 2024-07-08 cs.LG cs.ET 89%

Leveraging Large Language Models for Integrated Satellite-Aerial-Terrestrial Networks: Recent Advances and Future Directions

Shumaila Javaid, Ruhul Amin Khalil, Nasir Saeed, Bin He, Mohamed-Slim Alouini

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2403.20041 2024-07-08 cs.CL 89%

Transformer-Lite: High-efficiency Deployment of Large Language Models on Mobile Phone GPUs

Luchang Li, Sheng Qian, Jie Lu, Lunxi Yuan, Rui Wang, Qin Xie

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 21 pages, 6 figures, fix "E0M4" spell mistake, fix FLOPS to TFLOPS

2407.01955 2024-07-03 cs.CL 89%

S2D: Sorted Speculative Decoding For More Efficient Deployment of Nested Large Language Models

Parsa Kavehzadeh, Mohammadreza Pourreza, Mojtaba Valipour, Tinashu Zhu, Haoli Bai, Ali Ghodsi, Boxing Chen, Mehdi Rezagholizadeh

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2406.07588 2024-07-02 cs.MM cs.CL 89%

AIM: Let Any Multi-modal Large Language Models Embrace Efficient In-Context Learning

Jun Gao, Qian Qiao, Ziqiang Cao, Zili Wang, Wenjie Li

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2406.19707 2024-07-01 cs.LG cs.DC 89%

InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management

Wonbeom Lee, Jungi Lee, Junghwan Seo, Jaewoong Sim

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments OSDI 2024

2406.18832 2024-06-28 cs.CL 89%

OutlierTune: Efficient Channel-Wise Quantization for Large Language Models

Jinguang Wang, Yuexi Yin, Haifeng Sun, Qi Qi, Jingyu Wang, Zirui Zhuang, Tingting Yang, Jianxin Liao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.CL

2309.10253 2024-06-28 cs.AI 89%

GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts

Jiahao Yu, Xingwei Lin, Zheng Yu, Xinyu Xing

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2406.14757 2024-06-24 cs.AI 89%

A Large Language Model Outperforms Other Computational Approaches to the High-Throughput Phenotyping of Physician Notes

Syed I. Munzir, Daniel B. Hier, Chelsea Oommen, Michael D. Carrithers

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Submitted to AMIA Annual Symposium 2024, San Francisco CA

2406.14709 2024-06-24 cs.CL 89%

Factual Dialogue Summarization via Learning from Large Language Models

Rongxin Zhu, Jey Han Lau, Jianzhong Qi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2406.12930 2024-06-21 cs.LG cs.AR 89%

Tender: Accelerating Large Language Models via Tensor Decomposition and Runtime Requantization

Jungi Lee, Wonbeom Lee, Jaewoong Sim

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments To appear at the 51st International Symposium on Computer Architecture (ISCA 2024)

2406.11884 2024-06-19 cs.SI cs.AI 89%

Hierarchical Compression of Text-Rich Graphs via Large Language Models

Shichang Zhang, Da Zheng, Jiani Zhang, Qi Zhu, Xiang song, Soji Adeshina, Christos Faloutsos, George Karypis, Yizhou Sun

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2406.11025 2024-06-18 cs.SD cs.CL eess.AS 89%

Large Language Models for Dysfluency Detection in Stuttered Speech

Dominik Wagner, Sebastian P. Bayerl, Ilja Baumann, Korbinian Riedhammer, Elmar Nöth, Tobias Bocklet

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted at Interspeech 2024

2406.09900 2024-06-17 cs.CL 89%

GEB-1.3B: Open Lightweight Large Language Model

Jie Wu, Yufeng Zhu, Lei Shen, Xuqing Lu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments GEB-1.3B technical report

2304.04675 2024-06-17 cs.CL 89%

Multilingual Machine Translation with Large Language Models: Empirical Results and Analysis

Wenhao Zhu, Hongyi Liu, Qingxiu Dong, Jingjing Xu, Shujian Huang, Lingpeng Kong, Jiajun Chen, Lei Li

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to Findings of NAACL 2024

2406.08413 2024-06-13 cs.AR cs.LG 89%

Memory Is All You Need: An Overview of Compute-in-Memory Architectures for Accelerating Large Language Model Inference

Christopher Wolters, Xiaoxuan Yang, Ulf Schlichtmann, Toyotaro Suzumura

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2406.07483 2024-06-12 cs.CL 89%

Advancing Annotation of Stance in Social Media Posts: A Comparative Analysis of Large Language Models and Crowd Sourcing

Mao Li, Frederick Conrad

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2406.07177 2024-06-12 cs.LG 89%

TernaryLLM: Ternarized Large Language Model

Tianqi Chen, Zhe Li, Weixiang Xu, Zeyu Zhu, Dong Li, Lu Tian, Emad Barsoum, Peisong Wang, Jian Cheng

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2406.03243 2024-06-07 cs.AR cs.DC cs.LG 89%

Llumnix: Dynamic Scheduling for Large Language Model Serving

Biao Sun, Ziming Huang, Hanyu Zhao, Wencong Xiao, Xinyi Zhang, Yong Li, Wei Lin

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments To appear at OSDI '24; open-source repo will be available in June 2024

2406.02368 2024-06-05 cs.IR cs.CL 89%

Large Language Models Make Sample-Efficient Recommender Systems

Jianghao Lin, Xinyi Dai, Rong Shan, Bo Chen, Ruiming Tang, Yong Yu, Weinan Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by Frontier of Computer Science

2406.02120 2024-06-05 cs.CL 89%

Diver: Large Language Model Decoding with Span-Level Mutual Information Verification

Jinliang Lu, Chen Wang, Jiajun Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2401.07851 2024-06-05 cs.CL 89%

Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative Decoding

Heming Xia, Zhe Yang, Qingxiu Dong, Peiyi Wang, Yongqi Li, Tao Ge, Tianyu Liu, Wenjie Li, Zhifang Sui

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments ACL 2024 Findings (Long Paper), camera-ready version

2405.19686 2024-05-31 cs.AI 89%

Knowledge Graph Tuning: Real-time Large Language Model Personalization based on Human Feedback

Jingwei Sun, Zhixu Du, Yiran Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2402.14808 2024-05-31 cs.CL 89%

RelayAttention for Efficient Large Language Model Serving with Long System Prompts

Lei Zhu, Xinjiang Wang, Wayne Zhang, Rynson W. H. Lau

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments accepted by the ACL 2024 main conference

2311.13373 2024-05-28 cs.AI 89%

Large Language Model as a Policy Teacher for Training Reinforcement Learning Agents

Zihao Zhou, Bin Hu, Chenyang Zhao, Pu Zhang, Bin Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Accepted and Published by IJCAI 2024

2405.07162 2024-05-17 cs.RO cs.AI 89%

Learning Reward for Robot Skills Using Large Language Models via Self-Alignment

Yuwei Zeng, Yao Mu, Lin Shao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments ICML 2024

2310.10505 2024-05-17 cs.LG 89%

ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models

Ziniu Li, Tian Xu, Yushun Zhang, Zhihang Lin, Yang Yu, Ruoyu Sun, Zhi-Quan Luo

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；RLHF(abstract)；分类 cs.LG

2405.04781 2024-05-09 cs.CL 89%

CourseGPT-zh: an Educational Large Language Model Based on Knowledge Distillation Incorporating Prompt Optimization

Zheyan Qu, Lu Yin, Zitong Yu, Wenbo Wang, Xing zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2405.02937 2024-05-08 cs.CL 89%

Unraveling the Dominance of Large Language Models Over Transformer Models for Bangla Natural Language Inference: A Comprehensive Study

Fatema Tuj Johora Faria, Mukaffi Bin Moin, Asif Iftekher Fahim, Pronay Debnath, Faisal Muhammad Shah

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted in 4th International Conference on Computing and Communication Networks (ICCCNet-2024)

2311.09709 2024-04-30 cs.CL 89%

The Ups and Downs of Large Language Model Inference with Vocabulary Trimming by Language Heuristics

Nikolay Bogoychev, Pinzhen Chen, Barry Haddow, Alexandra Birch

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Versions 2, accepted at Insights from negative results 2024

2310.10586 2024-04-30 cs.CV cs.CL 89%

VidCoM: Fast Video Comprehension through Large Language Models with Multimodal Tools

Ji Qi, Kaixuan Ji, Jifan Yu, Duokang Wang, Bin Xu, Lei Hou, Juanzi Li

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

1. 效率与部署 22243 篇

Leveraging Large Language Models for Integrated Satellite-Aerial-Terrestrial Networks: Recent Advances and Future Directions

Transformer-Lite: High-efficiency Deployment of Large Language Models on Mobile Phone GPUs

S2D: Sorted Speculative Decoding For More Efficient Deployment of Nested Large Language Models

AIM: Let Any Multi-modal Large Language Models Embrace Efficient In-Context Learning

InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management

OutlierTune: Efficient Channel-Wise Quantization for Large Language Models

GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts

A Large Language Model Outperforms Other Computational Approaches to the High-Throughput Phenotyping of Physician Notes

Factual Dialogue Summarization via Learning from Large Language Models

Tender: Accelerating Large Language Models via Tensor Decomposition and Runtime Requantization

Hierarchical Compression of Text-Rich Graphs via Large Language Models

Large Language Models for Dysfluency Detection in Stuttered Speech

GEB-1.3B: Open Lightweight Large Language Model

Multilingual Machine Translation with Large Language Models: Empirical Results and Analysis

Memory Is All You Need: An Overview of Compute-in-Memory Architectures for Accelerating Large Language Model Inference

Advancing Annotation of Stance in Social Media Posts: A Comparative Analysis of Large Language Models and Crowd Sourcing

TernaryLLM: Ternarized Large Language Model

Llumnix: Dynamic Scheduling for Large Language Model Serving

Large Language Models Make Sample-Efficient Recommender Systems

Diver: Large Language Model Decoding with Span-Level Mutual Information Verification

Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative Decoding

Knowledge Graph Tuning: Real-time Large Language Model Personalization based on Human Feedback

RelayAttention for Efficient Large Language Model Serving with Long System Prompts

Large Language Model as a Policy Teacher for Training Reinforcement Learning Agents

Learning Reward for Robot Skills Using Large Language Models via Self-Alignment

ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models

CourseGPT-zh: an Educational Large Language Model Based on Knowledge Distillation Incorporating Prompt Optimization

Unraveling the Dominance of Large Language Models Over Transformer Models for Bangla Natural Language Inference: A Comprehensive Study

The Ups and Downs of Large Language Model Inference with Vocabulary Trimming by Language Heuristics

VidCoM: Fast Video Comprehension through Large Language Models with Multimodal Tools