语言大模型 / LLM - arXivDaily 专题

2310.00163 2024-03-08 cs.RO 89%

Cook2LTL: Translating Cooking Recipes to LTL Formulae using Large Language Models

Angelos Mavrogiannis, Christoforos Mavrogiannis, Yiannis Aloimonos

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments ICRA 2024 final version

2403.01008 2024-03-05 cs.CR cs.IR 89%

BasedAI: A decentralized P2P network for Zero Knowledge Large Language Models (ZK-LLMs)

Sean Wellington

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2402.17985 2024-02-29 cs.LG cs.AI cs.CL 89%

FlattenQuant: Breaking Through the Inference Compute-bound for Large Language Models with Per-tensor Quantization

Yi Zhang, Fei Yang, Shuang Peng, Fangyu Wang, Aimin Pan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2402.11323 2024-02-20 cs.DL 89%

Towards Development of Automated Knowledge Maps and Databases for Materials Engineering using Large Language Models

Deepak Prasad, Mayur Pimpude, Alankar Alankar

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2402.09748 2024-02-16 cs.CL cs.AI cs.LG cs.PF 89%

Model Compression and Efficient Inference for Large Language Models: A Survey

Wenxiao Wang, Wei Chen, Yicong Luo, Yongliu Long, Zhengkai Lin, Liye Zhang, Binbin Lin, Deng Cai, Xiaofei He

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 47 pages, review 380 papers. The work is ongoing

2402.00251 2024-02-02 cs.LG cs.AI cs.CL 89%

Efficient Non-Parametric Uncertainty Quantification for Black-Box Large Language Models and Decision Planning

Yao-Hung Hubert Tsai, Walter Talbott, Jian Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2309.15223 2024-01-29 cs.CL cs.AI cs.LG cs.NE cs.SD eess.AS 89%

Low-rank Adaptation of Large Language Model Rescoring for Parameter-Efficient Speech Recognition

Yu Yu, Chao-Han Huck Yang, Jari Kolehmainen, Prashanth G. Shivakumar, Yile Gu, Sungho Ryu, Roger Ren, Qi Luo, Aditya Gourav, I-Fan Chen, Yi-Chieh Liu, Tuan Dinh, Ankur Gandhe, Denis Filimonov, Shalini Ghosh, Andreas Stolcke, Ariya Rastow, Ivan Bulyko

专题命中效率与部署：language model(title,abstract)；large language model(title)；pretraining(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to IEEE ASRU 2023. Internal Review Approved. Revised 2nd version with Andreas and Huck. The first version is in Sep 29th. 8 pages

Journal ref Proc. IEEE ASRU Workshop, Dec. 2023

2401.09149 2024-01-23 cs.DC 89%

InternEvo: Efficient Long-sequence Large Language Model Training via Hybrid Parallelism and Redundant Sharding

Qiaoling Chen, Diandian Gu, Guoteng Wang, Xun Chen, YingTong Xiong, Ting Huang, Qinghao Hu, Xin Jin, Yonggang Wen, Tianwei Zhang, Peng Sun

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2310.16984 2024-01-09 cs.CY 89%

Patterns of Student Help-Seeking When Using a Large Language Model-Powered Programming Assistant

Brad Sheese, Mark Liffiton, Jaromir Savelka, Paul Denny

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2312.17449 2024-01-04 cs.DB 89%

DB-GPT: Empowering Database Interactions with Private Large Language Models

Siqiao Xue, Caigao Jiang, Wenhui Shi, Fangyin Cheng, Keting Chen, Hongjun Yang, Zhiping Zhang, Jianshan He, Hongyang Zhang, Ganglin Wei, Wang Zhao, Fan Zhou, Danrui Qi, Hong Yi, Shaodong Liu, Faqiang Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2304.05501 2023-12-27 cs.RO 89%

L3MVN: Leveraging Large Language Models for Visual Target Navigation

Bangguo Yu, Hamidreza Kasaei, Ming Cao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 7 pages

Journal ref 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

2312.12464 2023-12-22 cs.LG cs.AI cs.CL 89%

Towards Better Serialization of Tabular Data for Few-shot Classification with Large Language Models

Sukriti Jaitly, Tanay Shah, Ashish Shugani, Razik Singh Grewal

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 4 pages, 2 figures

2312.13225 2023-12-21 cs.SE 89%

Automated DevOps Pipeline Generation for Code Repositories using Large Language Models

Deep Mehta, Kartik Rawool, Subodh Gujar, Bowen Xu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2309.02784 2023-12-14 cs.LG cs.AI cs.CL 89%

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Liang Li, Qingyuan Li, Bo Zhang, Xiangxiang Chu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2311.17474 2023-11-30 cs.NI 89%

Large Language Models for Networking: Applications, Enabling Techniques, and Challenges

Yudong Huang, Hongyang Du, Xinyuan Zhang, Dusit Niyato, Jiawen Kang, Zehui Xiong, Shuo Wang, Tao Huang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 7 pages, 3 figures, 2 tables

2311.01266 2023-11-03 cs.SE 89%

Let's Discover More API Relations: A Large Language Model-based AI Chain for Unsupervised API Relation Inference

Qing Huang, Yanbang Sun, Zhenchang Xing, Yuanlong Cao, Jieshan Chen, Xiwei Xu, Huan Jin, Jiaxing Lu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2310.18356 2023-11-01 cs.CL cs.AI cs.LG 89%

LoRAShear: Efficient Large Language Model Structured Pruning and Knowledge Recovery

Tianyi Chen, Tianyu Ding, Badal Yadav, Ilya Zharkov, Luming Liang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2310.04698 2023-10-10 cs.CV 89%

Tree-GPT: Modular Large Language Model Expert System for Forest Remote Sensing Image Understanding and Interactive Analysis

Siqi Du, Shengjun Tang, Weixi Wang, Xiaoming Li, Renzhong Guo

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2310.01612 2023-10-04 cs.IR 89%

Towards Efficient and Effective Adaptation of Large Language Models for Sequential Recommendation

Bo Peng, Ben Burns, Ziqi Chen, Srinivasan Parthasarathy, Xia Ning

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2309.05248 2023-09-15 eess.AS cs.SD 89%

Enhancing Speaker Diarization with Large Language Models: A Contextual Beam Search Approach

Tae Jin Park, Kunal Dhawan, Nithin Koluguri, Jagadeesh Balam

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 4 pages 1 reference page, ICASSP format

2305.17256 2023-09-12 cs.CL cs.AI cs.LG 89%

Large Language Models Can be Lazy Learners: Analyze Shortcuts in In-Context Learning

Ruixiang Tang, Dehan Kong, Longtao Huang, Hui Xue

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2308.11601 2023-08-24 cs.LG cs.AI cs.CL cs.MA 89%

Tryage: Real-time, intelligent Routing of User Prompts to Large Language Models

Surya Narayanan Hari, Matt Thomson

专题命中效率与部署：language model(title,abstract)；large language model(title)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2308.10837 2023-08-22 cs.IR 89%

Leveraging Large Language Models for Pre-trained Recommender Systems

Zhixuan Chu, Hongyan Hao, Xin Ouyang, Simeng Wang, Yan Wang, Yue Shen, Jinjie Gu, Qing Cui, Longfei Li, Siqiao Xue, James Y Zhang, Sheng Li

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 13 pages, 4 figures

2303.04673 2023-08-10 cs.CL cs.AI cs.LG 89%

Cost-Effective Hyperparameter Optimization for Large Language Model Generation Inference

Chi Wang, Susan Xueqing Liu, Ahmed H. Awadallah

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2305.15336 2023-05-25 cs.CR 89%

From Text to MITRE Techniques: Exploring the Malicious Use of Large Language Models for Generating Cyber Attack Payloads

P. V. Sai Charan, Hrushikesh Chunduri, P. Mohan Anand, Sandeep K Shukla

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2304.07493 2023-04-18 cs.AR 89%

OliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantization

Cong Guo, Jiaming Tang, Weiming Hu, Jingwen Leng, Chen Zhang, Fan Yang, Yunxin Liu, Minyi Guo, Yuhao Zhu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments ISCA 2023

2302.02094 2023-02-14 cs.HC 89%

Chat2VIS: Generating Data Visualisations via Natural Language using ChatGPT, Codex and GPT-3 Large Language Models

Paula Maddigan, Teo Susnjak

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments revision

2204.06644 2022-04-19 cs.LG cs.AI cs.CL 89%

METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals

Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Di He, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao

专题命中效率与部署：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Update details in scaled initialization and add acknowledgement

2606.21238 2026-06-23 cs.DC cs.AI cs.LG 新提交 89%

Recency/Frequency Adaptive KV Caching for Large Language Model Serving

面向大语言模型服务的近期/频率自适应KV缓存

Yang Shen, Meghana Madhyastha, Robert Underwood, Bogdan Nicolae, Randal Burns

机构 * Department of Computer Science, Johns Hopkins University, Baltimore, USA（约翰霍普金斯大学计算机科学系）； Argonne National Laboratory, Lemont, USA（阿贡国家实验室）； Parasail, Inc., San Mateo, USA（Parasail公司）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG；foundation model(comments)

AI总结针对LRU策略在多工作负载下缓存失效问题，提出自适应KV缓存，动态分配近期与高频KV块的空间，在合成文档问答中缓存命中率提升10.8%，首令牌时间降低12.6%。

Comments Accepted at the ICML 2026 Workshop on Resource-Adaptive Foundation Model Inference (AdaptFM)

2604.24542 2026-04-28 cs.CR cs.AI cs.CL 89%

Layerwise Convergence Fingerprints for Runtime Misbehavior Detection in Large Language Models

用于大语言模型运行时恶意行为检测的分层收敛指纹

Nay Myat Min, Long H. Pham, Jun Sun

机构 * Singapore Management University（新加坡管理大学）

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI；LLM(comments)

AI总结本文提出LCF方法，通过分析神经网络层间隐藏状态轨迹来检测运行时恶意行为，无需参考模型或重训练，有效降低攻击成功率并高检测率识别多种威胁。

Comments 34 pages, 5 figures. Code: https://github.com/NayMyatMin/LCF-LLM

1. 效率与部署 22280 篇

Cook2LTL: Translating Cooking Recipes to LTL Formulae using Large Language Models

BasedAI: A decentralized P2P network for Zero Knowledge Large Language Models (ZK-LLMs)

FlattenQuant: Breaking Through the Inference Compute-bound for Large Language Models with Per-tensor Quantization

Towards Development of Automated Knowledge Maps and Databases for Materials Engineering using Large Language Models

Model Compression and Efficient Inference for Large Language Models: A Survey

Efficient Non-Parametric Uncertainty Quantification for Black-Box Large Language Models and Decision Planning

Low-rank Adaptation of Large Language Model Rescoring for Parameter-Efficient Speech Recognition

InternEvo: Efficient Long-sequence Large Language Model Training via Hybrid Parallelism and Redundant Sharding

Patterns of Student Help-Seeking When Using a Large Language Model-Powered Programming Assistant

DB-GPT: Empowering Database Interactions with Private Large Language Models

L3MVN: Leveraging Large Language Models for Visual Target Navigation

Towards Better Serialization of Tabular Data for Few-shot Classification with Large Language Models

Automated DevOps Pipeline Generation for Code Repositories using Large Language Models

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Large Language Models for Networking: Applications, Enabling Techniques, and Challenges

Let's Discover More API Relations: A Large Language Model-based AI Chain for Unsupervised API Relation Inference

LoRAShear: Efficient Large Language Model Structured Pruning and Knowledge Recovery

Tree-GPT: Modular Large Language Model Expert System for Forest Remote Sensing Image Understanding and Interactive Analysis

Towards Efficient and Effective Adaptation of Large Language Models for Sequential Recommendation

Enhancing Speaker Diarization with Large Language Models: A Contextual Beam Search Approach

Large Language Models Can be Lazy Learners: Analyze Shortcuts in In-Context Learning

Tryage: Real-time, intelligent Routing of User Prompts to Large Language Models

Leveraging Large Language Models for Pre-trained Recommender Systems

Cost-Effective Hyperparameter Optimization for Large Language Model Generation Inference

From Text to MITRE Techniques: Exploring the Malicious Use of Large Language Models for Generating Cyber Attack Payloads

OliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantization

Chat2VIS: Generating Data Visualisations via Natural Language using ChatGPT, Codex and GPT-3 Large Language Models

METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals

Recency/Frequency Adaptive KV Caching for Large Language Model Serving

Layerwise Convergence Fingerprints for Runtime Misbehavior Detection in Large Language Models