语言大模型 / LLM - arXivDaily 专题

2409.09040 2024-09-17 cs.HC cs.AI cs.CL 90%

ChatSUMO: Large Language Model for Automating Traffic Scenario Generation in Simulation of Urban MObility

Shuyang Li, Talha Azfar, Ruimin Ke

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2401.03426 2024-09-13 cs.CL cs.AI 90%

On Leveraging Large Language Models for Enhancing Entity Resolution: A Cost-efficient Approach

Huahang Li, Longyu Feng, Shuangyin Li, Fei Hao, Chen Jason Zhang, Yuanfeng Song

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 9 pages, preprint under review

2401.06118 2024-09-12 cs.LG cs.CL 90%

Extreme Compression of Large Language Models via Additive Quantization

Vage Egiazarian, Andrei Panferov, Denis Kuznedelev, Elias Frantar, Artem Babenko, Dan Alistarh

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments ICML, 2024

2312.12391 2024-09-11 cs.LG cs.AI cs.AR 90%

vTrain: A Simulation Framework for Evaluating Cost-effective and Compute-optimal Large Language Model Training

Jehyeon Bang, Yujeong Choi, Myeongwoo Kim, Yongdeok Kim, Minsoo Rhu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2409.04833 2024-09-10 cs.CL cs.AI 90%

Achieving Peak Performance for Large Language Models: A Systematic Review

Zhyar Rzgar K Rostam, Sándor Szénási, Gábor Kertész

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 34 pages, 7 figures, 8 tables. Journal Article: IEEE Access

Journal ref IEEE Access (2024) 96017-96050;

2409.04073 2024-09-10 cs.CL cs.AI cs.DB 90%

AnyMatch -- Efficient Zero-Shot Entity Matching with a Small Language Model

Zeyu Zhang, Paul Groth, Iacer Calixto, Sebastian Schelter

专题命中效率与部署：language model(title,abstract)；small language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI

Comments 12 pages excluding references, 3 figures, and 5 tables

2402.19465 2024-09-04 cs.CL cs.AI 90%

Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period of Large Language Models

Chen Qian, Jie Zhang, Wei Yao, Dongrui Liu, Zhenfei Yin, Yu Qiao, Yong Liu, Jing Shao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted at ACL 2024

2406.10260 2024-08-29 cs.CL cs.LG 90%

Flextron: Many-in-One Flexible Large Language Model

Ruisi Cai, Saurav Muralidharan, Greg Heinrich, Hongxu Yin, Zhangyang Wang, Jan Kautz, Pavlo Molchanov

专题命中效率与部署：large language model(title)；language model(title)；LLM(abstract)；pretraining(abstract)

2408.11393 2024-08-22 cs.CL cs.LG 90%

First Activations Matter: Training-Free Methods for Dynamic Activation in Large Language Models

Chi Ma, Mincong Huang, Ying Zhang, Chao Wang, Yujie Wang, Lei Yu, Chuan Liu, Wei Lin

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2407.12021 2024-08-20 cs.CL cs.AI 90%

Adaptive Draft-Verification for Efficient Large Language Model Decoding

Xukun Liu, Bowen Lei, Ruqi Zhang, Dongkuan Xu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Under review of Neurips 2024

2408.04140 2024-08-09 cs.CL cs.AI 90%

UNLEARN Efficient Removal of Knowledge in Large Language Models

Tyler Lizzo, Larry Heck

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 11 pages, 2 Figures

2311.08640 2024-08-06 cs.CL cs.LG 90%

Multistage Collaborative Knowledge Distillation from a Large Language Model for Semi-Supervised Sequence Generation

Jiachen Zhao, Wenlong Zhao, Andrew Drozdov, Benjamin Rozonoyer, Md Arafat Sultan, Jay-Yoon Lee, Mohit Iyyer, Andrew McCallum

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments ACL 2024

2408.01050 2024-08-05 cs.SE cs.CL cs.LG 90%

The Impact of Hyperparameters on Large Language Model Inference Performance: An Evaluation of vLLM and HuggingFace Pipelines

Matias Martinez

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2407.20503 2024-07-31 cs.LG cs.AI 90%

A federated large language model for long-term time series forecasting

Raed Abdel-Sater, A. Ben Hamza

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2407.19947 2024-07-30 cs.CL cs.LG 90%

Inference acceleration for large language models using "stairs" assisted greedy generation

Domas Grigaliūnas, Mantas Lukoševičius

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments Accepted at the 29th International Conference on Information Society and University Studies (IVUS 2024)

2407.19055 2024-07-30 cs.SE cs.AI cs.LG 90%

Effective Large Language Model Debugging with Best-first Tree Search

Jialin Song, Jonathan Raiman, Bryan Catanzaro

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2407.17126 2024-07-25 cs.CL cs.AI 90%

SDoH-GPT: Using Large Language Models to Extract Social Determinants of Health (SDoH)

Bernardo Consoli, Xizhi Wu, Song Wang, Xinyu Zhao, Yanshan Wang, Justin Rousseau, Tom Hartvigsen, Li Shen, Huanmei Wu, Yifan Peng, Qi Long, Tianlong Chen, Ying Ding

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2407.15366 2024-07-23 cs.CL cs.AI cs.CY 90%

Walking in Others' Shoes: How Perspective-Taking Guides Large Language Models in Reducing Toxicity and Bias

Rongwu Xu, Zi'an Zhou, Tianwei Zhang, Zehan Qi, Su Yao, Ke Xu, Wei Xu, Han Qiu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI

2404.14294 2024-07-22 cs.CL cs.AI 90%

A Survey on Efficient Inference for Large Language Models

Zixuan Zhou, Xuefei Ning, Ke Hong, Tianyu Fu, Jiaming Xu, Shiyao Li, Yuming Lou, Luning Wang, Zhihang Yuan, Xiuhong Li, Shengen Yan, Guohao Dai, Xiao-Ping Zhang, Yuhan Dong, Yu Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2310.08419 2024-07-22 cs.LG cs.AI 90%

Jailbreaking Black Box Large Language Models in Twenty Queries

Patrick Chao, Alexander Robey, Edgar Dobriban, Hamed Hassani, George J. Pappas, Eric Wong

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2310.15007 2024-07-17 cs.CL cs.CR cs.LG 90%

Did the Neurons Read your Book? Document-level Membership Inference for Large Language Models

Matthieu Meeus, Shubham Jain, Marek Rei, Yves-Alexandre de Montjoye

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments Accepted at 33rd USENIX Security Symposium (USENIX Security 2024)

2404.08698 2024-07-11 cs.CL cs.LG 90%

Lossless Acceleration of Large Language Model via Adaptive N-gram Parallel Decoding

Jie Ou, Yueming Chen, Wenhong Tian

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2407.05690 2024-07-09 cs.CL cs.AI 90%

Pruning Large Language Models to Intra-module Low-rank Architecture with Transitional Activations

Bowen Shen, Zheng Lin, Daren Zha, Wei Liu, Jian Luan, Bin Wang, Weiping Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Findings of ACL 2024

2407.05580 2024-07-09 cs.LG cs.AI 90%

$\mathrm{E^{2}CFD}$: Towards Effective and Efficient Cost Function Design for Safe Reinforcement Learning via Large Language Model

Zepeng Wang, Chao Ma, Linjiang Zhou, Libing Wu, Lei Yang, Xiaochuan Shi, Guojun Peng

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2407.04118 2024-07-08 cs.CL cs.AI 90%

MAPO: Boosting Large Language Model Performance with Model-Adaptive Prompt Optimization

Yuyan Chen, Zhihao Wen, Ge Fan, Zhengyu Chen, Wei Wu, Dayiheng Liu, Zhixu Li, Bang Liu, Yanghua Xiao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted to EMNLP 2023 (Findings)

2305.13338 2024-07-08 q-bio.GN cs.AI cs.CL q-bio.QM 90%

Gene Set Summarization using Large Language Models

Marcin P. Joachimiak, J. Harry Caufield, Nomi L. Harris, Hyeongsik Kim, Christopher J. Mungall

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2403.19708 2024-07-02 cs.CL cs.LG 90%

Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttention

Bin Gao, Zhuomin He, Puru Sharma, Qingxuan Kang, Djordje Jevdjic, Junbo Deng, Xingkun Yang, Zhou Yu, Pengfei Zuo

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments Accepted to USENIX Annual Technical Conference (ATC) 2024

2305.14752 2024-07-01 cs.SE cs.AI cs.FL cs.LG 90%

A New Era in Software Security: Towards Self-Healing Software via Large Language Models and Formal Verification

Norbert Tihanyi, Ridhi Jain, Yiannis Charalambous, Mohamed Amine Ferrag, Youcheng Sun, Lucas C. Cordeiro

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2406.17992 2024-06-27 cs.CL cs.AI 90%

Catching Chameleons: Detecting Evolving Disinformation Generated using Large Language Models

Bohan Jiang, Chengshuai Zhao, Zhen Tan, Huan Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 10 pages, 5 figures

2406.16963 2024-06-26 cs.LG cs.AI cs.CR cs.SI 90%

Large Language Models for Link Stealing Attacks Against Graph Neural Networks

Faqian Guan, Tianqing Zhu, Hui Sun, Wanlei Zhou, Philip S. Yu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

1. 效率与部署 22210 篇

ChatSUMO: Large Language Model for Automating Traffic Scenario Generation in Simulation of Urban MObility

On Leveraging Large Language Models for Enhancing Entity Resolution: A Cost-efficient Approach

Extreme Compression of Large Language Models via Additive Quantization

vTrain: A Simulation Framework for Evaluating Cost-effective and Compute-optimal Large Language Model Training

Achieving Peak Performance for Large Language Models: A Systematic Review

AnyMatch -- Efficient Zero-Shot Entity Matching with a Small Language Model

Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period of Large Language Models

Flextron: Many-in-One Flexible Large Language Model

First Activations Matter: Training-Free Methods for Dynamic Activation in Large Language Models

Adaptive Draft-Verification for Efficient Large Language Model Decoding

UNLEARN Efficient Removal of Knowledge in Large Language Models

Multistage Collaborative Knowledge Distillation from a Large Language Model for Semi-Supervised Sequence Generation

The Impact of Hyperparameters on Large Language Model Inference Performance: An Evaluation of vLLM and HuggingFace Pipelines

A federated large language model for long-term time series forecasting

Inference acceleration for large language models using "stairs" assisted greedy generation

Effective Large Language Model Debugging with Best-first Tree Search

SDoH-GPT: Using Large Language Models to Extract Social Determinants of Health (SDoH)

Walking in Others' Shoes: How Perspective-Taking Guides Large Language Models in Reducing Toxicity and Bias

A Survey on Efficient Inference for Large Language Models

Jailbreaking Black Box Large Language Models in Twenty Queries

Did the Neurons Read your Book? Document-level Membership Inference for Large Language Models

Lossless Acceleration of Large Language Model via Adaptive N-gram Parallel Decoding

Pruning Large Language Models to Intra-module Low-rank Architecture with Transitional Activations

$\mathrm{E^{2}CFD}$: Towards Effective and Efficient Cost Function Design for Safe Reinforcement Learning via Large Language Model

MAPO: Boosting Large Language Model Performance with Model-Adaptive Prompt Optimization

Gene Set Summarization using Large Language Models

Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttention

A New Era in Software Security: Towards Self-Healing Software via Large Language Models and Formal Verification

Catching Chameleons: Detecting Evolving Disinformation Generated using Large Language Models

Large Language Models for Link Stealing Attacks Against Graph Neural Networks