语言大模型 / LLM - arXivDaily 专题

2402.01706 2024-02-06 cs.CL cs.LG 90%

MULTIVERSE: Exposing Large Language Model Alignment Problems in Diverse Worlds

Xiaolong Jin, Zhuo Zhang, Xiangyu Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2401.16960 2024-01-31 cs.CL cs.AI 90%

Two Heads Are Better Than One: Integrating Knowledge from Knowledge Graphs and Large Language Models for Entity Alignment

Linyao Yang, Hongyang Chen, Xiao Wang, Jing Yang, Fei-Yue Wang, Han Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2311.17227 2024-01-31 cs.AI cs.CL cs.CY 90%

War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Wars

Wenyue Hua, Lizhou Fan, Lingyao Li, Kai Mei, Jianchao Ji, Yingqiang Ge, Libby Hemphill, Yongfeng Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 47 pages, 9 figures, 5 tables

2401.15123 2024-01-30 cs.LG cs.AI 90%

Large Language Model Guided Knowledge Distillation for Time Series Anomaly Detection

Chen Liu, Shibo He, Qihang Zhou, Shizhong Li, Wenchao Meng

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments 12 pages, 5 figures

2311.01282 2024-01-08 cs.LG cs.CL 90%

FlashDecoding++: Faster Large Language Model Inference on GPUs

Ke Hong, Guohao Dai, Jiaming Xu, Qiuli Mao, Xiuhong Li, Jun Liu, Kangdi Chen, Yuhan Dong, Yu Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2312.11983 2023-12-20 cs.CL cs.AI 90%

Fluctuation-based Adaptive Structured Pruning for Large Language Models

Yongqi An, Xu Zhao, Tao Yu, Ming Tang, Jinqiao Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted to AAAI 2024

2312.03788 2023-12-08 cs.LG cs.CL 90%

SmoothQuant+: Accurate and Efficient 4-bit Post-Training WeightQuantization for LLM

Jiayi Pan, Chengcan Wang, Kaifu Zheng, Yangguang Li, Zhenyu Wang, Bin Feng

专题命中效率与部署：post-training(title,abstract)；LLM(title)；large language model(abstract)；language model(abstract)

2312.00843 2023-12-05 cs.LG cs.AI cs.CR 90%

Exploring the Robustness of Decentralized Training for Large Language Models

Lin Lu, Chenxi Dai, Wangcheng Tao, Binhang Yuan, Yanan Sun, Pan Zhou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；foundation model(abstract)；分类 cs.AI、cs.LG

Comments 6 pages, 3 figures

2311.03687 2023-12-04 cs.PF cs.CL cs.LG 90%

Dissecting the Runtime Performance of the Training, Fine-tuning, and Inference of Large Language Models

Longteng Zhang, Xiang Liu, Zeyu Li, Xinglin Pan, Peijie Dong, Ruibo Fan, Rui Guo, Xin Wang, Qiong Luo, Shaohuai Shi, Xiaowen Chu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2311.15566 2023-11-28 cs.DC cs.CL cs.LG 90%

SpotServe: Serving Generative Large Language Models on Preemptible Instances

Xupeng Miao, Chunan Shi, Jiangfei Duan, Xiaoli Xi, Dahua Lin, Bin Cui, Zhihao Jia

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments ASPLOS 2024

2311.08692 2023-11-16 cs.CL cs.LG 90%

Routing to the Expert: Efficient Reward-guided Ensemble of Large Language Models

Keming Lu, Hongyi Yuan, Runji Lin, Junyang Lin, Zheng Yuan, Chang Zhou, Jingren Zhou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2311.01786 2023-11-06 cs.CL cs.AI 90%

TCM-GPT: Efficient Pre-training of Large Language Models for Domain Adaptation in Traditional Chinese Medicine

Guoxing Yang, Jianyu Shi, Zan Wang, Xiaohong Liu, Guangyu Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2305.14152 2023-10-31 cs.LG cs.AI 90%

Memory-Efficient Fine-Tuning of Compressed Large Language Models via sub-4-bit Integer Quantization

Jeonghoon Kim, Jung Hyun Lee, Sungdong Kim, Joonsuk Park, Kang Min Yoo, Se Jung Kwon, Dongsoo Lee

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments Published at NeurIPS 2023. Camera-ready version

2310.13012 2023-10-24 cs.CL cs.AI 90%

H2O Open Ecosystem for State-of-the-art Large Language Models

Arno Candel, Jon McKinney, Philipp Singer, Pascal Pfeiffer, Maximilian Jeblick, Chun Ming Lee, Marcos V. Conde

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments EMNLP 2023 Demo - ACL Empirical Methods in Natural Language Processing

2310.04564 2023-10-10 cs.LG cs.AI 90%

ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models

Iman Mirzadeh, Keivan Alizadeh, Sachin Mehta, Carlo C Del Mundo, Oncel Tuzel, Golnoosh Samei, Mohammad Rastegari, Mehrdad Farajtabar

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments preprint

2309.11042 2023-09-21 cs.CL cs.AI 90%

Making Small Language Models Better Multi-task Learners with Mixture-of-Task-Adapters

Yukang Xie, Chengyu Wang, Junbing Yan, Jiyong Zhou, Feiqi Deng, Jun Huang

专题命中效率与部署：language model(title,abstract)；small language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI

2309.00964 2023-09-15 cs.LG cs.AI 90%

eDKM: An Efficient and Accurate Train-time Weight Clustering for Large Language Models

Minsik Cho, Keivan A. Vahid, Qichen Fu, Saurabh Adya, Carlo C Del Mundo, Mohammad Rastegari, Devang Naik, Peter Zatloukal

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments preprint

2309.04646 2023-09-12 cs.CL cs.AI 90%

Efficient Finetuning Large Language Models For Vietnamese Chatbot

Vu-Thuan Doan, Quoc-Truong Truong, Duc-Vu Nguyen, Vinh-Tiep Nguyen, Thuy-Ngan Nguyen Luu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI

Comments arXiv admin note: text overlap with arXiv:2304.08177, arXiv:2303.16199 by other authors

2308.13067 2023-08-28 cs.AI cs.CL 90%

Causal Parrots: Large Language Models May Talk Causality But Are Not Causal

Matej Zečević, Moritz Willig, Devendra Singh Dhami, Kristian Kersting

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Published in Transactions in Machine Learning Research (TMLR) (08/2023). Main paper: 17 pages, References: 3 pages, Appendix: 7 pages. Figures: 5 main, 3 appendix. Tables: 3 main

Journal ref Transactions in Machine Learning Research (08/2023)

2307.08072 2023-07-27 cs.CL cs.AI 90%

Do Emergent Abilities Exist in Quantized Large Language Models: An Empirical Study

Peiyu Liu, Zikang Liu, Ze-Feng Gao, Dawei Gao, Wayne Xin Zhao, Yaliang Li, Bolin Ding, Ji-Rong Wen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；small language model(abstract)；分类 cs.CL、cs.AI

Comments 15 pages, 4 figures

2307.07171 2023-07-17 cs.CL cs.LG 90%

Certified Robustness for Large Language Models with Self-Denoising

Zhen Zhang, Guanhua Zhang, Bairu Hou, Wenqi Fan, Qing Li, Sijia Liu, Yang Zhang, Shiyu Chang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2306.07402 2023-06-14 cs.CL cs.AI 90%

The economic trade-offs of large language models: A case study

Kristen Howell, Gwen Christian, Pavel Fomitchov, Gitit Kehat, Julianne Marzulla, Leanne Rolston, Jadin Tredup, Ilana Zimmerman, Ethan Selfridge, Joseph Bradley

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Paper to be published at the Association for Computational Linguistics in the Industry Track 2023

2303.06865 2023-06-13 cs.LG cs.AI cs.PF 90%

FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU

Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Daniel Y. Fu, Zhiqiang Xie, Beidi Chen, Clark Barrett, Joseph E. Gonzalez, Percy Liang, Christopher Ré, Ion Stoica, Ce Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2306.02295 2023-06-06 cs.CL cs.LG 90%

A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Models

Ritwik Sinha, Zhao Song, Tianyi Zhou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2305.15594 2023-05-26 cs.LG cs.CL cs.CR 90%

Flocks of Stochastic Parrots: Differentially Private Prompt Learning for Large Language Models

Haonan Duan, Adam Dziedzic, Nicolas Papernot, Franziska Boenisch

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.LG

2305.12356 2023-05-23 cs.LG cs.AI 90%

Integer or Floating Point? New Outlooks for Low-Bit Quantization on Large Language Models

Yijia Zhang, Lingran Zhao, Shijie Cao, Wenqiang Wang, Ting Cao, Fan Yang, Mao Yang, Shanghang Zhang, Ningyi Xu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.AI、cs.LG

2305.05027 2023-05-11 cs.LG cs.CL cs.IR 90%

Web Content Filtering through knowledge distillation of Large Language Models

Tamás Vörös, Sean Paul Bergeron, Konstantin Berlin

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2304.04487 2023-04-11 cs.CL cs.AI 90%

Inference with Reference: Lossless Acceleration of Large Language Models

Nan Yang, Tao Ge, Liang Wang, Binxing Jiao, Daxin Jiang, Linjun Yang, Rangan Majumder, Furu Wei

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 9 pages

2304.00612 2023-04-04 cs.CL cs.AI 90%

Eight Things to Know about Large Language Models

Samuel R. Bowman

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2302.08917 2023-02-20 cs.CL cs.LG 90%

Massively Multilingual Shallow Fusion with Large Language Models

Ke Hu, Tara N. Sainath, Bo Li, Nan Du, Yanping Huang, Andrew M. Dai, Yu Zhang, Rodrigo Cabrera, Zhifeng Chen, Trevor Strohman

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments Accepted to IEEE ICASSP 2023

1. 效率与部署 22210 篇

MULTIVERSE: Exposing Large Language Model Alignment Problems in Diverse Worlds

Two Heads Are Better Than One: Integrating Knowledge from Knowledge Graphs and Large Language Models for Entity Alignment

War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Wars

Large Language Model Guided Knowledge Distillation for Time Series Anomaly Detection

FlashDecoding++: Faster Large Language Model Inference on GPUs

Fluctuation-based Adaptive Structured Pruning for Large Language Models

SmoothQuant+: Accurate and Efficient 4-bit Post-Training WeightQuantization for LLM

Exploring the Robustness of Decentralized Training for Large Language Models

Dissecting the Runtime Performance of the Training, Fine-tuning, and Inference of Large Language Models

SpotServe: Serving Generative Large Language Models on Preemptible Instances

Routing to the Expert: Efficient Reward-guided Ensemble of Large Language Models

TCM-GPT: Efficient Pre-training of Large Language Models for Domain Adaptation in Traditional Chinese Medicine

Memory-Efficient Fine-Tuning of Compressed Large Language Models via sub-4-bit Integer Quantization

H2O Open Ecosystem for State-of-the-art Large Language Models

ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models

Making Small Language Models Better Multi-task Learners with Mixture-of-Task-Adapters

eDKM: An Efficient and Accurate Train-time Weight Clustering for Large Language Models

Efficient Finetuning Large Language Models For Vietnamese Chatbot

Causal Parrots: Large Language Models May Talk Causality But Are Not Causal

Do Emergent Abilities Exist in Quantized Large Language Models: An Empirical Study

Certified Robustness for Large Language Models with Self-Denoising

The economic trade-offs of large language models: A case study

FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU

A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Models

Flocks of Stochastic Parrots: Differentially Private Prompt Learning for Large Language Models

Integer or Floating Point? New Outlooks for Low-Bit Quantization on Large Language Models

Web Content Filtering through knowledge distillation of Large Language Models

Inference with Reference: Lossless Acceleration of Large Language Models

Eight Things to Know about Large Language Models

Massively Multilingual Shallow Fusion with Large Language Models