语言大模型 / LLM - arXivDaily 专题

2312.00678 2024-04-22 cs.CL 89%

The Efficiency Spectrum of Large Language Models: An Algorithmic Survey

Tianyu Ding, Tianyi Chen, Haidong Zhu, Jiachen Jiang, Yiqi Zhong, Jinxin Zhou, Guangzhi Wang, Zhihui Zhu, Ilya Zharkov, Luming Liang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2404.11122 2024-04-18 cs.AI 89%

Small Language Models are Good Too: An Empirical Study of Zero-Shot Classification

Pierre Lepagnol, Thomas Gerald, Sahar Ghannay, Christophe Servan, Sophie Rosset

专题命中效率与部署：language model(title,abstract)；small language model(title,abstract)；prompting(abstract)；分类 cs.AI

Journal ref LREC-COLING 2024, May 2024, TURIN, Italy

2404.04900 2024-04-09 cs.CL 89%

Radial Networks: Dynamic Layer Routing for High-Performance Large Language Models

Jordan Dotzel, Yash Akhauri, Ahmed S. AbouElhamayed, Carly Jiang, Mohamed Abdelfattah, Zhiru Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.CL

Comments First two authors have equal contribution

2404.04722 2024-04-09 cs.CL cs.CR cs.SE 89%

PoLLMgraph: Unraveling Hallucinations in Large Language Models via State Transition Dynamics

Derui Zhu, Dingfan Chen, Qing Li, Zongxiong Chen, Lei Ma, Jens Grossklags, Mario Fritz

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 15 pages

2311.09533 2024-04-04 cs.CL 89%

Effective Large Language Model Adaptation for Improved Grounding and Citation Generation

Xi Ye, Ruoxi Sun, Sercan Ö. Arik, Tomas Pfister

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments NAACL 2024

2310.12558 2024-04-03 cs.CL cs.HC 89%

Large Language Models Help Humans Verify Truthfulness -- Except When They Are Convincingly Wrong

Chenglei Si, Navita Goyal, Sherry Tongshuang Wu, Chen Zhao, Shi Feng, Hal Daumé, Jordan Boyd-Graber

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments NAACL 2024

2403.09522 2024-04-02 cs.CL 89%

MT-PATCHER: Selective and Extendable Knowledge Distillation from Large Language Models for Machine Translation

Jiahuan Li, Shanbo Cheng, Shujian Huang, Jiajun Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to NAACL-2024 main conference

2403.18152 2024-03-28 cs.CL 89%

Large Language Models as Financial Data Annotators: A Study on Effectiveness and Efficiency

Toyin Aguda, Suchetha Siddagangappa, Elena Kochkina, Simerjot Kaur, Dongsheng Wang, Charese Smiley, Sameena Shah

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to LREC-COLING 2024

2403.06199 2024-03-26 cs.CV cs.CL 89%

Mipha: A Comprehensive Overhaul of Multimodal Assistant with Small Language Models

Minjie Zhu, Yichen Zhu, Xin Liu, Ning Liu, Zhiyuan Xu, Chaomin Shen, Yaxin Peng, Zhicai Ou, Feifei Feng, Jian Tang

专题命中效率与部署：language model(title,abstract)；small language model(title,abstract)；large language model(abstract)；分类 cs.CL

2402.09282 2024-03-26 cs.CL 89%

Leveraging Large Language Models for Enhanced NLP Task Performance through Knowledge Distillation and Optimized Training Strategies

Yining Huang, Keke Tang, Meilian Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 16 pages, 3 figures

2403.06664 2024-03-12 cs.AR cs.LG 89%

Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System

Hongsun Jang, Jaeyong Song, Jaewon Jung, Jaeyoung Park, Youngsok Kim, Jinho Lee

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments Published at HPCA 2024 (Best Paper Award Honorable Mention)

2403.00277 2024-03-04 cs.CL 89%

Gender Bias in Large Language Models across Multiple Languages

Jinman Zhao, Yitian Ding, Chen Jia, Yining Wang, Zifan Qian

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 20 pages, 27 tables, 7 figures, submitted to ACL2024

2402.18169 2024-03-01 cs.CL 89%

MIKO: Multimodal Intention Knowledge Distillation from Large Language Models for Social-Media Commonsense Discovery

Feihong Lu, Weiqi Wang, Yangyifei Luo, Ziqin Zhu, Qingyun Sun, Baixuan Xu, Haochen Shi, Shiqi Gao, Qian Li, Yangqiu Song, Jianxin Li

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 11 pages, 5 figures

2402.15627 2024-02-27 cs.LG cs.DC 89%

MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs

Ziheng Jiang, Haibin Lin, Yinmin Zhong, Qi Huang, Yangrui Chen, Zhi Zhang, Yanghua Peng, Xiang Li, Cong Xie, Shibiao Nong, Yulu Jia, Sun He, Hongmin Chen, Zhihao Bai, Qi Hou, Shipeng Yan, Ding Zhou, Yiyao Sheng, Zhuo Jiang, Haohan Xu, Haoran Wei, Zhang Zhang, Pengfei Nie, Leqi Zou, Sida Zhao, Liang Xiang, Zherui Liu, Zhe Li, Xiaoying Jia, Jianxi Ye, Xin Jin, Xin Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2402.13667 2024-02-22 cs.CL 89%

GCOF: Self-iterative Text Generation for Copywriting Using Large Language Model

Jianghui Zhou, Ya Gao, Jie Liu, Xuemin Zhao, Zhaohua Yang, Yue Wu, Lirong Shi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 8 pages, 5 figures, 1 table

2401.07764 2024-02-20 cs.AI cs.NI 89%

When Large Language Model Agents Meet 6G Networks: Perception, Grounding, and Alignment

Minrui Xu, Dusit Niyato, Jiawen Kang, Zehui Xiong, Shiwen Mao, Zhu Han, Dong In Kim, Khaled B. Letaief

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2402.01994 2024-02-06 cs.HC cs.AI cs.CR 89%

Human-Centered Privacy Research in the Age of Large Language Models

Tianshi Li, Sauvik Das, Hao-Ping Lee, Dakuo Wang, Bingsheng Yao, Zhiping Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments 4 pages, CHI EA'24

2401.16212 2024-01-30 cs.CY cs.CL 89%

Better Call GPT, Comparing Large Language Models Against Lawyers

Lauren Martin, Nick Whitehouse, Stephanie Yiu, Lizzie Catterson, Rivindu Perera

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 16 pages

2306.02272 2024-01-25 cs.CL 89%

OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Models

Changhun Lee, Jungyu Jin, Taesu Kim, Hyungjun Kim, Eunhyeok Park

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted at AAAI 2024 (oral presentation)

2308.03279 2024-01-22 cs.CL 89%

UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition

Wenxuan Zhou, Sheng Zhang, Yu Gu, Muhao Chen, Hoifung Poon

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

Comments Accepted at ICLR 2024. Project page: https://universal-ner.github.io/

2307.14995 2024-01-22 cs.CL 89%

TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormer

Zhen Qin, Dong Li, Weigao Sun, Weixuan Sun, Xuyang Shen, Xiaodong Han, Yunshen Wei, Baohong Lv, Xiao Luo, Yu Qiao, Yiran Zhong

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Technical Report. Yiran Zhong is the corresponding author. Zhen Qin, Dong Li, Weigao Sun, Weixuan Sun, Xuyang Shen contribute equally to this paper. Code is released at: https://github.com/OpenNLPLab/TransnormerLLM

2401.03868 2024-01-10 cs.AR cs.AI 89%

FlightLLM: Efficient Large Language Model Inference with a Complete Mapping Flow on FPGAs

Shulin Zeng, Jun Liu, Guohao Dai, Xinhao Yang, Tianyu Fu, Hongyi Wang, Wenheng Ma, Hanbo Sun, Shiyao Li, Zixiao Huang, Yadong Dai, Jintao Li, Zehao Wang, Ruoyu Zhang, Kairui Wen, Xuefei Ning, Yu Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Accepted to FPGA'24

2312.15661 2024-01-04 cs.IR cs.AI 89%

Unlocking the Potential of Large Language Models for Explainable Recommendations

Yucong Luo, Mingyue Cheng, Hao Zhang, Junyu Lu, Qi Liu, Enhong Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2312.08361 2023-12-14 cs.LG cs.DC 89%

Distributed Inference and Fine-tuning of Large Language Models Over The Internet

Alexander Borzunov, Max Ryabinin, Artem Chumachenko, Dmitry Baranchuk, Tim Dettmers, Younes Belkada, Pavel Samygin, Colin Raffel

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments Accepted to Conference on Neural Information Processing Systems (NeurIPS) 2023. 20 pages, 3 figures

2312.05662 2023-12-13 cs.CL 89%

Understanding the Effect of Model Compression on Social Bias in Large Language Models

Gustavo Gonçalves, Emma Strubell

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments EMNLP 2023 Main

2312.06099 2023-12-12 cs.CL 89%

Generative Large Language Models Are All-purpose Text Analytics Engines: Text-to-text Learning Is All Your Need

Cheng Peng, Xi Yang, Aokun Chen, Zehao Yu, Kaleb E Smith, Anthony B Costa, Mona G Flores, Jiang Bian, Yonghui Wu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2312.03134 2023-12-07 cs.AR cs.DC cs.LG 89%

A Hardware Evaluation Framework for Large Language Model Inference

Hengrui Zhang, August Ning, Rohan Prabhakar, David Wentzlaff

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2312.02443 2023-12-06 cs.IR cs.AI 89%

E4SRec: An Elegant Effective Efficient Extensible Solution of Large Language Models for Sequential Recommendation

Xinhang Li, Chong Chen, Xiangyu Zhao, Yong Zhang, Chunxiao Xing

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2312.00388 2023-12-04 cs.LG cs.DC cs.NI 89%

LinguaLinked: A Distributed Large Language Model Inference System for Mobile Devices

Junchen Zhao, Yurun Song, Simeng Liu, Ian G. Harris, Sangeetha Abdu Jyothi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments 16 pages, 8 figures

2311.08213 2023-11-15 cs.CV cs.CL 89%

Unlock the Power: Competitive Distillation for Multi-Modal Large Language Models

Xinwei Li, Li Lin, Shuai Wang, Chen Qian

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

1. 效率与部署 22243 篇

The Efficiency Spectrum of Large Language Models: An Algorithmic Survey

Small Language Models are Good Too: An Empirical Study of Zero-Shot Classification

Radial Networks: Dynamic Layer Routing for High-Performance Large Language Models

PoLLMgraph: Unraveling Hallucinations in Large Language Models via State Transition Dynamics

Effective Large Language Model Adaptation for Improved Grounding and Citation Generation

Large Language Models Help Humans Verify Truthfulness -- Except When They Are Convincingly Wrong

MT-PATCHER: Selective and Extendable Knowledge Distillation from Large Language Models for Machine Translation

Large Language Models as Financial Data Annotators: A Study on Effectiveness and Efficiency

Mipha: A Comprehensive Overhaul of Multimodal Assistant with Small Language Models

Leveraging Large Language Models for Enhanced NLP Task Performance through Knowledge Distillation and Optimized Training Strategies

Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System

Gender Bias in Large Language Models across Multiple Languages

MIKO: Multimodal Intention Knowledge Distillation from Large Language Models for Social-Media Commonsense Discovery

MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs

GCOF: Self-iterative Text Generation for Copywriting Using Large Language Model

When Large Language Model Agents Meet 6G Networks: Perception, Grounding, and Alignment

Human-Centered Privacy Research in the Age of Large Language Models

Better Call GPT, Comparing Large Language Models Against Lawyers

OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Models

UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition

TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormer

FlightLLM: Efficient Large Language Model Inference with a Complete Mapping Flow on FPGAs

Unlocking the Potential of Large Language Models for Explainable Recommendations

Distributed Inference and Fine-tuning of Large Language Models Over The Internet

Understanding the Effect of Model Compression on Social Bias in Large Language Models

Generative Large Language Models Are All-purpose Text Analytics Engines: Text-to-text Learning Is All Your Need

A Hardware Evaluation Framework for Large Language Model Inference

E4SRec: An Elegant Effective Efficient Extensible Solution of Large Language Models for Sequential Recommendation

LinguaLinked: A Distributed Large Language Model Inference System for Mobile Devices

Unlock the Power: Competitive Distillation for Multi-Modal Large Language Models