语言大模型 / LLM - arXivDaily 专题

2412.11629 2024-12-17 cs.LG 88%

QPruner: Probabilistic Decision Quantization for Structured Pruning in Large Language Models

Changhai Zhou, Yuhua Zhou, Shijie Han, Qian Qiao, Hongguang Li

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

2412.11494 2024-12-17 cs.CL 88%

FTP: A Fine-grained Token-wise Pruner for Large Language Models via Token Routing

Zekai Li, Jintu Zheng, Ji Liu, Han Liu, Haowei Zhu, Zeping Li, Fuwei Yang, Haiduo Huang, Jinzhang Peng, Dong Li, Lu Tian, Emad Barsoum

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2403.15268 2024-12-17 cs.CL 88%

Awakening Augmented Generation: Learning to Awaken Internal Knowledge of Large Language Models for Question Answering

Huanxuan Liao, Shizhu He, Yao Xu, Yuanzhe Zhang, Kang Liu, Shengping Liu, Jun Zhao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted to COLING 2025

2311.08883 2024-12-17 cs.CL 88%

Distilling Rule-based Knowledge into Large Language Models

Wenkai Yang, Yankai Lin, Jie Zhou, Ji-Rong Wen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted at COLING 2025, camera-ready version. Code and data are available at https://github.com/RUCBM/rule-distillation

2409.19454 2024-12-16 cs.HC cs.AI cs.CV 88%

See Where You Read with Eye Gaze Tracking and Large Language Model

Sikai Yang, Gang Yan, Wan Du

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 9 pages

2412.04964 2024-12-12 cs.AI 88%

Flash Communication: Reducing Tensor Parallelization Bottleneck for Fast Large Language Model Inference

Qingyuan Li, Bo Zhang, Liang Ye, Yifan Zhang, Wei Wu, Yerui Sun, Lin Ma, Yuchen Xie

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2409.18222 2024-12-09 cs.AI 88%

Trustworthy AI: Securing Sensitive Data in Large Language Models

Georgios Feretzakis, Vassilios S. Verykios

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 40 pages, 1 figure

Journal ref AI 5(4), 2773-2800 (2024)

2410.19456 2024-12-03 cs.LG 88%

Computational Bottlenecks of Training Small-scale Large Language Models

Saleh Ashkboos, Iman Mirzadeh, Keivan Alizadeh, Mohammad Hossein Sekhavat, Moin Nabi, Mehrdad Farajtabar, Fartash Faghri

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments 8 pages, 4 figures

2404.02837 2024-12-02 cs.CL 88%

Cherry on Top: Parameter Heterogeneity and Quantization in Large Language Models

Wanyun Cui, Qianle Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2402.10527 2024-12-02 cs.CL cs.CR stat.AP 88%

Assessing biomedical knowledge robustness in large language models by query-efficient sampling attacks

R. Patrick Xian, Alex J. Lee, Satvik Lolla, Vincent Wang, Qiming Cui, Russell Ro, Reza Abbasi-Asl

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 31 pages incl. appendix, accepted by TMLR

2311.03191 2024-12-02 cs.LG cs.CR 88%

DeepInception: Hypnotize Large Language Model to Be Jailbreaker

Xuan Li, Zhanke Zhou, Jianing Zhu, Jiangchao Yao, Tongliang Liu, Bo Han

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

2406.13659 2024-11-27 cs.AI 88%

Leveraging Large Language Models for Patient Engagement: The Power of Conversational AI in Digital Health

Bo Wen, Raquel Norel, Julia Liu, Thaddeus Stappenbeck, Farhana Zulkernine, Huamin Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 10 pages, 6 figures, ICDH 2024 invited paper

2404.02827 2024-11-18 cs.LG 88%

BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models

Qijun Luo, Hengxu Yu, Xiao Li

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments Accepted for Publication in Conference on Neural Information Processing Systems, 2024

2402.09579 2024-11-18 cs.HC cs.AI 88%

Advancing Building Energy Modeling with Large Language Models: Exploration and Case Studies

Liang Zhang, Zhelun Chen, Vitaly Ford

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2411.08728 2024-11-14 cs.AI 88%

Polymetis:Large Language Modeling for Multiple Material Domains

Chao Huang, Huichen Xiao, Chen Chen, Chunyan Chen, Yi Zhao, Shiyu Du, Yiming Zhang, He Sha, Ruixin Gu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2405.15586 2024-11-14 cs.LG cs.DC 88%

DAGER: Exact Gradient Inversion for Large Language Models

Ivo Petrov, Dimitar I. Dimitrov, Maximilian Baader, Mark Niklas Müller, Martin Vechev

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

2402.10705 2024-11-14 cs.AI 88%

AutoSAT: Automatically Optimize SAT Solvers via Large Language Models

Yiwen Sun, Furong Ye, Xianyin Zhang, Shiyu Huang, Bingzhen Zhang, Ke Wei, Shaowei Cai

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2411.05966 2024-11-12 q-bio.BM cs.LG 88%

Energy Efficient Protein Language Models: Leveraging Small Language Models with LoRA for Controllable Protein Generation

Aayush Shah, Shankar Jayaratnam

专题命中效率与部署：language model(title,abstract)；small language model(title)；large language model(abstract)；分类 cs.LG

2401.07013 2024-11-12 cs.CL 88%

Knowledge Distillation of Black-Box Large Language Models

Hongzhan Chen, Ruijun Chen, Yuqi Yi, Xiaojun Quan, Chenliang Li, Ming Yan, Ji Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2410.17235 2024-11-08 eess.IV cs.CL cs.CV 88%

Automated Spinal MRI Labelling from Reports Using a Large Language Model

Robin Y. Park, Rhydian Windsor, Amir Jamaludin, Andrew Zisserman

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted to Medical Image Computing and Computer Assisted Intervention (MICCAI 2024, Spotlight). 11 pages plus appendix

Journal ref vol 15005, 2024, pp 101-111

2405.04304 2024-11-08 cs.CL 88%

Dynamic Speculation Lookahead Accelerates Speculative Decoding of Large Language Models

Jonathan Mamou, Oren Pereg, Daniel Korat, Moshe Berchansky, Nadav Timor, Moshe Wasserblat, Roy Schwartz

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2411.00414 2024-11-04 cs.CY cs.AI 88%

On the Opportunities of Large Language Models for Programming Process Data

John Edwards, Arto Hellas, Juho Leinonen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 14 pages

2411.00406 2024-11-04 cs.LG 88%

MoD: A Distribution-Based Approach for Merging Large Language Models

Quy-Anh Dang, Chris Ngo

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

2406.12311 2024-10-31 cs.LG 88%

Mixture of Scales: Memory-Efficient Token-Adaptive Binarization for Large Language Models

Dongwon Jo, Taesu Kim, Yulhwa Kim, Jae-Joon Kim

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments 38th Conference on Neural Information Processing Systems (NeurIPS 2024)

2410.20011 2024-10-29 cs.CL 88%

A Survey of Small Language Models

Chien Van Nguyen, Xuan Shen, Ryan Aponte, Yu Xia, Samyadeep Basu, Zhengmian Hu, Jian Chen, Mihir Parmar, Sasidhar Kunapuli, Joe Barrow, Junda Wu, Ashish Singh, Yu Wang, Jiuxiang Gu, Franck Dernoncourt, Nesreen K. Ahmed, Nedim Lipka, Ruiyi Zhang, Xiang Chen, Tong Yu, Sungchul Kim, Hanieh Deilamsalehy, Namyong Park, Mike Rimer, Zhehao Zhang, Huanrui Yang, Ryan A. Rossi, Thien Huu Nguyen

专题命中效率与部署：language model(title,abstract)；small language model(title,abstract)；分类 cs.CL

2410.19812 2024-10-29 cs.CY cs.CL 88%

Ethics Whitepaper: Whitepaper on Ethical Research into Large Language Models

Eddie L. Ungless, Nikolas Vitsakis, Zeerak Talat, James Garforth, Björn Ross, Arno Onken, Atoosa Kasirzadeh, Alexandra Birch

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 47 pages

2309.14763 2024-10-28 cs.CL 88%

ConPET: Continual Parameter-Efficient Tuning for Large Language Models

Chenyang Song, Xu Han, Zheni Zeng, Kuai Li, Chen Chen, Zhiyuan Liu, Maosong Sun, Tao Yang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 12 pages, 3 figures. This work has been submitted to the IEEE for possible publication

2402.11819 2024-10-25 cs.CL 88%

Head-wise Shareable Attention for Large Language Models

Zouying Cao, Yifei Yang, Hai Zhao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 17 pages, 7 figures, 21 tables, EMNLP'24 Findings

2408.12025 2024-10-24 cs.AI 88%

Exploring Large Language Models for Feature Selection: A Data-centric Perspective

Dawei Li, Zhen Tan, Huan Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments Accepted by SIGKDD Explorations (December 2024)

2410.15657 2024-10-22 cs.CV cs.CL 88%

CL-HOI: Cross-Level Human-Object Interaction Distillation from Vision Large Language Models

Jianjun Gao, Chen Cai, Ruoyu Wang, Wenyang Liu, Kim-Hui Yap, Kratika Garg, Boon-Siew Han

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

1. 效率与部署 22280 篇

QPruner: Probabilistic Decision Quantization for Structured Pruning in Large Language Models

FTP: A Fine-grained Token-wise Pruner for Large Language Models via Token Routing

Awakening Augmented Generation: Learning to Awaken Internal Knowledge of Large Language Models for Question Answering

Distilling Rule-based Knowledge into Large Language Models

See Where You Read with Eye Gaze Tracking and Large Language Model

Flash Communication: Reducing Tensor Parallelization Bottleneck for Fast Large Language Model Inference

Trustworthy AI: Securing Sensitive Data in Large Language Models

Computational Bottlenecks of Training Small-scale Large Language Models

Cherry on Top: Parameter Heterogeneity and Quantization in Large Language Models

Assessing biomedical knowledge robustness in large language models by query-efficient sampling attacks

DeepInception: Hypnotize Large Language Model to Be Jailbreaker

Leveraging Large Language Models for Patient Engagement: The Power of Conversational AI in Digital Health

BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models

Advancing Building Energy Modeling with Large Language Models: Exploration and Case Studies

Polymetis:Large Language Modeling for Multiple Material Domains

DAGER: Exact Gradient Inversion for Large Language Models

AutoSAT: Automatically Optimize SAT Solvers via Large Language Models

Energy Efficient Protein Language Models: Leveraging Small Language Models with LoRA for Controllable Protein Generation

Knowledge Distillation of Black-Box Large Language Models

Automated Spinal MRI Labelling from Reports Using a Large Language Model

Dynamic Speculation Lookahead Accelerates Speculative Decoding of Large Language Models

On the Opportunities of Large Language Models for Programming Process Data

MoD: A Distribution-Based Approach for Merging Large Language Models

Mixture of Scales: Memory-Efficient Token-Adaptive Binarization for Large Language Models

A Survey of Small Language Models

Ethics Whitepaper: Whitepaper on Ethical Research into Large Language Models

ConPET: Continual Parameter-Efficient Tuning for Large Language Models

Head-wise Shareable Attention for Large Language Models

Exploring Large Language Models for Feature Selection: A Data-centric Perspective

CL-HOI: Cross-Level Human-Object Interaction Distillation from Vision Large Language Models