语言大模型 / LLM - arXivDaily 专题

2405.01943 2024-10-22 cs.CL cs.AI cs.LG 89%

Dependency-Aware Semi-Structured Sparsity of GLU Variants in Large Language Models

Zhiyu Guo, Hidetaka Kamigaito, Taro Wanatnabe

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2410.00131 2024-10-21 cs.LG cs.AI cs.CL cs.DC 89%

Fisher Information-based Efficient Curriculum Federated Learning with Large Language Models

Ji Liu, Jiaxiang Ren, Ruoming Jin, Zijie Zhang, Yang Zhou, Patrick Valduriez, Dejing Dou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 27 pages, 8 figures, 14 tables, to appear in EMNLP 2024

2410.12870 2024-10-18 cs.CL cs.AI cs.DB cs.ET cs.LG 89%

Skill Learning Using Process Mining for Large Language Model Plan Generation

Andrei Cosmin Redis, Mohammadreza Fani Sani, Bahram Zarrin, Andrea Burattin

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 12 pages, 5 figures, 2 tables, accepted at ICPM 2024'

2410.02223 2024-10-18 cs.CL cs.AI cs.LG 89%

EmbedLLM: Learning Compact Representations of Large Language Models

Richard Zhuang, Tianhao Wu, Zhaojin Wen, Andrew Li, Jiantao Jiao, Kannan Ramchandran

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2407.02211 2024-10-17 cs.CL cs.AI cs.LG 89%

PromptIntern: Saving Inference Costs by Internalizing Recurrent Prompt during Large Language Model Fine-tuning

Jiaru Zou, Mengyu Zhou, Tao Li, Shi Han, Dongmei Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments This paper has been accepted by EMNLP 2024

2410.09680 2024-10-15 eess.SY cs.SY 89%

Integrating Reinforcement Learning and Large Language Models for Crop Production Process Management Optimization and Control through A New Knowledge-Based Deep Learning Paradigm

Dong Chen, Yanbo Huang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 13 pages

2410.09241 2024-10-15 cs.SE 89%

Large Language Models for Energy-Efficient Code: Emerging Results and Future Directions

Huiyun Peng, Arjun Gupte, Nicholas John Eliopoulos, Chien Chou Ho, Rishi Mantri, Leo Deng, Wenxin Jiang, Yung-Hsiang Lu, Konstantin Läufer, George K. Thiruvathukal, James C. Davis

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2404.14408 2024-10-08 cs.CL cs.AI cs.LG 89%

SpaceByte: Towards Deleting Tokenization from Large Language Modeling

Kevin Slagle

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 9+10 pages, 3+1 figures, 2+4 tables

2409.17141 2024-09-26 cs.CL cs.AI cs.LG 89%

FineZip : Pushing the Limits of Large Language Models for Practical Lossless Text Compression

Fazal Mittu, Yihuan Bu, Akshat Gupta, Ashok Devireddy, Alp Eren Ozdarendeli, Anant Singh, Gopala Anumanchipalli

专题命中效率与部署：language model(title,abstract)；large language model(title)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2406.15534 2024-09-25 cs.LG cs.AI cs.CL q-bio.QM 89%

Geneverse: A collection of Open-source Multimodal Large Language Models for Genomic and Proteomic Research

Tianyu Liu, Yijia Xiao, Xiao Luo, Hua Xu, W. Jim Zheng, Hongyu Zhao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 8 pages

Journal ref EMNLP 2024

2404.18322 2024-09-25 cs.DC 89%

BlockLLM: Multi-tenant Finer-grained Serving for Large Language Models

Bodun Hu, Jiamin Li, Le Xu, Myungjin Lee, Akshay Jajoo, Geon-Woo Kim, Hong Xu, Aditya Akella

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2407.10106 2024-09-17 cs.SE 89%

DistillSeq: A Framework for Safety Alignment Testing in Large Language Models using Knowledge Distillation

Mingke Yang, Yuqi Chen, Yi Liu, Ling Shi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2409.05055 2024-09-10 cs.SE cs.ET 89%

Investigating the Role of Cultural Values in Adopting Large Language Models for Software Engineering

Stefano Lambiase, Gemma Catolino, Fabio Palomba, Filomena Ferrucci, Daniel Russo

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2404.09932 2024-09-09 cs.LG cs.AI cs.CL cs.CY 89%

Foundational Challenges in Assuring Alignment and Safety of Large Language Models

Usman Anwar, Abulhair Saparov, Javier Rando, Daniel Paleka, Miles Turpin, Peter Hase, Ekdeep Singh Lubana, Erik Jenner, Stephen Casper, Oliver Sourbut, Benjamin L. Edelman, Zhaowei Zhang, Mario Günther, Anton Korinek, Jose Hernandez-Orallo, Lewis Hammond, Eric Bigelow, Alexander Pan, Lauro Langosco, Tomasz Korbak, Heidi Zhang, Ruiqi Zhong, Seán Ó hÉigeartaigh, Gabriel Recchia, Giulio Corsi, Alan Chan, Markus Anderljung, Lilian Edwards, Aleksandar Petrov, Christian Schroeder de Witt, Sumeet Ramesh Motwan, Yoshua Bengio, Danqi Chen, Philip H. S. Torr, Samuel Albanie, Tegan Maharaj, Jakob Foerster, Florian Tramer, He He, Atoosa Kasirzadeh, Yejin Choi, David Krueger

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2409.02836 2024-09-05 cs.CL cs.AI cs.CE cs.LG 89%

Exploring Sentiment Dynamics and Predictive Behaviors in Cryptocurrency Discussions by Few-Shot Learning with Large Language Models

Moein Shahiki Tash, Zahra Ahani, Mohim Tash, Olga Kolesnikova, Grigori Sidorov

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2409.02119 2024-09-05 cs.LG cs.AI cs.CL 89%

CoRA: Optimizing Low-Rank Adaptation with Common Subspace of Large Language Models

Xiaojun Xiao, Sen Shen, Qiming Bao, Hongfei Rong, Kairui Liu, Zhongsheng Wang, Jiamou Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2407.14962 2024-08-26 cs.CL cs.AI cs.LG 89%

Recent Advances in Generative AI and Large Language Models: Current Status, Challenges, and Perspectives

Desta Haileselassie Hagos, Rick Battle, Danda B. Rawat

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments This version is accepted for publication in the Journal of IEEE Transactions on Artificial Intelligence (TAI)

2408.11855 2024-08-23 cs.CL cs.AI cs.LG 89%

FactorLLM: Factorizing Knowledge via Mixture of Experts for Large Language Models

Zhongyu Zhao, Menghang Dong, Rongyu Zhang, Wenzhao Zheng, Yunpeng Zhang, Huanrui Yang, Dalong Du, Kurt Keutzer, Shanghang Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2408.10520 2024-08-21 cs.IR 89%

Efficient and Deployable Knowledge Infusion for Open-World Recommendations via Large Language Models

Yunjia Xi, Weiwen Liu, Jianghao Lin, Muyan Weng, Xiaoling Cai, Hong Zhu, Jieming Zhu, Bo Chen, Ruiming Tang, Yong Yu, Weinan Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)

Comments arXiv admin note: text overlap with arXiv:2306.10933

2405.00338 2024-08-21 cs.IR 89%

Distillation Matters: Empowering Sequential Recommenders to Match the Performance of Large Language Model

Yu Cui, Feng Liu, Pengbo Wang, Bohao Wang, Heng Tang, Yi Wan, Jun Wang, Jiawei Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 11 pages, 2 figures

2408.09491 2024-08-20 cs.SD eess.AS 89%

A Transcription Prompt-based Efficient Audio Large Language Model for Robust Speech Recognition

Yangze Li, Xiong Wang, Songjun Cao, Yike Zhang, Long Ma, Lei Xie

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2408.07326 2024-08-15 cs.AR 89%

LPU: A Latency-Optimized and Highly Scalable Processor for Large Language Model Inference

Seungjae Moon, Jung-Hoon Kim, Junsoo Kim, Seongmin Hong, Junseo Cha, Minsu Kim, Sukbin Lim, Gyubin Choi, Dongjin Seo, Jongho Kim, Hunjong Lee, Hyunjun Park, Ryeowook Ko, Soongyu Choi, Jongse Park, Jinwon Lee, Joo-Young Kim

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2408.02087 2024-08-06 cs.CE 89%

Constructing Mechanical Design Agent Based on Large Language Models

Jiaxing Lu, Heran Li, Fangwei Ning, Yixuan Wang, Xinze Li, Yan Shi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2408.01760 2024-08-06 cs.SE 89%

Large Language Models for Equivalent Mutant Detection: How Far Are We?

Zhao Tian, Honglin Shu, Dong Wang, Xuejie Cao, Yasutaka Kamei, Junjie Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments This paper has been accepted by ISSTA'2024

2405.06999 2024-08-05 eess.SY cs.SY 89%

Large Language Model-aided Edge Learning in Distribution System State Estimation

Renyou Xie, Xin Yin, Chaojie Li, Guo Chen, Nian Liu, Bo Zhao, Zhaoyang Dong

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2403.11057 2024-07-31 cs.CV cs.RO 89%

Large Language Models Powered Context-aware Motion Prediction in Autonomous Driving

Xiaoji Zheng, Lixiu Wu, Zhijie Yan, Yuanrong Tang, Hao Zhao, Chen Zhong, Bokui Chen, Jiangtao Gong

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 6 pages,4 figures

2404.03384 2024-07-23 cs.CV 89%

LongVLM: Efficient Long Video Understanding via Large Language Models

Yuetian Weng, Mingfei Han, Haoyu He, Xiaojun Chang, Bohan Zhuang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments Accepted by ECCV 2024

2407.07016 2024-07-10 cond-mat.mtrl-sci 89%

Is Large Language Model All You Need to Predict the Synthesizability and Precursors of Crystal Structures?

Zhilong Song, Shuaihua Lu, Minggang Ju, Qionghua Zhou, Jinlan Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2402.03898 2024-07-04 cs.CL cs.AI cs.LG 89%

DistiLLM: Towards Streamlined Distillation for Large Language Models

Jongwoo Ko, Sungnyun Kim, Tianyi Chen, Se-Young Yun

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICML 2024; Code is available at https://github.com/jongwooko/distillm

2402.07647 2024-07-01 cs.IR 89%

GRILLBot In Practice: Lessons and Tradeoffs Deploying Large Language Models for Adaptable Conversational Task Assistants

Sophie Fischer, Carlos Gemmell, Niklas Tecklenburg, Iain Mackie, Federico Rossetto, Jeffrey Dalton

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 11 pages, KDD Preprint

1. 效率与部署 22280 篇

Dependency-Aware Semi-Structured Sparsity of GLU Variants in Large Language Models

Fisher Information-based Efficient Curriculum Federated Learning with Large Language Models

Skill Learning Using Process Mining for Large Language Model Plan Generation

EmbedLLM: Learning Compact Representations of Large Language Models

PromptIntern: Saving Inference Costs by Internalizing Recurrent Prompt during Large Language Model Fine-tuning

Integrating Reinforcement Learning and Large Language Models for Crop Production Process Management Optimization and Control through A New Knowledge-Based Deep Learning Paradigm

Large Language Models for Energy-Efficient Code: Emerging Results and Future Directions

SpaceByte: Towards Deleting Tokenization from Large Language Modeling

FineZip : Pushing the Limits of Large Language Models for Practical Lossless Text Compression

Geneverse: A collection of Open-source Multimodal Large Language Models for Genomic and Proteomic Research

BlockLLM: Multi-tenant Finer-grained Serving for Large Language Models

DistillSeq: A Framework for Safety Alignment Testing in Large Language Models using Knowledge Distillation

Investigating the Role of Cultural Values in Adopting Large Language Models for Software Engineering

Foundational Challenges in Assuring Alignment and Safety of Large Language Models

Exploring Sentiment Dynamics and Predictive Behaviors in Cryptocurrency Discussions by Few-Shot Learning with Large Language Models

CoRA: Optimizing Low-Rank Adaptation with Common Subspace of Large Language Models

Recent Advances in Generative AI and Large Language Models: Current Status, Challenges, and Perspectives

FactorLLM: Factorizing Knowledge via Mixture of Experts for Large Language Models

Efficient and Deployable Knowledge Infusion for Open-World Recommendations via Large Language Models

Distillation Matters: Empowering Sequential Recommenders to Match the Performance of Large Language Model

A Transcription Prompt-based Efficient Audio Large Language Model for Robust Speech Recognition

LPU: A Latency-Optimized and Highly Scalable Processor for Large Language Model Inference

Constructing Mechanical Design Agent Based on Large Language Models

Large Language Models for Equivalent Mutant Detection: How Far Are We?

Large Language Model-aided Edge Learning in Distribution System State Estimation

Large Language Models Powered Context-aware Motion Prediction in Autonomous Driving

LongVLM: Efficient Long Video Understanding via Large Language Models

Is Large Language Model All You Need to Predict the Synthesizability and Precursors of Crystal Structures?

DistiLLM: Towards Streamlined Distillation for Large Language Models

GRILLBot In Practice: Lessons and Tradeoffs Deploying Large Language Models for Adaptable Conversational Task Assistants