语言大模型 / LLM - arXivDaily 专题

2410.19130 2024-12-24 cs.LG cs.AI cs.CR 88%

Research on Key Technologies for Cross-Cloud Federated Training of Large Language Models

Haowei Yang, Mingxiu Sui, Shaobo Liu, Xinyue Qian, Zhaoyang Zhang, Bingying Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

2412.11919 2024-12-17 cs.CL cs.AI cs.IR 88%

RetroLLM: Empowering Large Language Models to Retrieve Fine-grained Evidence within Generation

Xiaoxi Li, Jiajie Jin, Yujia Zhou, Yongkang Wu, Zhonghua Li, Qi Ye, Zhicheng Dou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2408.08470 2024-12-17 cs.LG cs.AI 88%

Context-Aware Assistant Selection for Improved Inference Acceleration with Large Language Models

Jerry Huang, Prasanna Parthasarathi, Mehdi Rezagholizadeh, Sarath Chandar

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

Comments Published as a long paper at the 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP). Official version of paper within conference proceedings is available at http://aclanthology.org/2024.emnlp-main.332

2412.06512 2024-12-10 cs.AI cs.CL cs.SE 88%

The Fusion of Large Language Models and Formal Methods for Trustworthy AI Agents: A Roadmap

Yedi Zhang, Yufan Cai, Xinyue Zuo, Xiaokun Luan, Kailong Wang, Zhe Hou, Yifan Zhang, Zhiyuan Wei, Meng Sun, Jun Sun, Jing Sun, Jin Song Dong

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 24 pages, 4 figures

2412.03575 2024-12-06 cs.IR cs.AI cs.CL 88%

Leveraging Large Language Models for Generating Labeled Mineral Site Record Linkage Data

Jiyoon Pyo, Yao-Yi Chiang

专题命中效率与部署：language model(title,abstract)；large language model(title)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 11 pages, 10 figures

2412.02454 2024-12-04 cs.CL cs.AI cs.CR 88%

Gracefully Filtering Backdoor Samples for Generative Large Language Models without Retraining

Zongru Wu, Pengzhou Cheng, Lingyong Fang, Zhuosheng Zhang, Gongshen Liu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted at COLING 2025

2411.18700 2024-12-02 cs.CL cs.AI 88%

On the Effectiveness of Incremental Training of Large Language Models

Miles Q. Li, Benjamin C. M. Fung, Shih-Chia Huang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2406.16838 2024-11-21 cs.CL cs.LG 88%

From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models

Sean Welleck, Amanda Bertsch, Matthew Finlayson, Hailey Schoelkopf, Alex Xie, Graham Neubig, Ilia Kulikov, Zaid Harchaoui

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2411.10629 2024-11-19 cs.CL cs.AI 88%

Leveraging large language models for efficient representation learning for entity resolution

Xiaowei Xu, Bi T. Foua, Xingqiao Wang, Vivek Gunasekaran, John R. Talburt

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 22 pages and 12 figures

2405.06219 2024-11-13 cs.LG cs.CL 88%

SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models

Haojie Duanmu, Zhihang Yuan, Xiuhong Li, Jiangfei Duan, Xingcheng Zhang, Dahua Lin

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2411.06171 2024-11-12 cs.CL cs.LG 88%

SEEKR: Selective Attention-Guided Knowledge Retention for Continual Learning of Large Language Models

Jinghan He, Haiyun Guo, Kuan Zhu, Zihan Zhao, Ming Tang, Jinqiao Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments EMNLP2024

2407.07330 2024-11-08 cs.CL cs.AI 88%

Interpretable Differential Diagnosis with Dual-Inference Large Language Models

Shuang Zhou, Mingquan Lin, Sirui Ding, Jiashuo Wang, Genevieve B. Melton, James Zou, Rui Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 16 pages

2404.08763 2024-11-05 cs.LG cs.CL 88%

CATS: Contextually-Aware Thresholding for Sparsity in Large Language Models

Donghyun Lee, Je-Yong Lee, Genghan Zhang, Mo Tiwari, Azalia Mirhoseini

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2408.05241 2024-11-01 cs.CL cs.AI cs.CY cs.ET cs.GT 88%

Large Model Strategic Thinking, Small Model Efficiency: Transferring Theory of Mind in Large Language Models

Nunzio Lore, Sepehr Ilami, Babak Heydari

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 18 pages, 6 figures

2311.09335 2024-10-28 cs.CL cs.AI 88%

Investigating Hallucinations in Pruned Large Language Models for Abstractive Summarization

George Chrysostomou, Zhixue Zhao, Miles Williams, Nikolaos Aletras

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments TACL 2024 (Presented at EMNLP 2024)

Journal ref Transactions of the Association for Computational Linguistics (2024) 12: 1163-1181

2410.18311 2024-10-25 cs.LG cs.CL 88%

CoreInfer: Accelerating Large Language Model Inference with Semantics-Inspired Adaptive Sparse Activation

Qinsi Wang, Saeed Vahidian, Hancheng Ye, Jianyang Gu, Jianyi Zhang, Yiran Chen

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments Project page: https://wangqinsi1.github.io/coreinfer_page/

2410.12686 2024-10-18 cs.CV cs.AI cs.LG 88%

Automatic Mapping of Anatomical Landmarks from Free-Text Using Large Language Models: Insights from Llama-2

Mohamad Abdi, Gerardo Hermosillo Valadez, Halid Ziya Yerebakan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

Comments 6 pages, 2 figures, 1 table

2406.15524 2024-10-14 cs.CL cs.LG 88%

Rethinking Pruning Large Language Models: Benefits and Pitfalls of Reconstruction Error Minimization

Sungbin Shin, Wonpyo Park, Jaeho Lee, Namhoon Lee

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments EMNLP 2024 main

2401.17244 2024-10-11 cs.CL cond-mat.mtrl-sci cs.AI 88%

LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval and Distillation

Yuan Chiang, Elvis Hsieh, Chia-Hong Chou, Janosh Riebesell

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 32 pages, 5 figures

2410.03765 2024-10-08 cs.CL cs.LG 88%

Basis Sharing: Cross-Layer Parameter Sharing for Large Language Model Compression

Jingcun Wang, Yu-Guang Chen, Ing-Chao Lin, Bing Li, Grace Li Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2407.01614 2024-10-08 cs.LG cs.AI 88%

Enhancing Stability for Large Language Models Training in Constrained Bandwidth Networks

Yun Dai, Tejas Dharamsi, Byron Hsu, Tao Song, Hamed Firooz

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

2406.16069 2024-10-08 cs.CL cs.AI 88%

FastMem: Fast Memorization of Prompt Improves Context Awareness of Large Language Models

Junyi Zhu, Shuochen Liu, Yu Yu, Bo Tang, Yibo Yan, Zhiyu Li, Feiyu Xiong, Tong Xu, Matthew B. Blaschko

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2307.00526 2024-10-07 cs.CL cs.LG cs.NA cs.NE math.NA 88%

TensorGPT: Efficient Compression of Large Language Models based on Tensor-Train Decomposition

Mingxue Xu, Yao Lei Xu, Danilo P. Mandic

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2410.02202 2024-10-04 cs.CL cs.AI 88%

Can Language Models Take A Hint? Prompting for Controllable Contextualized Commonsense Inference

Pedro Colon-Hernandez, Nanxi Liu, Chelsea Joe, Peter Chin, Claire Yin, Henry Lieberman, Yida Xin, Cynthia Breazeal

专题命中效率与部署：language model(title,abstract)；prompting(title,abstract)；分类 cs.CL、cs.AI

Comments Submitted to ACL Rolling Review. arXiv admin note: text overlap with arXiv:2302.05406

2410.00362 2024-10-02 cs.CL cs.AI 88%

FedPT: Federated Proxy-Tuning of Large Language Models on Resource-Constrained Edge Devices

Zhidong Gao, Yu Zhang, Zhenxiao Zhang, Yanmin Gong, Yuanxiong Guo

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 29 pages, 19 figures

2406.17328 2024-10-02 cs.CL cs.AI 88%

Dual-Space Knowledge Distillation for Large Language Models

Songming Zhang, Xue Zhang, Zengkui Sun, Yufeng Chen, Jinan Xu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments The camera-ready version for EMNLP 2024 main conference. 17 pages, 11 figures, code available at: https://github.com/songmzhang/DSKD

2408.04905 2024-09-24 cs.CL cs.AI 88%

GlitchProber: Advancing Effective Detection and Mitigation of Glitch Tokens in Large Language Models

Zhibo Zhang, Wuxia Bai, Yuxi Li, Mark Huasong Meng, Kailong Wang, Ling Shi, Li Li, Jun Wang, Haoyu Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2409.13747 2024-09-24 cs.CL cs.ET cs.LG 88%

Machine Translation with Large Language Models: Decoder Only vs. Encoder-Decoder

Abhinav P. M., SujayKumar Reddy M, Oswald Christopher

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2409.12500 2024-09-20 cs.CL cs.AI 88%

LLMR: Knowledge Distillation with a Large Language Model-Induced Reward

Dongheng Li, Yongchang Hao, Lili Mou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by LERC COLING 2024

2405.13014 2024-09-20 cs.CL cs.AI 88%

QCRD: Quality-guided Contrastive Rationale Distillation for Large Language Models

Wei Wang, Zhaowei Li, Qi Xu, Yiqing Cai, Hang Song, Qi Qi, Ran Zhou, Zhida Huang, Tao Wang, Li Xiao

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

1. 效率与部署 22280 篇

Research on Key Technologies for Cross-Cloud Federated Training of Large Language Models

RetroLLM: Empowering Large Language Models to Retrieve Fine-grained Evidence within Generation

Context-Aware Assistant Selection for Improved Inference Acceleration with Large Language Models

The Fusion of Large Language Models and Formal Methods for Trustworthy AI Agents: A Roadmap

Leveraging Large Language Models for Generating Labeled Mineral Site Record Linkage Data

Gracefully Filtering Backdoor Samples for Generative Large Language Models without Retraining

On the Effectiveness of Incremental Training of Large Language Models

From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models

Leveraging large language models for efficient representation learning for entity resolution

SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models

SEEKR: Selective Attention-Guided Knowledge Retention for Continual Learning of Large Language Models

Interpretable Differential Diagnosis with Dual-Inference Large Language Models

CATS: Contextually-Aware Thresholding for Sparsity in Large Language Models

Large Model Strategic Thinking, Small Model Efficiency: Transferring Theory of Mind in Large Language Models

Investigating Hallucinations in Pruned Large Language Models for Abstractive Summarization

CoreInfer: Accelerating Large Language Model Inference with Semantics-Inspired Adaptive Sparse Activation

Automatic Mapping of Anatomical Landmarks from Free-Text Using Large Language Models: Insights from Llama-2

Rethinking Pruning Large Language Models: Benefits and Pitfalls of Reconstruction Error Minimization

LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval and Distillation

Basis Sharing: Cross-Layer Parameter Sharing for Large Language Model Compression

Enhancing Stability for Large Language Models Training in Constrained Bandwidth Networks

FastMem: Fast Memorization of Prompt Improves Context Awareness of Large Language Models

TensorGPT: Efficient Compression of Large Language Models based on Tensor-Train Decomposition

Can Language Models Take A Hint? Prompting for Controllable Contextualized Commonsense Inference

FedPT: Federated Proxy-Tuning of Large Language Models on Resource-Constrained Edge Devices

Dual-Space Knowledge Distillation for Large Language Models

GlitchProber: Advancing Effective Detection and Mitigation of Glitch Tokens in Large Language Models

Machine Translation with Large Language Models: Decoder Only vs. Encoder-Decoder

LLMR: Knowledge Distillation with a Large Language Model-Induced Reward

QCRD: Quality-guided Contrastive Rationale Distillation for Large Language Models