语言大模型 / LLM - arXivDaily 专题

2404.09336 2024-04-16 cs.CL cs.AI 90%

Self-Selected Attention Span for Accelerating Large Language Model Inference

Tian Jin, Wanzin Yazar, Zifei Xu, Sayeh Sharify, Xin Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2404.09163 2024-04-16 cs.CL cs.AI 90%

GeMQuAD : Generating Multilingual Question Answering Datasets from Large Language Models using Few Shot Learning

Amani Namboori, Shivam Mangale, Andy Rosenbaum, Saleh Soltan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted to The 37th International Conference on Neural Information Processing Systems (NeurIPS 2023)December 10-16, 2023 - SyntheticData4ML workshop, New Orleans, United States https://neurips.cc/Conferences/2023

2303.08559 2024-04-15 cs.CL cs.AI 90%

Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!

Yubo Ma, Yixin Cao, YongChing Hong, Aixin Sun

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI

Comments Accepted by EMNLP 2023 Findings

2312.15918 2024-04-12 cs.CL cs.AI 90%

Supervised Knowledge Makes Large Language Models Better In-context Learners

Linyi Yang, Shuibai Zhang, Zhuohao Yu, Guangsheng Bao, Yidong Wang, Jindong Wang, Ruochen Xu, Wei Ye, Xing Xie, Weizhu Chen, Yue Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted to ICLR 2024

2404.06003 2024-04-10 cs.CL cs.AI 90%

FreeEval: A Modular Framework for Trustworthy and Efficient Evaluation of Large Language Models

Zhuohao Yu, Chang Gao, Wenjin Yao, Yidong Wang, Zhengran Zeng, Wei Ye, Jindong Wang, Yue Zhang, Shikun Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments We open-source all our code at: https://github.com/WisdomShell/FreeEval

2404.04287 2024-04-09 cs.CL cs.AI 90%

CONFLARE: CONFormal LArge language model REtrieval

Pouria Rouzrokh, Shahriar Faghani, Cooper U. Gamble, Moein Shariatnia, Bradley J. Erickson

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Github code: https://github.com/Mayo-Radiology-Informatics-Lab/conflare

2404.02717 2024-04-04 cs.CL cs.LG 90%

Automatic Prompt Selection for Large Language Models

Viet-Tung Do, Van-Khanh Hoang, Duy-Hung Nguyen, Shahab Sabahi, Jeff Yang, Hajime Hotta, Minh-Tien Nguyen, Hung Le

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments preprint

2305.09781 2024-04-02 cs.CL cs.DC cs.LG 90%

SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verification

Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Xinhao Cheng, Zeyu Wang, Zhengxin Zhang, Rae Ying Yee Wong, Alan Zhu, Lijie Yang, Xiaoxiang Shi, Chunan Shi, Zhuoming Chen, Daiyaan Arfeen, Reyna Abhyankar, Zhihao Jia

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments ASPLOS'24

2403.17312 2024-03-27 cs.AI cs.LG cs.PF 90%

ALISA: Accelerating Large Language Model Inference via Sparsity-Aware KV Caching

Youpeng Zhao, Di Wu, Jun Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments ISCA 2024

2312.08274 2024-03-27 cs.CL cs.AI 90%

High-throughput Biomedical Relation Extraction for Semi-Structured Web Articles Empowered by Large Language Models

Songchi Zhou, Sheng Yu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2403.06420 2024-03-20 cs.RO cs.AI cs.HC cs.LG 90%

RLingua: Improving Reinforcement Learning Sample Efficiency in Robotic Manipulations With Large Language Models

Liangliang Chen, Yutian Lei, Shiyu Jin, Ying Zhang, Liangjun Zhang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2305.12544 2024-03-19 cs.CL cs.AI 90%

Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models

Oana Ignat, Zhijing Jin, Artem Abzaliev, Laura Biester, Santiago Castro, Naihao Deng, Xinyi Gao, Aylin Gunal, Jacky He, Ashkan Kazemi, Muhammad Khalifa, Namho Koh, Andrew Lee, Siyang Liu, Do June Min, Shinka Mori, Joan Nwatu, Veronica Perez-Rosas, Siqi Shen, Zekun Wang, Winston Wu, Rada Mihalcea

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted at COLING 2024

2403.09733 2024-03-18 cs.CL cs.AI 90%

OverleafCopilot: Empowering Academic Writing in Overleaf with Large Language Models

Haomin Wen, Zhenjie Wei, Yan Lin, Jiyuan Wang, Yuxuan Liang, Huaiyu Wan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2310.04363 2024-03-15 cs.LG cs.CL 90%

Amortizing intractable inference in large language models

Edward J. Hu, Moksh Jain, Eric Elmoznino, Younesse Kaddar, Guillaume Lajoie, Yoshua Bengio, Nikolay Malkin

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments ICLR 2024; 23 pages; code: https://github.com/GFNOrg/gfn-lm-tuning

2403.06408 2024-03-12 cs.LG cs.AI 90%

What Makes Quantization for Large Language Models Hard? An Empirical Study from the Lens of Perturbation

Zhuocheng Gong, Jiahao Liu, Jingang Wang, Xunliang Cai, Dongyan Zhao, Rui Yan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2403.03432 2024-03-07 cs.CL cs.AI 90%

Mixture-of-LoRAs: An Efficient Multitask Tuning for Large Language Models

Wenfeng Feng, Chuzhan Hao, Yuewei Zhang, Yu Han, Hao Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI

Comments 10 pages, COLING24 Accepted

2402.00421 2024-03-06 cs.CL cs.HC cs.IR cs.LG 90%

From PARIS to LE-PARIS: Toward Patent Response Automation with Recommender Systems and Collaborative Large Language Models

Jung-Mei Chu, Hao-Cheng Lo, Jieh Hsiang, Chun-Chieh Cho

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments 28 pages, 5 figures, typos corrected, references added, under review

2403.00830 2024-03-05 cs.AI cs.CL 90%

MedAide: Leveraging Large Language Models for On-Premise Medical Assistance on Edge Devices

Abdul Basit, Khizar Hussain, Muhammad Abdullah Hanif, Muhammad Shafique

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；RLHF(abstract)；分类 cs.CL、cs.AI

Comments 7 pages, 11 figures, ACM conference paper, 33 references

2402.17764 2024-02-28 cs.CL cs.LG 90%

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Li Dong, Ruiping Wang, Jilong Xue, Furu Wei

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments Work in progress

2310.14403 2024-02-27 cs.AI cs.CL 90%

O3D: Offline Data-driven Discovery and Distillation for Sequential Decision-Making with Large Language Models

Yuchen Xiao, Yanchao Sun, Mengda Xu, Udari Madhushani, Jared Vann, Deepeka Garg, Sumitra Ganesh

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2310.09266 2024-02-27 cs.CR cs.CL cs.LG 90%

User Inference Attacks on Large Language Models

Nikhil Kandpal, Krishna Pillutla, Alina Oprea, Peter Kairouz, Christopher A. Choquette-Choo, Zheng Xu

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments v2 contains experiments on additional datasets and differential privacy

2308.06013 2024-02-27 cs.IT cs.AI cs.LG math.IT 90%

Large Language Models for Telecom: Forthcoming Impact on the Industry

Ali Maatouk, Nicola Piovesan, Fadhel Ayed, Antonio De Domenico, Merouane Debbah

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2402.14714 2024-02-23 cs.CL cs.AI 90%

Efficient and Effective Vocabulary Expansion Towards Multilingual Large Language Models

Seungduk Kim, Seungtaek Choi, Myeongho Jeong

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2402.09588 2024-02-20 cs.AI cs.CL 90%

Emerging Opportunities of Using Large Language Models for Translation Between Drug Molecules and Indications

David Oniani, Jordan Hilsman, Chengxi Zang, Junmei Wang, Lianjin Cai, Jan Zawala, Yanshan Wang

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2402.06696 2024-02-13 cs.LG cs.AI 90%

FL-NAS: Towards Fairness of NAS for Resource Constrained Devices via Large Language Models

Ruiyang Qin, Yuting Hu, Zheyu Yan, Jinjun Xiong, Ahmed Abbasi, Yiyu Shi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments ASP-DAC 2024

2310.15080 2024-02-13 cs.LG cs.CL cs.DC 90%

Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization

Tianshi Che, Ji Liu, Yang Zhou, Jiaxiang Ren, Jiwen Zhou, Victor S. Sheng, Huaiyu Dai, Dejing Dou

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments 18 pages, accepted by EMNLP 2023

2309.08968 2024-02-12 cs.CL cs.LG 90%

Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference

Parsa Kavehzadeh, Mojtaba Valipour, Marzieh Tahaei, Ali Ghodsi, Boxing Chen, Mehdi Rezagholizadeh

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL、cs.LG

Comments Accepted to EACL 2024 - Findings

2402.02309 2024-02-07 cs.LG cs.CL cs.CR cs.CV 90%

Jailbreaking Attack against Multimodal Large Language Model

Zhenxing Niu, Haodong Ren, Xinbo Gao, Gang Hua, Rong Jin

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2402.01750 2024-02-06 cs.CL cs.AI 90%

PACE: A Pragmatic Agent for Enhancing Communication Efficiency Using Large Language Models

Jiaxuan Li, Minxi Yang, Dahua Gao, Wenlong Xu, Guangming Shi

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 11 pages,11 figures, submitted to IJCAI 2024

2402.01725 2024-02-06 cs.CL cs.AI 90%

Fortifying Ethical Boundaries in AI: Advanced Strategies for Enhancing Security in Large Language Models

Yunhong He, Jianling Qiu, Wei Zhang, Zhengqing Yuan

专题命中效率与部署：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

1. 效率与部署 22210 篇

Self-Selected Attention Span for Accelerating Large Language Model Inference

GeMQuAD : Generating Multilingual Question Answering Datasets from Large Language Models using Few Shot Learning

Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!

Supervised Knowledge Makes Large Language Models Better In-context Learners

FreeEval: A Modular Framework for Trustworthy and Efficient Evaluation of Large Language Models

CONFLARE: CONFormal LArge language model REtrieval

Automatic Prompt Selection for Large Language Models

SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verification

ALISA: Accelerating Large Language Model Inference via Sparsity-Aware KV Caching

High-throughput Biomedical Relation Extraction for Semi-Structured Web Articles Empowered by Large Language Models

RLingua: Improving Reinforcement Learning Sample Efficiency in Robotic Manipulations With Large Language Models

Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models

OverleafCopilot: Empowering Academic Writing in Overleaf with Large Language Models

Amortizing intractable inference in large language models

What Makes Quantization for Large Language Models Hard? An Empirical Study from the Lens of Perturbation

Mixture-of-LoRAs: An Efficient Multitask Tuning for Large Language Models

From PARIS to LE-PARIS: Toward Patent Response Automation with Recommender Systems and Collaborative Large Language Models

MedAide: Leveraging Large Language Models for On-Premise Medical Assistance on Edge Devices

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

O3D: Offline Data-driven Discovery and Distillation for Sequential Decision-Making with Large Language Models

User Inference Attacks on Large Language Models

Large Language Models for Telecom: Forthcoming Impact on the Industry

Efficient and Effective Vocabulary Expansion Towards Multilingual Large Language Models

Emerging Opportunities of Using Large Language Models for Translation Between Drug Molecules and Indications

FL-NAS: Towards Fairness of NAS for Resource Constrained Devices via Large Language Models

Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization

Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference

Jailbreaking Attack against Multimodal Large Language Model

PACE: A Pragmatic Agent for Enhancing Communication Efficiency Using Large Language Models

Fortifying Ethical Boundaries in AI: Advanced Strategies for Enhancing Security in Large Language Models