语言大模型 / LLM - arXivDaily 专题

2410.15226 2024-10-24 cs.CL 89%

On the Diversity of Synthetic Data and its Impact on Training Large Language Models

Hao Chen, Abdul Waheed, Xiang Li, Yidong Wang, Jindong Wang, Bhiksha Raj, Marah I. Abdin

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2410.17152 2024-10-23 cs.IR cs.CL 89%

Improving Pinterest Search Relevance Using Large Language Models

Han Wang, Mukuntha Narayanan Sundararaman, Onur Gungor, Yu Xu, Krishna Kamath, Rakesh Chalasani, Kurchi Subhra Hazra, Jinfeng Rao

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments CIKM 2024 Workshop on Industrial Recommendation Systems

2312.11075 2024-10-11 cs.CL 89%

Split and Rephrase with Large Language Models

David Ponce, Thierry Etchegoyhen, Jesús Calleja Pérez, Harritxu Gete

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

2410.04784 2024-10-08 cs.CL 89%

Formality is Favored: Unraveling the Learning Preferences of Large Language Models on Data with Conflicting Knowledge

Jiahuan Li, Yiqing Cao, Shujian Huang, Jiajun Chen

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments accepted by EMNLP 2024, main conference

2311.09812 2024-10-08 cs.CL 89%

Large Language Models for Propaganda Span Annotation

Maram Hasanain, Fatema Ahmad, Firoj Alam

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments propaganda, span detection, disinformation, misinformation, fake news, LLMs, GPT-4

2410.04197 2024-10-08 cs.CL 89%

CS4: Measuring the Creativity of Large Language Models Automatically by Controlling the Number of Story-Writing Constraints

Anirudh Atmakuru, Jatin Nainani, Rohith Siddhartha Reddy Bheemreddy, Anirudh Lakkaraju, Zonghai Yao, Hamed Zamani, Haw-Shiuan Chang

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2410.04103 2024-10-08 cs.CL 89%

A Learning Rate Path Switching Training Paradigm for Version Updates of Large Language Models

Zhihao Wang, Shiyu Liu, Jianheng Huang, Zheng Wang, Yixuan Liao, Xiaoxin Chen, Junfeng Yao, Jinsong Su

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments EMNLP 2024 (main,long paper)

2405.05417 2024-09-30 cs.CL 89%

Fishing for Magikarp: Automatically Detecting Under-trained Tokens in Large Language Models

Sander Land, Max Bartolo

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments 16 pages, 6 figures. Accepted at EMNLP 2024, main track. For associated code, see https://github.com/cohere-ai/magikarp/

2404.16807 2024-09-30 cs.CL 89%

Improving Diversity of Commonsense Generation by Large Language Models via In-Context Learning

Tianhui Zhang, Bei Peng, Danushka Bollegala

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments EMNLP 2024 Findings, Camera-ready version

2406.16332 2024-09-26 cs.IR cs.CL 89%

DemoRank: Selecting Effective Demonstrations for Large Language Models in Ranking Task

Wenhan Liu, Yutao Zhu, Zhicheng Dou

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2403.12958 2024-09-18 cs.CL 89%

Dated Data: Tracing Knowledge Cutoffs in Large Language Models

Jeffrey Cheng, Marc Marone, Orion Weller, Dawn Lawrie, Daniel Khashabi, Benjamin Van Durme

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2309.07606 2024-09-11 cs.CL cs.IR 89%

Zero-shot Audio Topic Reranking using Large Language Models

Mengjie Qian, Rao Ma, Adian Liusie, Erfan Loweimi, Kate M. Knill, Mark J. F. Gales

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2409.01952 2024-09-10 cs.CR cs.AI cs.AR 89%

Exploiting the Vulnerability of Large Language Models via Defense-Aware Architectural Backdoor

Abdullah Arafat Miah, Yu Bi

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2407.05750 2024-08-29 cs.CL 89%

Large Language Models Understand Layout

Weiming Li, Manni Duan, Dong An, Yan Shao

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments This paper has been accepted by ECAI-2024

2312.06731 2024-08-29 cs.CV cs.AI 89%

Genixer: Empowering Multimodal Large Language Models as a Powerful Data Generator

Henry Hengyuan Zhao, Pan Zhou, Mike Zheng Shou

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.AI

Comments Accepted by ECCV 2024

2401.06400 2024-08-23 cs.CL cs.CV 89%

Generalizing Visual Question Answering from Synthetic to Human-Written Questions via a Chain of QA with a Large Language Model

Taehee Kim, Yeongjae Cho, Heejun Shin, Yohan Jo, Dongmyung Shin

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；foundation model(abstract)；分类 cs.CL

2408.11396 2024-08-22 cs.CL 89%

MoE-LPR: Multilingual Extension of Large Language Models through Mixture-of-Experts with Language Priors Routing

Hao Zhou, Zhijun Wang, Shujian Huang, Xin Huang, Xue Han, Junlan Feng, Chao Deng, Weihua Luo, Jiajun Chen

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

2408.05941 2024-08-13 cs.CR cs.AI 89%

Multimodal Large Language Models for Phishing Webpage Detection and Identification

Jehyun Lee, Peiyuan Lim, Bryan Hooi, Dinil Mon Divakaran

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments To appear in eCrime 2024

2408.04420 2024-08-09 cs.CL 89%

Recognizing Emotion Regulation Strategies from Human Behavior with Large Language Models

Philipp Müller, Alexander Heimerl, Sayed Muddashir Hossain, Lea Siegel, Jan Alexandersson, Patrick Gebhard, Elisabeth André, Tanja Schneeberger

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to ACII'24

2407.20743 2024-07-31 cs.CL 89%

Meltemi: The first open Large Language Model for Greek

Leon Voukoutis, Dimitris Roussis, Georgios Paraskevopoulos, Sokratis Sofianopoulos, Prokopis Prokopidis, Vassilis Papavasileiou, Athanasios Katsamanis, Stelios Piperidis, Vassilis Katsouros

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

2404.01461 2024-07-24 cs.CL cs.HC 89%

Will the Real Linda Please Stand up...to Large Language Models? Examining the Representativeness Heuristic in LLMs

Pengda Wang, Zilin Xiao, Hanjie Chen, Frederick L. Oswald

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Published as a conference paper at COLM 2024

2312.17173 2024-07-18 stat.ML cs.LG 89%

Non-Vacuous Generalization Bounds for Large Language Models

Sanae Lotfi, Marc Finzi, Yilun Kuang, Tim G. J. Rudner, Micah Goldblum, Andrew Gordon Wilson

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments ICML 2024

2407.08716 2024-07-12 cs.CL 89%

A Taxonomy for Data Contamination in Large Language Models

Medha Palavalli, Amanda Bertsch, Matthew R. Gormley

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments 19 pages, 8 figures, accepted to CONDA Workshop on Data Contamination @ ACL 2024

2407.03145 2024-07-04 cs.CL 89%

Enhancing Translation Accuracy of Large Language Models through Continual Pre-Training on Parallel Data

Minato Kondo, Takehito Utsuro, Masaaki Nagata

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments IWSLT2024, 18 pages

2406.13275 2024-06-26 cs.SD cs.CL eess.AS 89%

Enhancing Automated Audio Captioning via Large Language Models with Optimized Audio Encoding

Jizhong Liu, Gang Li, Junbo Zhang, Heinrich Dinkel, Yongqing Wang, Zhiyong Yan, Yujun Wang, Bin Wang

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by Interspeech 2024

2406.15720 2024-06-25 cs.CL 89%

Scaling Laws for Fact Memorization of Large Language Models

Xingyu Lu, Xiaonan Li, Qinyuan Cheng, Kai Ding, Xuanjing Huang, Xipeng Qiu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2406.13893 2024-06-21 cs.CL 89%

Open Generative Large Language Models for Galician

Pablo Gamallo, Pablo Rodríguez, Iria de-Dios-Flores, Susana Sotelo, Silvia Paniagua, Daniel Bardanca, José Ramom Pichel, Marcos Garcia

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments 12 pages, 1 figure

2406.13357 2024-06-21 cs.CL cs.SD eess.AS 89%

Transferable speech-to-text large language model alignment module

Boyong Wu, Chao Yan, Haoran Pu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；foundation model(abstract)；分类 cs.CL

Comments Accepted by InterSpeech 2024; 5 pages, 2 figures

2406.12397 2024-06-19 cs.CL 89%

Unveiling the Flaws: Exploring Imperfections in Synthetic Data and Mitigation Strategies for Large Language Models

Jie Chen, Yupeng Zhang, Bingning Wang, Wayne Xin Zhao, Ji-Rong Wen, Weipeng Chen

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 15 pages

2406.10274 2024-06-18 cs.IR cs.CL cs.DL 89%

Using General Large Language Models to Classify Mathematical Documents

Patrick D. F. Ion, Stephen M. Watt

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

1. 预训练与数据 12353 篇

On the Diversity of Synthetic Data and its Impact on Training Large Language Models

Improving Pinterest Search Relevance Using Large Language Models

Split and Rephrase with Large Language Models

Formality is Favored: Unraveling the Learning Preferences of Large Language Models on Data with Conflicting Knowledge

Large Language Models for Propaganda Span Annotation

CS4: Measuring the Creativity of Large Language Models Automatically by Controlling the Number of Story-Writing Constraints

A Learning Rate Path Switching Training Paradigm for Version Updates of Large Language Models

Fishing for Magikarp: Automatically Detecting Under-trained Tokens in Large Language Models

Improving Diversity of Commonsense Generation by Large Language Models via In-Context Learning

DemoRank: Selecting Effective Demonstrations for Large Language Models in Ranking Task

Dated Data: Tracing Knowledge Cutoffs in Large Language Models

Zero-shot Audio Topic Reranking using Large Language Models

Exploiting the Vulnerability of Large Language Models via Defense-Aware Architectural Backdoor

Large Language Models Understand Layout

Genixer: Empowering Multimodal Large Language Models as a Powerful Data Generator

Generalizing Visual Question Answering from Synthetic to Human-Written Questions via a Chain of QA with a Large Language Model

MoE-LPR: Multilingual Extension of Large Language Models through Mixture-of-Experts with Language Priors Routing

Multimodal Large Language Models for Phishing Webpage Detection and Identification

Recognizing Emotion Regulation Strategies from Human Behavior with Large Language Models

Meltemi: The first open Large Language Model for Greek

Will the Real Linda Please Stand up...to Large Language Models? Examining the Representativeness Heuristic in LLMs

Non-Vacuous Generalization Bounds for Large Language Models

A Taxonomy for Data Contamination in Large Language Models

Enhancing Translation Accuracy of Large Language Models through Continual Pre-Training on Parallel Data

Enhancing Automated Audio Captioning via Large Language Models with Optimized Audio Encoding

Scaling Laws for Fact Memorization of Large Language Models

Open Generative Large Language Models for Galician

Transferable speech-to-text large language model alignment module

Unveiling the Flaws: Exploring Imperfections in Synthetic Data and Mitigation Strategies for Large Language Models

Using General Large Language Models to Classify Mathematical Documents