语言大模型 / LLM - arXivDaily 专题

2410.04784 2024-10-08 cs.CL 89%

Formality is Favored: Unraveling the Learning Preferences of Large Language Models on Data with Conflicting Knowledge

Jiahuan Li, Yiqing Cao, Shujian Huang, Jiajun Chen

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments accepted by EMNLP 2024, main conference

2311.09812 2024-10-08 cs.CL 89%

Large Language Models for Propaganda Span Annotation

Maram Hasanain, Fatema Ahmad, Firoj Alam

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments propaganda, span detection, disinformation, misinformation, fake news, LLMs, GPT-4

2410.04197 2024-10-08 cs.CL 89%

CS4: Measuring the Creativity of Large Language Models Automatically by Controlling the Number of Story-Writing Constraints

Anirudh Atmakuru, Jatin Nainani, Rohith Siddhartha Reddy Bheemreddy, Anirudh Lakkaraju, Zonghai Yao, Hamed Zamani, Haw-Shiuan Chang

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2410.04103 2024-10-08 cs.CL 89%

A Learning Rate Path Switching Training Paradigm for Version Updates of Large Language Models

Zhihao Wang, Shiyu Liu, Jianheng Huang, Zheng Wang, Yixuan Liao, Xiaoxin Chen, Junfeng Yao, Jinsong Su

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments EMNLP 2024 (main,long paper)

2405.05417 2024-09-30 cs.CL 89%

Fishing for Magikarp: Automatically Detecting Under-trained Tokens in Large Language Models

Sander Land, Max Bartolo

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments 16 pages, 6 figures. Accepted at EMNLP 2024, main track. For associated code, see https://github.com/cohere-ai/magikarp/

2404.16807 2024-09-30 cs.CL 89%

Improving Diversity of Commonsense Generation by Large Language Models via In-Context Learning

Tianhui Zhang, Bei Peng, Danushka Bollegala

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments EMNLP 2024 Findings, Camera-ready version

2406.16332 2024-09-26 cs.IR cs.CL 89%

DemoRank: Selecting Effective Demonstrations for Large Language Models in Ranking Task

Wenhan Liu, Yutao Zhu, Zhicheng Dou

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2403.12958 2024-09-18 cs.CL 89%

Dated Data: Tracing Knowledge Cutoffs in Large Language Models

Jeffrey Cheng, Marc Marone, Orion Weller, Dawn Lawrie, Daniel Khashabi, Benjamin Van Durme

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2309.07606 2024-09-11 cs.CL cs.IR 89%

Zero-shot Audio Topic Reranking using Large Language Models

Mengjie Qian, Rao Ma, Adian Liusie, Erfan Loweimi, Kate M. Knill, Mark J. F. Gales

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2409.01952 2024-09-10 cs.CR cs.AI cs.AR 89%

Exploiting the Vulnerability of Large Language Models via Defense-Aware Architectural Backdoor

Abdullah Arafat Miah, Yu Bi

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2407.05750 2024-08-29 cs.CL 89%

Large Language Models Understand Layout

Weiming Li, Manni Duan, Dong An, Yan Shao

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments This paper has been accepted by ECAI-2024

2312.06731 2024-08-29 cs.CV cs.AI 89%

Genixer: Empowering Multimodal Large Language Models as a Powerful Data Generator

Henry Hengyuan Zhao, Pan Zhou, Mike Zheng Shou

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.AI

Comments Accepted by ECCV 2024

2401.06400 2024-08-23 cs.CL cs.CV 89%

Generalizing Visual Question Answering from Synthetic to Human-Written Questions via a Chain of QA with a Large Language Model

Taehee Kim, Yeongjae Cho, Heejun Shin, Yohan Jo, Dongmyung Shin

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；foundation model(abstract)；分类 cs.CL

2408.11396 2024-08-22 cs.CL 89%

MoE-LPR: Multilingual Extension of Large Language Models through Mixture-of-Experts with Language Priors Routing

Hao Zhou, Zhijun Wang, Shujian Huang, Xin Huang, Xue Han, Junlan Feng, Chao Deng, Weihua Luo, Jiajun Chen

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

2408.05941 2024-08-13 cs.CR cs.AI 89%

Multimodal Large Language Models for Phishing Webpage Detection and Identification

Jehyun Lee, Peiyuan Lim, Bryan Hooi, Dinil Mon Divakaran

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments To appear in eCrime 2024

2408.04420 2024-08-09 cs.CL 89%

Recognizing Emotion Regulation Strategies from Human Behavior with Large Language Models

Philipp Müller, Alexander Heimerl, Sayed Muddashir Hossain, Lea Siegel, Jan Alexandersson, Patrick Gebhard, Elisabeth André, Tanja Schneeberger

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to ACII'24

2407.20743 2024-07-31 cs.CL 89%

Meltemi: The first open Large Language Model for Greek

Leon Voukoutis, Dimitris Roussis, Georgios Paraskevopoulos, Sokratis Sofianopoulos, Prokopis Prokopidis, Vassilis Papavasileiou, Athanasios Katsamanis, Stelios Piperidis, Vassilis Katsouros

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

2404.01461 2024-07-24 cs.CL cs.HC 89%

Will the Real Linda Please Stand up...to Large Language Models? Examining the Representativeness Heuristic in LLMs

Pengda Wang, Zilin Xiao, Hanjie Chen, Frederick L. Oswald

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Published as a conference paper at COLM 2024

2312.17173 2024-07-18 stat.ML cs.LG 89%

Non-Vacuous Generalization Bounds for Large Language Models

Sanae Lotfi, Marc Finzi, Yilun Kuang, Tim G. J. Rudner, Micah Goldblum, Andrew Gordon Wilson

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments ICML 2024

2407.08716 2024-07-12 cs.CL 89%

A Taxonomy for Data Contamination in Large Language Models

Medha Palavalli, Amanda Bertsch, Matthew R. Gormley

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments 19 pages, 8 figures, accepted to CONDA Workshop on Data Contamination @ ACL 2024

2407.03145 2024-07-04 cs.CL 89%

Enhancing Translation Accuracy of Large Language Models through Continual Pre-Training on Parallel Data

Minato Kondo, Takehito Utsuro, Masaaki Nagata

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments IWSLT2024, 18 pages

2406.13275 2024-06-26 cs.SD cs.CL eess.AS 89%

Enhancing Automated Audio Captioning via Large Language Models with Optimized Audio Encoding

Jizhong Liu, Gang Li, Junbo Zhang, Heinrich Dinkel, Yongqing Wang, Zhiyong Yan, Yujun Wang, Bin Wang

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by Interspeech 2024

2406.15720 2024-06-25 cs.CL 89%

Scaling Laws for Fact Memorization of Large Language Models

Xingyu Lu, Xiaonan Li, Qinyuan Cheng, Kai Ding, Xuanjing Huang, Xipeng Qiu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2406.13893 2024-06-21 cs.CL 89%

Open Generative Large Language Models for Galician

Pablo Gamallo, Pablo Rodríguez, Iria de-Dios-Flores, Susana Sotelo, Silvia Paniagua, Daniel Bardanca, José Ramom Pichel, Marcos Garcia

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments 12 pages, 1 figure

2406.13357 2024-06-21 cs.CL cs.SD eess.AS 89%

Transferable speech-to-text large language model alignment module

Boyong Wu, Chao Yan, Haoran Pu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；foundation model(abstract)；分类 cs.CL

Comments Accepted by InterSpeech 2024; 5 pages, 2 figures

2406.12397 2024-06-19 cs.CL 89%

Unveiling the Flaws: Exploring Imperfections in Synthetic Data and Mitigation Strategies for Large Language Models

Jie Chen, Yupeng Zhang, Bingning Wang, Wayne Xin Zhao, Ji-Rong Wen, Weipeng Chen

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 15 pages

2406.10274 2024-06-18 cs.IR cs.CL cs.DL 89%

Using General Large Language Models to Classify Mathematical Documents

Patrick D. F. Ion, Stephen M. Watt

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2402.19167 2024-06-14 cs.CL 89%

Teaching Large Language Models an Unseen Language on the Fly

Chen Zhang, Xiao Liu, Jiuheng Lin, Yansong Feng

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments ACL 2024 https://github.com/luciusssss/ZhuangBench

2406.04638 2024-06-10 cs.CL 89%

Large Language Model-guided Document Selection

Xiang Kong, Tom Gunter, Ruoming Pang

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 9 pages

2402.09363 2024-06-06 cs.CL cs.CR 89%

Copyright Traps for Large Language Models

Matthieu Meeus, Igor Shilov, Manuel Faysse, Yves-Alexandre de Montjoye

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 41st International Conference on Machine Learning (ICML 2024)

1. 预训练与数据 12318 篇

Formality is Favored: Unraveling the Learning Preferences of Large Language Models on Data with Conflicting Knowledge

Large Language Models for Propaganda Span Annotation

CS4: Measuring the Creativity of Large Language Models Automatically by Controlling the Number of Story-Writing Constraints

A Learning Rate Path Switching Training Paradigm for Version Updates of Large Language Models

Fishing for Magikarp: Automatically Detecting Under-trained Tokens in Large Language Models

Improving Diversity of Commonsense Generation by Large Language Models via In-Context Learning

DemoRank: Selecting Effective Demonstrations for Large Language Models in Ranking Task

Dated Data: Tracing Knowledge Cutoffs in Large Language Models

Zero-shot Audio Topic Reranking using Large Language Models

Exploiting the Vulnerability of Large Language Models via Defense-Aware Architectural Backdoor

Large Language Models Understand Layout

Genixer: Empowering Multimodal Large Language Models as a Powerful Data Generator

Generalizing Visual Question Answering from Synthetic to Human-Written Questions via a Chain of QA with a Large Language Model

MoE-LPR: Multilingual Extension of Large Language Models through Mixture-of-Experts with Language Priors Routing

Multimodal Large Language Models for Phishing Webpage Detection and Identification

Recognizing Emotion Regulation Strategies from Human Behavior with Large Language Models

Meltemi: The first open Large Language Model for Greek

Will the Real Linda Please Stand up...to Large Language Models? Examining the Representativeness Heuristic in LLMs

Non-Vacuous Generalization Bounds for Large Language Models

A Taxonomy for Data Contamination in Large Language Models

Enhancing Translation Accuracy of Large Language Models through Continual Pre-Training on Parallel Data

Enhancing Automated Audio Captioning via Large Language Models with Optimized Audio Encoding

Scaling Laws for Fact Memorization of Large Language Models

Open Generative Large Language Models for Galician

Transferable speech-to-text large language model alignment module

Unveiling the Flaws: Exploring Imperfections in Synthetic Data and Mitigation Strategies for Large Language Models

Using General Large Language Models to Classify Mathematical Documents

Teaching Large Language Models an Unseen Language on the Fly

Large Language Model-guided Document Selection

Copyright Traps for Large Language Models