语言大模型 / LLM - arXivDaily 专题

2501.13720 2025-02-04 cs.CL cs.AI cs.SD eess.AS 88%

Musical ethnocentrism in Large Language Models

Anna Kruspe

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Journal ref Proceedings of the 3rd Workshop on NLP for Music and Audio (NLP4MusA) 2024

2411.15287 2025-01-30 cs.CL cs.AI 88%

Sycophancy in Large Language Models: Causes and Mitigations

Lars Malmqvist

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Journal ref Computing Conference 2025 (upcoming)

2501.16247 2025-01-28 cs.LG cs.CL 88%

Zero-Shot Decision Tree Construction via Large Language Models

Lucas Carrasco, Felipe Urrutia, Andrés Abeliuk

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2501.14818 2025-01-28 cs.CV cs.AI cs.LG 88%

Eagle 2: Building Post-Training Data Strategies from Scratch for Frontier Vision-Language Models

Zhiqi Li, Guo Chen, Shilong Liu, Shihao Wang, Vibashan VS, Yishen Ji, Shiyi Lan, Hao Zhang, Yilin Zhao, Subhashree Radhakrishnan, Nadine Chang, Karan Sapra, Amala Sanjay Deshmukh, Tuomas Rintamaki, Matthieu Le, Ilia Karmanov, Lukas Voegtle, Philipp Fischer, De-An Huang, Timo Roman, Tong Lu, Jose M. Alvarez, Bryan Catanzaro, Jan Kautz, Andrew Tao, Guilin Liu, Zhiding Yu

专题命中预训练与数据：language model(title,abstract)；post-training(title,abstract)；分类 cs.AI、cs.LG

2501.11747 2025-01-27 cs.CL cs.AI 88%

Optimizing Pretraining Data Mixtures with LLM-Estimated Utility

William Held, Bhargavi Paranjape, Punit Singh Koura, Mike Lewis, Frank Zhang, Todor Mihaylov

专题命中预训练与数据：LLM(title)；pretraining(title)；large language model(abstract)；language model(abstract)

Comments 10 pages, 8 figures

2412.14670 2024-12-20 cs.CL cs.AI 88%

Analysis and Visualization of Linguistic Structures in Large Language Models: Neural Representations of Verb-Particle Constructions in BERT

Hassane Kissane, Achim Schilling, Patrick Krauss

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2412.07144 2024-12-16 cs.AI cs.CL 88%

Political Actor Agent: Simulating Legislative System for Roll Call Votes Prediction with Large Language Models

Hao Li, Ruoyuan Gong, Hao Jiang

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted at AAAI 2025

2412.08846 2024-12-13 cs.CL cs.AI 88%

Exploring Large Language Models on Cross-Cultural Values in Connection with Training Methodology

Minsang Kim, Seungjun Baek

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2401.15861 2024-12-11 cs.CL cs.AI 88%

BPDec: Unveiling the Potential of Masked Language Modeling Decoder in BERT pretraining

Wen Liang, Youzhi Liang

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.AI

2411.12240 2024-11-27 cs.CL cs.AI 88%

Evaluating Tokenizer Performance of Large Language Models Across Official Indian Languages

S. Tamang, D. J. Bora

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2403.11793 2024-11-26 cs.CL cs.AI cs.ET cs.SC 88%

Reasoning Abilities of Large Language Models: In-Depth Analysis on the Abstraction and Reasoning Corpus

Seungpil Lee, Woochang Sim, Donghyeon Shin, Wongyu Seo, Jiwon Park, Seokki Lee, Sanha Hwang, Sejin Kim, Sundong Kim

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2411.06402 2024-11-12 cs.CL cs.AI 88%

Fineweb-Edu-Ar: Machine-translated Corpus to Support Arabic Small Language Models

Sultan Alrashed, Dmitrii Khizbullin, David R. Pugh

专题命中预训练与数据：language model(title,abstract)；small language model(title)；large language model(abstract)；分类 cs.CL、cs.AI

2406.16148 2024-11-08 cs.SD cs.AI cs.LG eess.AS 88%

Towards Open Respiratory Acoustic Foundation Models: Pretraining and Benchmarking

Yuwei Zhang, Tong Xia, Jing Han, Yu Wu, Georgios Rizos, Yang Liu, Mohammed Mosuily, Jagmohan Chauhan, Cecilia Mascolo

专题命中预训练与数据：foundation model(title,abstract)；pretraining(title,abstract)；分类 cs.AI、cs.LG

Comments accepted by NeurIPS 2024 Track Datasets and Benchmarks

2411.03340 2024-11-07 cs.CV cs.CL cs.DL cs.LG 88%

Unlocking the Archives: Using Large Language Models to Transcribe Handwritten Historical Documents

Mark Humphries, Lianne C. Leddy, Quinn Downton, Meredith Legace, John McConnell, Isabella Murray, Elizabeth Spence

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments 29 Pages, 11 Tables, 2 Figures

2410.20340 2024-10-29 cs.CL cs.AI 88%

Maintaining Informative Coherence: Migrating Hallucinations in Large Language Models via Absorbing Markov Chains

Jiemin Wu, Songning Lai, Ruiqiang Xiao, Tianlang Xue, Jiayu Yang, Yutao Yue

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2410.13298 2024-10-18 cs.CL cs.AI 88%

Advancing Large Language Model Attribution through Self-Improving

Lei Huang, Xiaocheng Feng, Weitao Ma, Liang Zhao, Yuchun Fan, Weihong Zhong, Dongliang Xu, Qing Yang, Hongtao Liu, Bing Qin

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by EMNLP 2024 Main Conference

2410.05661 2024-10-10 cs.LG cs.AI 88%

Scaling Laws Across Model Architectures: A Comparative Analysis of Dense and MoE Models in Large Language Models

Siqi Wang, Zhengyu Chen, Bei Li, Keqing He, Min Zhang, Jingang Wang

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

2410.03568 2024-10-07 cs.CL cs.LG 88%

Towards Linguistically-Aware and Language-Independent Tokenization for Large Language Models (LLMs)

Abrar Rahman, Garry Bowlin, Binit Mohanty, Sean McGunigal

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2301.02458 2024-08-27 cs.CL cs.LG 88%

Topics as Entity Clusters: Entity-based Topics from Large Language Models and Graph Neural Networks

Manuel V. Loureiro, Steven Derby, Tri Kurniawan Wijaya

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments 16 pages, 1 figure. Accepted in LREC-COLING 2024

Journal ref https://aclanthology.org/2024.lrec-main.1418/

2402.10892 2024-08-20 cs.CR cs.CL cs.LG 88%

Proving membership in LLM pretraining data via data watermarks

Johnny Tian-Zheng Wei, Ryan Yixiang Wang, Robin Jia

专题命中预训练与数据：LLM(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.LG

Comments Findings of ACL 2024

2311.07032 2024-08-13 cs.CL cs.AI 88%

ExpNote: Black-box Large Language Models are Better Task Solvers with Experience Notebook

Wangtao Sun, Xuanqing Yu, Shizhu He, Jun Zhao, Kang Liu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments EMNLP 2023 findings

2408.03119 2024-08-07 cs.CL cs.AI 88%

Evaluating the Translation Performance of Large Language Models Based on Euas-20

Yan Huang, Wei Liu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 15 pages, 8 figures

2407.12813 2024-07-23 cs.CL cs.AI 88%

Data Generation Using Large Language Models for Text Classification: An Empirical Case Study

Yinheng Li, Rogerio Bonatti, Sara Abdali, Justin Wagle, Kazuhito Koishida

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by DMLR @ ICML 2024

2407.12141 2024-07-18 cs.CL cs.AI 88%

Predicting Emotion Intensity in Polish Political Texts: Comparing Supervised Models and Large Language Models in a Resource-Poor Language

Hubert Plisiecki, Piotr Koc, Maria Flakus, Artur Pokropek

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments The Appendix is located at the very bottom of the manuscript

2407.07551 2024-07-11 cs.CL cs.AI 88%

Arabic Automatic Story Generation with Large Language Models

Ahmed Oumar El-Shangiti, Fakhraddin Alwajih, Muhammad Abdul-Mageed

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2401.07237 2024-07-03 cs.CL cs.AI 88%

Distilling Event Sequence Knowledge From Large Language Models

Somin Wadhwa, Oktie Hassanzadeh, Debarun Bhattacharjya, Ken Barker, Jian Ni

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments In Proceedings of 23rd International Semantic Web Conference (ISWC), 2024

2406.19853 2024-07-01 cs.CL cs.AI 88%

YuLan: An Open-source Large Language Model

Yutao Zhu, Kun Zhou, Kelong Mao, Wentong Chen, Yiding Sun, Zhipeng Chen, Qian Cao, Yihan Wu, Yushuo Chen, Feng Wang, Lei Zhang, Junyi Li, Xiaolei Wang, Lei Wang, Beichen Zhang, Zican Dong, Xiaoxue Cheng, Yuhan Chen, Xinyu Tang, Yupeng Hou, Qiangqiang Ren, Xincheng Pang, Shufang Xie, Wayne Xin Zhao, Zhicheng Dou, Jiaxin Mao, Yankai Lin, Ruihua Song, Jun Xu, Xu Chen, Rui Yan, Zhewei Wei, Di Hu, Wenbing Huang, Ze-Feng Gao, Yueguo Chen, Weizheng Lu, Ji-Rong Wen

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2306.12656 2024-06-28 cs.CL cs.AI 88%

Identifying and Extracting Rare Disease Phenotypes with Large Language Models

Cathy Shyr, Yan Hu, Paul A. Harris, Hua Xu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Journal ref J Healthc Inform Res 8, 438-461 (2024)

2406.15996 2024-06-25 cs.CL cs.AI 88%

Memorizing Documents with Guidance in Large Language Models

Bumjin Park, Jaesik Choi

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments IJCAI 2024

2406.06455 2024-06-17 cs.AI cs.CL 88%

A Large Language Model Pipeline for Breast Cancer Oncology

Tristen Pool, Dennis Trujillo

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

1. 预训练与数据 12353 篇

Musical ethnocentrism in Large Language Models

Sycophancy in Large Language Models: Causes and Mitigations

Zero-Shot Decision Tree Construction via Large Language Models

Eagle 2: Building Post-Training Data Strategies from Scratch for Frontier Vision-Language Models

Optimizing Pretraining Data Mixtures with LLM-Estimated Utility

Analysis and Visualization of Linguistic Structures in Large Language Models: Neural Representations of Verb-Particle Constructions in BERT

Political Actor Agent: Simulating Legislative System for Roll Call Votes Prediction with Large Language Models

Exploring Large Language Models on Cross-Cultural Values in Connection with Training Methodology

BPDec: Unveiling the Potential of Masked Language Modeling Decoder in BERT pretraining

Evaluating Tokenizer Performance of Large Language Models Across Official Indian Languages

Reasoning Abilities of Large Language Models: In-Depth Analysis on the Abstraction and Reasoning Corpus

Fineweb-Edu-Ar: Machine-translated Corpus to Support Arabic Small Language Models

Towards Open Respiratory Acoustic Foundation Models: Pretraining and Benchmarking

Unlocking the Archives: Using Large Language Models to Transcribe Handwritten Historical Documents

Maintaining Informative Coherence: Migrating Hallucinations in Large Language Models via Absorbing Markov Chains

Advancing Large Language Model Attribution through Self-Improving

Scaling Laws Across Model Architectures: A Comparative Analysis of Dense and MoE Models in Large Language Models

Towards Linguistically-Aware and Language-Independent Tokenization for Large Language Models (LLMs)

Topics as Entity Clusters: Entity-based Topics from Large Language Models and Graph Neural Networks

Proving membership in LLM pretraining data via data watermarks

ExpNote: Black-box Large Language Models are Better Task Solvers with Experience Notebook

Evaluating the Translation Performance of Large Language Models Based on Euas-20

Data Generation Using Large Language Models for Text Classification: An Empirical Case Study

Predicting Emotion Intensity in Polish Political Texts: Comparing Supervised Models and Large Language Models in a Resource-Poor Language

Arabic Automatic Story Generation with Large Language Models

Distilling Event Sequence Knowledge From Large Language Models

YuLan: An Open-source Large Language Model

Identifying and Extracting Rare Disease Phenotypes with Large Language Models

Memorizing Documents with Guidance in Large Language Models

A Large Language Model Pipeline for Breast Cancer Oncology