语言大模型 / LLM - arXivDaily 专题

2407.15362 2025-03-26 cs.CV cs.AI 83%

A Multimodal Knowledge-enhanced Whole-slide Pathology Foundation Model

Yingxue Xu, Yihui Wang, Fengtao Zhou, Jiabo Ma, Cheng Jin, Shu Yang, Jinbang Li, Zhengyu Zhang, Chenglong Zhao, Huajun Zhou, Zhenhui Li, Huangjing Lin, Xin Wang, Jiguang Wang, Anjia Han, Ronald Cheong Kin Chan, Li Liang, Xiuming Zhang, Hao Chen

专题命中预训练与数据：foundation model(title,abstract)；pretraining(abstract)；分类 cs.AI

Comments 62 pages

2412.21124 2025-03-18 cs.LG math.OC stat.ML 83%

Adaptive Batch Size Schedules for Distributed Training of Language Models with Data and Model Parallelism

Tim Tsz-Kit Lau, Weijian Li, Chenwei Xu, Han Liu, Mladen Kolar

专题命中预训练与数据：language model(title,abstract)；pretraining(abstract)；分类 cs.LG

Comments The Second Conference on Parsimony and Learning (CPAL; Proceedings Track), March 2025, Stanford, CA

2406.04927 2025-03-18 eess.AS cs.CL 83%

LLM-based speaker diarization correction: A generalizable approach

Georgios Efstathiadis, Vijay Yadav, Anzar Abbas

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL

Journal ref Speech Communication, Volume 170, 2025, Page 103224

2411.04986 2025-03-12 cs.CL 83%

The Semantic Hub Hypothesis: Language Models Share Semantic Representations Across Languages and Modalities

Zhaofeng Wu, Xinyan Velocity Yu, Dani Yogatama, Jiasen Lu, Yoon Kim

专题命中预训练与数据：language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments ICLR 2025

2503.02328 2025-03-05 cs.CL cs.CY cs.HC cs.SI 83%

Limited Effectiveness of LLM-based Data Augmentation for COVID-19 Misinformation Stance Detection

Eun Cheol Choi, Ashwin Balasubramanian, Jinhu Qi, Emilio Ferrara

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL

2502.11965 2025-03-04 eess.SP cs.AI 83%

A MIMO Wireless Channel Foundation Model via CIR-CSI Consistency

Jun Jiang, Wenjun Yu, Yunfan Li, Yuan Gao, Shugong Xu

专题命中预训练与数据：foundation model(title,abstract)；pretraining(abstract)；分类 cs.AI

Comments 6 pages, 2025 ICMLCN accepted

2409.02841 2025-02-26 cs.CL 83%

Historical German Text Normalization Using Type- and Token-Based Language Modeling

Anton Ehrmanntraut

专题命中预训练与数据：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments 27 pages, 3 figures; minor editorial changes

2502.17464 2025-02-26 eess.SP cs.LG q-bio.NC 83%

Large Cognition Model: Towards Pretrained EEG Foundation Model

Chi-Sheng Chen, Ying-Jung Chen, Aidan Hung-Wen Tsai

专题命中预训练与数据：foundation model(title,abstract)；pretraining(abstract)；分类 cs.LG

2502.11830 2025-02-21 cs.CL 83%

Text Classification in the LLM Era -- Where do we stand?

Sowmya Vajjala, Shwetali Shimangaud

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Pre-print

2410.16505 2025-02-21 cs.SD cs.LG eess.AS 83%

Do Audio-Language Models Understand Linguistic Variations?

Ramaneswaran Selvakumar, Sonal Kumar, Hemant Kumar Giri, Nishit Anand, Ashish Seth, Sreyan Ghosh, Dinesh Manocha

专题命中预训练与数据：language model(title,abstract)；pretraining(abstract)；分类 cs.LG

Comments Accepted to NAACL 2025

2502.11831 2025-02-18 cs.CV cs.AI 83%

Intuitive physics understanding emerges from self-supervised pretraining on natural videos

Quentin Garrido, Nicolas Ballas, Mahmoud Assran, Adrien Bardes, Laurent Najman, Michael Rabbat, Emmanuel Dupoux, Yann LeCun

专题命中预训练与数据：pretraining(title)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 24 pages,14 figures, 5 tables

2502.10140 2025-02-17 cs.CL 83%

Small Models, Big Impact: Efficient Corpus and Graph-Based Adaptation of Small Multilingual Language Models for Low-Resource Languages

Daniil Gurgurov, Ivan Vykopal, Josef van Genabith, Simon Ostermann

专题命中预训练与数据：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments Pre-print

2502.08515 2025-02-13 cs.LG 83%

The Paradox of Stochasticity: Limited Creativity and Computational Decoupling in Temperature-Varied LLM Outputs of Structured Fictional Data

Evgenii Evstafev

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.LG

Comments 8 pages, 6 figures

2502.00996 2025-02-04 cs.CL 83%

Self-supervised Analogical Learning using Language Models

Ben Zhou, Sarthak Jain, Yi Zhang, Qiang Ning, Shuai Wang, Yassine Benajiba, Dan Roth

专题命中预训练与数据：language model(title,abstract)；large language model(abstract)；分类 cs.CL

2502.00344 2025-02-04 cs.CL 83%

FinchGPT: a Transformer based language model for birdsong analysis

Kosei Kobayashi, Kosuke Matsuzaki, Masaya Taniguchi, Keisuke Sakaguchi, Kentaro Inui, Kentaro Abe

专题命中预训练与数据：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments 12 pages, 4 figures

2412.14528 2025-01-22 cs.CL 83%

Multi-Level Optimal Transport for Universal Cross-Tokenizer Knowledge Distillation on Language Models

Xiao Cui, Mo Zhu, Yulei Qin, Liang Xie, Wengang Zhou, Houqiang Li

专题命中预训练与数据：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments Accepted by AAAI 2025 (Oral)

2501.04858 2025-01-10 cs.CL 83%

Advancing Retrieval-Augmented Generation for Persian: Development of Language Models, Comprehensive Benchmarks, and Best Practices for Optimization

Sara Bourbour Hosseinbeigi, Sina Asghari, Mohammad Ali Seif Kashani, Mohammad Hossein Shalchian, Mohammad Amin Abbasi

专题命中预训练与数据：language model(title,abstract)；pretraining(abstract)；分类 cs.CL

2412.00395 2024-12-18 cs.LG cs.RO stat.ML 83%

On Foundation Models for Dynamical Systems from Purely Synthetic Data

Martin Ziegler, Andres Felipe Posada-Moreno, Friedrich Solowjow, Sebastian Trimpe

专题命中预训练与数据：foundation model(title,abstract)；pretraining(abstract)；分类 cs.LG

Comments 10 pages

2405.09913 2024-12-17 cs.CL 83%

TransMI: A Framework to Create Strong Baselines from Multilingual Pretrained Language Models for Transliterated Data

Yihong Liu, Chunlan Ma, Haotian Ye, Hinrich Schütze

专题命中预训练与数据：language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments COLING 2025

2409.02391 2024-12-10 econ.GN cs.AI q-fin.EC 83%

Scaling Laws for Economic Productivity: Experimental Evidence in LLM-Assisted Translation

Ali Merali

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.AI

2406.15275 2024-12-09 cs.CL 83%

How language models extrapolate outside the training data: A case study in Textualized Gridworld

Doyoung Kim, Jongwon Lee, Jinho Park, Minjoon Seo

专题命中预训练与数据：language model(title,abstract)；prompting(abstract)；分类 cs.CL

2411.15500 2024-11-26 cs.ET cs.CL 83%

MolMetaLM: a Physicochemical Knowledge-Guided Molecular Meta Language Model

Yifan Wu, Min Zeng, Yang Li, Yang Zhang, Min Li

专题命中预训练与数据：language model(title,abstract)；pretraining(abstract)；分类 cs.CL

2407.17616 2024-11-21 cs.LG 83%

Pretraining a Neural Operator in Lower Dimensions

AmirPouya Hemmasian, Amir Barati Farimani

专题命中预训练与数据：pretraining(title,abstract)；language model(abstract)；分类 cs.LG

2406.03816 2024-11-19 cs.CL 83%

ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search

Dan Zhang, Sining Zhoubian, Ziniu Hu, Yisong Yue, Yuxiao Dong, Jie Tang

专题命中预训练与数据：LLM(title,abstract)；language model(abstract)；分类 cs.CL

Comments Accepted to NeurIPS 2024

2411.09996 2024-11-18 eess.SP cs.AI cs.NI 83%

Building 6G Radio Foundation Models with Transformer Architectures

Ahmed Aboulfotouh, Ashkan Eshaghbeigi, Hatem Abou-Zeid

专题命中预训练与数据：foundation model(title,abstract)；pretraining(abstract)；分类 cs.AI

2401.03735 2024-11-15 cs.CL 83%

Language Models Encode the Value of Numbers Linearly

Fangwei Zhu, Damai Dai, Zhifang Sui

专题命中预训练与数据：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments The code and data are available at https://github.com/solitaryzero/NumProbe

2411.05489 2024-11-11 cs.LG cs.CV 83%

Do Histopathological Foundation Models Eliminate Batch Effects? A Comparative Study

Jonah Kömen, Hannah Marienwald, Jonas Dippel, Julius Hense

专题命中预训练与数据：foundation model(title,abstract)；pretraining(abstract)；分类 cs.LG

Comments Accepted to AIM-FM Workshop @ NeurIPS'24

2411.04642 2024-11-08 cs.CV cs.AI 83%

TAP-VL: Text Layout-Aware Pre-training for Enriched Vision-Language Models

Jonathan Fhima, Elad Ben Avraham, Oren Nuriel, Yair Kittenplon, Roy Ganz, Aviad Aberdam, Ron Litman

专题命中预训练与数据：language model(title)；LLM(abstract)；pretraining(abstract)；分类 cs.AI

2410.19965 2024-10-29 cs.CV cs.AI cs.DC 83%

OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagery

Philipe Dias, Aristeidis Tsaris, Jordan Bowman, Abhishek Potnis, Jacob Arndt, H. Lexie Yang, Dalton Lunga

专题命中预训练与数据：foundation model(title,abstract)；pretraining(abstract)；分类 cs.AI

Journal ref The 32nd ACM International Conference on Advances in Geographic Information Systems (SIGSPATIAL 24), October 29-November 1, 2024, Atlanta, GA, USA. ACM, New York, NY, USA, 4 pages

2410.19290 2024-10-28 cs.CL 83%

Fictitious Synthetic Data Can Improve LLM Factuality via Prerequisite Learning

Yujian Liu, Shiyu Chang, Tommi Jaakkola, Yang Zhang

专题命中预训练与数据：LLM(title,abstract)；SFT(abstract)；分类 cs.CL

1. 预训练与数据 12379 篇

A Multimodal Knowledge-enhanced Whole-slide Pathology Foundation Model

Adaptive Batch Size Schedules for Distributed Training of Language Models with Data and Model Parallelism

LLM-based speaker diarization correction: A generalizable approach

The Semantic Hub Hypothesis: Language Models Share Semantic Representations Across Languages and Modalities

Limited Effectiveness of LLM-based Data Augmentation for COVID-19 Misinformation Stance Detection

A MIMO Wireless Channel Foundation Model via CIR-CSI Consistency

Historical German Text Normalization Using Type- and Token-Based Language Modeling

Large Cognition Model: Towards Pretrained EEG Foundation Model

Text Classification in the LLM Era -- Where do we stand?

Do Audio-Language Models Understand Linguistic Variations?

Intuitive physics understanding emerges from self-supervised pretraining on natural videos

Small Models, Big Impact: Efficient Corpus and Graph-Based Adaptation of Small Multilingual Language Models for Low-Resource Languages

The Paradox of Stochasticity: Limited Creativity and Computational Decoupling in Temperature-Varied LLM Outputs of Structured Fictional Data

Self-supervised Analogical Learning using Language Models

FinchGPT: a Transformer based language model for birdsong analysis

Multi-Level Optimal Transport for Universal Cross-Tokenizer Knowledge Distillation on Language Models

Advancing Retrieval-Augmented Generation for Persian: Development of Language Models, Comprehensive Benchmarks, and Best Practices for Optimization

On Foundation Models for Dynamical Systems from Purely Synthetic Data

TransMI: A Framework to Create Strong Baselines from Multilingual Pretrained Language Models for Transliterated Data

Scaling Laws for Economic Productivity: Experimental Evidence in LLM-Assisted Translation

How language models extrapolate outside the training data: A case study in Textualized Gridworld

MolMetaLM: a Physicochemical Knowledge-Guided Molecular Meta Language Model

Pretraining a Neural Operator in Lower Dimensions

ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search

Building 6G Radio Foundation Models with Transformer Architectures

Language Models Encode the Value of Numbers Linearly

Do Histopathological Foundation Models Eliminate Batch Effects? A Comparative Study

TAP-VL: Text Layout-Aware Pre-training for Enriched Vision-Language Models

OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagery

Fictitious Synthetic Data Can Improve LLM Factuality via Prerequisite Learning