语言大模型 / LLM - arXivDaily 专题

2412.04107 2025-04-29 cs.IR cs.AI 89%

Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Models

Yuhao Wang, Junwei Pan, Pengyue Jia, Wanyu Wang, Maolin Wang, Zhixiang Feng, Xiaotian Li, Jie Jiang, Xiangyu Zhao

机构 * City University of Hong Kong（香港城市大学）； Tencent Inc.（腾讯公司）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments accepted to SIGIR 2025

2504.17426 2025-04-25 cs.SE cs.AI 89%

Towards Leveraging Large Language Model Summaries for Topic Modeling in Source Code

Michele Carissimi, Martina Saletta, Claudio Ferretti

机构 * Dept. of Informatics, Systems and Communication, University of Milano-Bicocca（信息与通信系统系，米兰-比科卡大学）； Dept. of Human and Social Sciences, University of Bergamo（人文与社会科学系，贝拉戈莫大学）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2504.06011 2025-04-09 cs.CL 89%

Llama-3-Nanda-10B-Chat: An Open Generative Large Language Model for Hindi

Monojit Choudhury, Shivam Chauhan, Rocktim Jyoti Das, Dhruv Sahnan, Xudong Han, Haonan Li, Aaryamonvikram Singh, Alok Anil Jadhav, Utkarsh Agarwal, Mukund Choudhary, Debopriyo Banerjee, Fajri Koto, Junaid Bhat, Awantika Shukla, Samujjwal Ghosh, Samta Kamboj, Onkar Pandit, Lalit Pradhan, Rahul Pal, Sunil Sahu, Soundar Doraiswamy, Parvez Mullah, Ali El Filali, Neha Sengupta, Gokul Ramakrishnan, Rituraj Joshi, Gurpreet Gosal, Avraham Sheinin, Natalia Vassilieva, Preslav Nakov

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2503.20798 2025-03-28 cs.CR cs.AI 89%

Payload-Aware Intrusion Detection with CMAE and Large Language Models

Yongcheol Kim, Chanjae Lee, Young Yoon

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2411.04905 2025-03-21 cs.CL cs.PL 89%

OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

Siming Huang, Tianhao Cheng, J. K. Liu, Jiaran Hao, Liuyihan Song, Yang Xu, J. Yang, Jiaheng Liu, Chenchen Zhang, Linzheng Chai, Ruifeng Yuan, Zhaoxiang Zhang, Jie Fu, Qian Liu, Ge Zhang, Zili Wang, Yuan Qi, Yinghui Xu, Wei Chu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2503.12072 2025-03-18 cs.CL 89%

Information-Guided Identification of Training Data Imprint in (Proprietary) Large Language Models

Abhilasha Ravichander, Jillian Fisher, Taylor Sorensen, Ximing Lu, Yuchen Lin, Maria Antoniak, Niloofar Mireshghallah, Chandra Bhagavatula, Yejin Choi

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments NAACL 2025

2503.09645 2025-03-14 cs.GR cs.CL cs.CV 89%

Global Position Aware Group Choreography using Large Language Model

Haozhou Pang, Tianwei Ding, Lanshan He, Qi Gan

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2501.17202 2025-03-13 cs.SD cs.CL eess.AS 89%

Audio Large Language Models Can Be Descriptive Speech Quality Evaluators

Chen Chen, Yuchen Hu, Siyin Wang, Helin Wang, Zhehuai Chen, Chao Zhang, Chao-Han Huck Yang, Eng Siong Chng

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments ICLR 2025

2503.07493 2025-03-11 cs.CV cs.AI 89%

V2Flow: Unifying Visual Tokenization and Large Language Model Vocabularies for Autoregressive Image Generation

Guiwei Zhang, Tianyu Zhang, Mohan Zhou, Yalong Bai, Biye Li

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments 11 pages, 6 figures

2503.01659 2025-03-04 cs.CL 89%

Detecting Stylistic Fingerprints of Large Language Models

Yehonatan Bitton, Elad Bitton, Shai Nisan

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2412.07298 2025-03-04 cs.CL 89%

The Rise and Down of Babel Tower: Investigating the Evolution Process of Multilingual Code Large Language Model

Jiawei Chen, Wentao Chen, Jing Su, Jingjing Xu, Hongyu Lin, Mengjie Ren, Yaojie Lu, Xianpei Han, Le Sun

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to ICLR 2025

2502.16790 2025-02-25 cs.CL 89%

Are Large Language Models Good Data Preprocessors?

Elyas Meguellati, Nardiena Pratama, Shazia Sadiq, Gianluca Demartini

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2502.02481 2025-02-25 cs.CL 89%

Multilingual Machine Translation with Open Large Language Models at Practical Scale: An Empirical Study

Menglong Cui, Pengzhi Gao, Wei Liu, Jian Luan, Bin Wang

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments Accept to NAACL2025 Main Conference

2410.09817 2025-02-25 cs.CL 89%

Reverse Modeling in Large Language Models

Sicheng Yu, Yuanchen Xu, Cunxiao Du, Yanying Zhou, Minghui Qiu, Qianru Sun, Hao Zhang, Jiawei Wu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments NAACL 2025 Camera-ready Version

2502.13252 2025-02-20 cs.CL 89%

Multilingual Language Model Pretraining using Machine-translated Data

Jiayi Wang, Yao Lu, Maurice Weber, Max Ryabinin, David Adelani, Yihong Chen, Raphael Tang, Pontus Stenetorp

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；large language model(abstract)；分类 cs.CL

2501.16524 2025-01-29 cs.CL 89%

Programming by Examples Meets Historical Linguistics: A Large Language Model Based Approach to Sound Law Induction

Atharva Naik, Darsh Agrawal, Hong Sng, Clayton Marr, Kexun Zhang, Nathaniel R Robinson, Kalvin Chang, Rebecca Byrnes, Aravind Mysore, Carolyn Rose, David R Mortensen

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2501.08769 2025-01-28 cs.CL 89%

Enhanced Large Language Models for Effective Screening of Depression and Anxiety

June M. Liu, Mengxia Gao, Sahand Sabour, Zhuang Chen, Minlie Huang, Tatia M. C. Lee

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2412.20641 2024-12-31 cs.LG cs.CR 89%

SafeSynthDP: Leveraging Large Language Models for Privacy-Preserving Synthetic Data Generation Using Differential Privacy

Md Mahadi Hasan Nahid, Sadid Bin Hasan

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments 15 pages, 1 figure, 5 tables

2412.18626 2024-12-30 cs.CL 89%

Why Do Large Language Models (LLMs) Struggle to Count Letters?

Tairan Fu, Raquel Ferrando, Javier Conde, Carlos Arriaga, Pedro Reviriego

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2412.12956 2024-12-18 cs.CL 89%

SnakModel: Lessons Learned from Training an Open Danish Large Language Model

Mike Zhang, Max Müller-Eberstein, Elisa Bassignana, Rob van der Goot

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted at NoDaLiDa 2025 (oral)

2312.16044 2024-12-18 cs.AI 89%

LLMLight: Large Language Models as Traffic Signal Control Agents

Siqi Lai, Zhao Xu, Weijia Zhang, Hao Liu, Hui Xiong

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2409.12435 2024-12-16 cs.CL 89%

Linguistic Minimal Pairs Elicit Linguistic Similarity in Large Language Models

Xinyu Zhou, Delong Chen, Samuel Cahyawijaya, Xufeng Duan, Zhenguang G. Cai

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments COLING 2025

2412.05185 2024-12-12 cs.CV cs.LG cs.MM 89%

LinVT: Empower Your Image-level Large Language Model to Understand Videos

Lishuai Gao, Yujie Zhong, Yingsen Zeng, Haoxian Tan, Dengjie Li, Zheng Zhao

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2406.11248 2024-11-28 eess.AS cs.AI cs.SD 89%

Performance Improvement of Language-Queried Audio Source Separation Based on Caption Augmentation From Large Language Models for DCASE Challenge 2024 Task 9

Do Hyun Lee, Yoonah Song, Hong Kook Kim

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments DCASE 2024 Challenge Task 9, 4 pages

2411.14513 2024-11-25 cs.SE cs.CL 89%

Towards a Middleware for Large Language Models

Narcisa Guran, Florian Knauf, Man Ngo, Stefan Petrescu, Jan S. Rellermeyer

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2411.04448 2024-11-08 cs.CL 89%

Gradient Localization Improves Lifelong Pretraining of Language Models

Jared Fernandez, Yonatan Bisk, Emma Strubell

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；large language model(abstract)；分类 cs.CL

Comments EMNLP Findings 2024

2311.09180 2024-11-06 cs.CL cs.HC cs.IR 89%

Pearl: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrievers

Sheshera Mysore, Zhuoran Lu, Mengting Wan, Longqi Yang, Bahareh Sarrafzadeh, Steve Menezes, Tina Baghaee, Emmanuel Barajas Gonzalez, Jennifer Neville, Tara Safavi

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to Workshop on Customizable NLP at EMNLP 2024

2410.15226 2024-10-24 cs.CL 89%

On the Diversity of Synthetic Data and its Impact on Training Large Language Models

Hao Chen, Abdul Waheed, Xiang Li, Yidong Wang, Jindong Wang, Bhiksha Raj, Marah I. Abdin

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2410.17152 2024-10-23 cs.IR cs.CL 89%

Improving Pinterest Search Relevance Using Large Language Models

Han Wang, Mukuntha Narayanan Sundararaman, Onur Gungor, Yu Xu, Krishna Kamath, Rakesh Chalasani, Kurchi Subhra Hazra, Jinfeng Rao

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments CIKM 2024 Workshop on Industrial Recommendation Systems

2312.11075 2024-10-11 cs.CL 89%

Split and Rephrase with Large Language Models

David Ponce, Thierry Etchegoyhen, Jesús Calleja Pérez, Harritxu Gete

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

1. 预训练与数据 12318 篇

Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Models

Towards Leveraging Large Language Model Summaries for Topic Modeling in Source Code

Llama-3-Nanda-10B-Chat: An Open Generative Large Language Model for Hindi

Payload-Aware Intrusion Detection with CMAE and Large Language Models

OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

Information-Guided Identification of Training Data Imprint in (Proprietary) Large Language Models

Global Position Aware Group Choreography using Large Language Model

Audio Large Language Models Can Be Descriptive Speech Quality Evaluators

V2Flow: Unifying Visual Tokenization and Large Language Model Vocabularies for Autoregressive Image Generation

Detecting Stylistic Fingerprints of Large Language Models

The Rise and Down of Babel Tower: Investigating the Evolution Process of Multilingual Code Large Language Model

Are Large Language Models Good Data Preprocessors?

Multilingual Machine Translation with Open Large Language Models at Practical Scale: An Empirical Study

Reverse Modeling in Large Language Models

Multilingual Language Model Pretraining using Machine-translated Data

Programming by Examples Meets Historical Linguistics: A Large Language Model Based Approach to Sound Law Induction

Enhanced Large Language Models for Effective Screening of Depression and Anxiety

SafeSynthDP: Leveraging Large Language Models for Privacy-Preserving Synthetic Data Generation Using Differential Privacy

Why Do Large Language Models (LLMs) Struggle to Count Letters?

SnakModel: Lessons Learned from Training an Open Danish Large Language Model

LLMLight: Large Language Models as Traffic Signal Control Agents

Linguistic Minimal Pairs Elicit Linguistic Similarity in Large Language Models

LinVT: Empower Your Image-level Large Language Model to Understand Videos

Performance Improvement of Language-Queried Audio Source Separation Based on Caption Augmentation From Large Language Models for DCASE Challenge 2024 Task 9

Towards a Middleware for Large Language Models

Gradient Localization Improves Lifelong Pretraining of Language Models

Pearl: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrievers

On the Diversity of Synthetic Data and its Impact on Training Large Language Models

Improving Pinterest Search Relevance Using Large Language Models

Split and Rephrase with Large Language Models