语言大模型 / LLM

ICH-Qwen: A Large Language Model Towards Chinese Intangible Cultural Heritage

Wenhao Ye, Tiansheng Zheng, Yue Qi, Wenhua Zhao, Xiyu Wang, Xue Zhao, Jiacheng He, Yaya Zheng, Dongbo Wang

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 16 pages, 2 figures

Leveraging Encoder-only Large Language Models for Mobile App Review Feature Extraction

Quim Motger, Alessio Miaschi, Felice Dell'Orletta, Xavier Franch, Jordi Marco

机构 * Universitat Politècnica de Catalunya, Department of Service and Information System Engineering（巴塞罗那理工大学服务与信息系统工程系） ； Universitat Politècnica de Catalunya, Department of Computer Science（巴塞罗那理工大学计算机科学系） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 46 pages, 7 tables, 11 figures

Rethinking Data Mixture for Large Language Models: A Comprehensive Survey and New Perspectives

Yajiao Liu, Congliang Chen, Junchi Yang, Ruoyu Sun

机构 * The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳）） ； Shenzhen Research Institute of Big Data（深圳大数据研究院） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments The first version of this paper was submitted to ACL ARR 2025 February Submission

Semantic Pivots Enable Cross-Lingual Transfer in Large Language Models

Kaiyu He, Tong Zhou, Yubo Chen, Delai Qiu, Shengping Liu, Kang Liu, Jun Zhao

机构 * The Key Laboratory of Cognition and Decision Intelligence for Complex Systems Institute of Automation, Chinese Academy of Sciences（认知与决策智能复杂系统重点实验室，中国科学院自动化研究所） ； School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院） ； University of Science and Technology Beijing（北京科技大学） ； Unisound Al Technology Co,Ltd（Unisound人工智能技术有限公司） ； Shanghai Artificial Intelligence Laboratory（上海人工智能实验室） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 14 pages, 10 figures

MAS-KCL: Knowledge component graph structure learning with large language model-based agentic workflow

Yuan-Hao Jiang, Kezong Tang, Zi-Wei Chen, Yuang Wei, Tian-Yi Liu, Jiayi Wu

机构 * Shanghai Institute of Artificial Intelligence for Education, East China Normal University, Shanghai, China（上海教育人工智能研究院，华东师范大学，上海，中国） ； School of Computer Science and Technology, East China Normal University, Shanghai, China（华东师范大学计算机科学与技术学院，上海，中国） ； Lab of Artificial Intelligence for Education, East China Normal University, Shanghai, China（教育人工智能实验室，华东师范大学，上海，中国） ； Graduate School, Shanghai Jiao Tong University, Shanghai, China（上海交通大学研究生院，上海，中国） ； School of Information Engineering, Jingdezhen Ceramic University, Jingdezhen, China（景德镇陶瓷大学信息工程学院，景德镇，中国） ； School of Computer, Jiangsu University of Science and Technology, Zhenjiang, China（江苏科技大学计算机学院，镇江，中国） ； Department of Educational Information Technology, East China Normal University, Shanghai, China（教育信息技术系，华东师范大学，上海，中国） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments In CGI 2025: 42nd Computer Graphics International Conference, Kowloon, Hong Kong, Peper No. 134

RN-F: A Novel Approach for Mitigating Contaminated Data in Large Language Models

Le Vu Anh, Dinh Duc Nha Nguyen, Phi Long Nguyen

机构 * TinyAI Research（TinyAI研究所） ； Center for Environmental Intelligence（环境智能中心） ； College of Engineering & Computer Science（工程与计算机科学学院） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments 12 pages, 4 figures, 3 tables

Have Multimodal Large Language Models (MLLMs) Really Learned to Tell the Time on Analog Clocks?

Tairan Fu, Miguel González, Javier Conde, Elena Merino-Gómez, Pedro Reviriego

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 6 pages, 5 figures, 2 tables

Optimized Couplings for Watermarking Large Language Models

Dor Tsur, Carol Xuan Long, Claudio Mayrink Verdun, Hsiang Hsu, Haim Permuter, Flavio P. Calmon

机构 * Ben Gurion University（本· Gurion 大学） ； Harvard University（哈佛大学） ； JPMorganChase（摩根大通） 纠错

专题命中 预训练与数据 ：language model(title,abstract)；large language model(title)；LLM(abstract)；分类 cs.AI

Comments Accepted at ISIT25

BadLingual: A Novel Lingual-Backdoor Attack against Large Language Models

Zihan Wang, Hongwei Li, Rui Zhang, Wenbo Jiang, Kangjie Chen, Tianwei Zhang, Qingchuan Zhao, Guowen Xu

机构 * University of Electronic Science and Technology of China（电子科技大学） ； Nanyang Technological University（南洋理工大学） ； City University of Hong Kong（香港城市大学） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Synthline: A Product Line Approach for Synthetic Requirements Engineering Data Generation using Large Language Models

Abdelkarim El-Hajjami, Camille Salinesi

机构 * Paris 1 Panthéon–Sorbonne University（巴黎1 Panthéon–Sorbonne大学） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Investigating Literary Motifs in Ancient and Medieval Novels with Large Language Models

Emelie Hallenberg

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

The Paradox of Poetic Intent in Back-Translation: Evaluating the Quality of Large Language Models in Chinese Translation

Li Weigang, Pedro Carvalho Brom

机构 * Computer Science Department University of Brasilia（布拉兹利亚大学计算机科学系） ； Math Department Federal Institute of Brasilia（布拉兹利亚联邦学院数学系） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 24 pages, 3 figures

Multilingual Large Language Models and Curse of Multilinguality

Daniil Gurgurov, Tanja Bäumel, Tatiana Anikina

机构 * Universität des Saarlandes（萨尔兰大学） ； German Research Center for Artificial Intelligence (DFKI)（德国人工智能研究中心） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Large corpora and large language models: a replicable method for automating grammatical annotation

Cameron Morin, Matti Marttinen Larsson

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Journal ref Linguistics Vanguard, 1-10 (2025)

DEEM: Diffusion Models Serve as the Eyes of Large Language Models for Image Perception

Run Luo, Yunshui Li, Longze Chen, Wanwei He, Ting-En Lin, Ziqiang Liu, Lei Zhang, Zikai Song, Xiaobo Xia, Tongliang Liu, Min Yang, Binyuan Hui

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 25 pages. arXiv admin note: text overlap with arXiv:2401.10208 by other authors

Policy-as-Prompt: Rethinking Content Moderation in the Age of Large Language Models

Konstantina Palla, José Luis Redondo García, Claudia Hauff, Francesco Fabbri, Henrik Lindström, Daniel R. Taber, Andreas Damianou, Mounia Lalmas

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 14 pages, 5 figures

WarriorCoder: Learning from Expert Battles to Augment Code Large Language Models

Huawen Feng, Pu Zhao, Qingfeng Sun, Can Xu, Fangkai Yang, Lu Wang, Qianli Ma, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Qi Zhang

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Why Are My Prompts Leaked? Unraveling Prompt Extraction Threats in Customized Large Language Models

Zi Liang, Haibo Hu, Qingqing Ye, Yaxin Xiao, Haoyang Li

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Source Code: https://github.com/liangzid/PromptExtractionEval

A Recipe of Parallel Corpora Exploitation for Multilingual Large Language Models

Peiqin Lin, André F. T. Martins, Hinrich Schütze

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments NAACL 2025 Findings

Are Large Language Models a Threat to Digital Public Goods? Evidence from Activity on Stack Overflow

Maria del Rio-Chanona, Nadzeya Laurentsyeva, Johannes Wachs

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Knowledge-Aware Query Expansion with Large Language Models for Textual and Relational Retrieval

Yu Xia, Junda Wu, Sungchul Kim, Tong Yu, Ryan A. Rossi, Haoliang Wang, Julian McAuley

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments NAACL 2025

Evaluating Large Language Models along Dimensions of Language Variation: A Systematik Invesdigatiom uv Cross-lingual Generalization

Niyati Bafna, Kenton Murray, David Yarowsky

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 21 pages. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing

ResoFilter: Fine-grained Synthetic Data Filtering for Large Language Models through Data-Parameter Resonance Analysis

Zeao Tu, Xiangdi Meng, Yu He, Zihan Yao, Tianyu Qi, Jun Liu, Ming Li

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted by NAACL 2025 Findings

The Impact of Copyrighted Material on Large Language Models: A Norwegian Perspective

Javier de la Rosa, Vladislav Mikhailov, Lemei Zhang, Freddy Wetjen, David Samuel, Peng Liu, Rolv-Arild Braaten, Petter Mæhlum, Magnus Breder Birkenes, Andrey Kutuzov, Tita Enstad, Hans Christian Farsethås, Svein Arne Brygfjeld, Jon Atle Gulla, Stephan Oepen, Erik Velldal, Wilfred Østgulen, Liljia Øvrelid, Aslak Sira Myhre

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 17 pages, 5 figures, 8 tables. Accepted at NoDaLiDa/Baltic-HLT 2025

Leveraging Open-Source Large Language Models for Native Language Identification

Yee Man Ng, Ilia Markov

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

An Active Learning Framework for Inclusive Generation by Large Language Models

Sabit Hassan, Anthony Sicilia, Malihe Alikhani

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments COLING, 2025

Pretraining Vision-Language Model for Difference Visual Question Answering in Longitudinal Chest X-rays

Yeongjae Cho, Taehee Kim, Heejun Shin, Sungzoon Cho, Dongmyung Shin

专题命中 预训练与数据 ：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL

Depression Detection and Analysis using Large Language Models on Textual and Audio-Visual Modalities

Chayan Tank, Sarthak Pol, Vinayak Katoch, Shaina Mehta, Avinash Anand, Rajiv Ratn Shah

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 12 pages, 9 figures, 9 tables

Rephrasing Electronic Health Records for Pretraining Clinical Language Models

Jinghui Liu, Anthony Nguyen

专题命中 预训练与数据 ：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL

Enhancing Training Data Attribution for Large Language Models with Fitting Error Consideration

Kangxi Wu, Liang Pang, Huawei Shen, Xueqi Cheng

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted to the EMNLP 2024 main