语言大模型 / LLM - arXivDaily 专题

2508.07173 2025-09-30 cs.CL 89%

Omni-SafetyBench: A Benchmark for Safety Evaluation of Audio-Visual Large Language Models

Leyi Pan, Zheyu Fu, Yunpeng Zhai, Shuchang Tao, Sheng Guan, Shiyu Huang, Lingzhe Zhang, Zhaoyang Liu, Bolin Ding, Felix Henry, Aiwei Liu, Lijie Wen

机构 * Tsinghua University（清华大学）； Tongyi Lab（通义实验室）； Peking University（北京大学）； OpenRL Lab（OpenRL实验室）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.CL

Comments 22 pages, 10 figures, 12 tables

2509.21949 2025-09-29 cs.NI cs.CL 89%

Evaluating Open-Source Large Language Models for Technical Telecom Question Answering

Arina Caraus, Alessio Buscemi, Sumit Kumar, Ion Turcanu

机构 * Luxembourg Institute of Science and Technology (LIST)（卢森堡科学与技术研究院）； RMT Labs（RMT实验室）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted at the IEEE GLOBECOM Workshops 2025: "Large AI Model over Future Wireless Networks"

2505.13577 2025-09-29 cs.SD cs.AI eess.AS 89%

VocalAgent: Large Language Models for Vocal Health Diagnostics with Safety-Aware Evaluation

Yubin Kim, Taehan Kim, Wonjune Kang, Eugene Park, Joonsik Yoon, Dongjae Lee, Xin Liu, Daniel McDuff, Hyeonhoon Lee, Cynthia Breazeal, Hae Won Park

机构 * Massachusetts Institute of Technology, USA（麻省理工学院, 美国）； Seoul National University Hospital, South Korea（首尔国立大学医院, 韩国）； Doctor Diary, South Korea（Doctor Diary, 韩国）； Google Research, USA（谷歌研究, 美国）； Independent Researcher（独立研究者）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Accepted by Proceedings of Interspeech 2025; Website: https://han811.github.io/VocalAgent2025/

2509.21104 2025-09-26 cs.CL 89%

PerHalluEval: Persian Hallucination Evaluation Benchmark for Large Language Models

Mohammad Hosseini, Kimia Hosseini, Shayan Bali, Zahra Zanjani, Saeedeh Momtazi

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2502.18993 2025-09-25 cs.CL cs.DB 89%

MEBench: Benchmarking Large Language Models for Cross-Document Multi-Entity Question Answering

Teng Lin, Yuyu Luo, Honglin Zhang, Jicheng Zhang, Chunlin Liu, Kaishun Wu, Nan Tang

机构 * The Hong Kong University of Science and Technology (Guangzhou)（香港科学与技术大学（广州））； The Hong Kong University of Science and Technology（香港科学与技术大学）； China Mobile Information Technology Company Limited（中国移动信息技术有限公司）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments EMNLP2025 Main

2509.18862 2025-09-24 cs.CL 89%

Multi-Hierarchical Feature Detection for Large Language Model Generated Text

Luyan Zhang, Xinyu Xie

机构 * Northeastern University（东北大学）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 9 pages, 6 tables, empirical study on multi-feature AI text detection

2509.18446 2025-09-24 cs.CY cs.LG 89%

Large-Scale, Longitudinal Study of Large Language Models During the 2024 US Election Season

Sarah H. Cen, Andrew Ilyas, Hedi Driss, Charlotte Park, Aspen Hopkins, Chara Podimata, Aleksander Mądry

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments 100 pages, 69 figures

2509.16610 2025-09-23 cs.CL 89%

LLMsPark: A Benchmark for Evaluating Large Language Models in Strategic Gaming Contexts

Junhao Chen, Jingbo Sun, Xiang Li, Haidong Xin, Yuhao Xue, Yibin Xu, Hao Zhao

机构 * Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院）； Institute of Computing Technology, Chinese Academy of Sciences（中国科学院计算技术研究所）； School of Software and Microelectronics, Peking University（北京大学软件与微电子学院）； School of Computer Science and Engineering, Northeastern University（东北大学计算机科学与工程学院）； Tongji University（同济大学）； AIR, Tsinghua University（清华大学人工智能研究院）； BAAI（百度人工智能研究院）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by EMNLP 2025 Findings

2502.11528 2025-09-23 cs.AI 89%

A Survey of Personalized Large Language Models: Progress and Future Directions

Jiahong Liu, Zexuan Qiu, Zhongyang Li, Quanyu Dai, Wenhao Yu, Jieming Zhu, Minda Hu, Menglin Yang, Tat-Seng Chua, Irwin King

机构 * The Chinese University of Hong Kong（香港中文大学）； Huawei Technologies Co., Ltd（华为技术有限公司）； The Hong Kong University of Science and Technology (Guangzhou)（香港科学与技术大学（广州））； National University of Singapore（新加坡国立大学）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.AI

Comments 34 pages, 8 figures, 7 tables, Under Review

2509.16330 2025-09-23 cs.AI 89%

Generalizability of Large Language Model-Based Agents: A Comprehensive Survey

Minxing Zhang, Yi Yang, Roy Xie, Bhuwan Dhingra, Shuyan Zhou, Jian Pei

机构 * Duke University（杜克大学）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2509.14749 2025-09-19 cs.CL cs.IR 89%

Evaluating Large Language Models for Cross-Lingual Retrieval

Longfei Zuo, Pingjun Hong, Oliver Kraus, Barbara Plank, Robert Litschko

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted at EMNLP 2025 (Findings)

2509.14623 2025-09-19 cs.SE cs.AI cs.PL cs.SY eess.SY 89%

Automating Modelica Module Generation Using Large Language Models: A Case Study on Building Control Description Language

Hanlong Wan, Xing Lu, Yan Chen, Karthik Devaprasad, Laura Hinkle

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments This is the pre-peer-review version of a journal paper; the repo is available at: https://github.com/pnnl/prompt2control

2506.08375 2025-09-17 cs.CL 89%

EIFBENCH: Extremely Complex Instruction Following Benchmark for Large Language Models

Tao Zou, Xinghua Zhang, Haiyang Yu, Minzheng Wang, Fei Huang, Yongbin Li

机构 * Tongyi Lab, Alibaba Group（通义实验室，阿里巴巴集团）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by EMNLP 2025

2505.15805 2025-09-17 cs.CL 89%

Keep Security! Benchmarking Security Policy Preservation in Large Language Model Contexts Against Indirect Attacks in Question Answering

Hwan Chang, Yumin Kim, Yonghyun Jun, Hwanhee Lee

机构 * Chung-Ang University（Chung-Ang 大学）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments EMNLP 2025 (Main Conference)

2509.10683 2025-09-16 cs.CV cs.AI 89%

A Comparison and Evaluation of Fine-tuned Convolutional Neural Networks to Large Language Models for Image Classification and Segmentation of Brain Tumors on MRI

Felicia Liu, Jay J. Yoo, Farzad Khalvati

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2502.03814 2025-09-16 cs.RO cs.AI 89%

Large Language Models for Multi-Robot Systems: A Survey

Peihan Li, Zijian An, Shams Abrar, Lifeng Zhou

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2507.02074 2025-09-10 cs.CV cs.AI 89%

Large Language Models for Crash Detection in Video: A Survey of Methods, Datasets, and Challenges

Sanjeda Akter, Ibne Farabi Shihab, Anuj Sharma

机构 * Department of Computer Science, Iowa State University（计算机科学系，爱荷华州立大学）； Department of Civil, Construction and Environmental Engineering, Iowa State University（土木、建设与环境工程系，爱荷华州立大学）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；foundation model(abstract)；分类 cs.AI

2509.07010 2025-09-10 cs.CV cs.AI cs.ET 89%

Human-in-the-Loop: Quantitative Evaluation of 3D Models Generation by Large Language Models

Ahmed R. Sadik, Mariusz Bujny

机构 * Honda Research Institute Europe - Germany（本田欧洲研究机构）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2509.06838 2025-09-09 cs.CL cs.CR 89%

EPT Benchmark: Evaluation of Persian Trustworthiness in Large Language Models

Mohammad Reza Mirbagheri, Mohammad Mahdi Mirkamali, Zahra Motoshaker Arani, Ali Javeri, Amir Mahdi Sadeghzadeh, Rasool Jalili

机构 * Department of Computer Engineering, Sharif University of Technology（谢里夫理工大学计算机工程系）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2509.06065 2025-09-09 cs.CL 89%

KatotohananQA: Evaluating Truthfulness of Large Language Models in Filipino

Lorenzo Alfred Nery, Ronald Dawson Catignas, Thomas James Tiam-Lee

机构 * De La Salle University, Manila, Philippines（德拉萨大学，马尼拉，菲律宾）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 14 pages, 1 figure, 9 tables, 1 listing. To appear in Proceedings of NLPIR 2025

2509.04809 2025-09-09 cs.AI cs.HC 89%

TalkToAgent: A Human-centric Explanation of Reinforcement Learning Agents with Large Language Models

Haechang Kim, Hao Chen, Can Li, Jong Min Lee

机构 * Department of Chemical and Biological Engineering, Seoul National University, Republic of Korea（化学与生物工程系，首尔国立大学）； Davidson School of Chemical Engineering, Purdue University, United States（化学工程大卫森学院，普渡大学）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments 31 pages total

2509.04078 2025-09-09 cs.SE cs.AI 89%

RepoDebug: Repository-Level Multi-Task and Multi-Language Debugging Evaluation of Large Language Models

Jingjing Liu, Zeming Liu, Zihao Cheng, Mengliang He, Xiaoming Shi, Yuhang Guo, Xiangrong Zhu, Yuanfang Guo, Yunhong Wang, Haifeng Wang

机构 * School of Computer Science and Engineering, Beihang University（北京航空航天大学计算机科学与工程学院）； East China Normal University（华东师范大学）； School of Computer Science and Technology, Beijing Institute of Technology（北京理工大学计算机科学与技术学院）； Baidu Inc.（百度公司）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments 30 pages, 12 figures, EMNLP 2025 Findings

2411.05665 2025-09-09 cs.CL 89%

Exploring the Limits of Large Language Models: A Systematic Evaluation of Masked Text Processing Ability through MskQA and MskCal

Fuka Matsuzaki, Haru-Tada Sato

机构 * Department of Data Science（数据科学系）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 19 pages

2509.01962 2025-09-03 cs.CL 89%

DRAssist: Dispute Resolution Assistance using Large Language Models

Sachin Pawar, Manoj Apte, Girish K. Palshikar, Basit Ali, Nitin Ramrakhiyani

机构 * TCS Research, Tata Consultancy Services Limited（塔塔咨询公司研究部）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments Accepted at the 20th International Conference on Artificial Intelligence and Law (ICAIL 2025)

2509.00987 2025-09-03 cs.AI 89%

Causal MAS: A Survey of Large Language Model Architectures for Discovery and Effect Estimation

Adib Bazgir, Amir Habibdoust, Yuwen Zhang, Xing Song

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments 24 pages. 2 figures

2506.20008 2025-09-01 cs.AI cs.PL cs.SE 89%

QHackBench: Benchmarking Large Language Models for Quantum Code Generation Using PennyLane Hackathon Challenges

Abdul Basit, Minghao Shao, Muhammad Haider Asif, Nouhaila Innan, Muhammad Kashif, Alberto Marchisio, Muhammad Shafique

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.AI

Comments To appear at the IEEE International Conference on Quantum Artificial Intelligence (QAI), Naples, Italy, November 2025

2508.20385 2025-08-29 cs.CL 89%

CAPE: Context-Aware Personality Evaluation Framework for Large Language Models

Jivnesh Sandhan, Fei Cheng, Tushar Sandhan, Yugo Murawaki

机构 * Kyoto University（京都大学）； IIT Kanpur（印度理工学院坎浦尔）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted at EMNLP25 (Findings)

2508.19492 2025-08-28 cs.CY cs.CL 89%

Geopolitical Parallax: Beyond Walter Lippmann Just After Large Language Models

Mehmet Can Yavuz, Humza Gohar Kabir, Aylin Özkan

机构 * Faculty of Engineering and Natural Sciences, Işık University（工程与自然科学学院，伊斯克大学）； Arky Multimedia（Arky多媒体）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 7 pages, 4 figures, 7 tables

2508.18905 2025-08-27 cs.AI 89%

Interactive Evaluation of Large Language Models for Multi-Requirement Software Engineering Tasks

Dimitrios Rontogiannis, Maxime Peyrard, Nicolas Baldwin, Martin Josifoski, Robert West, Dimitrios Gunopulos

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2504.21038 2025-08-27 cs.CR cs.AI 89%

Prefill-level Jailbreak: A Black-Box Risk Analysis of Large Language Models

Yakai Li, Jiekang Hu, Weiduan Sang, Luping Ma, Dongsheng Nie, Weijuan Zhang, Aimin Yu, Yi Su, Qingjia Huang, Qihang Zhou

机构 * Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所）； School of Cyber Security, University of Chinese Academy of Sciences（中国科学院大学网络安全学院）； Sinochem Energy High-Tech Co., Ltd.（中石化能源高科技有限公司）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

1. 评测与基准 32006 篇

Omni-SafetyBench: A Benchmark for Safety Evaluation of Audio-Visual Large Language Models

Evaluating Open-Source Large Language Models for Technical Telecom Question Answering

VocalAgent: Large Language Models for Vocal Health Diagnostics with Safety-Aware Evaluation

PerHalluEval: Persian Hallucination Evaluation Benchmark for Large Language Models

MEBench: Benchmarking Large Language Models for Cross-Document Multi-Entity Question Answering

Multi-Hierarchical Feature Detection for Large Language Model Generated Text

Large-Scale, Longitudinal Study of Large Language Models During the 2024 US Election Season

LLMsPark: A Benchmark for Evaluating Large Language Models in Strategic Gaming Contexts

A Survey of Personalized Large Language Models: Progress and Future Directions

Generalizability of Large Language Model-Based Agents: A Comprehensive Survey

Evaluating Large Language Models for Cross-Lingual Retrieval

Automating Modelica Module Generation Using Large Language Models: A Case Study on Building Control Description Language

EIFBENCH: Extremely Complex Instruction Following Benchmark for Large Language Models

Keep Security! Benchmarking Security Policy Preservation in Large Language Model Contexts Against Indirect Attacks in Question Answering

A Comparison and Evaluation of Fine-tuned Convolutional Neural Networks to Large Language Models for Image Classification and Segmentation of Brain Tumors on MRI

Large Language Models for Multi-Robot Systems: A Survey

Large Language Models for Crash Detection in Video: A Survey of Methods, Datasets, and Challenges

Human-in-the-Loop: Quantitative Evaluation of 3D Models Generation by Large Language Models

EPT Benchmark: Evaluation of Persian Trustworthiness in Large Language Models

KatotohananQA: Evaluating Truthfulness of Large Language Models in Filipino

TalkToAgent: A Human-centric Explanation of Reinforcement Learning Agents with Large Language Models

RepoDebug: Repository-Level Multi-Task and Multi-Language Debugging Evaluation of Large Language Models

Exploring the Limits of Large Language Models: A Systematic Evaluation of Masked Text Processing Ability through MskQA and MskCal

DRAssist: Dispute Resolution Assistance using Large Language Models

Causal MAS: A Survey of Large Language Model Architectures for Discovery and Effect Estimation

QHackBench: Benchmarking Large Language Models for Quantum Code Generation Using PennyLane Hackathon Challenges

CAPE: Context-Aware Personality Evaluation Framework for Large Language Models

Geopolitical Parallax: Beyond Walter Lippmann Just After Large Language Models

Interactive Evaluation of Large Language Models for Multi-Requirement Software Engineering Tasks

Prefill-level Jailbreak: A Black-Box Risk Analysis of Large Language Models