AI Agent - arXivDaily 专题

2504.04365 2025-11-05 cs.LG cs.AI cs.PL 73%

AutoPDL: Automatic Prompt Optimization for LLM Agents

Claudio Spiess, Mandana Vaziri, Louis Mandel, Martin Hirzel

专题命中 Agent评测：agent(abstract)；agentic(abstract)；分类 cs.AI、cs.LG

Comments An earlier version of this paper was published in AutoML 2025 Methods Track. This version adds missing standard deviations in Table 1

2511.01166 2025-11-04 cs.CL cs.SE 73%

MicroRemed: Benchmarking LLMs in Microservices Remediation

Lingzhe Zhang, Yunpeng Zhai, Tong Jia, Chiming Duan, Minghua He, Leyi Pan, Zhaoyang Liu, Bolin Ding, Ying Li

机构 * Peking University（北京大学）； Alibaba Group（阿里巴巴集团）； Tsinghua University（清华大学）

专题命中 Agent评测：agent(abstract)；multi-agent(abstract)；分类 cs.CL、cs.SE

Comments 24 pages, 13 figures, 5 tables

2511.00039 2025-11-04 cs.AI cs.LG 73%

Graph-Attentive MAPPO for Dynamic Retail Pricing

Krishna Kumar Neelakanta Pillai Santha Kumari Amma

机构 * Independent Researcher（独立研究者）

专题命中 Agent评测：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.LG

2510.27238 2025-11-03 cs.DB cs.AI cs.CL cs.IR 73%

DRAMA: Unifying Data Retrieval and Analysis for Open-Domain Analytic Queries

Chuxuan Hu, Maxwell Yang, James Weiland, Yeji Lim, Suhas Palawala, Daniel Kang

机构 * University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）

专题命中 Agent评测：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL

Comments Accepted to SIGMOD 2026

2510.21031 2025-10-27 cs.SE cs.AI 73%

AgentArcEval: An Architecture Evaluation Method for Foundation Model based Agents

Qinghua Lu, Dehai Zhao, Yue Liu, Hao Zhang, Liming Zhu, Xiwei Xu, Angela Shi, Tristan Tan, Rick Kazman

机构 * Data61, CSIRO, Australia（Data61，CSIRO，澳大利亚）； Empathetic AI, Australia（Empathetic AI，澳大利亚）； University of Hawaii, Honolulu, HI, USA（夏威夷大学）

专题命中 Agent评测：agent(abstract)；autonomous agent(abstract)；分类 cs.AI、cs.SE

2411.10213 2025-10-21 cs.SE cs.AI 73%

An Empirical Study on LLM-based Agents for Automated Bug Fixing

Xiangxin Meng, Zexiong Ma, Pengfei Gao, Chao Peng

机构 * ByteDance（字节跳动）

专题命中 Agent评测：agent(abstract)；agentic(abstract)；分类 cs.AI、cs.SE

2510.15996 2025-10-21 cs.LG cs.AI 73%

Using Kolmogorov-Smirnov Distance for Measuring Distribution Shift in Machine Learning

Ozan K. Tonguz, Federico Taschin

机构 * Carnegie Mellon University, USA（卡内基梅隆大学，美国）； KTH Royal Institute of Technology, Sweden（皇家理工学院）

专题命中 Agent评测：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.LG

2510.14677 2025-10-17 cs.RO cs.AI cs.LG cs.MA 73%

When Planners Meet Reality: How Learned, Reactive Traffic Agents Shift nuPlan Benchmarks

Steffen Hagedorn, Luka Donkov, Aron Distelzweig, Alexandru P. Condurache

机构 * Robert Bosch GmbH（罗伯特·博世有限公司）； Institute for Neuro- and Bioinformatics, University of Lübeck（神经与生物医学研究所，吕贝克大学）； Engineering Faculty, DHBW Stuttgart（工程学院，斯图加特DHBW）； Department of Computer Science, University of Freiburg（计算机科学系，弗赖堡大学）

专题命中 Agent评测：agent(abstract)；planning(abstract)；分类 cs.AI、cs.LG

2510.12750 2025-10-15 cs.CV cs.AI cs.LG 73%

VQArt-Bench: A semantically rich VQA Benchmark for Art and Cultural Heritage

A. Alfarano, L. Venturoli, D. Negueruela del Castillo

机构 * University of Zurich, Max Planck Society（苏黎世大学、马克斯·普朗克研究所）

专题命中 Agent评测：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.LG

2510.08429 2025-10-10 cs.LG cs.AI stat.ML 73%

ClauseLens: Clause-Grounded, CVaR-Constrained Reinforcement Learning for Trustworthy Reinsurance Pricing

Stella C. Dong, James R. Finlay

机构 * Department of Applied Mathematics, University of California, Davis, CA, USA（加州大学戴维斯分校应用数学系）； Wharton School of Business, University of Pennsylvania, Philadelphia, PA, USA（宾夕法尼亚大学沃顿商学院）

专题命中 Agent评测：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.LG

Comments Accepted for publication at the 6th ACM International Conference on AI in Finance (ICAIF 2025), Singapore. Author-accepted version (October 2025). 10 pages, 5 figures

2510.07740 2025-10-10 cs.SE cs.AI 73%

AppForge: From Assistant to Independent Developer -- Are GPTs Ready for Software Development?

Dezhi Ran, Yuan Cao, Mengzhou Wu, Simin Chen, Yuzhe Guo, Jun Ren, Zihe Song, Hao Yu, Jialei Wei, Linyi Li, Wei Yang, Baishakhi Ray, Tao Xie

机构 * Key Lab of HCST (PKU), MOE（HCST关键实验室（PKU））； School of Computer Science, Peking University, China（北京大学计算机科学学院）； Columbia University, USA（哥伦比亚大学）； Beijing Jiaotong University, China（北京交通大学）； University of Texas at Dallas, USA（德克萨斯大学达拉斯分校）； Hong Kong University of Science and Technology, Hong Kong SAR, China（香港科技大学）； Fudan University Institute of Systems for Advanced Computing, Shanghai, China（复旦大学先进计算系统研究所）； Simon Fraser University, Canada（西蒙弗雷泽大学）； Shanghai Institute of Systems for Open Computing, Shanghai, China（上海开放计算系统研究所）

专题命中 Agent评测：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.SE

Comments Under Review. Benchmark and leadboards at https://appforge-bench.github.io/

2510.05096 2025-10-10 cs.CV cs.AI cs.CL cs.MA cs.MM 73%

Paper2Video: Automatic Video Generation from Scientific Papers

Zeyu Zhu, Kevin Qinghong Lin, Mike Zheng Shou

机构 * Show Lab, National University of Singapore（展示实验室，新加坡国立大学）

专题命中 Agent评测：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL

Comments Project Page: https://showlab.github.io/Paper2Video/

2510.03696 2025-10-07 cs.AI cs.CL 73%

Mind the Goal: Data-Efficient Goal-Oriented Evaluation of Conversational Agents and Chatbots using Teacher Models

Deepak Babu Piskala, Sharlene Chen, Udita Patel, Parul Kalra, Rafael Castrillo

专题命中 Agent评测：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL

2510.01780 2025-10-03 cs.CR cs.AI cs.CY cs.LG 73%

Secure Multi-Modal Data Fusion in Federated Digital Health Systems via MCP

Aueaphum Aueawatthanaphisut

机构 * School of Information, Computer, and Communication Technology（信息、计算机与通信技术学院）； Sirindhorn International Institute of Technology, Thammasat University（泰国朱拉安吞国际技术学院，泰国 Thammasat 大学）

专题命中 Agent评测：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.LG

Comments 6 pages, 8 figures, 7 equations, 1 algorithm

2509.24297 2025-10-01 cs.CL cs.AI 73%

Q-Mirror: Unlocking the Multi-Modal Potential of Scientific Text-Only QA Pairs

Junying Wang, Zicheng Zhang, Ye Shen, Yalun Wu, Yingji Liang, Yijin Guo, Farong Wen, Wenzhe Li, Xuezhi Zhao, Qi Jia, Guangtao Zhai

机构 * Fudan University（复旦大学）； Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）； Shanghai Jiao Tong University（上海交通大学）

专题命中 Agent评测：agent(abstract)；agentic(abstract)；分类 cs.AI、cs.CL

Comments 25 pages

2509.24002 2025-09-30 cs.CL cs.AI 73%

MCPMark: A Benchmark for Stress-Testing Realistic and Comprehensive MCP Use

Zijian Wu, Xiangyan Liu, Xinyuan Zhang, Lingjun Chen, Fanqing Meng, Lingxiao Du, Yiran Zhao, Fanshi Zhang, Yaoqi Ye, Jiawei Wang, Zirui Wang, Jinjie Ni, Yufan Yang, Arvin Xu, Michael Qizhe Shieh

专题命中 Agent评测：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.CL

Comments 42 pages, 27 figures, 10 tables

2505.10482 2025-09-30 cs.LG cs.AI 73%

Fine-tuning Diffusion Policies with Backpropagation Through Diffusion Timesteps

Ningyuan Yang, Jiaxuan Gao, Feng Gao, Yi Wu, Chao Yu

机构 * Tsinghua University（清华大学）

专题命中 Agent评测：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.LG

Comments 9 pages for main text, 23 pages in total, submitted to Neurips, 13 figures

2509.15957 2025-09-22 cs.AI cs.CL cs.HC cs.IR 73%

EHR-MCP: Real-world Evaluation of Clinical Information Retrieval by Large Language Models via Model Context Protocol

Kanato Masayoshi, Masahiro Hashimoto, Ryoichi Yokoyama, Naoki Toda, Yoshifumi Uwamino, Shogo Fukuda, Ho Namkoong, Masahiro Jinzaki

机构 * Department of Radiology, Keio University Hospital, Tokyo, Japan（Keio大学医院放射科）； Division of Infectious Diseases and Infection Control, Keio University Hospital, Tokyo, Japan（Keio大学医院感染病学与感染控制科）

专题命中 Agent评测：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.CL

2410.08388 2025-09-17 cs.CL cs.AI 73%

Responsible AI in NLP: GUS-Net Span-Level Bias Detection Dataset and Benchmark for Generalizations, Unfairness, and Stereotypes

Maximus Powers, Shaina Raza, Alex Chang, Rehana Riaz, Umang Mavani, Harshitha Reddy Jonala, Ansh Tiwari, Hua Wei

专题命中 Agent评测：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL

2509.12190 2025-09-16 cs.CY cs.AI cs.CL 73%

Survival at Any Cost? LLMs and the Choice Between Self-Preservation and Human Harm

Alireza Mohamadi, Ali Yavari

专题命中 Agent评测：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL

Comments Preprint. Under review

2509.08756 2025-09-11 cs.LG cs.AI cs.HC 73%

Using AI to Optimize Patient Transfer and Resource Utilization During Mass-Casualty Incidents: A Simulation Platform

Zhaoxun "Lorenz" Liu, Wagner H. Souza, Jay Han, Amin Madani

机构 * Surgical Artificial Intelligence Research Academy（外科人工智能研究学院）； University Health Network（大学健康网络）； University of Toronto（多伦多大学）； Department of Surgery（外科系）

专题命中 Agent评测：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.LG

2507.23674 2025-09-11 cs.LG cs.CL 73%

TweakLLM: A Routing Architecture for Dynamic Tailoring of Cached Responses

Muhammad Taha Cheema, Abeer Aamir, Khawaja Gul Muhammad, Naveed Anwar Bhatti, Ihsan Ayyub Qazi, Zafar Ayyub Qazi

机构 * Department of Computer Science（计算机科学系）； Lahore University of Management Sciences（拉合尔管理科学大学）

专题命中 Agent评测：agent(abstract)；multi-agent(abstract)；分类 cs.CL、cs.LG

Comments 13 pages, 9 figures

2505.24671 2025-09-03 cs.CL cs.AI 73%

Multiple LLM Agents Debate for Equitable Cultural Alignment

Dayeon Ki, Rachel Rudinger, Tianyi Zhou, Marine Carpuat

机构 * University of Maryland（马里兰大学）

专题命中 Agent评测：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL

Comments ACL 2025 (Oral)

2508.20737 2025-08-29 cs.SE cs.AI 73%

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol

Wei Ma, Yixiao Yang, Qiang Hu, Shi Ying, Zhi Jin, Bo Du, Zhenchang Xing, Tianlin Li, Junjie Shi, Yang Liu, Linxiao Jiang

机构 * Singapore Management University Singapore ； Capital Normal University Beijing China ； Tianjin University Tianjin China ； Wuhan University China ； CSIRO's Data61 \& Australian National University Australia ； Nanyang Technological University Singapore ； Singapore Management University ； Capital Normal University ； Tianjin University ； Wuhan University ； CSIRO's Data61 \& Australian National University ； Nanyang Technological University

专题命中 Agent评测：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.SE

2508.19461 2025-08-28 cs.AI cs.CR cs.LG 73%

Reliable Weak-to-Strong Monitoring of LLM Agents

Neil Kale, Chen Bo Calvin Zhang, Kevin Zhu, Ankit Aich, Paula Rodriguez, Scale Red Team, Christina Q. Knight, Zifan Wang

机构 * Scale AI ； Carnegie Mellon University（卡内基梅隆大学）； Massachusetts Institute of Technology（麻省理工学院）

专题命中 Agent评测：agent(abstract)；workflow(abstract)；分类 cs.AI、cs.LG

Comments 18 pages, 15 figures

2505.18596 2025-08-27 cs.CL cs.AI 73%

Debate-to-Detect: Reformulating Misinformation Detection as a Real-World Debate with Large Language Models

Chen Han, Wenzhen Zheng, Xijin Tang

机构 * School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences（中国科学院大学先进交叉学科学院）； State Key Laboratory of Mathematical Sciences, Academy of Mathematics and Systems Science, Chinese Academy of Sciences（中国科学院数学与系统科学研究院）

专题命中 Agent评测：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL

Comments This paper has been accepted to EMNLP 2025 (Main Conference)

2508.14357 2025-08-21 cs.LG cs.AI cs.CV 73%

Organ-Agents: Virtual Human Physiology Simulator via LLMs

Rihao Chang, He Jiao, Weizhi Nie, Honglin Guo, Keliang Xie, Zhenhua Wu, Lina Zhao, Yunpeng Bai, Yongtao Ma, Lanjun Wang, Yuting Su, Xi Gao, Weijie Wang, Nicu Sebe, Bruno Lepri, Bingwei Sun

机构 * Tianjin University（天津大学）； University of Trento（特伦托大学）； Tianjin Medical University General Hospital（天津医科大学总医院）； Chest Hospital, Tianjin University（天津大学胸科医院）； The Affiliated Suzhou Hospital of Nanjing Medical University（南京医科大学附属苏州医院）； Fondazione Bruno Kessler（布鲁诺·凯斯勒基金会）

专题命中 Agent评测：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.LG

2508.05668 2025-08-20 cs.IR cs.AI cs.CL 73%

A Survey of LLM-based Deep Search Agents: Paradigm, Optimization, Evaluation, and Challenges

Yunjia Xi, Jianghao Lin, Yongzhao Xiao, Zheli Zhou, Rong Shan, Te Gao, Jiachen Zhu, Weiwen Liu, Yong Yu, Weinan Zhang

机构 * Shanghai Jiao Tong University（上海交通大学）

专题命中 Agent评测：agent(abstract)；planning(abstract)；分类 cs.AI、cs.CL

2508.13186 2025-08-20 cs.CL cs.AI cs.CV 73%

MM-BrowseComp: A Comprehensive Benchmark for Multimodal Browsing Agents

Shilong Li, Xingyuan Bu, Wenjie Wang, Jiaheng Liu, Jun Dong, Haoyang He, Hao Lu, Haozhe Zhang, Chenchen Jing, Zhen Li, Chuanhao Li, Jiayi Tian, Chenchen Zhang, Tianhao Peng, Yancheng He, Jihao Gu, Yuanxing Zhang, Jian Yang, Ge Zhang, Wenhao Huang, Wangchunshu Zhou, Zhaoxiang Zhang, Ruizhe Ding, Shilei Wen

机构 * Nanjing University（南京大学）； Zhejiang University（浙江大学）

专题命中 Agent评测：AI agent(abstract)；tool use(abstract)；分类 cs.AI、cs.CL

Comments The first two authors contribute equally, 26 pages, repo at https://github.com/MMBrowseComp/MM-BrowseComp

2508.11310 2025-08-18 cs.CL cs.AI cs.IR 73%

SGSimEval: A Comprehensive Multifaceted and Similarity-Enhanced Benchmark for Automatic Survey Generation Systems

Beichen Guo, Zhiyuan Wen, Yu Yang, Peng Gao, Ruosong Yang, Jiaxing Shen

机构 * The Hong Kong Polytechnic University（香港理工大学）； The Education University of Hong Kong（香港教育大学）； China Mobile (Hong Kong) Innovation and Research Institute（中国移动（香港）创新与研究院）； Lingnan University（岭南大学）

专题命中 Agent评测：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL

Comments Accepted to The 21st International Conference on Advanced Data Mining and Applications (ADMA2025)

1. Agent评测 15729 篇

AutoPDL: Automatic Prompt Optimization for LLM Agents

MicroRemed: Benchmarking LLMs in Microservices Remediation

Graph-Attentive MAPPO for Dynamic Retail Pricing

DRAMA: Unifying Data Retrieval and Analysis for Open-Domain Analytic Queries

AgentArcEval: An Architecture Evaluation Method for Foundation Model based Agents

An Empirical Study on LLM-based Agents for Automated Bug Fixing

Using Kolmogorov-Smirnov Distance for Measuring Distribution Shift in Machine Learning

When Planners Meet Reality: How Learned, Reactive Traffic Agents Shift nuPlan Benchmarks

VQArt-Bench: A semantically rich VQA Benchmark for Art and Cultural Heritage

ClauseLens: Clause-Grounded, CVaR-Constrained Reinforcement Learning for Trustworthy Reinsurance Pricing

AppForge: From Assistant to Independent Developer -- Are GPTs Ready for Software Development?

Paper2Video: Automatic Video Generation from Scientific Papers

Mind the Goal: Data-Efficient Goal-Oriented Evaluation of Conversational Agents and Chatbots using Teacher Models

Secure Multi-Modal Data Fusion in Federated Digital Health Systems via MCP

Q-Mirror: Unlocking the Multi-Modal Potential of Scientific Text-Only QA Pairs

MCPMark: A Benchmark for Stress-Testing Realistic and Comprehensive MCP Use

Fine-tuning Diffusion Policies with Backpropagation Through Diffusion Timesteps

EHR-MCP: Real-world Evaluation of Clinical Information Retrieval by Large Language Models via Model Context Protocol

Responsible AI in NLP: GUS-Net Span-Level Bias Detection Dataset and Benchmark for Generalizations, Unfairness, and Stereotypes

Survival at Any Cost? LLMs and the Choice Between Self-Preservation and Human Harm

Using AI to Optimize Patient Transfer and Resource Utilization During Mass-Casualty Incidents: A Simulation Platform

TweakLLM: A Routing Architecture for Dynamic Tailoring of Cached Responses

Multiple LLM Agents Debate for Equitable Cultural Alignment

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol

Reliable Weak-to-Strong Monitoring of LLM Agents

Debate-to-Detect: Reformulating Misinformation Detection as a Real-World Debate with Large Language Models

Organ-Agents: Virtual Human Physiology Simulator via LLMs

A Survey of LLM-based Deep Search Agents: Paradigm, Optimization, Evaluation, and Challenges

MM-BrowseComp: A Comprehensive Benchmark for Multimodal Browsing Agents

SGSimEval: A Comprehensive Multifaceted and Similarity-Enhanced Benchmark for Automatic Survey Generation Systems