AI Agent - arXivDaily 专题

2509.01659 2025-09-03 cs.AI 88%

Physics Supernova: AI Agent Matches Elite Gold Medalists at IPhO 2025

Jiahao Qiu, Jingzhe Shi, Xinzhe Juan, Zelin Zhao, Jiayi Geng, Shilong Liu, Hongru Wang, Sanfeng Wu, Mengdi Wang

专题命中 Agent评测：agent(title,abstract)；AI agent(title,abstract)；分类 cs.AI

2508.19163 2025-08-27 cs.AI cs.HC cs.MA 88%

MATRIX: Multi-Agent simulaTion fRamework for safe Interactions and conteXtual clinical conversational evaluation

Ernest Lim, Yajie Vera He, Jared Joselowitz, Kate Preston, Mohita Chowdhury, Louis Williams, Aisling Higham, Katrina Mason, Mariane Melo, Tom Lawton, Yan Jia, Ibrahim Habli

机构 * Ufonia Limited（乌菲尼亚有限公司）； University of York（约克大学）； NHS Improvement Academy（国家健康服务改进学院）

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.AI

Comments 36 pages, 16 figures

2504.03255 2025-08-06 cs.CY cs.CL cs.MA 88%

Inherent and emergent liability issues in LLM-based agentic systems: a principal-agent perspective

Garry A. Gabison, R. Patrick Xian

机构 * Queen Mary University of London（伦敦女王大学）； UC Berkeley（伯克利大学）； Certivize AI ； UC San Francisco（旧金山大学）

专题命中 Agent评测：agent(title,abstract)；agentic(title,abstract)；分类 cs.CL

Comments 22 pages (incl. appendix), accepted at REALM workshop, ACL2025

2508.00632 2025-08-04 cs.AI cs.MA cs.MM 88%

Multi-Agent Game Generation and Evaluation via Audio-Visual Recordings

Alexia Jolicoeur-Martineau

机构 * Samsung SAIL Montréal（三星SAIL蒙特利尔）

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.AI

2507.21028 2025-07-29 cs.CL 88%

Multi-Agent-as-Judge: Aligning LLM-Agent-Based Automated Evaluation with Multi-Dimensional Human Evaluation

Jiaju Chen, Yuxuan Lu, Xiaojie Wang, Huimin Zeng, Jing Huang, Jiri Gesi, Ying Xu, Bingsheng Yao, Dakuo Wang

机构 * Rice University（里士满大学）； Northeastern University（东北大学）； Amazon（亚马逊）； University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）； Harvard University（哈佛大学）

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.CL

2506.10467 2025-07-22 cs.CR cs.AI 88%

Specification and Evaluation of Multi-Agent LLM Systems -- Prototype and Cybersecurity Applications

Felix Härer

机构 * University of Applied Sciences Northwestern Switzerland（西北瑞士应用科学大学）

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.AI

Comments This work has been submitted for publication. Copyright may be transferred. In this case, this version will be updated with a notice, according to the publisher's guidelines

2507.12801 2025-07-18 cs.AI cs.MA 88%

Imitating Mistakes in a Learning Companion AI Agent for Online Peer Learning

Sosui Moribe, Taketoshi Ushiama

机构 * Gratuate School of Design Kyushu University（九州大学设计研究生院）； Faculty of Design Kyushu University（九州大学设计学院）

专题命中 Agent评测：agent(title,abstract)；AI agent(title,abstract)；分类 cs.AI

Comments This is the preprint version of the paper published in IMCOM 2025, IEEE Xplore (DOI: 10.1109/IMCOM64595.2025.10857528)

Journal ref 2025 19th International Conference on Ubiquitous Information Management and Communication (IMCOM), Bangkok, Thailand, 2025, pp. 1-8

2507.05755 2025-07-09 cs.AI 88%

An autonomous agent for auditing and improving the reliability of clinical AI models

Lukas Kuhn, Florian Buettner

机构 * Goethe University Frankfurt（弗赖堡歌德大学）； German Cancer Consortium (DKTK)（德国癌症联盟（DKTK））； German Cancer Research Center (DKFZ)（德国癌症研究中心（DKFZ））

专题命中 Agent评测：agent(title,abstract)；autonomous agent(title)；multi-agent(abstract)；分类 cs.AI

2507.03904 2025-07-08 cs.AI cs.MA 88%

Agent Exchange: Shaping the Future of AI Agent Economics

Yingxuan Yang, Ying Wen, Jun Wang, Weinan Zhang

机构 * Shanghai Jiao Tong University（上海交通大学）； University College London（伦敦大学学院）； Shanghai Innovation Institute（上海创新研究院）

专题命中 Agent评测：agent(title,abstract)；AI agent(title,abstract)；分类 cs.AI

2507.01019 2025-07-03 cs.CL cs.CY 88%

MALIBU Benchmark: Multi-Agent LLM Implicit Bias Uncovered

Imran Mirza, Cole Huang, Ishwara Vasista, Rohan Patil, Asli Akalin, Sean O'Brien, Kevin Zhu

机构 * Algoverse AI Research（Algoverse AI研究院）

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.CL

Comments Accepted to Building Trust in LLMs @ ICLR 2025 and NAACL SRW 2025

2412.03359 2025-06-27 cs.AI 88%

WiS Platform: Enhancing Evaluation of LLM-Based Multi-Agent Systems Through Game-Based Analysis

Chengwei Hu, Jianhui Zheng, Yancheng He, Hangyu Guo, Junguang Jiang, Han Zhu, Kai Sun, Yuning Jiang, Wenbo Su, Bo Zheng

机构 * Taobao & Tmall Group of Alibaba（阿里巴巴淘宝及天猫集团）

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.AI

2506.07116 2025-06-10 cs.AI 88%

BRIGHT+: Upgrading the BRIGHT Benchmark with MARCUS, a Multi-Agent RAG Clean-Up Suite

Liyang Chen, Yujun Cai, Jieqiong Dong, Yiwei Wang

机构 * University of California, Los Angeles（加州大学洛杉矶分校）； The University of Queensland（昆士兰大学）； Central South University（中央南大学）； University of California, Merced（加州大学默塞德分校）

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.AI

Comments 8 pages, 7 figures, 4 tables. Submitted to EMNLP 2025

2506.03332 2025-06-05 cs.AI 88%

Helpful Agent Meets Deceptive Judge: Understanding Vulnerabilities in Agentic Workflows

Yifei Ming, Zixuan Ke, Xuan-Phi Nguyen, Jiayu Wang, Shafiq Joty

机构 * Salesforce AI Research（Salesforce人工智能研究）； University of Wisconsin-Madison（威斯康星大学麦迪逊分校）

专题命中 Agent评测：agentic(title,abstract)；agent(title)；workflow(abstract)；分类 cs.AI

2506.02068 2025-06-04 quant-ph cs.LG 88%

Enhancing Interpretability of Quantum-Assisted Blockchain Clustering via AI Agent-Based Qualitative Analysis

Yun-Cheng Tsai, Yen-Ku Liu, Samuel Yen-Chi Chen

机构 * National Taiwan Normal University（国立台湾师范大学）； Wells Fargo（沃尔摩斯银行）

专题命中 Agent评测：agent(title,abstract)；AI agent(title,abstract)；分类 cs.LG

2505.12710 2025-05-20 cs.LG cs.NI 88%

Confidence-Regulated Generative Diffusion Models for Reliable AI Agent Migration in Vehicular Metaverses

Yingkai Kang, Jiawen Kang, Jinbo Wen, Tao Zhang, Zhaohui Yang, Dusit Niyato, Yan Zhang

机构 * School of Automation, Guangdong University of Technology（广东工业大学自动化学院）； College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics（南京航空航天大学计算机科学与技术学院）； School of Cyberspace Science and Technology, Beijing Jiaotong University（北京交通大学网络空间科学与技术学院）； College of Computing and Data Science, Nanyang Technological University（南洋理工大学计算机与数据科学学院）； Department of Informatics, University of Oslo（奥斯陆大学信息学院）； Simula Research Laboratory（Simula研究实验室）

专题命中 Agent评测：agent(title,abstract)；AI agent(title,abstract)；分类 cs.LG

2504.18373 2025-04-28 cs.CL 88%

Auto-SLURP: A Benchmark Dataset for Evaluating Multi-Agent Frameworks in Smart Personal Assistant

Lei Shen, Xiaoyu Shen

机构 * GEB Tech（GEB科技）； Ningbo Institute of Digital Twin, EIT, Ningbo（宁波数字孪生研究院）

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.CL

2503.15497 2025-03-21 cs.HC cs.AI cs.CY 88%

The Impact of Big Five Personality Traits on AI Agent Decision-Making in Public Spaces: A Social Simulation Study

Mingjun Ren, Wentao Xu

专题命中 Agent评测：agent(title,abstract)；AI agent(title,abstract)；分类 cs.AI

2503.12687 2025-03-18 cs.AI 88%

AI Agents: Evolution, Architecture, and Real-World Applications

Naveen Krishnan

专题命中 Agent评测：AI agent(title,abstract)；agent(abstract,comments)；tool use(abstract)；planning(abstract)

Comments 52 pages, 4 figures, comprehensive survey and analysis of AI agent evolution, architecture, evaluation frameworks, and applications

2502.14144 2025-02-21 cs.CL 88%

UM_FHS at TREC 2024 PLABA: Exploration of Fine-tuning and AI agent approach for plain language adaptations of biomedical text

Primoz Kocbek, Leon Kopitar, Zhihong Zhang, Emirhan Aydin, Maxim Topaz, Gregor Stiglic

专题命中 Agent评测：agent(title,abstract)；AI agent(title,abstract)；分类 cs.CL

Comments 10 pages, 2 figures, to be published in the 33rd Text REtrieval Conference (TREC 2024) proceedings

2411.09856 2025-02-12 cs.LG cs.CY cs.MA econ.GN q-fin.EC 88%

InvestESG: A multi-agent reinforcement learning benchmark for studying climate investment as a social dilemma

Xiaoxuan Hou, Jiayi Yuan, Joel Z. Leibo, Natasha Jaques

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.LG

2501.13592 2025-01-24 cs.LG cs.MA cs.SY eess.SY 88%

WFCRL: A Multi-Agent Reinforcement Learning Benchmark for Wind Farm Control

Claire Bizon Monroc, Ana Bušić, Donatien Dubuc, Jiamin Zhu

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.LG

Journal ref 38th Conference on Neural Information Processing Systems (NeurIPS 2024) Track on Datasets and Benchmarks

2409.12882 2024-09-24 cs.CR cs.DC cs.LG 88%

On the Hardness of Decentralized Multi-Agent Policy Evaluation under Byzantine Attacks

Hairi, Minghong Fang, Zifan Zhang, Alvaro Velasquez, Jia Liu

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.LG

Comments To appear in Proceedings of the 22nd International Symposium on Modeling and Optimization in Mobile, Ad hoc, and Wireless Networks (WiOpt 2024)

2408.15971 2024-08-29 cs.CL 88%

BattleAgentBench: A Benchmark for Evaluating Cooperation and Competition Capabilities of Language Models in Multi-Agent Systems

Wei Wang, Dan Zhang, Tao Feng, Boyan Wang, Jie Tang

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.CL

2402.09742 2024-07-01 cs.CL 88%

AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulator

Zhihao Fan, Jialong Tang, Wei Chen, Siyuan Wang, Zhongyu Wei, Jun Xi, Fei Huang, Jingren Zhou

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.CL

Comments https://github.com/LibertFan/AI_Hospital

2403.10482 2024-03-25 q-fin.CP cs.AI q-fin.PM 88%

Can a GPT4-Powered AI Agent Be a Good Enough Performance Attribution Analyst?

Bruno de Melo, Jamiel Sheikh

专题命中 Agent评测：agent(title,abstract)；AI agent(title,abstract)；分类 cs.AI

2402.11443 2024-02-20 cs.CL 88%

Benchmark Self-Evolving: A Multi-Agent Framework for Dynamic LLM Evaluation

Siyuan Wang, Zhuohan Long, Zhihao Fan, Zhongyu Wei, Xuanjing Huang

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.CL

2312.08463 2024-01-29 cs.AI 88%

How much can change in a year? Revisiting Evaluation in Multi-Agent Reinforcement Learning

Siddarth Singh, Omayma Mahjoub, Ruan de Kock, Wiem Khlifi, Abidine Vall, Kale-ab Tessera, Arnu Pretorius

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.AI

Comments 6 pages, AAAI XAI4DRL workshop 2023; typos corrected, images updated, page count updated

2212.07489 2023-10-18 cs.LG cs.MA 88%

SMACv2: An Improved Benchmark for Cooperative Multi-Agent Reinforcement Learning

Benjamin Ellis, Jonathan Cook, Skander Moalla, Mikayel Samvelyan, Mingfei Sun, Anuj Mahajan, Jakob N. Foerster, Shimon Whiteson

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.LG

2306.07542 2023-06-14 cs.AI 88%

A Versatile Multi-Agent Reinforcement Learning Benchmark for Inventory Management

Xianliang Yang, Zhihao Liu, Wei Jiang, Chuheng Zhang, Li Zhao, Lei Song, Jiang Bian

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.AI

2202.10574 2023-03-28 stat.ML cs.LG 88%

A Multi-Agent Reinforcement Learning Framework for Off-Policy Evaluation in Two-sided Markets

Chengchun Shi, Runzhe Wan, Ge Song, Shikai Luo, Rui Song, Hongtu Zhu

专题命中 Agent评测：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.LG

1. Agent评测 15616 篇

Physics Supernova: AI Agent Matches Elite Gold Medalists at IPhO 2025

MATRIX: Multi-Agent simulaTion fRamework for safe Interactions and conteXtual clinical conversational evaluation

Inherent and emergent liability issues in LLM-based agentic systems: a principal-agent perspective

Multi-Agent Game Generation and Evaluation via Audio-Visual Recordings

Multi-Agent-as-Judge: Aligning LLM-Agent-Based Automated Evaluation with Multi-Dimensional Human Evaluation

Specification and Evaluation of Multi-Agent LLM Systems -- Prototype and Cybersecurity Applications

Imitating Mistakes in a Learning Companion AI Agent for Online Peer Learning

An autonomous agent for auditing and improving the reliability of clinical AI models

Agent Exchange: Shaping the Future of AI Agent Economics

MALIBU Benchmark: Multi-Agent LLM Implicit Bias Uncovered

WiS Platform: Enhancing Evaluation of LLM-Based Multi-Agent Systems Through Game-Based Analysis

BRIGHT+: Upgrading the BRIGHT Benchmark with MARCUS, a Multi-Agent RAG Clean-Up Suite

Helpful Agent Meets Deceptive Judge: Understanding Vulnerabilities in Agentic Workflows

Enhancing Interpretability of Quantum-Assisted Blockchain Clustering via AI Agent-Based Qualitative Analysis

Confidence-Regulated Generative Diffusion Models for Reliable AI Agent Migration in Vehicular Metaverses

Auto-SLURP: A Benchmark Dataset for Evaluating Multi-Agent Frameworks in Smart Personal Assistant

The Impact of Big Five Personality Traits on AI Agent Decision-Making in Public Spaces: A Social Simulation Study

AI Agents: Evolution, Architecture, and Real-World Applications

UM_FHS at TREC 2024 PLABA: Exploration of Fine-tuning and AI agent approach for plain language adaptations of biomedical text

InvestESG: A multi-agent reinforcement learning benchmark for studying climate investment as a social dilemma

WFCRL: A Multi-Agent Reinforcement Learning Benchmark for Wind Farm Control

On the Hardness of Decentralized Multi-Agent Policy Evaluation under Byzantine Attacks

BattleAgentBench: A Benchmark for Evaluating Cooperation and Competition Capabilities of Language Models in Multi-Agent Systems

AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulator

Can a GPT4-Powered AI Agent Be a Good Enough Performance Attribution Analyst?

Benchmark Self-Evolving: A Multi-Agent Framework for Dynamic LLM Evaluation

How much can change in a year? Revisiting Evaluation in Multi-Agent Reinforcement Learning

SMACv2: An Improved Benchmark for Cooperative Multi-Agent Reinforcement Learning

A Versatile Multi-Agent Reinforcement Learning Benchmark for Inventory Management

A Multi-Agent Reinforcement Learning Framework for Off-Policy Evaluation in Two-sided Markets