AI Agent

ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery

Ziru Chen, Shijie Chen, Yuting Ning, Qianheng Zhang, Boshi Wang, Botao Yu, Yifei Li, Zeyi Liao, Chen Wei, Zitong Lu, Vishal Dey, Mingyi Xue, Frazier N. Baker, Benjamin Burns, Daniel Adu-Ampratwum, Xuhui Huang, Xia Ning, Song Gao, Yu Su, Huan Sun

专题命中 Agent评测 ：agent(abstract)；workflow(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments ICLR 2025. 60 pages

A Rapid Trajectory Optimization and Control Framework for Resource-Constrained Applications

Deep Parikh, Thomas L. Ahrens, Manoranjan Majji

专题命中 Agent评测 ：agent(abstract)；autonomous agent(abstract)；multi-agent(abstract)

Comments This work has been accepted for publication at the IEEE ACC 2025

Fourier Head: Helping Large Language Models Learn Complex Probability Distributions

Nate Gillman, Daksh Aggarwal, Michael Freeman, Saurabh Singh, Chen Sun

专题命中 Agent评测 ：agent(abstract)；agentic(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments Camera ready version (ICLR 2025). Code at https://nategillman.com/fourier-head

Large Language Model Critics for Execution-Free Evaluation of Code Changes

Aashish Yadavally, Hoan Nguyen, Laurent Callot, Gauthier Guinet

专题命中 Agent评测 ：agent(abstract)；agentic(abstract)；分类 cs.AI、cs.CL、cs.SE

Comments 10 pages, 4 figures

Human-In-the-Loop Software Development Agents

Wannita Takerngsaksiri, Jirat Pasuksmit, Patanamon Thongtanunam, Chakkrit Tantithamthavorn, Ruixiong Zhang, Fan Jiang, Jing Li, Evan Cook, Kun Chen, Ming Wu

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.LG、cs.SE

Comments 10 pages, 9 figures, ICSE SEIP 2025

Moving Object Segmentation in Point Cloud Data using Hidden Markov Models

Vedant Bhandari, Jasmin James, Tyson Phillips, P. Ross McAree

专题命中 Agent评测 ：agent(abstract)；autonomous agent(abstract)；planning(abstract)

Comments Accepted to the IEEE IROS 2024 workshop on Long-Term Perception for Autonomy in Dynamic Human-shared Environments: What Do Robots Need?

Observational Scaling Laws and the Predictability of Language Model Performance

Yangjun Ruan, Chris J. Maddison, Tatsunori Hashimoto

专题命中 Agent评测 ：agent(abstract)；agentic(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments Accepted at NeurIPS 2024 as a spotlight

Using Generative Agents to Create Tip Sheets for Investigative Data Reporting

Joris Veerbeek, Nicholas Diakopoulos

专题命中 Agent评测 ：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments Short paper to be presented at Computation + Journalism 2024

CARFF: Conditional Auto-encoded Radiance Field for 3D Scene Forecasting

Jiezhi Yang, Khushi Desai, Charles Packer, Harshil Bhatia, Nicholas Rhinehart, Rowan McAllister, Joseph Gonzalez

专题命中 Agent评测 ：agent(abstract)；planning(abstract)；multi-agent(abstract)

Comments ECCV 2024. Project page with video and code: www.carff.website

The Vision of Autonomic Computing: Can LLMs Make It a Reality?

Zhiyang Zhang, Fangkai Yang, Xiaoting Qin, Jue Zhang, Qingwei Lin, Gong Cheng, Dongmei Zhang, Saravan Rajmohan, Qi Zhang

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL、cs.SE

IDAT: A Multi-Modal Dataset and Toolkit for Building and Evaluating Interactive Task-Solving Agents

Shrestha Mohanty, Negar Arabzadeh, Andrea Tupini, Yuxuan Sun, Alexey Skrynnik, Artem Zholus, Marc-Alexandre Côté, Julia Kiseleva

专题命中 Agent评测 ：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.CL、cs.LG

NExT-GPT: Any-to-Any Multimodal LLM

Shengqiong Wu, Hao Fei, Leigang Qu, Wei Ji, Tat-Seng Chua

专题命中 Agent评测 ：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments ICML 2024 (Oral)

Understanding Understanding: A Pragmatic Framework Motivated by Large Language Models

Kevin Leyton-Brown, Yoav Shoham

专题命中 Agent评测 ：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Feedback Loops With Language Models Drive In-Context Reward Hacking

Alexander Pan, Erik Jones, Meena Jagadeesan, Jacob Steinhardt

专题命中 Agent评测 ：agent(abstract)；autonomous agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments ICML 2024 camera-ready

Measuring Social Norms of Large Language Models

Ye Yuan, Kexin Tang, Jianhao Shen, Ming Zhang, Chenguang Wang

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Identifying the Risks of LM Agents with an LM-Emulated Sandbox

Yangjun Ruan, Honghua Dong, Andrew Wang, Silviu Pitis, Yongchao Zhou, Jimmy Ba, Yann Dubois, Chris J. Maddison, Tatsunori Hashimoto

专题命中 Agent评测 ：agent(abstract)；tool use(abstract)；分类 cs.AI、cs.CL、cs.LG

Weaver: Foundation Models for Creative Writing

Tiannan Wang, Jiamin Chen, Qingrui Jia, Shuai Wang, Ruoyu Fang, Huilin Wang, Zhaowei Gao, Chunzhao Xie, Chuou Xu, Jihong Dai, Yibin Liu, Jialong Wu, Shengwei Ding, Long Li, Zhiwei Huang, Xinle Deng, Teng Yu, Gangan Ma, Han Xiao, Zixin Chen, Danjun Xiang, Yunxia Wang, Yuanyuan Zhu, Yi Xiao, Jing Wang, Yiru Wang, Siran Ding, Jiayang Huang, Jiayi Xu, Yilihamu Tayier, Zhenyu Hu, Yuan Gao, Chengfeng Zheng, Yueshu Ye, Yihang Li, Lei Wan, Xinyue Jiang, Yujie Wang, Siyu Cheng, Zhule Song, Xiangru Tang, Xiaohua Xu, Ningyu Zhang, Huajun Chen, Yuchen Eleanor Jiang, Wangchunshu Zhou

专题命中 Agent评测 ：agent(abstract)；function calling(abstract)；分类 cs.AI、cs.CL、cs.LG

Skill-Mix: a Flexible and Expandable Family of Evaluations for AI models

Dingli Yu, Simran Kaur, Arushi Gupta, Jonah Brown-Cohen, Anirudh Goyal, Sanjeev Arora

专题命中 Agent评测 ：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Language Instructed Reinforcement Learning for Human-AI Coordination

Hengyuan Hu, Dorsa Sadigh

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Winning the 3rd Japan Automotive AI Challenge -- Autonomous Racing with the Autoware.Auto Open Source Software Stack

Zirui Zang, Renukanandan Tumu, Johannes Betz, Hongrui Zheng, Rahul Mangharam

专题命中 Agent评测 ：agent(abstract)；planning(abstract)；multi-agent(abstract)

Comments Accepted at Autoware Workshop at IV 2022

MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge

Linxi Fan, Guanzhi Wang, Yunfan Jiang, Ajay Mandlekar, Yuncong Yang, Haoyi Zhu, Andrew Tang, De-An Huang, Yuke Zhu, Anima Anandkumar

专题命中 Agent评测 ：agent(abstract)；autonomous agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments Outstanding Paper Award at NeurIPS 2022. Project website: https://minedojo.org

Don't Copy the Teacher: Data and Model Challenges in Embodied Dialogue

So Yeon Min, Hao Zhu, Ruslan Salakhutdinov, Yonatan Bisk

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments To Appear in the Proceedings of EMNLP 2022

EgoTaskQA: Understanding Human Tasks in Egocentric Videos

Baoxiong Jia, Ting Lei, Song-Chun Zhu, Siyuan Huang

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments Published at NeurIPS Track on Datasets and Benchmarks 2022

ALFWorld: Aligning Text and Embodied Environments for Interactive Learning

Mohit Shridhar, Xingdi Yuan, Marc-Alexandre Côté, Yonatan Bisk, Adam Trischler, Matthew Hausknecht

专题命中 Agent评测 ：agent(abstract)；planning(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments ICLR 2021; Data, code, and videos are available at alfworld.github.io

Simulating Autonomous Driving in Massive Mixed Urban Traffic

Yuanfu Luo, Panpan Cai, Yiyuan Lee, David Hsu

专题命中 Agent评测 ：agent(abstract)；planning(abstract)；multi-agent(abstract)

Comments Journal extension of the ICRA2020 paper (arXiv:1911.04074)

SUMMIT: A Simulator for Urban Driving in Massive Mixed Traffic

Panpan Cai, Yiyuan Lee, Yuanfu Luo, David Hsu

专题命中 Agent评测 ：agent(abstract)；planning(abstract)；multi-agent(abstract)

Robo-Taxi service fleet sizing: assessing the impact of user trust and willingness-to-use

Reza Vosooghi, Joseph Kamel, Jakob Puchinger, Vincent Leblond, Marija Jankovic

专题命中 Agent评测 ：agent(abstract)；planning(abstract)；multi-agent(abstract)

Comments Transportation, Springer Verlag, 2019

AgentGraph: Towards Universal Dialogue Management with Structured Deep Reinforcement Learning

Lu Chen, Zhi Chen, Bowen Tan, Sishan Long, Milica Gasic, Kai Yu

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments 14 pages, 8 figures; Accepted by IEEE/ACM TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING

Architecture for Modular Microsimulation of Real Estate Markets and Transportation

Paul Waddell, Ignacio Garcia-Dorado, Samuel M. Maurer, Geoff Boeing, Max Gardner, Emily Porter, Daniel Aliaga

专题命中 Agent评测 ：agent(abstract)；planning(abstract)；workflow(abstract)

Comments Paper presented at the Symposium on Applied Urban Modelling. Cambridge, England. June 27-29, 2018. arXiv admin note: substantial text overlap with arXiv:1802.09335

Visual Dialog

Abhishek Das, Satwik Kottur, Khushi Gupta, Avi Singh, Deshraj Yadav, José M. F. Moura, Devi Parikh, Dhruv Batra

专题命中 Agent评测 ：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments 23 pages, 18 figures, CVPR 2017 camera-ready, results on VisDial v0.9 dataset, Webpage: http://visualdialog.org