AI Agent

Aria-UI: Visual Grounding for GUI Instructions

Yuhao Yang, Yue Wang, Dongxu Li, Ziyang Luo, Bei Chen, Chao Huang, Junnan Li

专题命中 GUI与网页智能体 ：agent(abstract)；planning(abstract)；分类 cs.AI

Comments ACL 2025

Audio-Driven Reinforcement Learning for Head-Orientation in Naturalistic Environments

Wessel Ledder, Yuzhen Qin, Kiki van der Heijden

机构 * Radboud University（拉德堡德大学） ； Donders Institute（多纳德研究所） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；autonomous agent(abstract)；分类 cs.AI

Comments Accepted at ICASSP 2025

Journal ref Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), pp. 1-5, 2025

Context manipulation attacks : Web agents are susceptible to corrupted memory

Atharv Singh Patlan, Ashwin Hebbar, Pramod Viswanath, Prateek Mittal

机构 * princeton（普林斯顿大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；agentic(abstract)；分类 cs.AI

Comments 10 pages, 6 figures

The Discovery Engine: A Framework for AI-Driven Synthesis and Navigation of Scientific Knowledge Landscapes

Vladimir Baulin, Austin Cook, Daniel Friedman, Janna Lumiruusu, Andrew Pashea, Shagor Rahman, Benedikt Waldeck

机构 * Active Inference Institute（主动推断研究所） ； Universitat Rovira i Virgili（罗维拉-维格利大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；AI agent(abstract)；分类 cs.AI

MedBrowseComp: Benchmarking Medical Deep Research and Computer Use

Shan Chen, Pedro Moreira, Yuxin Xiao, Sam Schmidgall, Jeremy Warner, Hugo Aerts, Thomas Hartvigsen, Jack Gallifant, Danielle S. Bitterman

机构 * Harvard（哈佛大学） ； Mass General Brigham（麻省总医院） ； Boston Children’s Hospital（波士顿儿童医院） ； MIT（麻省理工学院） ； Universitat Pompeu Fabra（庞培法华大学） ； Johns Hopkins University（约翰霍普金斯大学） ； Brown University（布朗大学） ； Maastricht University（马斯特里赫特大学） ； University of Virginia（弗吉尼亚大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；agentic(abstract)；分类 cs.CL

Comments You can visit our project page at: https://moreirap12.github.io/mbc-browse-app/

ViMo: A Generative Visual GUI World Model for App Agents

Dezhao Luo, Bohan Tang, Kang Li, Georgios Papoudakis, Jifei Song, Shaogang Gong, Jianye Hao, Jun Wang, Kun Shao

机构 * Queen Mary University of London（伦敦女王学院） ； University of Oxford（牛津大学） ； Huawei Noah’s Ark Lab（华为诺亚实验室） ； University College London（伦敦大学学院） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；planning(abstract)；分类 cs.LG

Comments https://ai-agents-2030.github.io/ViMo/

SafePath: Conformal Prediction for Safe LLM-Based Autonomous Navigation

Achref Doula, Max Mühlhäuser, Alejandro Sanchez Guinea

机构 * Technical University of Darmstadt（德累斯顿技术大学） ； NTT Data（NTT数据） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；planning(abstract)；分类 cs.LG

A Survey on GUI Agents with Foundation Models Enhanced by Reinforcement Learning

Jiahao Li, Kaer Huang

机构 * Lenovo Research（联想研究院） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；planning(abstract)；分类 cs.AI

Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction

Yiheng Xu, Zekun Wang, Junli Wang, Dunjie Lu, Tianbao Xie, Amrita Saha, Doyen Sahoo, Tao Yu, Caiming Xiong

专题命中 GUI与网页智能体 ：agent(abstract)；planning(abstract)；分类 cs.CL

Comments ICML 2025

ScaleTrack: Scaling and back-tracking Automated GUI Agents

Jing Huang, Zhixiong Zeng, Wenkang Han, Yufeng Zhong, Liming Zheng, Shuai Fu, Jingyuan Chen, Lin Ma

机构 * Meituan（美团） ； Zhejiang University（浙江大学） ； University of Adelaide（阿德莱德大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；planning(abstract)；分类 cs.AI

Cooperative Task Offloading through Asynchronous Deep Reinforcement Learning in Mobile Edge Computing for Future Networks

Yuelin Liu, Haiyuan Li, Xenofon Vasilakos, Rasheed Hussain, Dimitra Simeonidou

机构 * High Performance Networks (HPN) Research Group, Smart Internet Lab, University of Bristol（布里斯托大学智能互联网实验室） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；multi-agent(abstract)；分类 cs.LG

Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigation

Hyungjoo Chae, Namyoung Kim, Kai Tzu-iunn Ong, Minju Gwak, Gwanwoo Song, Jihoon Kim, Sunghwan Kim, Dongha Lee, Jinyoung Yeo

专题命中 GUI与网页智能体 ：agent(abstract)；autonomous agent(abstract)；分类 cs.CL

Comments ICLR 2025

Safe Human Robot Navigation in Warehouse Scenario

Seth Farrell, Chenghao Li, Hongzhan Yu, Ryo Yoshimitsu, Sicun Gao, Henrik I. Christensen

专题命中 GUI与网页智能体 ：agent(abstract)；multi-agent(abstract)；分类 cs.LG

From Text to Space: Mapping Abstract Spatial Models in LLMs during a Grid-World Navigation Task

Nicolas Martorell

专题命中 GUI与网页智能体 ：agent(abstract)；agentic(abstract)；分类 cs.AI

UITrans: Seamless UI Translation from Android to HarmonyOS

Lina Gong, Chen Wang, Yujun Huang, Di Cui, Mingqiang Wei

专题命中 GUI与网页智能体 ：agent(abstract)；multi-agent(abstract)；分类 cs.SE

Comments 5 pages

Feudal Networks for Visual Navigation

Faith Johnson, Bryan Bo Cao, Ashwin Ashok, Shubham Jain, Kristin Dana

专题命中 GUI与网页智能体 ：agent(abstract)；planning(abstract)；分类 cs.LG

From Voice to Value: Leveraging AI to Enhance Spoken Online Reviews on the Go

Kavindu Ravishan, Dániel Szabó, Niels van Berkel, Aku Visuri, Chi-Lan Yang, Koji Yatani, Simo Hosio

专题命中 GUI与网页智能体 ：agent(abstract)；AI agent(abstract)；分类 cs.AI

Comments \c{opyright} Kavindu Ravishan | ACM 2024. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in the Proceedings of the ACM Conference on Mobile and Ubiquitous Multimedia (MUM '24), http://dx.doi.org/10.1145/3701571.3701593

Journal ref International Conference on Mobile and Ubiquitous Multimedia MUM '24, December 1-4, 2024, Stockholm, Sweden

Vision-Based Deep Reinforcement Learning of UAV Autonomous Navigation Using Privileged Information

Junqiao Wang, Zhongliang Yu, Dong Zhou, Jiaqi Shi, Runran Deng

专题命中 GUI与网页智能体 ：agent(abstract)；multi-agent(abstract)；分类 cs.LG

Comments 19 pages, 9 figures

Seeing is Believing: Vision-driven Non-crash Functional Bug Detection for Mobile Apps

Zhe Liu, Cheng Li, Chunyang Chen, Junjie Wang, Mengzhuo Chen, Boyu Wu, Yawen Wang, Jun Hu, Qing Wang

专题命中 GUI与网页智能体 ：agent(abstract)；multi-agent(abstract)；分类 cs.SE

EDGE: Enhanced Grounded GUI Understanding with Enriched Multi-Granularity Synthetic Data

Xuetian Chen, Hangcheng Li, Jiaqing Liang, Sihang Jiang, Deqing Yang

专题命中 GUI与网页智能体 ：agent(abstract)；autonomous agent(abstract)；分类 cs.AI

Refusal-Trained LLMs Are Easily Jailbroken As Browser Agents

Priyanshu Kumar, Elaine Lau, Saranya Vijayakumar, Tu Trinh, Scale Red Team, Elaine Chang, Vaughn Robinson, Sean Hendryx, Shuyan Zhou, Matt Fredrikson, Summer Yue, Zifan Wang

专题命中 GUI与网页智能体 ：agent(abstract)；agentic(abstract)；分类 cs.LG

Navigation in a simplified Urban Flow through Deep Reinforcement Learning

Federica Tonti, Jean Rabault, Ricardo Vinuesa

专题命中 GUI与网页智能体 ：agent(abstract)；planning(abstract)；分类 cs.AI

DIDUP: Dynamic Iterative Development for UI Prototyping

Jenny Ma, Karthik Sreedhar, Vivian Liu, Sitong Wang, Pedro Alejandro Perez, Lydia B. Chilton

专题命中 GUI与网页智能体 ：planning(abstract)；workflow(abstract)；分类 cs.SE

Comments 5 pages, 3 figures

Decentralized Task Offloading and Load-Balancing for Mobile Edge Computing in Dense Networks

Mariam Yahya, Alexander Conzelmann, Setareh Maghsudi

专题命中 GUI与网页智能体 ：agent(abstract)；multi-agent(abstract)；分类 cs.LG

Transformers for Image-Goal Navigation

Nikhilanj Pelluri

专题命中 GUI与网页智能体 ：agent(abstract)；planning(abstract)；分类 cs.LG

Comments NOTE: This work was submitted as part of a Master's Capstone Project and must be treated as such. This is still an early work in progress and not the final version

A Learning-based Incentive Mechanism for Mobile AIGC Service in Decentralized Internet of Vehicles

Jiani Fan, Minrui Xu, Ziyao Liu, Huanyi Ye, Chaojie Gu, Dusit Niyato, Kwok-Yan Lam

专题命中 GUI与网页智能体 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI

Comments 2023 IEEE 98th Vehicular Technology Conference (VTC2023-Fall)

WROOM: An Autonomous Driving Approach for Off-Road Navigation

Dvij Kalaria, Shreya Sharma, Sarthak Bhagat, Haoru Xue, John M. Dolan

专题命中 GUI与网页智能体 ：agent(abstract)；planning(abstract)；分类 cs.LG

Multi-Object Navigation in real environments using hybrid policies

Assem Sadek, Guillaume Bono, Boris Chidlovskii, Atilla Baskurt, Christian Wolf

专题命中 GUI与网页智能体 ：agent(abstract)；planning(abstract)；分类 cs.AI

Decentralized Social Navigation with Non-Cooperative Robots via Bi-Level Optimization

Rohan Chandra, Rahul Menon, Zayne Sprague, Arya Anantula, Joydeep Biswas

专题命中 GUI与网页智能体 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI

Comments Submitted to IROS 2023

Navigates Like Me: Understanding How People Evaluate Human-Like AI in Video Games

Stephanie Milani, Arthur Juliani, Ida Momennejad, Raluca Georgescu, Jaroslaw Rzpecki, Alison Shaw, Gavin Costello, Fei Fang, Sam Devlin, Katja Hofmann

专题命中 GUI与网页智能体 ：agent(abstract)；AI agent(abstract)；分类 cs.LG

Comments 18 pages; accepted at CHI 2023