AI Agent

GUI Agents: A Survey

Dang Nguyen, Jian Chen, Yu Wang, Gang Wu, Namyong Park, Zhengmian Hu, Hanjia Lyu, Junda Wu, Ryan Aponte, Yu Xia, Xintong Li, Jing Shi, Hongjie Chen, Viet Dac Lai, Zhouhang Xie, Sungchul Kim, Ruiyi Zhang, Tong Yu, Mehrab Tanjim, Nesreen K. Ahmed, Puneet Mathur, Seunghyun Yoon, Lina Yao, Branislav Kveton, Jihyung Kil, Thien Huu Nguyen, Trung Bui, Tianyi Zhou, Ryan A. Rossi, Franck Dernoncourt

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments Accepted to Findings of ACL 2025

Human-like Navigation in a World Built for Humans

Bhargav Chandaka, Gloria X. Wang, Haozhe Chen, Henry Che, Albert J. Zhai, Shenlong Wang

机构 * University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments CoRL 2025. Project website: https://reasonnav.github.io/

Assistive Decision-Making for Right of Way Navigation at Uncontrolled Intersections

Navya Tiwari, Joseph Vazhaeparampil, Victoria Preston

机构 * Olin College of Engineering（奥林工程学院） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments 6 pages, 5 figures. Accepted as a poster at Northeast Robotics Colloquium (NERC 2025). Extended abstract

Audio-Guided Dynamic Modality Fusion with Stereo-Aware Attention for Audio-Visual Navigation

Jia Li, Yinfeng Yu, Liejun Wang, Fuchun Sun, Wendong Zheng

机构 * Xinjiang Multimodal Intelligent Processing and Information Security Engineering Technology Research Center（新疆多模态智能处理与信息安全工程技术创新中心） ； School of Computer Science and Technology, Xinjiang University（新疆大学计算机科学与技术学院） ； Department of Computer Science and Technology, Tsinghua University（清华大学计算机科学与技术系） ； School of Electrical Engineering and Automation, Tianjin University of Technology（天津理工大学电气工程与自动化学院） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments Main paper (14 pages). Accepted for publication by ICONIP( International Conference on Neural Information Processing) 2025

Walk and Read Less: Improving the Efficiency of Vision-and-Language Navigation via Tuning-Free Multimodal Token Pruning

Wenda Qin, Andrea Burns, Bryan A. Plummer, Margrit Betke

机构 * Boston University（波士顿大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments Accepted to EMNLP 2025. Data and code to be released at https://github.com/wdqin/VLN-NAP

Detecting Pipeline Failures through Fine-Grained Analysis of Web Agents

Daniel Röder, Akhil Juneja, Roland Roller, Sven Schmeier

机构 * German Research Center for Artificial Intelligence (DFKI)（德国人工智能研究中心） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

ActiveVLN: Towards Active Exploration via Multi-Turn RL in Vision-and-Language Navigation

Zekai Zhang, Weiye Zhu, Hewei Pan, Xiangchen Wang, Rongtao Xu, Xing Sun, Feng Zheng

机构 * Southern University of Science and Technology, China（南方科技大学，中国） ； Spatialtemporal AI, China（时空AI，中国） ； MBZUAI, UAE（MBZUAI，阿联酋） ； Tencent Youtu Lab（腾讯优图实验室） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Foundations and Recent Trends in Multimodal Mobile Agents: A Survey

Biao Wu, Yanda Li, Zhiwei Zhang, Yunchao Wei, Meng Fang, Ling Chen

机构 * Australian Artificial Intelligence Institute（澳大利亚人工智能研究所） ； The Pennsylvania State University（宾夕法尼亚州立大学） ； Beijing Jiaotong University（北京交通大学） ； University of Liverpool（利物浦大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments 8 pages, 1 figure

Poison Once, Control Anywhere: Clean-Text Visual Backdoors in VLM-based Mobile Agents

Xuan Wang, Siyuan Liang, Zhe Liu, Yi Yu, Aishan Liu, Yuliang Lu, Xitong Gao, Ee-Chien Chang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments 10 pages

Caution for the Environment: Multimodal LLM Agents are Susceptible to Environmental Distractions

Xinbei Ma, Yiting Wang, Yao Yao, Tongxin Yuan, Aston Zhang, Zhuosheng Zhang, Hai Zhao

机构 * School of Computer Science（计算机学院） ； Key Laboratory of Shanghai Education Commission for Intelligent Interaction and Cognitive Engineering（智能交互与认知工程重点实验室） ； Shanghai Jiao Tong University（上海交通大学） ； Shanghai Key Laboratory of Trusted Data Circulation and Governance in Web3（Web3可信数据流通与治理上海市重点实验室） ； GenAI, Meta（Meta GenAI） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

Comments ACL 2025

The Role of Embodiment in Intuitive Whole-Body Teleoperation for Mobile Manipulation

Sophia Bianchi Moyen, Rickmer Krohn, Sophie Lueth, Kay Pompetzki, Jan Peters, Vignesh Prasad, Georgia Chalvatzaki

机构 * Computer Science Department, TU Darmstadt（图恩-达姆施塔特大学计算机科学系） ； University of São Paulo（圣保罗大学） ； Centre for Cognitive Science, TU Darmstadt（图恩-达姆施塔特大学认知科学中心） ； Systems AI for Robot Learning, German Research Center for AI (DFKI)（德国人工智能研究中心（DFKI）机器人学习系统AI） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.LG

Comments 8 pages, 8 figures, Accepted at the IEEE-RAS International Conference on Humanoid Robots (Humanoids) 2025

IoT-based Noise Monitoring using Mobile Nodes for Smart Cities

Bhima Sankar Manthina, Shreyash Gujar, Sachin Chaudhari, Kavita Vemuri1, Shivam Chhirolya

机构 * Prezent.AI, India（Prezent.AI, 印度） ； International Institute of Information Technology-Hyderabad (IIIT-H), India（国际信息科技研究所-海得拉巴（IIIT-H），印度） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.LG

MobiAgent: A Systematic Framework for Customizable Mobile Agents

Cheng Zhang, Erhu Feng, Xi Zhao, Yisheng Zhao, Wangbo Gong, Jiahui Sun, Dong Du, Zhichao Hua, Yubin Xia, Haibo Chen

机构 * Institute of Parallel and Distributed Systems (IPADS)（并行与分布式系统研究所） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Jacobian Exploratory Dual-Phase Reinforcement Learning for Dynamic Endoluminal Navigation of Deformable Continuum Robots

Yu Tian, Chi Kit Ng, Hongliang Ren

机构 * The Department of Electronic Engineering, The Chinese University of Hong Kong（电子工程系，香港中文大学） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Contact-Aided Navigation of Flexible Robotic Endoscope Using Deep Reinforcement Learning in Dynamic Stomach

Chi Kit Ng, Huxin Gao, Tian-Ao Ren, Jiewen Lai, Hongliang Ren

机构 * Department of Electronic Engineering, The Chinese University of Hong Kong, Shatin, N.T., Hong Kong, China（电子工程系，香港中文大学（深圳）沙田分校，香港，中国） ； Department of Mechanical Engineering, Stanford University（机械工程系，斯坦福大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Morae: Proactively Pausing UI Agents for User Choices

Yi-Hao Peng, Dingzeyu Li, Jeffrey P. Bigham, Amy Pavel

机构 * Carnegie Mellon University（卡内基梅隆大学） ； Adobe Research（Adobe研究） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

Comments ACM UIST 2025

A Lightweight Crowd Model for Robot Social Navigation

Maryam Kazemi Eskeri, Thomas Wiedemann, Ville Kyrki, Dominik Baumann, Tomasz Piotr Kucner

机构 * Department of Electrical Engineering and Automation, Aalto University（艾尔沃斯大学电气工程与自动化系） ； Chair of Perception for Intelligent Systems, TU Munich（慕尼黑工业大学智能系统感知 chair） ； Institute of Communications and Navigation, German Aerospace Center (DLR)（德国航空航天中心通讯与导航研究所） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.LG

Comments 7 pages, 6 figures, accepted in ECMR 2025

SE-VLN: A Self-Evolving Vision-Language Navigation Framework Based on Multimodal Large Language Models

Xiangyu Dong, Haoran Zhao, Jiang Gao, Haozhou Li, Xiaoguang Ma, Yaoming Zhou, Fuhai Chen, Juan Liu

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Increasing Interaction Fidelity: Training Routines for Biomechanical Models in HCI

Michał Patryk Miazga, Patrick Ebel

机构 * ScaDS.AI, Leipzig University（ScaDS.AI，莱比锡大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Journal ref The 38th Annual ACM Symposium on User Interface Software and Technology (UIST Adjunct 2025)

Hierarchical Decision-Making for Autonomous Navigation: Integrating Deep Reinforcement Learning and Fuzzy Logic in Four-Wheel Independent Steering and Driving Systems

Yizhi Wang, Degang Xu, Yongfang Xie, Shuzhong Tan, Xianan Zhou, Peng Chen

机构 * School of Automation, Central South University（自动化学院，中南大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Deep Reinforcement Learning with anticipatory reward in LSTM for Collision Avoidance of Mobile Robots

Olivier Poulet, Frédéric Guinand, François Guérin

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Safety of Embodied Navigation: A Survey

Zixia Wang, Jia Hu, Ronghui Mu

机构 * University of Exeter（埃克塞特大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Navigation Pixie: Implementation and Empirical Study Toward On-demand Navigation Agents in Commercial Metaverse

Hikari Yanagawa, Yuichi Hiroi, Satomi Tokida, Yuji Hatada, Takefumi Hiraki

机构 * Cluster Metaverse Lab University of Tsukuba（茨川大学集群元宇宙实验室） ； Cluster Metaverse Lab（集群元宇宙实验室） ； The University of Tokyo（东京大学） ； University of Tsukuba（茨川大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments 11 pages + supplement 3 pages. To appear in IEEE ISMAR 2025

AeroSafe: Mobile Indoor Air Purification using Aerosol Residence Time Analysis and Robotic Cough Emulator Testbed

M Tanjid Hasan Tonmoy, Rahath Malladi, Kaustubh Singh, Forsad Al Hossain, Rajesh Gupta, Andrés E. Tejada-Martínez, Tauhidur Rahman

机构 * University of California San Diego（加州大学圣地亚哥分校） ； Plaksha University（Plaksha大学） ； University of Massachusetts Amherst（马萨诸塞大学阿默斯特分校） ； University of South Florida（佛罗里达州立大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments Accepted at IEEE International Conference on Robotics and Automation (ICRA) 2025. Author Accepted Manuscript

Generative AI as a Pillar for Predicting 2D and 3D Wildfire Spread: Beyond Physics-Based Models and Traditional Deep Learning

Haowen Xu, Sisi Zlatanova, Ruiyu Liang, Ismet Canbulat

机构 * GRID, School of Built Environment, UNSW Sydney, NSW 2052 Australia（GRID，环境建筑学院，新南威尔士大学悉尼分校） ； School of Minerals and Energy Resources Engineering, UNSW Sydney, NSW 2052 Australia（矿物与能源资源工程学院，新南威尔士大学悉尼分校） 纠错

专题命中 GUI与网页智能体 ：agentic(abstract)；分类 cs.AI

Quality-of-Service Aware LLM Routing for Edge Computing with Multiple Experts

Jin Yang, Qiong Wu, Zhiying Feng, Zhi Zhou, Deke Guo, Xu Chen

机构 * School of Computer Science and Engineering, Sun Yat-sen University（中山大学计算机科学与工程学院） ； Department of Computer Science and Engineering, The Hong Kong University of Science and Technology（香港科学与技术大学计算机科学与工程系） ； College of Systems Engineering, National University of Defense Technology（国防科技大学系统工程学院） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments Accepted by IEEE Transactions on Mobile Computing

Phi-Ground Tech Report: Advancing Perception in GUI Grounding

Miaosen Zhang, Ziqiang Xu, Jialiang Zhu, Qi Dai, Kai Qiu, Yifan Yang, Chong Luo, Tianyi Chen, Justin Wagle, Tim Franklin, Baining Guo

机构 * Microsoft（微软） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

GSON: A Group-based Social Navigation Framework with Large Multimodal Model

Shangyi Luo, Peng Sun, Ji Zhu, Yuhong Deng, Cunjun Yu, Anxing Xiao, Xueqian Wang

机构 * Center for Artificial Intelligence and Robotics, Tsinghua Shenzhen International Graduate School（人工智能与机器人中心，清华大学深圳国际研究生院） ； School of Computing, National University of Singapore（computing 学院，新加坡国立大学） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments Accepted by IEEE Robotics and Automation Letters (RA-L)

Adaptive and Accessible User Interfaces for Seniors Through Model-Driven Engineering

Shavindra Wickramathilaka, John Grundy, Kashumi Madampe, Omar Haggag

专题命中 GUI与网页智能体 ：workflow(abstract)；分类 cs.SE

Comments This paper has been accepted in the Automated Software Engineering Journal (ASEJ)

IndoorBEV: Joint Detection and Footprint Completion of Objects via Mask-based Prediction in Indoor Scenarios for Bird's-Eye View Perception

Haichuan Li, Changda Tian, Panos Trahanias, Tomi Westerlund

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI