AI Agent

WebLINX: Real-World Website Navigation with Multi-Turn Dialogue

Xing Han Lù, Zdeněk Kasner, Siva Reddy

机构 * Department of XXX, University of YYY, Location, Country（XXX系，YYY大学，地点，国家） ； School of ZZZ, Institute of WWW, Location, Country（ZZZ学院，WWW研究所，地点，国家） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL、cs.LG

Small Models, Big Results: Achieving Superior Intent Extraction through Decomposition

Danielle Cohen, Yoni Halpern, Noam Kahlon, Joel Oren, Omri Berkovitch, Sapir Caduri, Ido Dagan, Anatoly Efros

机构 * Google（谷歌） ； Bar-Ilan University（巴伊兰大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

TANGO: Traversability-Aware Navigation with Local Metric Control for Topological Goals

Stefan Podgorski, Sourav Garg, Mehdi Hosseinzadeh, Lachlan Mares, Feras Dayoub, Ian Reid

机构 * Australian Institute for Machine Learning (AIML)（澳大利亚机器学习研究所） ； The University of Adelaide（阿德莱德大学） ； Mohamed Bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.LG

Comments 9 pages, 5 figures, ICRA 2025

MCP-Universe: Benchmarking Large Language Models with Real-World Model Context Protocol Servers

Ziyang Luo, Zhiqi Shen, Wenzhuo Yang, Zirui Zhao, Prathyusha Jwalapuram, Amrita Saha, Doyen Sahoo, Silvio Savarese, Caiming Xiong, Junnan Li

机构 * Salesforce AI Research（Salesforce人工智能研究） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments Website: https://mcp-universe.github.io

UoMo: A Universal Model of Mobile Traffic Forecasting for Wireless Network Optimization

Haoye Chai, Shiyuan Zhang, Xiaoqian Qi, Baohua Qiu, Yong Li

机构 * Department of Electronic Engineering, BNRist, Tsinghua University（电子工程系，BNRist，清华大学） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.LG

Comments 2025 ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2025

Towards Generalizable Safety in Crowd Navigation via Conformal Uncertainty Handling

Jianpeng Yao, Xiaopan Zhang, Yu Xia, Zejin Wang, Amit K. Roy-Chowdhury, Jiachen Li

机构 * University of California, Riverside（加州大学河滨分校） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments 9th Conference on Robot Learning (CoRL 2025); Project website: https://gen-safe-nav.github.io/. arXiv admin note: text overlap with arXiv:2407.17460

WebGuard: Building a Generalizable Guardrail for Web Agents

Boyuan Zheng, Zeyi Liao, Scott Salisbury, Zeyuan Liu, Michael Lin, Qinyuan Zheng, Zifan Wang, Xiang Deng, Dawn Song, Huan Sun, Yu Su

机构 * The Ohio State University（俄亥俄州立大学） ； Scale AI ； University of California, Berkeley（加州大学伯克利分校） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments We publicly release WebGuard, along with its annotation tools and fine-tuned models, to facilitate open-source research on monitoring and safeguarding web agents. All resources are available at https://github.com/OSU-NLP-Group/WebGuard

Toward Autonomous UI Exploration: The UIExplorer Benchmark

Andrei Cristian Nica, Akshaya Vishnu Kudlu Shanbhogue, Harshil Shah, Aleix Cambray, Tudor Berariu, Lucas Maystre, David Barber

专题命中 GUI与网页智能体 ：autonomous agent(abstract)；分类 cs.AI、cs.LG

Cross from Left to Right Brain: Adaptive Text Dreamer for Vision-and-Language Navigation

Pingrui Zhang, Yifei Su, Pengyuan Wu, Dong An, Li Zhang, Zhigang Wang, Dong Wang, Yan Ding, Bin Zhao, Xuelong Li

机构 * Fudan University（复旦大学） ； Shanghai AI Laboratory（上海人工智能实验室） ； School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院） ； MAIS, Institute of Automation of Chinese Academy of Sciences（中国科学院自动化研究所MAIS） ； Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学） ； University of Science and Technology of China（中国科学技术大学） ； TeleAI, China Telecom Corp Ltd（中国电信TeleAI） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents

Boyu Gou, Ruohan Wang, Boyuan Zheng, Yanan Xie, Cheng Chang, Yiheng Shu, Huan Sun, Yu Su

机构 * The Ohio State University（俄亥俄州立大学） ； Orby AI（Orby人工智能） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments Accepted to ICLR 2025 (Oral). Project Homepage: https://osu-nlp-group.github.io/UGround/

Big Help or Big Brother? Auditing Tracking, Profiling, and Personalization in Generative AI Assistants

Yash Vekaria, Aurelio Loris Canino, Jonathan Levitsky, Alex Ciechonski, Patricia Callejo, Anna Maria Mandalari, Zubair Shafiq

机构 * UC Davis（加州大学戴维斯分校） ； UNIRC（意大利国家研究委员会） ； UCL（伦敦大学学院） ； UC3M（马德里卡洛斯三世大学） 纠错

专题命中 GUI与网页智能体 ：agentic(abstract)；分类 cs.AI、cs.CL

Multimodal Spatial Language Maps for Robot Navigation and Manipulation

Chenguang Huang, Oier Mees, Andy Zeng, Wolfram Burgard

机构 * University of Technology Nuremberg（图恩堡技术大学） ； UC Berkeley（伯克利大学） ； Google Research（谷歌研究） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments accepted to International Journal of Robotics Research (IJRR). 24 pages, 18 figures. The paper contains texts from VLMaps(arXiv:2210.05714) and AVLMaps(arXiv:2303.07522). The project page is https://mslmaps.github.io/

A Survey on (M)LLM-Based GUI Agents

Fei Tang, Haolei Xu, Hang Zhang, Siqi Chen, Xingyu Wu, Yongliang Shen, Wenqi Zhang, Guiyang Hou, Zeqi Tan, Yuchen Yan, Kaitao Song, Jian Shao, Weiming Lu, Jun Xiao, Yueting Zhuang

机构 * Zhejiang University（浙江大学） ； Microsoft Research Asia（微软亚洲研究院） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.CL

GUICourse: From General Vision Language Models to Versatile GUI Agents

Wentong Chen, Junbo Cui, Jinyi Hu, Yujia Qin, Junjie Fang, Yue Zhao, Chongyi Wang, Jun Liu, Guirong Chen, Yupeng Huo, Yuan Yao, Yankai Lin, Zhiyuan Liu, Maosong Sun

机构 * Renmin University of China（中国人民大学） ； Tsinghua University（清华大学） ； Xiamen University（厦门大学） ； BUPT（北邮） ； ModelBest ； Chinese Academy of Sciences（中国科学院） ； National University of Singapore（新加坡国立大学） ； Shanghai Qi Zhi Institute（上海启智研究院） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

ZeroGUI: Automating Online GUI Learning at Zero Human Cost

Chenyu Yang, Shiqian Su, Shi Liu, Xuan Dong, Yue Yu, Weijie Su, Xuehui Wang, Zhaoyang Liu, Jinguo Zhu, Hao Li, Wenhai Wang, Yu Qiao, Xizhou Zhu, Jifeng Dai

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

M3Bench: Benchmarking Whole-body Motion Generation for Mobile Manipulation in 3D Scenes

Zeyu Zhang, Sixu Yan, Muzhi Han, Zaijin Wang, Xinggang Wang, Song-Chun Zhu, Hangxin Liu

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments This paper has been accepted by IEEE Robotics and Automation Letters 2025 (RA-L)

Journal ref IEEE Robotics and Automation Letters 2025

UI-Genie: A Self-Improving Approach for Iteratively Boosting MLLM-based Mobile GUI Agents

Han Xiao, Guozhi Wang, Yuxiang Chai, Zimu Lu, Weifeng Lin, Hao He, Lue Fan, Liuyang Bian, Rui Hu, Liang Liu, Shuai Ren, Yafei Wen, Xiaoxin Chen, Aojun Zhou, Hongsheng Li

机构 * CUHK MMLab（香港中文大学MML实验室） ； vivo AI Lab（vivo人工智能实验室） ； CPII under InnoHK（创新科技署下的CPII） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL、cs.LG

Comments https://github.com/Euphoria16/UI-Genie

GUI-G1: Understanding R1-Zero-Like Training for Visual Grounding in GUI Agents

Yuqi Zhou, Sunhao Dai, Shuai Wang, Kaiwen Zhou, Qinglin Jia, Jun Xu

机构 * Gaoling School of Artificial Intelligence, Renmin University of China（中国人民大学 Gallagher人工智能学院） ； Huawei Noah’s Ark Lab（华为诺亚实验室） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

LLM-Explorer: Towards Efficient and Affordable LLM-based Exploration for Mobile Apps

Shanhui Zhao, Hao Wen, Wenjie Du, Cheng Liang, Yunxin Liu, Xiaozhou Ye, Ye Ouyang, Yuanchun Li

机构 * Institute for AI Industry Research (AIR), Tsinghua University（人工智能产业研究院（AIR），清华大学） ； Hong Kong University of Science and Technology（香港科学与技术大学） ； Beijing University of Posts and Telecommunications（北京邮电大学） ； AsiaInfo Technologies (China), Inc（亚洲信息科技（中国）有限公司） ； Shanghai Artificial Intelligence Laboratory（上海人工智能实验室） ； Beijing Academy of Artificial Intelligence (BAAI)（北京人工智能研究院） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.SE

Comments Accepted by MobiCom 2025

AI and Vision based Autonomous Navigation of Nano-Drones in Partially-Known Environments

Mattia Sartori, Chetna Singhal, Neelabhro Roy, Davide Brunelli, James Gross

机构 * KTH Royal Institute of Technology（皇家理工学院） ； Inria France（法国国家信息与自动化研究所） ； University of Trento（特伦托大学） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.LG

Comments in DCOSS-IoT 2025, Wi-DroIT 2025

UI-Vision: A Desktop-centric GUI Benchmark for Visual Perception and Interaction

Shravan Nayak, Xiangru Jian, Kevin Qinghong Lin, Juan A. Rodriguez, Montek Kalsi, Rabiul Awal, Nicolas Chapados, M. Tamer Özsu, Aishwarya Agrawal, David Vazquez, Christopher Pal, Perouz Taslakian, Spandana Gella, Sai Rajeswar

机构 * Mila - Quebec AI Institute（魁北克AI研究所） ； University of Waterloo（滑铁卢大学） ； National University of Singapore（新加坡国立大学） ； CIFAR AI Chair（CIFAR人工智能职位） 纠错

专题命中 GUI与网页智能体 ：autonomous agent(abstract)；分类 cs.AI、cs.CL

Comments This paper has been accepted to the 41st International Conference on Machine Learning (ICML 2025)

Enhance Exploration in Safe Reinforcement Learning with Contrastive Representation Learning

Duc Kien Doan, Bang Giang Le, Viet Cuong Ta

机构 * HMI Laboratory VNU University of Engineering and Technology（VNU工程技术大学HMI实验室） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments Accepted at ACIIDS 2025

Mission-driven Exploration for Accelerated Deep Reinforcement Learning with Temporal Logic Task Specifications

Jun Wang, Hosein Hasanbeig, Kaiyuan Tan, Zihe Sun, Yiannis Kantaros

机构 * Washington University in St. Louis（华盛顿大学圣路易斯分校） ； Microsoft Research（微软研究院） ； Vanderbilt University（范德比尔特大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

WebLists: Extracting Structured Information From Complex Interactive Websites Using Executable LLM Agents

Arth Bohra, Manvel Saroyan, Danil Melkozerov, Vahe Karufanyan, Gabriel Maher, Pascal Weinberger, Artem Harutyunyan, Giovanni Campagna

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Navigation World Models

Amir Bar, Gaoyue Zhou, Danny Tran, Trevor Darrell, Yann LeCun

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.LG

Comments CVPR 2025. Project page: https://www.amirbar.net/nwm/

SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skills

Boyuan Zheng, Michael Y. Fatemi, Xiaolong Jin, Zora Zhiruo Wang, Apurva Gandhi, Yueqi Song, Yu Gu, Jayanth Srinivasa, Gaowen Liu, Graham Neubig, Yu Su

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Large Language Models Empowered Personalized Web Agents

Hongru Cai, Yongqi Li, Wenjie Wang, Fengbin Zhu, Xiaoyu Shen, Wenjie Li, Tat-Seng Chua

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments Accepted to WWW 2025. The code and data are available on the project website https://hongrucai.github.io/PersonalWAB/

GUI-World: A Video Benchmark and Dataset for Multimodal GUI-oriented Understanding

Dongping Chen, Yue Huang, Siyuan Wu, Jingyu Tang, Liuyi Chen, Yilin Bai, Zhigang He, Chenlong Wang, Huichi Zhou, Yiqiang Li, Tianshuo Zhou, Yue Yu, Chujie Gao, Qihui Zhang, Yi Gui, Zhen Li, Yao Wan, Pan Zhou, Jianfeng Gao, Lichao Sun

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments Accepted by ICLR 2025

SafeSlice: Enabling SLA-Compliant O-RAN Slicing via Safe Deep Reinforcement Learning

Ahmad M. Nagib, Hatem Abou-Zeid, Hossam S. Hassanein

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments This article has been accepted for presentation in the IEEE International Conference on Machine Learning for Communication and Networking (ICMLCN) 2025

Virtual Guidance as a Mid-level Representation for Navigation with Augmented Reality

Hsuan-Kung Yang, Tsung-Chih Chiang, Jou-Min Liu, Ting-Ru Liu, Chun-Wei Huang, Tsu-Ching Hsiao, Chun-Yi Lee

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments Tsung-Chih Chiang, Jou-Min Liu, Ting-Ru Liu, and Chun-Wei Huang contributed equally to this work; This work has been submitted to the IEEE for possible publication