AI Agent

AutoDroid-V2: Boosting SLM-based GUI Agents via Code Generation

Hao Wen, Shizuo Tian, Borislav Pavlov, Wenjie Du, Yixuan Li, Ge Chang, Shanhui Zhao, Jiacheng Liu, Yunxin Liu, Ya-Qin Zhang, Yuanchun Li

机构 * Institute for AI Industry Research (AIR), Tsinghua University（人工智能产业研究院（AIR），清华大学） ； Shanghai Artificial Intelligence Laboratory（上海人工智能实验室） ； Beijing Academy of Artificial Intelligence (BAAI)（北京人工智能研究院） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments 13 pages, 5 figures

Towards Autonomous Micromobility through Scalable Urban Simulation

Wayne Wu, Honglin He, Chaoyuan Zhang, Jack He, Seth Z. Zhao, Ran Gong, Quanyi Li, Bolei Zhou

专题命中 GUI与网页智能体 ：AI agent(abstract)；分类 cs.AI

Comments CVPR 2025 Highlight. Project page: https://metadriverse.github.io/urban-sim/

SimPRIVE: a Simulation framework for Physical Robot Interaction with Virtual Environments

Federico Nesti, Gianluca D'Amico, Mauro Marinoni, Giorgio Buttazzo

机构 * Department of Excellence in Robotics & AI（机器人与人工智能卓越部门） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments Submitted to IEEE ITSC 2025

Unsupervised Feature Transformation via In-context Generation, Generator-critic LLM Agents, and Duet-play Teaming

Nanxu Gong, Xinyuan Wang, Wangyang Ying, Haoyue Bai, Sixun Dong, Haifeng Chen, Yanjie Fu

机构 * School of Computing and Augmented Intelligence, Arizona State University（计算与增强智能学院，亚利桑那州立大学） ； NEC Laboratories America（NEC美国实验室） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments Accepted to IJCAI 2025

Guiding VLM Agents with Process Rewards at Inference Time for GUI Navigation

Zhiyuan Hu, Shiyun Xiong, Yifan Zhang, See-Kiong Ng, Anh Tuan Luu, Bo An, Shuicheng Yan, Bryan Hooi

机构 * National University of Singapore（新加坡国立大学） ； Skywork AI ； Nanyang Technological University（南洋理工大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

AUTONAV: A Toolfor Autonomous Navigation of Robots

Mir Md Sajid Sarwar, Sudip Samanta, Rajarshi Ray

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments 5 pages, 5 figures

The Obvious Invisible Threat: LLM-Powered GUI Agents' Vulnerability to Fine-Print Injections

Chaoran Chen, Zhiping Zhang, Bingcan Guo, Shang Ma, Ibrahim Khalilov, Simret A Gebreegziabher, Yanfang Ye, Ziang Xiao, Yaxing Yao, Tianshi Li, Toby Jia-Jun Li

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

ATLASv2: LLM-Guided Adaptive Landmark Acquisition and Navigation on the Edge

Mikolaj Walczak, Uttej Kallakuri, Tinoosh Mohsenin

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

AppAgentX: Evolving GUI Agents as Proficient Smartphone Users

Wenjia Jiang, Yangyang Zhuang, Chenxi Song, Xu Yang, Joey Tianyi Zhou, Chi Zhang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

MLANet: Multi-Level Attention Network with Sub-instruction for Continuous Vision-and-Language Navigation

Zongtao He, Liuyi Wang, Shu Li, Qingqing Yan, Chengju Liu, Qijun Chen

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

Journal ref Appl Intell 55, 657 (2025)

Explorer: Robust Collection of Interactable GUI Elements

Iason Chaimalas, Arnas Vyšniauskas, Gabriel Brostow

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments 19 pages, 17 figures

Efficient Active Imitation Learning with Random Network Distillation

Emilien Biré, Anthony Kobanda, Ludovic Denoyer, Rémy Portelas

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments Accepted at ICLR 2025

ScreenLLM: Stateful Screen Schema for Efficient Action Understanding and Prediction

Yiqiao Jin, Stefano Petrangeli, Yu Shen, Gang Wu

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

Comments Accepted to MM4SG Workshop at The Web Conference 2025

Optimizing Navigation And Chemical Application in Precision Agriculture With Deep Reinforcement Learning And Conditional Action Tree

Mahsa Khosravi, Zhanhong Jiang, Joshua R Waite, Sarah Jonesc, Hernan Torres, Arti Singh, Baskar Ganapathysubramanian, Asheesh Kumar Singh, Soumik Sarkar

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments 32 pages, 9 figures

GUI-Xplore: Empowering Generalizable GUI Agents with One Exploration

Yuchen Sun, Shanhui Zhao, Tao Yu, Hao Wen, Samith Va, Mengwei Xu, Yuanchun Li, Chongyang Zhang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments CVPR 2025

Towards Self-constructive Artificial Intelligence: Algorithmic basis (Part I)

Fernando J. Corbacho

专题命中 GUI与网页智能体 ：autonomous agent(abstract)；分类 cs.AI

Comments arXiv admin note: substantial text overlap with arXiv:1608.02229

Leveraging Large Language Model-based Room-Object Relationships Knowledge for Enhancing Multimodal-Input Object Goal Navigation

Leyuan Sun, Asako Kanezaki, Guillaume Caron, Yusuke Yoshiyasu

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments will soon submit to the Elsevier journal, Advanced Engineering Informatics

Journal ref Advanced Engineering Informatics 65 (2025)

UnitedVLN: Generalizable Gaussian Splatting for Continuous Vision-Language Navigation

Guangzhao Dai, Jian Zhao, Yuantao Chen, Yusen Qin, Hao Zhao, Guosen Xie, Yazhou Yao, Xiangbo Shu, Xuelong Li

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Soft Actor-Critic-based Control Barrier Adaptation for Robust Autonomous Navigation in Unknown Environments

Nicholas Mohammad, Nicola Bezzo

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.LG

Comments To Appear in 2025 IEEE/RSJ International Conference on Robotics and Automation (ICRA), 2025

Evaluating Cultural and Social Awareness of LLM Web Agents

Haoyi Qiu, Alexander R. Fabbri, Divyansh Agarwal, Kung-Hsiang Huang, Sarah Tan, Nanyun Peng, Chien-Sheng Wu

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

Comments NAACL 2025 Findings

Unifying Large Language Model and Deep Reinforcement Learning for Human-in-Loop Interactive Socially-aware Navigation

Weizheng Wang, Ike Obi, Aniket Bera, Byung-Cheol Min

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

WinClick: GUI Grounding with Multimodal Large Language Models

Zheng Hui, Yinheng Li, Dan zhao, Tianyi Chen, Colby Banbury, Kazuhito Koishida

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

Symbiotic Cooperation for Web Agents: Harnessing Complementary Strengths of Large and Small LLMs

Ruichen Zhang, Mufan Qiu, Zhen Tan, Mohan Zhang, Vincent Lu, Jie Peng, Kaidi Xu, Leandro Z. Agudelo, Peter Qian, Tianlong Chen

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Indoor Localization for Autonomous Robot Navigation

Sean Kouma, Rachel Masters

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.LG

Comments 10 pages, 6 figures

Towards Sustainable Web Agents: A Plea for Transparency and Dedicated Metrics for Energy Consumption

Lars Krupp, Daniel Geißler, Paul Lukowicz, Jakob Karolus

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Whole-Body Teleoperation for Mobile Manipulation at Zero Added Cost

Daniel Honerkamp, Harsh Mahesheka, Jan Ole von Hartz, Tim Welschehold, Abhinav Valada

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments Project Website: https://moma-teleop.cs.uni-freiburg.de

Journal ref IEEE Robotics and Automation Letters, vol. 10, no. 4, pp. 3198-3205, April 2025

Fighter Jet Navigation and Combat using Deep Reinforcement Learning with Explainable AI

Swati Kar, Soumyabrata Dey, Mahesh K Banavar, Shahnewaz Karim Sakib

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Multi-dimensional Test Design

Xiaoyun Qiu, Liren Shan

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

FH-DRL: Exponential-Hyperbolic Frontier Heuristics with DRL for accelerated Exploration in Unknown Environments

Seunghyeop Nam, Tuan Anh Nguyen, Eunmi Choi, Dugki Min

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Beyond Pass or Fail: Multi-Dimensional Benchmarking of Foundation Models for Goal-based Mobile UI Navigation

Dezhi Ran, Mengzhou Wu, Hao Yu, Yuetong Li, Jun Ren, Yuan Cao, Xia Zeng, Haochuan Lu, Zexin Xu, Mengqian Xu, Ting Su, Liangchao Yao, Ting Xiong, Wei Yang, Yuetang Deng, Assaf Marron, David Harel, Tao Xie

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.SE