AI Agent

Shared Control of Holonomic Wheelchairs through Reinforcement Learning

Jannis Bähler, Diego Paez-Granados, Jorge Peña-Queralta

机构 * Swiss Paraplegic Research, SPF（瑞士瘫痪研究机构） ； SCAI Lab, D-HEST, Swiss Federal School of Technology in Zurich - ETH Zurich（SCAI实验室，瑞士联邦理工学院-苏黎世-ETH Zurich） ； Centre for Artificial Ingelligece, Zurich University of Applied Sciences - ZHAW. Switzerland（人工智能中心，瑞士应用科学大学-ZHAW） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Efficient Strategy Learning by Decoupling Searching and Pathfinding for Object Navigation

Yanwei Zheng, Shaopu Feng, Bowen Huang, Chuanlin Lan, Xiao Zhang, Dongxiao Yu

机构 * Shandong University（山东大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

NavVI: A Telerobotic Simulation with Multimodal Feedback for Visually Impaired Navigation in Warehouse Environments

Maisha Maimuna, Minhaz Bin Farukee, Sama Nikanfar, Mahfuza Siddiqua, Ayon Roy, Fillia Makedon

机构 * Department of Computer Science and Engineering（计算机科学与工程系） ； The University of Texas at Arlington（德克萨斯理工大学） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Manipulating LLM Web Agents with Indirect Prompt Injection Attack via HTML Accessibility Tree

Sam Johnson, Viet Pham, Thai Le

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments EMNLP 2025 System Demonstrations Submission

OS-Kairos: Adaptive Interaction for MLLM-Powered GUI Agents

Pengzhou Cheng, Zheng Wu, Zongru Wu, Aston Zhang, Zhuosheng Zhang, Gongshen Liu

机构 * School of Computer Science, Shanghai Jiao Tong University（上海交通大学计算机科学学院） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments 25 pages, 24 figures, 11 tables (ACL 2025, Findings)

SkyVLN: Vision-and-Language Navigation and NMPC Control for UAVs in Urban Environments

Tianshun Li, Tianyi Huai, Zhen Li, Yichun Gao, Haoang Li, Xinhu Zheng

机构 * The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments 8 pages, 9 figures, has been accepted by IROS 2025

SafeMobile: Chain-level Jailbreak Detection and Automated Evaluation for Multimodal Mobile Agents

Siyuan Liang, Tianmeng Fang, Zhe Liu, Aishan Liu, Yan Xiao, Jinyuan He, Ee-Chien Chang, Xiaochun Cao

机构 * Nanyang Technological University（南洋理工大学） ； Institute of Software, Chinese Academy of Sciences（中国科学院软件研究所） ； Beihang University（北京航空航天大学） ； Sun Yat-sen University（中山大学） ； Beijing Institute of Technology（北京理工大学） ； National University of Singapore（新加坡国立大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments 12 pages

Efficient and Generalizable Environmental Understanding for Visual Navigation

Ruoyu Wang, Xinshu Li, Chen Wang, Lina Yao

机构 * University of New South Wales（新南威尔士大学） ； CSIRO’s Data61（澳大利亚联邦科学与工业研究组织数据61） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Generalization in Deep Reinforcement Learning for Robotic Navigation by Reward Shaping

Victor R. F. Miranda, Armando A. Neto, Gustavo M. Freitas, Leonardo A. Mozelli

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments IEEE Transactions on Industrial Electronics (2023)

Journal ref IEEE Transactions on Industrial Electronics, vol. 71, no. 6, pp. 6013-6020, (2024)

A Navigation Framework Utilizing Vision-Language Models

Yicheng Duan, Kaiyu tang

机构 * Computer and Data Sciences, School of Engineering（计算机与数据科学系，工程学院） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

MCPWorld: A Unified Benchmarking Testbed for API, GUI, and Hybrid Computer Use Agents

Yunhe Yan, Shihe Wang, Jiajun Du, Yexuan Yang, Yuxuan Shan, Qichen Qiu, Xianqing Jia, Xinge Wang, Xin Yuan, Xu Han, Mao Qin, Yinxiao Chen, Chen Peng, Shangguang Wang, Mengwei Xu

机构 * Beijing University of Posts and Telecommunications（北京邮电大学） ； Pengcheng Laboratory（鹏城实验室） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Multi-Step Guided Diffusion for Image Restoration on Edge Devices: Toward Lightweight Perception in Embodied AI

Aditya Chakravarty

专题命中 GUI与网页智能体 ：AI agent(abstract)；分类 cs.LG

Comments Accepted in CVPR 2025 Embodied AI Workshop

Active Test-time Vision-Language Navigation

Heeju Ko, Sungjune Kim, Gyeongrok Oh, Jeongyoon Yoon, Honglak Lee, Sujin Jang, Seungryong Kim, Sangpil Kim

机构 * Korea University（韩国大学） ； University of Michigan（密歇根大学） ； Samsung AI Center, DS Division（三星人工智能中心，DS部门） ； Korea Advanced Institute of Science & Technology（韩国先进科学技术研究所） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Astra: Toward General-Purpose Mobile Robots via Hierarchical Multimodal Learning

Sheng Chen, Peiyu He, Jiaxin Hu, Ziyang Liu, Yansheng Wang, Tao Xu, Chi Zhang, Chongchong Zhang, Chao An, Shiyu Cai, Duo Cao, Kangping Chen, Shuai Chu, Tianwei Chu, Mingdi Dan, Min Du, Weiwei Fang, Pengyou Fu, Junkai Hu, Xiaowei Jiang, Zhaodi Jiang, Fuxuan Li, Jun Li, Minghui Li, Mingyao Li, Yanchang Li, Zhibin Li, Guangming Liu, Kairui Liu, Lihao Liu, Weizhi Liu, Xiaoshun Liu, Yufei Liu, Yunfei Liu, Qiang Lu, Yuanfei Luo, Xiang Lv, Hongying Ma, Sai Ma, Lingxian Mi, Sha Sa, Hongxiang Shu, Lei Tian, Chengzhi Wang, Jiayu Wang, Kaijie Wang, Qingyi Wang, Renwen Wang, Tao Wang, Wei Wang, Xirui Wang, Chao Wei, Xuguang Wei, Zijun Xia, Zhaohao Xiao, Tingshuai Yan, Liyan Yang, Yifan Yang, Zhikai Yang, Zhong Yin, Li Yuan, Liuchun Yuan, Chi Zhang, Jinyang Zhang, Junhui Zhang, Linge Zhang, Zhenyi Zhang, Zheyu Zhang, Dongjie Zhu, Hang Li, Yangang Zhang

机构 * Full author list in Contributions（完整作者列表） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments Astra Technical Report

SGN-CIRL: Scene Graph-based Navigation with Curriculum, Imitation, and Reinforcement Learning

Nikita Oskolkov, Huzhenyu Zhang, Dmitry Makarov, Dmitry Yudin, Aleksandr Panov

机构 * Moscow Institute of Physics and Technology (MIPT)（莫斯科物理技术学院） ； Federal Research Center for Computer Science and Control of Russian Academy of Sciences（俄罗斯科学院计算机科学与控制联邦研究中心） ； Artificial Intelligence Research Institute (AIRI)（人工智能研究院） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments 7 pages, 11 figures

Learning Rock Pushability on Rough Planetary Terrain

Tuba Girgin, Emre Girgin, Cagri Kilic

机构 * Department of Aerospace Engineering at Embry-Riddle Aeronautical University（艾姆伯-里德航空大学航空航天工程系） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.LG

Comments Paper presented at the Workshop on Field Robotics, ICRA 2025, Atlanta, GA, United States

Future-Oriented Navigation: Dynamic Obstacle Avoidance with One-Shot Energy-Based Multimodal Motion Prediction

Ze Zhang, Georg Hess, Junjie Hu, Emmanuel Dean, Lennart Svensson, Knut Åkesson

机构 * Chalmers University of Technology（查尔姆斯理工大学） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.LG

Comments Published in IEEE Robotics and Automation Letters (RA-L)

DPO Learning with LLMs-Judge Signal for Computer Use Agents

Man Luo, David Cobbley, Xin Su, Shachar Rosenman, Vasudev Lal, Shao-Yen Tseng, Phillip Howard

机构 * Intel（英特尔） ； Thoughtworks 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

AdvAgent: Controllable Blackbox Red-teaming on Web Agents

Chejian Xu, Mintong Kang, Jiawei Zhang, Zeyi Liao, Lingbo Mo, Mengqi Yuan, Huan Sun, Bo Li

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL

Comments ICML 2025

Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agents

Vardaan Pahuja, Yadong Lu, Corby Rosset, Boyu Gou, Arindam Mitra, Spencer Whitehead, Yu Su, Ahmed Awadallah

机构 * The Ohio State University（俄亥俄州立大学） ； Microsoft Research（微软研究院） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments ACL 2025 (Findings)

Disrupting Vision-Language Model-Driven Navigation Services via Adversarial Object Fusion

Chunlong Xie, Jialing He, Shangwei Guo, Jiacheng Wang, Shudong Zhang, Tianwei Zhang, Tao Xiang

机构 * College of Computer Science, Chongqing University（重庆大学计算机学院） ； College of Computing and Data Science, Nanyang Technological University（南洋理工大学计算机与数据科学学院） ； School of Computer Science and Technology, Xidian University（西安电子科技大学计算机科学与技术学院） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments Under review

AdInject: Real-World Black-Box Attacks on Web Agents via Advertising Delivery

Haowei Wang, Junjie Wang, Xiaojun Jia, Rupeng Zhang, Mingyang Li, Zhe Liu, Yang Liu, Qing Wang

机构 * State Key Laboratory of Intelligent Game（智能游戏国家重点实验室） ； Institute of Software, Chinese Academy of Sciences（中国科学院软件研究所） ； University of Chinese Academy of Sciences（中国科学院大学） ； Nanyang Technological University（南洋理工大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

ScreenExplorer: Training a Vision-Language Model for Diverse Exploration in Open GUI World

Runliang Niu, Jinglong Ji, Yi Chang, Qi Wang

机构 * School of Artificial Intelligence, Jilin University（吉林大学人工智能学院） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning

Zhengxi Lu, Yuxiang Chai, Yaxuan Guo, Xi Yin, Liang Liu, Hao Wang, Han Xiao, Shuai Ren, Guanjing Xiong, Hongsheng Li

机构 * vivo AI Lab（vivo人工智能实验室） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Comments Updated UI-R1-E-3B

Enhancing Visual Grounding for GUI Agents via Self-Evolutionary Reinforcement Learning

Xinbin Yuan, Jian Zhang, Kaixin Li, Zhuoxuan Cai, Lujian Yao, Jie Chen, Enguang Wang, Qibin Hou, Jinwei Chen, Peng-Tao Jiang, Bo Li

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI

Human-like Semantic Navigation for Autonomous Driving using Knowledge Representation and Large Language Models

Augusto Luis Ballardini, Miguel Ángel Sotelo

机构 * Computer Engineering Department, University of Alcalá（阿尔卡拉大学计算机工程系） 纠错

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI

Comments 7 pages, 5 figures, submitted for IEEE conference

Consistent Attack: Universal Adversarial Perturbation on Embodied Vision Navigation

Chengyang Ying, You Qiaoben, Xinning Zhou, Hang Su, Wenbo Ding, Jianyong Ai

机构 * Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua-Bosch Joint Center for Machine Learning, Institute for Artificial Intelligence, Tsinghua University, Beijing 100084, China（计算机科学与技术系，北京信息科学国家研究中心，清华-博世联合机器学习中心，人工智能研究院，清华大学，北京） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Journal ref Pattern Recognition Letters (PRL), 2023

A Retrieval-Augmented Generation Framework for Academic Literature Navigation in Data Science

Ahmet Yasin Aytar, Kemal Kilic, Kamer Kaya

专题命中 GUI与网页智能体 ：workflow(abstract)；分类 cs.AI

Realistic Counterfactual Explanations for Machine Learning-Controlled Mobile Robots using 2D LiDAR

Sindre Benjamin Remman, Anastasios M. Lekkas

机构 * Department of Engineering Cybernetics, Norwegian University of Science and Technology (NTNU)（工程 cybernetics 系，挪威科学技术大学） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments Accepted for publication at the 2025 European Control Conference (ECC)

CognoSpeak: an automatic, remote assessment of early cognitive decline in real-world conversational speech

Madhurananda Pahar, Fuxiang Tao, Bahman Mirheidari, Nathan Pevy, Rebecca Bright, Swapnil Gadgil, Lise Sproson, Dorota Braun, Caitlin Illingworth, Daniel Blackburn, Heidi Christensen

机构 * School of Computer Science, University of Sheffield, Sheffield, S1 4DP, UK（1 计算机科学学院，谢菲尔德大学，谢菲尔德，S1 4DP，英国） ； Therapy Box, London, UK（2 Therapy Box，伦敦，英国） ； NIHR Devices for Dignity HTC, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, S10 2JF, UK（3 NIHR尊严设备HTC，谢菲尔德教学医院国家健康服务基金会信托，谢菲尔德，S10 2JF，英国） ； Sheffield Institute for Translational Neuroscience (SITraN), University of Sheffield, Sheffield, S10 2HQ, UK（4 谢菲尔德转化神经科学研究所（SITraN），谢菲尔德大学，谢菲尔德，S10 2HQ，英国） 纠错

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.LG

Comments This paper has been accepted for publication in IEEE SSCI 2025. Copyright belongs to IEEE

Journal ref IEEE SSCI, 2025