AI Agent

Grounding Video Models to Actions through Goal Conditioned Exploration

Yunhao Luo, Yilun Du

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments ICLR 2025 (Spotlight). Project page: https://video-to-action.github.io/

FedMABench: Benchmarking Mobile Agents on Decentralized Heterogeneous User Data

Wenhao Wang, Zijie Yu, Rui Ye, Jianqing Zhang, Siheng Chen, Yanfeng Wang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

NavRAG: Generating User Demand Instructions for Embodied Navigation through Retrieval-Augmented LLM

Zihan Wang, Yaohui Zhu, Gim Hee Lee, Yachun Fan

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.CL

Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4V

Peiyuan Zhi, Zhiyuan Zhang, Yu Zhao, Muzhi Han, Zeyu Zhang, Zhitian Li, Ziyuan Jiao, Baoxiong Jia, Siyuan Huang

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.LG

Comments 6 pages, Accepted at 2025 IEEE ICRA, website: https://come-robot.github.io/

Together We Rise: Optimizing Real-Time Multi-Robot Task Allocation using Coordinated Heterogeneous Plays

Aritra Pal, Anandsingh Chauhan, Mayank Baranwal

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments Accepted to AAMAS 2025 (AAAI Track)

Uncertainty-Aware DRL for Autonomous Vehicle Crowd Navigation in Shared Space

Mahsa Golchoubian, Moojan Ghafurian, Kerstin Dautenhahn, Nasser Lashgarian Azad

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.LG

Comments Accepted for publication in IEEE Transactions on Intelligent Vehicles

SoNIC: Safe Social Navigation with Adaptive Conformal Inference and Constrained Reinforcement Learning

Jianpeng Yao, Xiaopan Zhang, Yu Xia, Zejin Wang, Amit K. Roy-Chowdhury, Jiachen Li

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments Project website: https://sonic-social-nav.github.io/; 16 pages

General Scene Adaptation for Vision-and-Language Navigation

Haodong Hong, Yanyuan Qiao, Sen Wang, Jiajun Liu, Qi Wu

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments ICLR 2025

UI-TARS: Pioneering Automated GUI Interaction with Native Agents

Yujia Qin, Yining Ye, Junjie Fang, Haoming Wang, Shihao Liang, Shizuo Tian, Junda Zhang, Jiahao Li, Yunxin Li, Shijue Huang, Wanjun Zhong, Kuanye Li, Jiale Yang, Yu Miao, Woyu Lin, Longxiang Liu, Xu Jiang, Qianli Ma, Jingyu Li, Xiaojun Xiao, Kai Cai, Chuang Li, Yaowei Zheng, Chaolin Jin, Chen Li, Xiao Zhou, Minchao Wang, Haoli Chen, Zhaojian Li, Haihua Yang, Haifeng Liu, Feng Lin, Tao Peng, Xin Liu, Guang Shi

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

FLAME: Learning to Navigate with Multimodal LLM in Urban Environments

Yunzhe Xu, Yiyuan Pan, Zhe Liu, Hesheng Wang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments Accepted to AAAI 2025 (Oral)

Few-Shot Task Learning through Inverse Generative Modeling

Aviv Netanyahu, Yilun Du, Antonia Bronars, Jyothish Pari, Joshua Tenenbaum, Tianmin Shu, Pulkit Agrawal

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments Added acknowledgment

Learning Dynamic Cognitive Map with Autonomous Navigation

Daria de Tinguy, Tim Verbelen, Bart Dhoedt

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments under submission at Frontiers Computer Neuroscience

Journal ref Volume 18 - 2024

Learning to Navigate in Mazes with Novel Layouts using Abstract Top-down Maps

Linfeng Zhao, Lawson L. S. Wong

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments Published at Reinforcement Learning Conference (RLC) 2024. Website: http://lfzhao.com/map-nav/

Journal ref Journal-ref: Reinforcement Learning Journal, Volume 5, 2024, Pages 2359-2372

To Train or Not to Train: Balancing Efficiency and Training Cost in Deep Reinforcement Learning for Mobile Edge Computing

Maddalena Boscaro, Federico Mason, Federico Chiariotti, Andrea Zanella

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Learning World Models for Unconstrained Goal Navigation

Yuanlin Duan, Wensen Mao, He Zhu

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments NeurIPS2024 Poster. arXiv admin note: substantial text overlap with arXiv:2411.01396

From Context to Action: Analysis of the Impact of State Representation and Context on the Generalization of Multi-Turn Web Navigation Agents

Nalin Tiwary, Vardhan Dongre, Sanil Arun Chawla, Ashwin Lamani, Dilek Hakkani-Tür

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments 10 pages, 3 figures, 5 tables

Journal ref NeurIPS 2024 Workshop on Open-World Agents

Deep Learning-driven Mobile Traffic Measurement Collection and Analysis

Yini Fang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments MPhil thesis

Human-Aware Robot Navigation via Reinforcement Learning with Hindsight Experience Replay and Curriculum Learning

Keyu Li, Ye Lu, Max Q. -H. Meng

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments Accepted at ROBIO 2021

A transformer-based deep reinforcement learning approach to spatial navigation in a partially observable Morris Water Maze

Marte Eggen, Inga Strümke

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

AdaShadow: Responsive Test-time Model Adaptation in Non-stationary Mobile Environments

Cheng Fang, Sicong Liu, Zimu Zhou, Bin Guo, Jiaqi Tang, Ke Ma, Zhiwen Yu

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.LG

Comments This paper is accepted by SenSys 2024. Copyright may be transferred without notice

Journal ref The 22th ACM Conference on Embedded Networked Sensor Systems, 2024

MobileVLM: A Vision-Language Model for Better Intra- and Inter-UI Understanding

Qinzhuo Wu, Weikai Xu, Wei Liu, Tao Tan, Jianfeng Liu, Ang Li, Jian Luan, Bin Wang, Shuo Shang

专题命中 GUI与网页智能体 ：AI agent(abstract)；分类 cs.AI、cs.CL

Aligning Robot Navigation Behaviors with Human Intentions and Preferences

Haresh Karnan

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments Haresh Karnan's PhD Dissertation A recording of the defense talk can be accessed here: https://youtu.be/MssiO6g0Gb8

Journal ref The University of Texas at Austin, May 2024

Research on Autonomous Robots Navigation based on Reinforcement Learning

Zixiang Wang, Hao Yan, Yining Wang, Zhengjia Xu, Zhuoyue Wang, Zhizhong Wu

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.LG

Effort and Size Estimation in Software Projects with Large Language Model-based Intelligent Interfaces

Claudionor N. Coelho, Hanchen Xiong, Tushar Karayil, Sree Koratala, Rex Shang, Jacob Bollinger, Mohamed Shabar, Syam Nair

专题命中 GUI与网页智能体 ：AI agent(abstract)；分类 cs.LG、cs.SE

InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environment

Yuxing Long, Wenzhe Cai, Hongcheng Wang, Guanqi Zhan, Hao Dong

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.CL

Comments Submitted to CoRL 2024

Correctable Landmark Discovery via Large Models for Vision-Language Navigation

Bingqian Lin, Yunshuang Nie, Ziming Wei, Yi Zhu, Hang Xu, Shikui Ma, Jianzhuang Liu, Xiaodan Liang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments Accepted by TPAMI 2024

Why Only Text: Empowering Vision-and-Language Navigation with Multi-modal Prompts

Haodong Hong, Sen Wang, Zi Huang, Qi Wu, Jiajun Liu

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments IJCAI 2024

WebSuite: Systematically Evaluating Why Web Agents Fail

Eric Li, Jim Waldo

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.SE

Vision-and-Language Navigation Generative Pretrained Transformer

Wen Hanlin

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

SPIN: Simultaneous Perception, Interaction and Navigation

Shagun Uppal, Ananye Agarwal, Haoyu Xiong, Kenneth Shaw, Deepak Pathak

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments In CVPR 2024. Website at https://spin-robot.github.io/