AI Agent

Quick and Accurate Affordance Learning

Fedor Scholz, Erik Ayari, Johannes Bertram, Martin V. Butz

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

RoboHop: Segment-based Topological Map Representation for Open-World Visual Navigation

Sourav Garg, Krishan Rana, Mehdi Hosseinzadeh, Lachlan Mares, Niko Sünderhauf, Feras Dayoub, Ian Reid

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.LG

Comments Published at ICRA 2024; 9 pages, 8 figures

AIGeN: An Adversarial Approach for Instruction Generation in VLN

Niyati Rawal, Roberto Bigazzi, Lorenzo Baraldi, Rita Cucchiara

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments Accepted to 7th Multimodal Learning and Applications Workshop (MULA 2024) at the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024

Explore and Explain: Self-supervised Navigation and Recounting

Roberto Bigazzi, Federico Landi, Marcella Cornia, Silvia Cascianelli, Lorenzo Baraldi, Rita Cucchiara

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments ICPR 2020

Training a Vision Language Model as Smartphone Assistant

Nicolai Dorka, Janusz Marecki, Ammar Anwar

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments ICLR 2024 workshop on Generative Models for Decision Making

Behavior Trees Enable Structured Programming of Language Model Agents

Richard Kelley

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

WILBUR: Adaptive In-Context Learning for Robust and Accurate Web Agents

Michael Lutz, Arth Bohra, Manvel Saroyan, Artem Harutyunyan, Giovanni Campagna

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

DELAN: Dual-Level Alignment for Vision-and-Language Navigation by Cross-Modal Contrastive Learning

Mengfei Du, Binhao Wu, Jiwen Zhang, Zhihao Fan, Zejun Li, Ruipu Luo, Xuanjing Huang, Zhongyu Wei

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.CL、cs.LG

Comments Accepted by LREC-COLING 2024

Dual-View Visual Contextualization for Web Navigation

Jihyung Kil, Chan Hee Song, Boyuan Zheng, Xiang Deng, Yu Su, Wei-Lun Chao

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments Accepted to CVPR 2024

LangNav: Language as a Perceptual Representation for Navigation

Bowen Pan, Rameswar Panda, SouYoung Jin, Rogerio Feris, Aude Oliva, Phillip Isola, Yoon Kim

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

From Two-Dimensional to Three-Dimensional Environment with Q-Learning: Modeling Autonomous Navigation with Reinforcement Learning and no Libraries

Ergon Cugler de Moraes Silva

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Navigation as Attackers Wish? Towards Building Robust Embodied Agents under Federated Learning

Yunchao Zhang, Zonglin Di, Kaiwen Zhou, Cihang Xie, Xin Eric Wang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

META-GUI: Towards Multi-modal Conversational Agents on Mobile GUI

Liangtai Sun, Xingyu Chen, Lu Chen, Tianle Dai, Zichen Zhu, Kai Yu

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments 14 pages, 10 figures

On the Multi-turn Instruction Following for Conversational Web Agents

Yang Deng, Xuan Zhang, Wenxuan Zhang, Yifei Yuan, See-Kiong Ng, Tat-Seng Chua

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.CL

VLN-Video: Utilizing Driving Videos for Outdoor Vision-and-Language Navigation

Jialu Li, Aishwarya Padmakumar, Gaurav Sukhatme, Mohit Bansal

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments AAAI 2024

VELMA: Verbalization Embodiment of LLM Agents for Vision and Language Navigation in Street View

Raphael Schumann, Wanrong Zhu, Weixi Feng, Tsu-Jui Fu, Stefan Riezler, William Yang Wang

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.CL

Comments Accepted at AAAI 2024

Nav-Q: Quantum Deep Reinforcement Learning for Collision-Free Navigation of Self-Driving Cars

Akash Sinha, Antonio Macaluso, Matthias Klusch

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments 28 pages, 12 figures, 4 tables

Modeling Boundedly Rational Agents with Latent Inference Budgets

Athul Paul Jacob, Abhishek Gupta, Jacob Andreas

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Autonomous Large Language Model Agents Enabling Intent-Driven Mobile GUI Testing

Juyeon Yoon, Robert Feldt, Shin Yoo

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.SE

Comments 10 pages

ConvXAI: Delivering Heterogeneous AI Explanations via Conversations to Support Human-AI Scientific Writing

Hua Shen, Chieh-Yang Huang, Tongshuang Wu, Ting-Hao 'Kenneth' Huang

专题命中 GUI与网页智能体 ：AI agent(abstract)；分类 cs.AI、cs.CL

Comments CSCW 2023 Demo. ConvXAI system code: https://github.com/huashen218/convxai.git

Deep Reinforcement Learning for Autonomous Vehicle Intersection Navigation

Badr Ben Elallid, Hamza El Alaoui, Nabil Benamar

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments Accepted for publication in the 2023 International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT)

Dealing with Sparse Rewards Using Graph Neural Networks

Matvey Gerasyov, Ilya Makarov

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Journal ref IEEE Access, vol. 11, pp. 89180-89187, 2023

Virtual Augmented Reality for Atari Reinforcement Learning

Christian A. Schiller

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments 20 pages (thereof 13 in appendix), 4 figures, 15 tables (thereof 12 in appendix), 12 Atari games explored

ILuvUI: Instruction-tuned LangUage-Vision modeling of UIs from Machine Conversations

Yue Jiang, Eldon Schoop, Amanda Swearngin, Jeffrey Nichols

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.CL

Causal Policy Gradient for Whole-Body Mobile Manipulation

Jiaheng Hu, Peter Stone, Roberto Martín-Martín

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Journal ref Robotics: science and systems. 2023

Principles and Guidelines for Evaluating Social Robot Navigation Algorithms

Anthony Francis, Claudia Pérez-D'Arpino, Chengshu Li, Fei Xia, Alexandre Alahi, Rachid Alami, Aniket Bera, Abhijat Biswas, Joydeep Biswas, Rohan Chandra, Hao-Tien Lewis Chiang, Michael Everett, Sehoon Ha, Justin Hart, Jonathan P. How, Haresh Karnan, Tsang-Wei Edward Lee, Luis J. Manso, Reuth Mirksy, Sören Pirk, Phani Teja Singamaneni, Peter Stone, Ada V. Taylor, Peter Trautman, Nathan Tsoi, Marynel Vázquez, Xuesu Xiao, Peng Xu, Naoki Yokoyama, Alexander Toshev, Roberto Martín-Martín

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments 42 pages, 11 figures, 6 tables

Deep Reinforcement Learning Based Framework for Mobile Energy Disseminator Dispatching to Charge On-the-Road Electric Vehicles

Jiaming Wang, Jiqian Dong, Sikai Chen, Shreyas Sundaram, Samuel Labi

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments Submitted for presentation only at the 2024 Annual Meeting of the Transportation Research Board

A Revolution of Personalized Healthcare: Enabling Human Digital Twin with Mobile AIGC

Jiayuan Chen, Changyan Yi, Hongyang Du, Dusit Niyato, Jiawen Kang, Jun Cai, Xuemin, Shen

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.LG

Control Transformer: Robot Navigation in Unknown Environments through PRM-Guided Return-Conditioned Sequence Modeling

Daniel Lawson, Ahmed H. Qureshi

专题命中 GUI与网页智能体 ：planning(abstract)；分类 cs.AI、cs.LG

SocNavGym: A Reinforcement Learning Gym for Social Navigation

Aditya Kapoor, Sushant Swamy, Luis Manso, Pilar Bachiller

专题命中 GUI与网页智能体 ：agent(abstract)；分类 cs.AI、cs.LG

Comments IEEE RO-MAN