多模态大模型

Hierarchical Imitation Learning of Team Behavior from Heterogeneous Demonstrations

Sangwon Seo, Vaibhav Unhelkar

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments Extended version of an identically-titled paper accepted at AAMAS 2025

PC-Agent: A Hierarchical Multi-Agent Collaboration Framework for Complex Task Automation on PC

Haowei Liu, Xi Zhang, Haiyang Xu, Yuyang Wanyan, Junyang Wang, Ming Yan, Ji Zhang, Chunfeng Yuan, Changsheng Xu, Weiming Hu, Fei Huang

专题命中 多模态Agent ：MLLM(abstract)；分类 cs.CV

Comments 14 pages, 7 figures

SmartAgent: Chain-of-User-Thought for Embodied Personalized Agent in Cyber World

Jiaqi Zhang, Chen Gao, Liyuan Zhang, Yong Li, Hongzhi Yin

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

FLIP: Flow-Centric Generative Planning as General-Purpose Manipulation World Model

Chongkai Gao, Haozhuo Zhang, Zhixuan Xu, Zhehao Cai, Lin Shao

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

AgentStudio: A Toolkit for Building General Virtual Agents

Longtao Zheng, Zhiyuan Huang, Zhenghai Xue, Xinrun Wang, Bo An, Shuicheng Yan

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments ICLR 2025. Project page: https://ltzheng.github.io/agent-studio

GUI Agents with Foundation Models: A Comprehensive Survey

Shuai Wang, Weiwen Liu, Jingxuan Chen, Yuqi Zhou, Weinan Gan, Xingshan Zeng, Yuhan Che, Shuai Yu, Xinlong Hao, Kun Shao, Bin Wang, Chuhan Wu, Yasheng Wang, Ruiming Tang, Jianye Hao

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Enabling Novel Mission Operations and Interactions with ROSA: The Robot Operating System Agent

Rob Royce, Marcel Kaufmann, Jonathan Becktor, Sangwoo Moon, Kalind Carpenter, Kai Pak, Amanda Towler, Rohan Thakker, Shehryar Khattak

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments Preprint. Accepted at IEEE Aerospace Conference 2025, 16 pages, 12 figures

Towards CausalGPT: A Multi-Agent Approach for Faithful Knowledge Reasoning via Promoting Causal Consistency in LLMs

Ziyi Tang, Ruilin Wang, Weixing Chen, Yongsen Zheng, Zechuan Chen, Yang Liu, Keze Wang, Tianshui Chen, Liang Lin

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments 12 pages, 9 figures. 3 tables

LLM-Powered Decentralized Generative Agents with Adaptive Hierarchical Knowledge Graph for Cooperative Planning

Hanqing Yang, Jingdi Chen, Marie Siew, Tania Lorido-Botran, Carlee Joe-Wong

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Every Software as an Agent: Blueprint and Case Study

Mengwei Xu

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

AccidentBlip: Agent of Accident Warning based on MA-former

Yihua Shao, Yeling Xu, Xinwei Long, Siyu Chen, Ziyang Yan, Yang Yang, Haoting Liu, Yan Wang, Hao Tang, Zhen Lei

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Embodied-RAG: General Non-parametric Embodied Memory for Retrieval and Generation

Quanting Xie, So Yeon Min, Pengliang Ji, Yue Yang, Tianyi Zhang, Kedi Xu, Aarav Bajaj, Ruslan Salakhutdinov, Matthew Johnson-Roberson, Yonatan Bisk

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments Web: https://quanting-xie.github.io/Embodied-RAG-web/

Generative Planning with 3D-vision Language Pre-training for End-to-End Autonomous Driving

Tengpeng Li, Hanli Wang, Xianfei Li, Wenlong Liao, Tao He, Pai Peng

专题命中 多模态Agent ：cross-modal(abstract)；分类 cs.CV

Enhancing Path Planning Performance through Image Representation Learning of High-Dimensional Configuration Spaces

Jorge Ocampo Jimenez, Wael Suleiman

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Cyber-Physical Steganography in Robotic Motion Control

Ching-Chun Chang, Yijie Lin, Isao Echizen

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

A little less conversation, a little more action, please: Investigating the physical common-sense of LLMs in a 3D embodied environment

Matteo G. Mecattaf, Ben Slater, Marko Tešić, Jonathan Prunty, Konstantinos Voudouris, Lucy G. Cheke

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments 25 pages, 4 figures; v2: Added AFMR Acknowledgment

Multi-Agent Planning Using Visual Language Models

Michele Brienza, Francesco Argenziano, Vincenzo Suriani, Domenico D. Bloisi, Daniele Nardi

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

LLM-based Multi-Agent Systems: Techniques and Business Perspectives

Yingxuan Yang, Qiuying Peng, Jun Wang, Ying Wen, Weinan Zhang

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

TravelAgent: Generative Agents in the Built Environment

Ariel Noyman, Kai Hu, Kent Larson

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 21 pages 9 figs

GenPlan: Generative Sequence Models as Adaptive Planners

Akash Karthikeyan, Yash Vardhan Pant

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments Accepted in AAAI 2025. Project page: https://aku02.github.io/projects/genplan/

GUI Testing Arena: A Unified Benchmark for Advancing Autonomous GUI Testing Agent

Kangjia Zhao, Jiahui Song, Leigang Sha, Haozhan Shen, Zhi Chen, Tiancheng Zhao, Xiubo Liang, Jianwei Yin

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

The Thousand Brains Project: A New Paradigm for Sensorimotor Intelligence

Viviane Clay, Niels Leadholm, Jeff Hawkins

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

TANGO: Training-free Embodied AI Agents for Open-world Tasks

Filippo Ziliotto, Tommaso Campari, Luciano Serafini, Lamberto Ballan

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Dockformer: A transformer-based molecular docking paradigm for large-scale virtual screening

Zhangfan Yang, Junkai Ji, Shan He, Jianqiang Li, Tiantian He, Ruibin Bai, Zexuan Zhu, Yew Soon Ong

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 15 pages, 10 figures

QuadrupedGPT: Towards a Versatile Quadruped Agent in Open-ended Worlds

Yuting Mei, Ye Wang, Sipeng Zheng, Qin Jin

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments Under review

APT: Architectural Planning and Text-to-Blueprint Construction Using Large Language Models for Open-World Agents

Jun Yu Chen, Tao Gao

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 8 pages

SceneMotion: From Agent-Centric Embeddings to Scene-Wide Forecasts

Royden Wagner, Ömer Sahin Tas, Marlon Steiner, Fabian Konstantinidis, Hendrik Königshof, Marvin Klemp, Carlos Fernandez, Christoph Stiller

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments ITSC'24; updated table VI

DuMapper: Towards Automatic Verification of Large-Scale POIs with Street Views at Baidu Maps

Miao Fan, Jizhou Huang, Haifeng Wang

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

IoT-Based 3D Pose Estimation and Motion Optimization for Athletes: Application of C3D and OpenPose

Fei Ren, Chao Ren, Tianyi Lyu

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments 17 pages

A Demonstration of Adaptive Collaboration of Large Language Models for Medical Decision-Making

Yubin Kim, Chanwoo Park, Hyewon Jeong, Cristina Grau-Vilchez, Yik Siu Chan, Xuhai Xu, Daniel McDuff, Hyeonhoon Lee, Cynthia Breazeal, Hae Won Park

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CL

Comments Under Review for ML4H 2024