多模态大模型

HAPFI: History-Aware Planning based on Fused Information

Sujin Jeon, Suyeon Shin, Byoung-Tak Zhang

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments 7 pages, 3 figures, published to ICRA 2024

Agent-E: From Autonomous Web Navigation to Foundational Design Principles in Agentic Systems

Tamer Abuelsaad, Deepak Akkil, Prasenjit Dey, Ashish Jagmohan, Aditya Vempaty, Ravi Kokku

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Exploring the Robustness of Decision-Level Through Adversarial Attacks on LLM-Based Embodied Models

Shuyuan Liu, Jiawei Chen, Shouwei Ruan, Hang Su, Zhaoxia Yin

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.MM

ShapeLLM: Universal 3D Object Understanding for Embodied Interaction

Zekun Qi, Runpei Dong, Shaochen Zhang, Haoran Geng, Chunrui Han, Zheng Ge, Li Yi, Kaisheng Ma

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments Accepted at ECCV 2024

Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent

Quentin Gallouédec, Edward Beeching, Clément Romac, Emmanuel Dellandréa

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Journal ref 38th Workshop on Aligning Reinforcement Learning Experimentalists and Theorists (ARLET 2024)

Blending Data-Driven Priors in Dynamic Games

Justin Lidard, Haimin Hu, Asher Hancock, Zixu Zhang, Albert Gimó Contreras, Vikash Modi, Jonathan DeCastro, Deepak Gopinath, Guy Rosman, Naomi Ehrich Leonard, María Santos, Jaime Fernández Fisac

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments 20 pages, 12 figures

Optimal Design and Implementation of an Open-source Emulation Platform for User-Centric Shared E-mobility Services

Maqsood Hussain Shah, Yue Ding, Shaoshu Zhu, Yingqi Gu, Mingming Liu

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments 15 pages, 5 figures

An Explainable Collaborative Dialogue System using a Theory of Mind

Philip R. Cohen, Lucian Galescu, Maayan Shvo

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 46 pages, 7 figures, 2 appendices

GUI Action Narrator: Where and When Did That Action Take Place?

Qinchen Wu, Difei Gao, Kevin Qinghong Lin, Zhuoyu Wu, Xiangwu Guo, Peiran Li, Weichen Zhang, Hengxu Wang, Mike Zheng Shou

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Improving Multi-Agent Debate with Sparse Communication Topology

Yunxuan Li, Yibing Du, Jiageng Zhang, Le Hou, Peter Grabowski, Yeqing Li, Eugene Ie

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Comments 13 pages, 9 figures

An Interactive Agent Foundation Model

Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley Llorens, Hoi Vo, Katsu Ikeuchi, Li Fei-Fei, Jianfeng Gao, Naoki Wake, Qiuyuan Huang

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

LLM-assisted Concept Discovery: Automatically Identifying and Explaining Neuron Functions

Nhat Hoang-Xuan, Minh Vu, My T. Thai

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

World Models with Hints of Large Language Models for Goal Achieving

Zeyuan Liu, Ziyu Huan, Xiyao Wang, Jiafei Lyu, Jian Tao, Xiu Li, Furong Huang, Huazhe Xu

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Nadine: An LLM-driven Intelligent Social Robot with Affective Capabilities and Human-like Memory

Hangyeol Kang, Maher Ben Moussa, Nadia Magnenat-Thalmann

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

AgentScope: A Flexible yet Robust Multi-Agent Platform

Dawei Gao, Zitao Li, Xuchen Pan, Weirui Kuang, Zhijian Ma, Bingchen Qian, Fei Wei, Wenhao Zhang, Yuexiang Xie, Daoyuan Chen, Liuyi Yao, Hongyi Peng, Zeyu Zhang, Lin Zhu, Chen Cheng, Hongzhu Shi, Yaliang Li, Bolin Ding, Jingren Zhou

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments We have released code on https://github.com/modelscope/agentscope

GOPlan: Goal-conditioned Offline Reinforcement Learning by Planning with Learned Models

Mianchu Wang, Rui Yang, Xi Chen, Hao Sun, Meng Fang, Giovanni Montana

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments Spotlight Presentation at Goal-conditioned Reinforcement Learning Workshop at NeurIPS 2023

Journal ref Transactions on Machine Learning Research (05/2024)

A First Step in Using Machine Learning Methods to Enhance Interaction Analysis for Embodied Learning Environments

Joyce Fonteles, Eduardo Davalos, Ashwin T. S., Yike Zhang, Mengxi Zhou, Efrat Ayalon, Alicia Lane, Selena Steinberg, Gabriella Anton, Joshua Danish, Noel Enyedy, Gautam Biswas

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Navigating Brain Language Representations: A Comparative Analysis of Neural Language Models and Psychologically Plausible Models

Yunhao Zhang, Shaonan Wang, Xinyi Dong, Jiajun Yu, Chengqing Zong

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CL

No Transfers Required: Integrating Last Mile with Public Transit Using Opti-Mile

Raashid Altaf, Pravesh Biyani

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

CLOVA: A Closed-Loop Visual Assistant with Tool Usage and Update

Zhi Gao, Yuntao Du, Xintong Zhang, Xiaojian Ma, Wenjuan Han, Song-Chun Zhu, Qing Li

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments CVPR 2024

AI2Apps: A Visual IDE for Building LLM-based AI Agent Applications

Xin Pang, Zhucong Li, Jiaxiang Chen, Yuan Cheng, Yinghui Xu, Yuan Qi

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Bootstrapping Developmental AIs: From Simple Competences to Intelligent Human-Compatible AIs

Mark Stefik, Robert Price

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 112 pages, 28 figures, 4 tables

Variational Dynamic for Self-Supervised Exploration in Deep Reinforcement Learning

Chenjia Bai, Peng Liu, Kaiyu Liu, Lingxiao Wang, Yingnan Zhao, Lei Han

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments IEEE Transactions on Neural Networks and Learning Systems (TNNLS) 2021

ProIn: Learning to Predict Trajectory Based on Progressive Interactions for Autonomous Driving

Yinke Dong, Haifeng Yuan, Hongkun Liu, Wei Jing, Fangzhen Li, Hongmin Liu, Bin Fan

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Pioneering SE(2)-Equivariant Trajectory Planning for Automated Driving

Steffen Hagedorn, Marcel Milich, Alexandru P. Condurache

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Hierarchical Auto-Organizing System for Open-Ended Multi-Agent Navigation

Zhonghan Zhao, Kewei Chen, Dongxu Guo, Wenhao Chai, Tian Ye, Yanting Zhang, Gaoang Wang

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments ICLR 2024 Workshop on LLM Agents

DiaLoc: An Iterative Approach to Embodied Dialog Localization

Chao Zhang, Mohan Li, Ignas Budvytis, Stephan Liwicki

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments 12 pages, 10 figures, to appear in CVPR 2024

MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Querying

Shaoshuai Shi, Li Jiang, Dengxin Dai, Bernt Schiele

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments Accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2024). The winning approaches for the Waymo Motion Prediction Challenge in 2022 and 2023

DNA Family: Boosting Weight-Sharing NAS with Block-Wise Supervisions

Guangrun Wang, Changlin Li, Liuchun Yuan, Jiefeng Peng, Xiaoyu Xian, Xiaodan Liang, Xiaojun Chang, Liang Lin

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments T-PAMI

Position Paper: Agent AI Towards a Holistic Intelligence

Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley Llorens, John Langford, Hoi Vo, Li Fei-Fei, Katsu Ikeuchi, Jianfeng Gao

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 22 pages, 4 figures. arXiv admin note: substantial text overlap with arXiv:2401.03568