机器人 / 具身智能

PIANIST: Learning Partially Observable World Models with LLMs for Multi-Agent Decision Making

Jonathan Light, Sixue Xing, Yuanzhe Liu, Weiqin Chen, Min Cai, Xiusi Chen, Guanzhi Wang, Wei Cheng, Yisong Yue, Ziniu Hu

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Comments Published at Language Gamification Workshop 2024 @ NeurIPS

Adaptive World Models: Learning Behaviors by Latent Imagination Under Non-Stationarity

Emiliyan Gospodinov, Vaisakh Shaj, Philipp Becker, Stefan Geyer, Gerhard Neumann

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted at NeurIPS 2024 Workshop Adaptive Foundation Models

IGOR: Image-GOal Representations are the Atomic Control Units for Foundation Models in Embodied AI

Xiaoyu Chen, Junliang Guo, Tianyu He, Chuheng Zhang, Pushi Zhang, Derek Cathera Yang, Li Zhao, Jiang Bian

专题命中 具身推理 ：embodied AI(title)；world model(abstract)；分类 cs.RO、cs.AI

Language Agents Meet Causality -- Bridging LLMs and Causal World Models

John Gkountouras, Matthias Lindemann, Phillip Lippe, Efstratios Gavves, Ivan Titov

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Comments Project page: https://j0hngou.github.io/LLMCWM/

Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability

Shenyuan Gao, Jiazhi Yang, Li Chen, Kashyap Chitta, Yihang Qiu, Andreas Geiger, Jun Zhang, Hongyang Li

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.CV

Comments NeurIPS 2024. Code and model: https://github.com/OpenDriveLab/Vista, demo page: https://vista-demo.github.io

Probing Multimodal LLMs as World Models for Driving

Shiva Sreeram, Tsun-Hsuan Wang, Alaa Maalouf, Guy Rosman, Sertac Karaman, Daniela Rus

专题命中 具身推理 ：world model(title,abstract)；分类 cs.RO、cs.CV

Comments https://github.com/sreeramsa/DriveSim https://www.youtube.com/watch?v=Fs8jgngOJzU

One-shot World Models Using a Transformer Trained on a Synthetic Prior

Fabio Ferreira, Moreno Schlageter, Raghu Rajan, Andre Biedenkapp, Frank Hutter

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Diffusion World Model: Future Modeling Beyond Step-by-Step Rollout for Offline Reinforcement Learning

Zihan Ding, Amy Zhang, Yuandong Tian, Qinqing Zheng

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

A Notion of Complexity for Theory of Mind via Discrete World Models

X. Angelo Huang, Emanuele La Malfa, Samuele Marro, Andrea Asperti, Anthony Cohn, Michael Wooldridge

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted EMNLP 2024, Website https://flecart.github.io/complexity-tom-dwm

Spatial Reasoning and Planning for Deep Embodied Agents

Shu Ishida

专题命中 具身推理 ：embodied agent(title,abstract)；分类 cs.AI、cs.LG

Comments DPhil Thesis - Engineering Science, University of Oxford. Original copy available at https://ora.ox.ac.uk/objects/uuid:19489c19-dc5a-464a-831d-bbf887687c41

Learning Multiple Probabilistic Decisions from Latent World Model in Autonomous Driving

Lingyu Xiao, Jiang-Jiang Liu, Sen Yang, Xiaofan Li, Xiaoqing Ye, Wankou Yang, Jingdong Wang

专题命中 具身推理 ：world model(title,abstract)；分类 cs.RO、cs.AI

OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous Driving

Julong Wei, Shanshuai Yuan, Pengfei Li, Qingda Hu, Zhongxue Gan, Wenchao Ding

专题命中 具身推理 ：world model(title,abstract)；分类 cs.RO、cs.CV

CarDreamer: Open-Source Learning Platform for World Model based Autonomous Driving

Dechen Gao, Shuangyu Cai, Hanchu Zhou, Hang Wang, Iman Soltani, Junshan Zhang

专题命中 具身推理 ：world model(title,abstract)；分类 cs.RO、cs.AI

Comments Dechen Gao, Shuangyu Cai, Hanchu Zhou, Hang Wang contributed equally

Structure-aware World Model for Probe Guidance via Large-scale Self-supervised Pre-train

Haojun Jiang, Meng Li, Zhenguo Sun, Ning Jia, Yu Sun, Shaqi Luo, Shiji Song, Gao Huang

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.CV

Comments Accepted by MICCAI 2024 ASMUS Workshop

LIMT: Language-Informed Multi-Task Visual World Models

Elie Aljalbout, Nikolaos Sotirakis, Patrick van der Smagt, Maximilian Karl, Nutan Chen

专题命中 具身推理 ：world model(title,abstract)；分类 cs.RO、cs.LG

Augmenting Replay in World Models for Continual Reinforcement Learning

Luke Yang, Levin Kuhlmann, Gideon Kowadlo

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Sora and V-JEPA Have Not Learned The Complete Real World Model -- A Philosophical Analysis of Video AIs Through the Theory of Productive Imagination

Jianqiu Zhang

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.CV

Comments 30 pages, 9 figures

From Efficient Multimodal Models to World Models: A Survey

Xinji Mai, Zeng Tao, Junxiong Lin, Haoran Wang, Yang Chang, Yanlan Kang, Yan Wang, Wenqiang Zhang

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Reinforcement Learning from Delayed Observations via World Models

Armin Karamzade, Kyungmin Kim, Montek Kalsi, Roy Fox

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Learning Abstract World Model for Value-preserving Planning with Options

Rafael Rodriguez-Sanchez, George Konidaris

专题命中 具身推理 ：world model(title)；navigation(abstract)；分类 cs.AI、cs.LG

Comments Published in the Proceedings of Reinforcement Learning Conference

Pandora: Towards General World Model with Natural Language Actions and Video States

Jiannan Xiang, Guangyi Liu, Yi Gu, Qiyue Gao, Yuting Ning, Yuheng Zha, Zeyu Feng, Tianhua Tao, Shibo Hao, Yemin Shi, Zhengzhong Liu, Eric P. Xing, Zhiting Hu

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.CV

Comments Website: https://world-model.maitrix.org/

AD3: Implicit Action is the Key for World Models to Distinguish the Diverse Visual Distractors

Yucen Wang, Shenghua Wan, Le Gan, Shuai Feng, De-Chuan Zhan

专题命中 具身推理 ：world model(title,abstract)；分类 cs.CV、cs.LG

Learning Latent Dynamic Robust Representations for World Models

Ruixiang Sun, Hongyu Zang, Xin Li, Riashat Islam

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Journal ref ICML 2024

Improving Token-Based World Models with Parallel Observation Prediction

Lior Cohen, Kaixin Wang, Bingyi Kang, Shie Mannor

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

In-Context Symmetries: Self-Supervised Learning through Contextual World Models

Sharut Gupta, Chenyu Wang, Yifei Wang, Tommi Jaakkola, Stefanie Jegelka

专题命中 具身推理 ：world model(title,abstract)；分类 cs.CV、cs.LG

Comments 32 pages, 24 tables and 11 figures

MuDreamer: Learning Predictive World Models without Reconstruction

Maxime Burchi, Radu Timofte

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.CV

GameVLM: A Decision-making Framework for Robotic Task Planning Based on Visual Language Models and Zero-sum Games

Aoran Mei, Jianhua Wang, Guo-Niu Zhu, Zhongxue Gan

专题命中 具身推理 ：robotic(title,abstract)；分类 cs.RO、cs.AI

Neurosymbolic Grounding for Compositional World Models

Atharva Sehgal, Arya Grayeli, Jennifer J. Sun, Swarat Chaudhuri

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Comments Uploading ICLR,2024 Camera Ready Version

On the Road to Clarity: Exploring Explainable AI for World Models in a Driver Assistance System

Mohamed Roshdi, Julian Petzold, Mostafa Wahby, Hussein Ebrahim, Mladen Berekovic, Heiko Hamann

专题命中 具身推理 ：world model(title,abstract)；分类 cs.CV、cs.LG

Comments 8 pages, 6 figures, to be published in IEEE CAI 2024

Locality Sensitive Sparse Encoding for Learning World Models Online

Zichen Liu, Chao Du, Wee Sun Lee, Min Lin

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Comments ICLR 2024