机器人 / 具身智能

WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment

Hao Tang, Darren Key, Kevin Ellis

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI

Think2Drive: Efficient Reinforcement Learning by Thinking in Latent World Model for Quasi-Realistic Autonomous Driving (in CARLA-v2)

Qifeng Li, Xiaosong Jia, Shaobo Wang, Junchi Yan

专题命中 具身推理 ：world model(title,abstract)；分类 cs.RO

Comments Accepted by ECCV 2024

Understanding Physical Dynamics with Counterfactual World Modeling

Rahul Venkatesh, Honglin Chen, Kevin Feigelis, Daniel M. Bear, Khaled Jedoui, Klemen Kotar, Felix Binder, Wanhee Lee, Sherry Liu, Kevin A. Smith, Judith E. Fan, Daniel L. K. Yamins

专题命中 具身推理 ：world model(title,abstract)；分类 cs.CV

Comments ECCV 2024. Project page at: https://neuroailab.github.io/cwm-physics/

Emergent World Models and Latent Variable Estimation in Chess-Playing Language Models

Adam Karvonen

专题命中 具身推理 ：world model(title,abstract)；分类 cs.LG

Comments Accepted to the 2024 Conference on Language Modeling

Predicting vs. Acting: A Trade-off Between World Modeling & Agent Modeling

Margaret Li, Weijia Shi, Artidoro Pagnoni, Peter West, Ari Holtzman

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI

CoDreamer: Communication-Based Decentralised World Models

Edan Toledo, Amanda Prorok

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI

Cognitively Inspired Energy-Based World Models

Alexi Gladstone, Ganesh Nanduru, Md Mofijul Islam, Aman Chadha, Jundong Li, Tariq Iqbal

专题命中 具身推理 ：world model(title,abstract)；分类 cs.LG

Comments 23 pages, 6 figures

World Modeling for Autonomous Wheel Loaders

Koji Aoshima, Arvid Fälldin, Eddie Wadbro, Martin Servin

专题命中 具身推理 ：world model(title,abstract)；分类 cs.RO

Comments 23 pages, 19 figures

BWArea Model: Learning World Model, Inverse Dynamics, and Policy for Controllable Language Generation

Chengxing Jia, Pengyuan Wang, Ziniu Li, Yi-Chen Li, Zhilong Zhang, Nan Tang, Yang Yu

专题命中 具身推理 ：world model(title,abstract)；分类 cs.LG

Enhance Sample Efficiency and Robustness of End-to-end Urban Autonomous Driving via Semantic Masked World Model

Zeyu Gao, Yao Mu, Chen Chen, Jingliang Duan, Shengbo Eben Li, Ping Luo, Yanfeng Lu

专题命中 具身推理 ：world model(title,abstract)；分类 cs.LG

Comments 13 pages, 13 figures, 4 tables, this version is accepted by IEEE Transactions on Intelligent Transportation Systems, the workshop version can be found in NeurIPS Deep RL Workshop 2022

DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Driving

Chen Min, Dawei Zhao, Liang Xiao, Jian Zhao, Xinli Xu, Zheng Zhu, Lei Jin, Jianshu Li, Yulan Guo, Junliang Xing, Liping Jing, Yiming Nie, Bin Dai

专题命中 具身推理 ：world model(title,abstract)；分类 cs.CV

Comments Accepted by CVPR2024

Compete and Compose: Learning Independent Mechanisms for Modular World Models

Anson Lei, Frederik Nolte, Bernhard Schölkopf, Ingmar Posner

专题命中 具身推理 ：world model(title,abstract)；分类 cs.LG

DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation

Guosheng Zhao, Xiaofeng Wang, Zheng Zhu, Xinze Chen, Guan Huang, Xiaoyi Bao, Xingang Wang

专题命中 具身推理 ：world model(title,abstract)；分类 cs.CV

Comments Project Page: https://drivedreamer2.github.io

From task structures to world models: What do LLMs know?

Ilker Yildirim, L. A. Paul

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI

Robotic Applications of Pre-Trained Vision-Language Models to Various Recognition Behaviors

Kento Kawaharazuka, Yoshiki Obinata, Naoaki Kanazawa, Kei Okada, Masayuki Inaba

专题命中 具身推理 ：robotic(title)；robotics(abstract)；分类 cs.RO

Comments Accepted at Humanoids2023

Mastering Memory Tasks with World Models

Mohammad Reza Samsami, Artem Zholus, Janarthanan Rajendran, Sarath Chandar

专题命中 具身推理 ：world model(title,abstract)；分类 cs.LG

Comments Published as a conference paper at The International Conference on Learning Representations 2024

Hieros: Hierarchical Imagination on Structured State Space Sequence World Models

Paul Mattes, Rainer Schlosser, Ralf Herbrich

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI

Comments Submitted to ICML 2024, 23 pages, 11 figures, code available at: https://github.com/Snagnar/Hieros

MABL: Bi-Level Latent-Variable World Model for Sample-Efficient Multi-Agent Reinforcement Learning

Aravind Venugopal, Stephanie Milani, Fei Fang, Balaraman Ravindran

专题命中 具身推理 ：world model(title,abstract)；分类 cs.LG

Comments 9 pages

Reward-Free Curricula for Training Robust World Models

Marc Rigter, Minqi Jiang, Ingmar Posner

专题命中 具身推理 ：world model(title,abstract)；分类 cs.LG

Comments ICLR 2024

WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokens

Xiaofeng Wang, Zheng Zhu, Guan Huang, Boyuan Wang, Xinze Chen, Jiwen Lu

专题命中 具身推理 ：world model(title,abstract)；分类 cs.CV

Comments project page: https://world-dreamer.github.io/

Semantic Scene Segmentation for Robotics

Juana Valeria Hurtado, Abhinav Valada

专题命中 具身推理 ：robotics(title,abstract)；分类 cs.RO

Journal ref Deep Learning for Robot Perception and Cognition, chapter 12, pp. 279-311, Elsevier, 2022

STORM: Efficient Stochastic Transformer based World Models for Reinforcement Learning

Weipu Zhang, Gang Wang, Jian Sun, Yetian Yuan, Gao Huang

专题命中 具身推理 ：world model(title,abstract)；分类 cs.LG

Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving

Yuqi Wang, Jiawei He, Lue Fan, Hongxin Li, Yuntao Chen, Zhaoxiang Zhang

专题命中 具身推理 ：world model(title,abstract)；分类 cs.CV

Comments Project page: https://drive-wm.github.io. Code: https://github.com/BraveGroup/Drive-WM

Facing Off World Model Backbones: RNNs, Transformers, and S4

Fei Deng, Junyeong Park, Sungjin Ahn

专题命中 具身推理 ：world model(title,abstract)；分类 cs.LG

Comments NeurIPS 2023. Added instantiation with S5. Project page: https://fdeng18.github.io/s4wm

ByteSized32: A Corpus and Challenge Task for Generating Task-Specific World Models Expressed as Text Games

Ruoyao Wang, Graham Todd, Eric Yuan, Ziang Xiao, Marc-Alexandre Côté, Peter Jansen

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI

Comments Accepted to EMNLP 2023

Perceptual Factors for Environmental Modeling in Robotic Active Perception

David Morilla-Cabello, Jonas Westheider, Marija Popovic, Eduardo Montijano

专题命中 具身推理 ：robotic(title)；robotics(abstract)；分类 cs.RO

Comments 7 pages, 9 figures, under review for IEEE ICRA 2023

Emergent Linear Representations in World Models of Self-Supervised Sequence Models

Neel Nanda, Andrew Lee, Martin Wattenberg

专题命中 具身推理 ：world model(title,abstract)；分类 cs.LG

From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thought

Lionel Wong, Gabriel Grand, Alexander K. Lew, Noah D. Goodman, Vikash K. Mansinghka, Jacob Andreas, Joshua B. Tenenbaum

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI

Semantic 3D scene segmentation for robotic assembly process execution

Andreas Wiedholz, Stefanie Wucherer, Simon Dietrich

专题命中 具身推理 ：robotic(title)；world model(abstract)；分类 cs.RO

Dynamic Update-to-Data Ratio: Minimizing World Model Overfitting

Nicolai Dorka, Tim Welschehold, Wolfram Burgard

专题命中 具身推理 ：world model(title,abstract)；分类 cs.LG

Comments ICLR 2023