arXivDaily arXiv每日学术速递 周一至周五更新

视觉与机器人

世界模型

面向环境建模、时序预测、仿真规划、具身智能和自动驾驶的世界模型方法与应用。

共收录 504 信号源:cs.AI, cs.LG, cs.CV, cs.RO, cs.MA

1. 具身与机器人 504 篇

2409.11452 2024-09-19 cs.RO cs.LG 58%

Learning a Terrain- and Robot-Aware Dynamics Model for Autonomous Mobile Robot Navigation

Jan Achterhold, Suresh Guttikonda, Jens U. Kreber, Haolong Li, Joerg Stueckler

专题命中 具身与机器人 :dynamics model(title,abstract);分类 cs.LG、cs.RO

Comments Submitted to Robotics and Autonomous Systems. arXiv admin note: substantial text overlap with arXiv:2307.09206

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.00802 2023-11-03 cs.RO cs.LG 58%

Neural Field Dynamics Model for Granular Object Piles Manipulation

Shangjie Xue, Shuo Cheng, Pujith Kachana, Danfei Xu

专题命中 具身与机器人 :dynamics model(title,abstract);分类 cs.LG、cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2202.12977 2022-07-19 cs.RO cs.AI 58%

Learning physics-informed simulation models for soft robotic manipulation: A case study with dielectric elastomer actuators

Manu Lahariya, Craig Innes, Chris Develder, Subramanian Ramamoorthy

专题命中 具身与机器人 :simulation model(title);分类 cs.AI、cs.RO;dynamics model(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2204.08647 2022-04-22 cs.RO cs.LG 58%

Learning Forward Dynamics Model and Informed Trajectory Sampler for Safe Quadruped Navigation

Yunho Kim, Chanyoung Kim, Jemin Hwangbo

专题命中 具身与机器人 :dynamics model(title,abstract);分类 cs.LG、cs.RO

Comments Accepted to Robotics: Science and Systems (RSS 2022)

详情

展开后加载摘要…

URL PDF HTML 收藏
1909.11652 2019-09-26 cs.RO cs.LG 58%

Deep Dynamics Models for Learning Dexterous Manipulation

Anusha Nagabandi, Kurt Konoglie, Sergey Levine, Vikash Kumar

专题命中 具身与机器人 :dynamics model(title,abstract);分类 cs.LG、cs.RO

Comments project website https://sites.google.com/view/pddm/

详情

展开后加载摘要…

URL PDF HTML 收藏
2606.31941 2026-07-01 cs.RO cs.AI 新提交 56%

LeCropFollow: Latent Space Planning for Navigation in Unstructured Crop Fields

LeCropFollow:非结构化农田中导航的潜在空间规划

Felipe Tommaselli, Francisco Affonso, Arthur Pompeu, Gianluca Capezzuto, Arun Narenthiran Sivakumar, Girish Chowdhary, Marcelo Becker

机构 * University of São Paulo(圣保罗大学) University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

专题命中 具身与机器人 :model-based reinforcement learning(abstract);分类 cs.AI、cs.RO

AI总结 提出LeCropFollow框架,利用自监督语义热图和基于模型的强化学习规划器在潜在流形中优化轨迹,无需几何建模,实现从简化模拟到真实世界的零样本迁移,在玉米田间隙中语义故障减少2.4倍。

Comments 8 pages, 7 figures, 3 tables. Github Repo: https://github.com/Felipe-Tommaselli/lecropfollow

Journal ref IEEE Robotics and Automation Letters, 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
1903.02531 2026-06-04 cs.RO cs.AI cs.CV cs.LG cs.SY eess.SY 56%

Combining Optimal Control and Learning for Visual Navigation in Novel Environments

将最优控制与学习相结合用于新环境中的视觉导航

Somil Bansal, Varun Tolani, Saurabh Gupta, Jitendra Malik, Claire Tomlin

机构 * University of California, Berkeley(加州大学伯克利分校) Facebook AI Research(脸书人工智能研究)

专题命中 具身与机器人 :分类 cs.AI、cs.LG、cs.CV;dynamics model(abstract)

AI总结 本文提出了一种结合模型控制与学习感知的方法,用于在新环境中实现可靠的视觉导航,通过生成无碰撞路径的 waypoints,使机器人能够高效地到达目标位置,同时在低帧率和仿真到现实的迁移中表现良好。

Comments Project website: https://vtolani95.github.io/WayPtNav/

详情

展开后加载摘要…

URL PDF HTML 收藏
1808.00113 2026-06-04 eess.SY cs.LG cs.RO cs.SY math.OC 56%

Learning Stabilizable Dynamical Systems via Control Contraction Metrics

通过控制收缩度量学习可稳定化的动态系统

Sumeet Singh, Vikas Sindhwani, Jean-Jacques E. Slotine, Marco Pavone

机构 * Dept. of Aeronautics and Astronautics, Stanford University(航空航天系,斯坦福大学) Google Brain Robotics, New York(谷歌大脑机器人,纽约) Dept. of Mechanical Engineering, Massachusetts Institute of Technology(机械工程系,麻省理工学院)

专题命中 具身与机器人 :model-based reinforcement learning(abstract);分类 cs.LG、cs.RO

AI总结 本文提出了一种新的框架,用于学习可稳定化的非线性动态系统,以实现机器人连续控制任务。核心方法是开发一种基于稳定性的控制理论正则化器,以确保学习到的系统可以配备一个稳健的控制器,能够稳定任何系统生成的开环轨迹。通过利用收缩理论、统计学习和凸优化工具,我们提供了一个通用且可操作的半监督算法来学习可稳定化的动态系统,可以应用于复杂的欠驱动系统。在模拟平面四旋翼系统上验证了所提算法,并观察到与传统回归技术学习的模型相比,使用控制理论正则化模型在轨迹生成和跟踪性能上有显著改进,尤其是在使用少量示范示例时。结果展示了将标准基于模型的强化学习算法与非线性控制理论概念结合的必要性,以提高可靠性。

Comments To appear at WAFR 2018. v2: re-structured Sections 3 & 4 to improve clarity; expanded discussion on limitations & future work in Section 5; added details on training & validation, significantly expanded experiments

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.01096 2026-05-05 cs.LG cs.RO 56%

Learning to Race in Minutes: Infoprop Dyna on the Mini Wheelbot

分钟级学习:信息传播动力学在迷你轮车上的应用

Devdutt Subhasish, Henrik Hose, Sebastian Trimpe

机构 * Institute for Data Science in Mechanical Engineering, RWTH Aachen University(机械工程数据科学研究所,亚琛工业大学)

专题命中 具身与机器人 :model-based reinforcement learning(abstract);分类 cs.LG、cs.RO

AI总结 本文提出利用信息传播动力学框架,使迷你轮车在11分钟内通过真实交互学习赛道竞速,无需依赖物理仿真器。

Comments Originally submitted to the German Robotics Conference, 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.23706 2026-03-02 cs.RO cs.CV 56%

A Reliable Indoor Navigation System for Humans Using AR-based Technique

基于AR技术的可靠室内导航系统

Vijay U. Rathod, Manav S. Sharma, Shambhavi Verma, Aadi Joshi, Sachin Aage, Sujal Shahane

专题命中 具身与机器人 :environment model(abstract);分类 cs.CV、cs.RO

AI总结 本文提出基于AR技术的室内导航系统,利用Vuforia Area Target和A*算法提升导航精度与用户体验,适用于校园等有限空间,但需进一步优化NavMesh以适应大规模动态环境。

Comments 6 pages, 6 figures, 2 tables, Presented at 7th International Conference on Advances in Science and Technology (ICAST 2024-25)

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.10102 2026-02-11 cs.CV 56%

VideoWorld 2: Learning Transferable Knowledge from Real-world Videos

VideoWorld 2: 从真实世界视频中学习可迁移的知识

Zhongwei Ren, Yunchao Wei, Xiao Yu, Guixun Luo, Yao Zhao, Bingyi Kang, Jiashi Feng, Xiaojie Jin

机构 * Beijing Jiaotong University(北京交通大学)

专题命中 具身与机器人 :latent dynamics(abstract);分类 cs.CV;dynamics model(abstract)

AI总结 VideoWorld 2通过动态增强的潜在动态模型从真实世界视频中学习可迁移知识,显著提升了任务成功率和长周期推理能力。

Comments Code and models are released at: https://maverickren.github.io/VideoWorld2.github.io/

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.03501 2026-02-04 cs.LG cs.AI 56%

Reparameterization Flow Policy Optimization

重参数化流策略优化

Hai Zhong, Zhuoran Li, Xun Wang, Longbo Huang

专题命中 具身与机器人 :model-based reinforcement learning(abstract);分类 cs.AI、cs.LG

AI总结 本文提出重参数化流策略优化方法,通过联合反向传播流生成过程和系统动力学,提升模型驱动强化学习的样本效率和探索能力。

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.02269 2026-02-03 cs.RO cs.AI cs.SE cs.SY eess.SY 56%

Bridging the Sim-to-Real Gap with multipanda ros2: A Real-Time ROS2 Framework for Multimanual Systems

通过multipanda ros2弥合仿真到现实的差距:一种用于多手系统的真实时间ROS2框架

Jon Škerlj, Seongjin Bien, Abdeldjallil Naceri, Sami Haddadin

专题命中 具身与机器人 :environment model(abstract);分类 cs.AI、cs.RO

AI总结 multipanda_ros2通过实时ROS2框架和高保真仿真整合,实现了多机器人系统的高精度控制与sim2real差距的弥合。

Comments This work has been submitted to the IEEE for possible publication

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.12898 2025-12-23 cs.LG cs.AI cs.CV cs.RO 56%

Vidar: Embodied Video Diffusion Model for Generalist Manipulation

Vidar:面向通用操作的具身视频扩散模型

Yao Feng, Hengkai Tan, Xinyi Mao, Chendong Xiang, Guodong Liu, Shuhe Huang, Hang Su, Jun Zhu

专题命中 具身与机器人 :分类 cs.AI、cs.LG、cs.CV;dynamics model(abstract)

AI总结 Vidar通过具身视频扩散模型和掩码逆动力学模型,实现了在不同机器人形态上的通用操作,仅需少量人类演示即可超越现有基线。

详情

展开后加载摘要…

URL PDF HTML 收藏
2512.15692 2025-12-22 cs.RO cs.AI cs.CV cs.LG 56%

mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAs

mimic-video: 用于超越VLAs的通用机器人控制的视频-动作模型

Jonas Pai, Liam Achenbach, Victoriano Montesinos, Benedek Forrai, Oier Mees, Elvis Nava

机构 * mimic robotics Microsoft Zurich(微软瑞士分公司) ETH Zurich(苏黎世联邦理工学院) ETH AI Center(苏黎世联邦理工学院人工智能中心) UC Berkeley(伯克利大学)

专题命中 具身与机器人 :分类 cs.AI、cs.LG、cs.CV;dynamics model(abstract)

AI总结 mimic-video通过结合预训练的视频模型和基于流匹配的动作解码器,实现了更有效的机器人控制,提升了样本效率和收敛速度。

Comments Revised Introduction, Related Work, and Appendix. Additional minor notational and grammatical fixes

详情

展开后加载摘要…

URL PDF HTML 收藏
2504.02477 2025-10-16 cs.RO cs.CV 56%

Multimodal Fusion and Vision-Language Models: A Survey for Robot Vision

Xiaofeng Han, Shunpeng Chen, Zenghuang Fu, Zhe Feng, Lue Fan, Dong An, Changwei Wang, Li Guo, Weiliang Meng, Xiaopeng Zhang, Rongtao Xu, Shibiao Xu

机构 * aThe State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, China [1ex] bSchool of Artificial Intelligence, University of Chinese Academy of Sciences, China [1ex] cSchool of Artificial Intelligence, Beijing University of Posts Telecommunications, China [1ex] dKey Laboratory of Computing Power Network Shandong Computer Science Center, Qilu University of Technology (Shandong Academy of Sciences), China [1ex] e Shandong Provincial Key Laboratory of Computing Power Internet Service Computing, Shandong Fundamental Research Center for Computer Science, China

专题命中 具身与机器人 :environment model(abstract);分类 cs.CV、cs.RO

Comments 27 pages, 11 figures. Accepted to Information Fusion. Final journal version: volume 126 (Part B), February 2026

Journal ref Information Fusion, 126 (Part B), February 2026, 103652

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.12497 2025-08-19 cs.AI cs.LG cs.RO 56%

Building Minimal and Reusable Causal State Abstractions for Reinforcement Learning

Zizhao Wang, Caroline Wang, Xuesu Xiao, Yuke Zhu, Peter Stone

专题命中 具身与机器人 :分类 cs.AI、cs.LG、cs.RO;dynamics model(abstract);simulation model(abstract)

Comments Accepted at AAAI24

Journal ref Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence (AAAI 2024), Article 1759, Pages 15778 - 15786

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.02205 2025-07-02 cs.LG cs.AI cs.SY eess.SY 56%

Bregman Centroid Guided Cross-Entropy Method

Yuliang Gu, Hongpeng Cao, Marco Caccamo, Naira Hovakimyan

机构 * Department of Mechanical Science and Engineering, UIUC, United States(伊利诺伊大学厄巴纳-香槟分校机械科学与工程系) School of Engineering and Design, TUM, Germany(慕尼黑工业大学工程与设计学院)

专题命中 具身与机器人 :model-based reinforcement learning(abstract);分类 cs.AI、cs.LG

详情

展开后加载摘要…

URL PDF HTML 收藏
2108.00385 2025-05-23 cs.RO cs.AI 56%

Transformer-based deep imitation learning for dual-arm robot manipulation

Heecheol Kim, Yoshiyuki Ohmura, Yasuo Kuniyoshi

机构 * The University of Tokyo(东京大学)

专题命中 具身与机器人 :environment model(abstract);分类 cs.AI、cs.RO

Comments 8 pages. Accepted in 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.07911 2025-05-14 cs.LG cs.AI 56%

Combining Bayesian Inference and Reinforcement Learning for Agent Decision Making: A Review

Chengmin Zhou, Ville Kyrki, Pasi Fränti, Laura Ruotsalainen

专题命中 具身与机器人 :model-based RL(abstract);分类 cs.AI、cs.LG

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.12297 2025-04-29 cs.RO 56%

Train Robots in a JIF: Joint Inverse and Forward Dynamics with Human and Robot Demonstrations

Gagan Khandate, Boxuan Wang, Sarah Park, Weizhe Ni, Joaquin Palacios, Kathyrn Lampo, Philippe Wu, Rosh Ho, Eric Chang, Matei Ciocarlie

机构 * Dept. of Computer Science(计算机科学系) Dept. of Mechanical Engineering(机械工程系) Columbia University(哥伦比亚大学)

专题命中 具身与机器人 :latent dynamics(abstract);分类 cs.RO;dynamics model(abstract)

Comments 9 pages, 8 figures, submission to RSS 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.22588 2025-03-31 cs.RO cs.CV cs.HC 56%

Next-Best-Trajectory Planning of Robot Manipulators for Effective Observation and Exploration

Heiko Renz, Maximilian Krämer, Frank Hoffmann, Torsten Bertram

专题命中 具身与机器人 :environment model(abstract);分类 cs.CV、cs.RO

Comments Accepted for publication at the IEEE International Conference on Robotics and Automation (ICRA), 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.09740 2025-03-10 cs.RO 56%

Gaussian Splatting Visual MPC for Granular Media Manipulation

Wei-Cheng Tseng, Ellina Zhang, Krishna Murthy Jatavallabhula, Florian Shkurti

专题命中 具身与机器人 :latent dynamics(abstract);分类 cs.RO;dynamics model(abstract)

Comments project website https://weichengtseng.github.io/gs-granular-mani/

详情

展开后加载摘要…

URL PDF HTML 收藏
2502.05244 2025-02-11 cs.AI cs.LG 56%

Probabilistic Artificial Intelligence

Andreas Krause, Jonas Hübotter

专题命中 具身与机器人 :model-based RL(abstract);分类 cs.AI、cs.LG

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.02787 2025-02-04 cs.RO cs.AI 56%

Make a Donut: Hierarchical EMD-Space Planning for Zero-Shot Deformable Manipulation with Tools

Yang You, Bokui Shen, Congyue Deng, Haoran Geng, Songlin Wei, He Wang, Leonidas Guibas

专题命中 具身与机器人 :latent dynamics(abstract);分类 cs.AI、cs.RO

Comments 8 pages. IEEE Robotics and Automation Letters (RA-L). Preprint Version. Accepted January, 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.12192 2024-11-01 cs.RO cs.AI cs.CV cs.LG 56%

DynaMo: In-Domain Dynamics Pretraining for Visuo-Motor Control

Zichen Jeff Cui, Hengkai Pan, Aadhithya Iyer, Siddhant Haldar, Lerrel Pinto

专题命中 具身与机器人 :分类 cs.AI、cs.LG、cs.CV;dynamics model(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.08488 2024-09-16 cs.RO 56%

Hierarchical Learning Framework for Whole-Body Model Predictive Control of a Real Humanoid Robot

Koji Ishihara, Hiroaki Gomi, Jun Morimoto

专题命中 具身与机器人 :model-based reinforcement learning(abstract);分类 cs.RO;dynamics model(abstract)

Comments 12 pages, 7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.16644 2024-09-04 cs.RO cs.LG 56%

Bridging the Sim-to-Real Gap with Bayesian Inference

Jonas Rothfuss, Bhavya Sukhija, Lenart Treven, Florian Dörfler, Stelian Coros, Andreas Krause

专题命中 具身与机器人 :model-based RL(abstract);分类 cs.LG、cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.16061 2024-06-24 cs.RO cs.AI 56%

MRHER: Model-based Relay Hindsight Experience Replay for Sequential Object Manipulation Tasks with Sparse Rewards

Yuming Huang, Bin Ren, Ziming Xu, Lianghong Wu

专题命中 具身与机器人 :model-based RL(abstract);分类 cs.AI、cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.03175 2024-06-06 cs.RO cs.AI cs.CV cs.LG 56%

Push Past Green: Learning to Look Behind Plant Foliage by Moving It

Xiaoyu Zhang, Saurabh Gupta

专题命中 具身与机器人 :分类 cs.AI、cs.LG、cs.CV;dynamics model(abstract)

Comments Accepted by Conference on Robot Learning (CoRL) 2023. for project website with video, see https://sites.google.com/view/pushpastgreen/

详情

展开后加载摘要…

URL PDF HTML 收藏