机器人 / 具身智能

Are Multimodal Large Language Models Ready for Omnidirectional Spatial Reasoning?

Zihao Dongfang, Xu Zheng, Ziqiao Weng, Yuanhuiyi Lyu, Danda Pani Paudel, Luc Van Gool, Kailun Yang, Xuming Hu

专题命中 具身推理 ：embodied AI(abstract)；分类 cs.CV

A Light and Smart Wearable Platform with Multimodal Foundation Model for Enhanced Spatial Reasoning in People with Blindness and Low Vision

Alexey Magay, Dhurba Tripathi, Yu Hao, Yi Fang

机构 * Embodied AI and Robotics (AIR) Lab New York University Abu Dhabi（embodied AI 和机器人（AIR）实验室 新 York 大学阿布扎赫德） 纠错

专题命中 具身推理 ：navigation(abstract)；分类 cs.CV

Comments Project website and code: https://dktpt44.github.io/LV-GPT/

Leveraging Computation of Expectation Models for Commonsense Affordance Estimation on 3D Scene Graphs

Mario A. V. Saucedo, Nikolaos Stathoulopoulos, Akash Patel, Christoforos Kanellakis, George Nikolakopoulos

机构 * Robotics & AI Team, Department of Computer, Electrical and Space Engineering, Luleå University of Technology（机器人与人工智能团队，计算机、电气与航天工程系，卢勒奥技术大学） 纠错

专题命中 具身推理 ：robotic(abstract)；分类 cs.RO

Comments Accepted at IROS24

3D Vision-Language Gaussian Splatting

Qucheng Peng, Benjamin Planche, Zhongpai Gao, Meng Zheng, Anwesa Choudhuri, Terrence Chen, Chen Chen, Ziyan Wu

机构 * Center for Research in Computer Vision, University of Central Florida（计算机视觉研究中心，佛罗里达大学） 纠错

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Comments Accepted at ICLR 2025. Main paper + supplementary material

Masked Point-Entity Contrast for Open-Vocabulary 3D Scene Understanding

Yan Wang, Baoxiong Jia, Ziyu Zhu, Siyuan Huang

机构 * State Key Laboratory of General Artificial Intelligence, BIGAI（通用人工智能国家重点实验室，BIGAI） ； Tsinghua University（清华大学） 纠错

专题命中 具身推理 ：embodied agent(abstract)；分类 cs.CV

Comments CVPR 2025

OpenFusion++: An Open-vocabulary Real-time Scene Understanding System

Xiaofeng Jin, Matteo Frosi, Matteo Matteucci

机构 * Politecnico di Milano（米兰理工学院） 纠错

专题命中 具身推理 ：navigation(abstract)；分类 cs.CV

Comments 8 pages, 9 figures

ReSpAct: Harmonizing Reasoning, Speaking, and Acting Towards Building Large Language Model-Based Conversational AI Agents

Vardhan Dongre, Xiaocheng Yang, Emre Can Acikgoz, Suvodip Dey, Gokhan Tur, Dilek Hakkani-Tür

机构 * University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） 纠错

专题命中 具身推理 ：world model(abstract)；分类 cs.AI

Comments 31 pages, 10 Figures, 25 Tables

CAGS: Open-Vocabulary 3D Scene Understanding with Context-Aware Gaussian Splatting

Wei Sun, Yanzhao Zhou, Jianbin Jiao, Yuan Li

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

3DAffordSplat: Efficient Affordance Reasoning with 3D Gaussians

Zeming Wei, Junyi Lin, Yang Liu, Weixing Chen, Jingzhou Luo, Guanbin Li, Liang Lin

专题命中 具身推理 ：embodied AI(abstract)；分类 cs.CV

Comments The first large-scale 3D Gaussians Affordance Reasoning Benchmark

InstanceGaussian: Appearance-Semantic Joint Gaussian Representation for 3D Instance-Level Perception

Haijie Li, Yanmin Wu, Jiarui Meng, Qiankun Gao, Zhiyao Zhang, Ronggang Wang, Jian Zhang

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Comments 14 pages, accepted by CVPR 2025 as poster

Localized Cultural Knowledge is Conserved and Controllable in Large Language Models

Veniamin Veselovsky, Berke Argin, Benedikt Stroebl, Chris Wendler, Robert West, James Evans, Thomas L. Griffiths, Arvind Narayanan

专题命中 具身推理 ：world model(abstract)；分类 cs.AI

Vision-Language Embodiment for Monocular Depth Estimation

Jinchang Zhang, Guoyu Lu

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

IAAO: Interactive Affordance Learning for Articulated Objects in 3D Environments

Can Zhang, Gim Hee Lee

专题命中 具身推理 ：manipulation(abstract)；分类 cs.CV

DCSEG: Decoupled 3D Open-Set Segmentation using Gaussian Splatting

Luis Wiedmann, Luca Wiehe, David Rozenberszki

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Comments To be published in CVPR Workshop on Open-World 3D Scene Understanding with Foundation Models

3D-TAFS: A Training-free Framework for 3D Affordance Segmentation

Meng Chu, Xuan Zhang, Zhedong Zheng, Tat-Seng Chua

专题命中 具身推理 ：robotic(abstract)；分类 cs.RO

Visual Agentic AI for Spatial Reasoning with a Dynamic API

Damiano Marsili, Rohun Agrawal, Yisong Yue, Georgia Gkioxari

专题命中 具身推理 ：embodied agent(abstract)；分类 cs.CV

Comments Project website: https://glab-caltech.github.io/vadar/

Motion Prompting: Controlling Video Generation with Motion Trajectories

Daniel Geng, Charles Herrmann, Junhwa Hur, Forrester Cole, Serena Zhang, Tobias Pfaff, Tatiana Lopez-Guevara, Carl Doersch, Yusuf Aytar, Michael Rubinstein, Chen Sun, Oliver Wang, Andrew Owens, Deqing Sun

专题命中 具身推理 ：world model(abstract)；分类 cs.CV

Comments CVPR 2025 camera ready. Project page: https://motion-prompting.github.io/

Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models

Ilias Stogiannidis, Steven McDonagh, Sotirios A. Tsaftaris

专题命中 具身推理 ：navigation(abstract)；分类 cs.CV

Comments 8 main pages, 4 pages Appendix, 5 figures

EndoChat: Grounded Multimodal Large Language Model for Endoscopic Surgery

Guankun Wang, Long Bai, Junyi Wang, Kun Yuan, Zhen Li, Tianxu Jiang, Xiting He, Jinlin Wu, Zhen Chen, Zhen Lei, Hongbin Liu, Jiazheng Wang, Fan Zhang, Nicolas Padoy, Nassir Navab, Hongliang Ren

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

DIV-FF: Dynamic Image-Video Feature Fields For Environment Understanding in Egocentric Videos

Lorenzo Mur-Labadia, Josechu Guerrero, Ruben Martinez-Cantin

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Chameleon: Fast-slow Neuro-symbolic Lane Topology Extraction

Zongzheng Zhang, Xinrun Li, Sizhe Zou, Guoxuan Chi, Siqi Li, Xuchong Qiu, Guoliang Wang, Guantian Zheng, Leichen Wang, Hang Zhao, Hao Zhao

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Comments ICRA 2025, Project Page: https://github.com/XR-Lee/neural-symbolic

SSNet: Saliency Prior and State Space Model-based Network for Salient Object Detection in RGB-D Images

Gargi Panda, Soumitra Kundu, Saumik Bhattacharya, Aurobinda Routray

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Towards Robust Algorithms for Surgical Phase Recognition via Digital Twin Representation

Hao Ding, Yuqian Zhang, Wenzheng Cheng, Xinyu Wang, Xu Lian, Chenhao Yu, Hongchao Shu, Ji Woong Kim, Axel Krieger, Mathias Unberath

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

ARCON: Advancing Auto-Regressive Continuation for Driving Videos

Ruibo Ming, Jingwei Wu, Zhewei Huang, Zhuoxuan Ju, Jianming HU, Lihui Peng, Shuchang Zhou

专题命中 具身推理 ：world model(abstract)；分类 cs.CV

Noumenal Labs White Paper: How To Build A Brain

Maxwell J. D. Ramstead, Candice Pattisapu, Jason Fox, Jeff Beck

专题命中 具身推理 ：world model(abstract)；分类 cs.AI

ElasticTok: Adaptive Tokenization for Image and Video

Wilson Yan, Volodymyr Mnih, Aleksandra Faust, Matei Zaharia, Pieter Abbeel, Hao Liu

专题命中 具身推理 ：world model(abstract)；分类 cs.LG

Predicting 3D representations for Dynamic Scenes

Di Qi, Tong Yang, Beining Wang, Xiangyu Zhang, Wenqiang Zhang

专题命中 具身推理 ：world model(abstract)；分类 cs.CV

Zero-Shot Scene Understanding for Automatic Target Recognition Using Large Vision-Language Models

Yasiru Ranasinghe, Vibashan VS, James Uplinger, Celso De Melo, Vishal M. Patel

专题命中 具身推理 ：navigation(abstract)；分类 cs.CV

How GPT learns layer by layer

Jason Du, Kelly Hong, Alishba Imran, Erfan Jahanparast, Mehdi Khfifi, Kaichun Qiao

专题命中 具身推理 ：world model(abstract)；分类 cs.AI

A new solution and concrete implementation steps for Artificial General Intelligence

Yongcong Chen, Ting Zeng, Xingyue Chen

专题命中 具身推理 ：world model(abstract)；分类 cs.LG

Comments 25 pages, 2 figures, 1 table