机器人 / 具身智能

MinkSORT: A 3D deep feature extractor using sparse convolutions to improve 3D multi-object tracking in greenhouse tomato plants

David Rapado-Rincon, Eldert J. van Henten, Gert Kootstra

专题命中 具身推理 ：world model(abstract)；分类 cs.RO

Challenges Faced by Large Language Models in Solving Multi-Agent Flocking

Peihan Li, Vishnu Menon, Bhavanaraj Gudiguntla, Daniel Ting, Lifeng Zhou

专题命中 具身推理 ：robotics(abstract)；分类 cs.AI

GEAL: Generalizable 3D Affordance Learning with Cross-Modal Consistency

Dongyue Lu, Lingdong Kong, Tianxin Huang, Gim Hee Lee

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Comments 22 pages, 8 figures, 12 tables; Project Page at https://dylanorange.github.io/projects/geal

Towards Robust and Fair Vision Learning in Open-World Environments

Thanh-Dat Truong

专题命中 具身推理 ：world model(abstract)；分类 cs.CV

Comments PhD Dissertation

Event fields: Capturing light fields at high speed, resolution, and dynamic range

Ziyuan Qu, Zihao Zou, Vivek Boominathan, Praneeth Chakravarthula, Adithya Pediredla

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Query-Efficient Planning with Language Models

Gonzalo Gonzalez-Pumariega, Wayne Chen, Kushal Kedia, Sanjiban Choudhury

专题命中 具身推理 ：world model(abstract)；分类 cs.AI

Comments 11 pages (not including references or appendix); 13 figures (9 main paper, 4 appendix); (v1) preprint

Monitoring Latent World States in Language Models with Propositional Probes

Jiahai Feng, Stuart Russell, Jacob Steinhardt

专题命中 具身推理 ：world model(abstract)；分类 cs.LG

HoloDrive: Holistic 2D-3D Multi-Modal Street Scene Generation for Autonomous Driving

Zehuan Wu, Jingcheng Ni, Xiaodong Wang, Yuxin Guo, Rui Chen, Lewei Lu, Jifeng Dai, Yuwen Xiong

专题命中 具身推理 ：world model(abstract)；分类 cs.CV

ROOT: VLM based System for Indoor Scene Understanding and Beyond

Yonghui Wang, Shi-Yong Chen, Zhenxing Zhou, Siyi Li, Haoran Li, Wengang Zhou, Houqiang Li

专题命中 具身推理 ：embodied AI(abstract)；分类 cs.CV

Reducing Label Dependency for Underwater Scene Understanding: A Survey of Datasets, Techniques and Applications

Scarlett Raine, Frederic Maire, Niko Suenderhauf, Tobias Fischer

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

Comments 70 pages, 20 figures

$SE(3)$ Equivariant Ray Embeddings for Implicit Multi-View Depth Estimation

Yinshuang Xu, Dian Chen, Katherine Liu, Sergey Zakharov, Rares Ambrus, Kostas Daniilidis, Vitor Guizilini

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Comments Accepted at NeurIPS 2024

Symbolic Graph Inference for Compound Scene Understanding

FNU Aryan, Simon Stepputtis, Sarthak Bhagat, Joseph Campbell, Kwonjoon Lee, Hossein Nourkhiz Mahjoub, Katia Sycara

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D Priors

Chenyang Ma, Kai Lu, Ta-Ying Cheng, Niki Trigoni, Andrew Markham

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Comments NeurIPS 2024; Project Page: https://dannymcy.github.io/zeroshot_task_hallucination/

Introduction to Latent Variable Energy-Based Models: A Path Towards Autonomous Machine Intelligence

Anna Dawid, Yann LeCun

专题命中 具身推理 ：world model(abstract)；分类 cs.LG

Comments 23 pages + 1-page appendix, 11 figures. These notes follow the content of three lectures given by Yann LeCun during the Les Houches Summer School on Statistical Physics and Machine Learning in 2022. Feedback and comments are most welcome!

Journal ref J. Stat. Mech. (2024) 104011

Surgical Scene Segmentation by Transformer With Asymmetric Feature Enhancement

Cheng Yuan, Yutong Ban

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

Looking Inward: Language Models Can Learn About Themselves by Introspection

Felix J Binder, James Chua, Tomek Korbak, Henry Sleight, John Hughes, Robert Long, Ethan Perez, Miles Turpin, Owain Evans

专题命中 具身推理 ：world model(abstract)；分类 cs.AI

Comments 15 pages, 9 figures

SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models

An-Chieh Cheng, Hongxu Yin, Yang Fu, Qiushan Guo, Ruihan Yang, Jan Kautz, Xiaolong Wang, Sifei Liu

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

Comments NeurIPS 2024, Project Page: https://www.anjiecheng.me/SpatialRGPT

EgoChoir: Capturing 3D Human-Object Interaction Regions from Egocentric Views

Yuhang Yang, Wei Zhai, Chengfeng Wang, Chengjun Yu, Yang Cao, Zheng-Jun Zha

专题命中 具身推理 ：embodied AI(abstract)；分类 cs.CV

Comments NeurIPS2024, project: https://yyvhang.github.io/EgoChoir/

Structured Spatial Reasoning with Open Vocabulary Object Detectors

Negar Nejatishahidin, Madhukar Reddy Vongala, Jana Kosecka

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

In-Place Panoptic Radiance Field Segmentation with Perceptual Prior for 3D Scene Understanding

Shenghao Li

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Str-L Pose: Integrating Point and Structured Line for Relative Pose Estimation in Dual-Graph

Zherong Zhang, Chunyu Lin, Shujuan Huang, Shangrong Yang, Yao Zhao

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

You Only Speak Once to See

Wenhao Yang, Jianguo Wei, Wenhuan Lu, Lei Li

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

Comments 7 pages, 4 figures

EPRecon: An Efficient Framework for Real-Time Panoptic 3D Reconstruction from Monocular Video

Zhen Zhou, Yunkai Ma, Junfeng Fan, Shaolin Zhang, Fengshui Jing, Min Tan

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

GauTOAO: Gaussian-based Task-Oriented Affordance of Objects

Jiawen Wang, Dingsheng Luo

专题命中 具身推理 ：manipulation(abstract)；分类 cs.RO

Comments 6 pages

Optimizing 3D Gaussian Splatting for Sparse Viewpoint Scene Reconstruction

Shen Chen, Jiale Zhou, Lei Li

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

BOX3D: Lightweight Camera-LiDAR Fusion for 3D Object Detection and Localization

Mario A. V. Saucedo, Nikolaos Stathoulopoulos, Vidya Sumathy, Christoforos Kanellakis, George Nikolakopoulos

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Comments Presented in MED 2024

Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splatting

Jun Guo, Xiaojian Ma, Yue Fan, Huaping Liu, Qing Li

专题命中 具身推理 ：embodied agent(abstract)；分类 cs.CV

Comments Project page: see https://semantic-gaussians.github.io

What Makes and Breaks Safety Fine-tuning? A Mechanistic Study

Samyak Jain, Ekdeep Singh Lubana, Kemal Oksuz, Tom Joy, Philip H. S. Torr, Amartya Sanyal, Puneet K. Dokania

专题命中 具身推理 ：world model(abstract)；分类 cs.LG

Comments Preprint

Shapley Marginal Surplus for Strong Models

Daniel de Marchi, Michael Kosorok, Scott de Marchi

专题命中 具身推理 ：world model(abstract)；分类 cs.LG

OpenIns3D: Snap and Lookup for 3D Open-vocabulary Instance Segmentation

Zhening Huang, Xiaoyang Wu, Xi Chen, Hengshuang Zhao, Lei Zhu, Joan Lasenby

专题命中 具身推理 ：world model(abstract)；分类 cs.CV

Comments ECCV 2024. Project page: https://zheninghuang.github.io/OpenIns3D/