3D 视觉

Learning Spatial Features from Audio-Visual Correspondence in Egocentric Videos

Sagnik Majumder, Ziad Al-Halah, Kristen Grauman

专题命中 空间理解 ：spatial understanding(abstract)；分类 cs.CV

Comments Accepted to CVPR 2024

RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understanding

Jihan Yang, Runyu Ding, Weipeng Deng, Zhe Wang, Xiaojuan Qi

专题命中 空间理解 ：3D vision(abstract)；分类 cs.CV

Comments To appear in CVPR2024 .project page: https://jihanyang.github.io/projects/RegionPLC

UniM-OV3D: Uni-Modality Open-Vocabulary 3D Scene Understanding with Fine-Grained Feature Representation

Qingdong He, Jinlong Peng, Zhengkai Jiang, Kai Wu, Xiaozhong Ji, Jiangning Zhang, Yabiao Wang, Chengjie Wang, Mingang Chen, Yunsheng Wu

专题命中 空间理解 ：point cloud(abstract)；分类 cs.CV

Comments Accepted by IJCAI 2024

SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Prediction

Pin Tang, Zhongdao Wang, Guoqing Wang, Jilai Zheng, Xiangxuan Ren, Bailan Feng, Chao Ma

专题命中 空间理解 ：point cloud(abstract)；分类 cs.CV

Comments 10 pages, 4 figures, accepted by CVPR 2024

Journal ref IEEE Conference on Computer Vision and Pattern Recognition 2024 (CVPR 2024)

Urban Architect: Steerable 3D Urban Scene Generation with Layout Prior

Fan Lu, Kwan-Yee Lin, Yan Xu, Hongsheng Li, Guang Chen, Changjun Jiang

专题命中 空间理解 ：3D generation(abstract)；分类 cs.CV

Comments Project page: https://urbanarchitect.github.io/

Honeybee: Locality-enhanced Projector for Multimodal LLM

Junbum Cha, Wooyoung Kang, Jonghwan Mun, Byungseok Roh

专题命中 空间理解 ：spatial understanding(abstract)；分类 cs.CV

Comments CVPR 2024 camera-ready

DOCTR: Disentangled Object-Centric Transformer for Point Scene Understanding

Xiaoxuan Yu, Hao Wang, Weiming Li, Qiang Wang, Soonyong Cho, Younghun Sung

专题命中 空间理解 ：point cloud(abstract)；分类 cs.CV

AmodalSynthDrive: A Synthetic Amodal Perception Dataset for Autonomous Driving

Ahmed Rida Sekkat, Rohit Mohan, Oliver Sawade, Elmar Matthes, Abhinav Valada

专题命中 空间理解 ：spatial understanding(abstract)；分类 cs.CV

DreamUp3D: Object-Centric Generative Models for Single-View 3D Scene Understanding and Real-to-Sim Transfer

Yizhe Wu, Haitz Sáez de Ocáriz Borde, Jack Collins, Oiwi Parker Jones, Ingmar Posner

专题命中 空间理解 ：3D reconstruction(abstract)；分类 cs.RO

POP-3D: Open-Vocabulary 3D Occupancy Prediction from Images

Antonin Vobecky, Oriane Siméoni, David Hurych, Spyros Gidaris, Andrei Bursuc, Patrick Pérez, Josef Sivic

专题命中 空间理解 ：point cloud(abstract)；分类 cs.CV

Comments accepted to NeurIPS 2023

Exploring Contextual Representation and Multi-Modality for End-to-End Autonomous Driving

Shoaib Azam, Farzeen Munir, Ville Kyrki, Moongu Jeon, Witold Pedrycz

专题命中 空间理解 ：spatial understanding(abstract)；分类 cs.RO

What's left can't be right -- The remaining positional incompetence of contrastive vision-language models

Nils Hoehing, Ellen Rushe, Anthony Ventresque

专题命中 空间理解 ：spatial understanding(abstract)；分类 cs.CV

A Simple Framework for 3D Occupancy Estimation in Autonomous Driving

Wanshui Gan, Ningkai Mo, Hongbin Xu, Naoto Yokoya

专题命中 空间理解 ：3D reconstruction(abstract)；分类 cs.CV

Comments 15 pages, 8 figures

CGOF++: Controllable 3D Face Synthesis with Conditional Generative Occupancy Fields

Keqiang Sun, Shangzhe Wu, Ning Zhang, Zhaoyang Huang, Quan Wang, Hongsheng Li

专题命中 空间理解 ：NeRF(abstract)；分类 cs.CV

Comments Accepted to IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI). This article is an extension of the NeurIPS'22 paper arXiv:2206.08361

Benchmarking Spatial Relationships in Text-to-Image Generation

Tejas Gokhale, Hamid Palangi, Besmira Nushi, Vibhav Vineet, Eric Horvitz, Ece Kamar, Chitta Baral, Yezhou Yang

专题命中 空间理解 ：spatial understanding(abstract)；分类 cs.CV

Comments preprint; Code and Data at https://github.com/microsoft/VISOR and https://huggingface.co/datasets/tgokhale/sr2d_visor

Changes to Captions: An Attentive Network for Remote Sensing Change Captioning

Shizhen Chang, Pedram Ghamisi

专题命中 空间理解 ：spatial understanding(abstract)；分类 cs.CV

ImageManip: Image-based Robotic Manipulation with Affordance-guided Next View Selection

Xiaoqi Li, Yanzi Wang, Yan Shen, Ponomarenko Iaroslav, Haoran Lu, Qianxu Wang, Boshi An, Jiaming Liu, Hao Dong

专题命中 空间理解 ：point cloud(abstract)；分类 cs.RO

Open-Vocabulary Affordance Detection using Knowledge Distillation and Text-Point Correlation

Tuan Van Vo, Minh Nhat Vu, Baoru Huang, Toan Nguyen, Ngan Le, Thieu Vo, Anh Nguyen

专题命中 空间理解 ：point cloud(abstract)；分类 cs.RO

Comments 8 pages

You Only Need One Thing One Click: Self-Training for Weakly Supervised 3D Scene Understanding

Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu

专题命中 空间理解 ：point cloud(abstract)；分类 cs.CV

Comments Extension of One Thing One Click (CVPR'2021) arXiv:2104.02246

VIRD: Immersive Match Video Analysis for High-Performance Badminton Coaching

Tica Lin, Alexandre Aouididi, Zhutian Chen, Johanna Beyer, Hanspeter Pfister, Jui-Hsien Wang

专题命中 空间理解 ：spatial understanding(abstract)；分类 cs.GR

Comments To Appear in IEEE Transactions on Visualization and Computer Graphics (IEEE VIS), 2023

Factored Neural Representation for Scene Understanding

Yu-Shiang Wong, Niloy J. Mitra

专题命中 空间理解 ：novel view synthesis(abstract)；分类 cs.CV

Learning Occupancy for Monocular 3D Object Detection

Liang Peng, Junkai Xu, Haoran Cheng, Zheng Yang, Xiaopei Wu, Wei Qian, Wenxiao Wang, Boxi Wu, Deng Cai

专题命中 空间理解 ：point cloud(abstract)；分类 cs.CV

Generating Visual Spatial Description via Holistic 3D Scene Understanding

Yu Zhao, Hao Fei, Wei Ji, Jianguo Wei, Meishan Zhang, Min Zhang, Tat-Seng Chua

专题命中 空间理解 ：spatial understanding(abstract)；分类 cs.CV

Comments ACL 2023

CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIP

Runnan Chen, Youquan Liu, Lingdong Kong, Xinge Zhu, Yuexin Ma, Yikang Li, Yuenan Hou, Yu Qiao, Wenping Wang

专题命中 空间理解 ：point cloud(abstract)；分类 cs.CV

Comments CVPR 2023

Controllable 3D Face Synthesis with Conditional Generative Occupancy Fields

Keqiang Sun, Shangzhe Wu, Zhaoyang Huang, Ning Zhang, Quan Wang, HongSheng Li

专题命中 空间理解 ：NeRF(abstract)；分类 cs.CV

Learning 6-DoF Task-oriented Grasp Detection via Implicit Estimation and Visual Affordance

Wenkai Chen, Hongzhuo Liang, Zhaopeng Chen, Fuchun Sun, Jianwei Zhang

专题命中 空间理解 ：point cloud(abstract)；分类 cs.RO

Comments Accepted to the 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

Novel 3D Scene Understanding Applications From Recurrence in a Single Image

Shimian Zhang, Skanda Bharadwaj, Keaton Kraiger, Yashasvi Asthana, Hong Zhang, Robert Collins, Yanxi Liu

专题命中 空间理解 ：spatial understanding(abstract)；分类 cs.CV

Towards Multimodal Multitask Scene Understanding Models for Indoor Mobile Agents

Yao-Hung Hubert Tsai, Hanlin Goh, Ali Farhadi, Jian Zhang

专题命中 空间理解 ：point cloud(abstract)；分类 cs.CV

Comments Submitted to ICRA2023

MCTS with Refinement for Proposals Selection Games in Scene Understanding

Sinisa Stekovic, Mahdi Rad, Alireza Moradi, Friedrich Fraundorfer, Vincent Lepetit

专题命中 空间理解 ：point cloud(abstract)；分类 cs.CV

Comments Submitted to: TPAMI Special Section on the Best Papers of ICCV2021 GitHub Repository: https://github.com/vevenom/MonteScene. arXiv admin note: substantial text overlap with arXiv:2103.11161

KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3D

Yiyi Liao, Jun Xie, Andreas Geiger

专题命中 空间理解 ：novel view synthesis(abstract)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:1511.03240