arXivDaily arXiv每日学术速递 周一至周五更新

视觉与机器人

多模态信息融合

面向图像、视频、多传感器和跨模态感知的信息融合,包括 Image Fusion、红外可见光、遥感、医学影像、LiDAR/雷达/相机和音视频融合。

共收录 259 信号源:cs.CV, eess.IV, eess.SP, cs.RO, cs.MM

1. 自动驾驶多传感器融合 259 篇

2404.04629 2024-09-25 cs.CV 89%

DifFUSER: Diffusion Model for Robust Multi-Sensor Fusion in 3D Object Detection and BEV Segmentation

Duy-Tho Le, Hengcan Shi, Jianfei Cai, Hamid Rezatofighi

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title,abstract);multi-modal fusion(abstract);分类 cs.CV

Comments ECCV 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.05329 2024-07-11 cs.CV 89%

OccFusion: Depth Estimation Free Multi-sensor Fusion for 3D Occupancy Prediction

Ji Zhang, Yiran Ding, Zixin Liu

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title,abstract);multi-modal fusion(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.00034 2025-10-29 cs.RO cs.CV 88%

GaussianFusion: Gaussian-Based Multi-Sensor Fusion for End-to-End Autonomous Driving

Shuai Liu, Quanmin Liang, Zefeng Li, Boyang Li, Kai Huang

机构 * School of Computer Science and Engineering, Sun Yat-sen University(计算机科学与工程学院,中山大学)

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title,abstract);分类 cs.CV、cs.RO

Comments Accepted at NeurIPS2025 (Spotlight)

详情

展开后加载摘要…

URL PDF HTML 收藏
2210.15316 2022-10-28 cs.CV cs.LG cs.RO 88%

MSF3DDETR: Multi-Sensor Fusion 3D Detection Transformer for Autonomous Driving

Gopi Krishna Erabati, Helder Araujo

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title,abstract);分类 cs.CV、cs.RO

Comments Accepted at the ICPR 2022 Workshop DLVDR2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.19972 2025-09-24 cs.CV 88%

DAOcc: 3D Object Detection Assisted Multi-Sensor Fusion for 3D Occupancy Prediction

Zhen Yang, Yanpeng Dong, Jiayu Wang, Heng Wang, Lichao Ma, Zijian Cui, Qi Liu, Haoran Pei, Kexin Zhang, Chao Zhang

机构 * Beijing Mechanical Equipment Institute(北京机械设备研究所)

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title,abstract);分类 cs.CV

Comments TCSVT Accepted version (not the final published version)

Journal ref IEEE Transactions on Circuits and Systems for Video Technology, 2025, Print ISSN: 1051-8215, Online ISSN: 1558-2205

详情

展开后加载摘要…

URL PDF HTML 收藏
2504.13420 2025-04-21 cs.RO cs.SE 88%

Testing the Fault-Tolerance of Multi-Sensor Fusion Perception in Autonomous Driving Systems

Haoxiang Tian, Wenqiang Ding, Xingshuo Han, Guoquan Wu, An Guo, Junqi Zhang. Wei Chen, Jun Wei, Tianwei Zhang

机构 * Institute of Software Chinese Academy of Sciences(中国科学院软件研究所) Nanyang Technological University(南洋理工大学) University of CAS, Nanjing(中国科学院大学南京分校) Nanjing Institute of Software Technology, University of CAS, Nanjing(中国科学院南京软件技术研究所) Continental-NTU Corporate Lab(Continental-NTU企业实验室) University of Science and Technology of China(中国科学技术大学)

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title,abstract);分类 cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2501.05997 2025-01-13 cs.CV 88%

Minimizing Occlusion Effect on Multi-View Camera Perception in BEV with Multi-Sensor Fusion

Sanjay Kumar, Hiep Truong, Sushil Sharma, Ganesh Sistu, Tony Scanlan, Eoin Grua, Ciarán Eising

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title,abstract);分类 cs.CV

Comments Accepted form publishing at the Electronic Imaging - Autonomous Vehicles and Machines Conference

详情

展开后加载摘要…

URL PDF HTML 收藏
2106.09249 2021-06-18 cs.CR cs.CV cs.LG 88%

Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attacks

Yulong Cao*, Ningfei Wang*, Chaowei Xiao*, Dawei Yang*, Jin Fang, Ruigang Yang, Qi Alfred Chen, Mingyan Liu, Bo Li

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title,abstract);分类 cs.CV

Comments Accepted by IEEE S&P 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2606.02979 2026-06-03 cs.CV cs.AI cs.RO 87%

Towards Compact Autonomous Driving Perception with Balanced Learning and Multi-sensor Fusion

面向紧凑型自动驾驶感知的平衡学习与多传感器融合

Oskar Natan, Jun Miura

机构 * Department of Computer Science and Engineering, Toyohashi University of Technology(计算机科学与工程系,丰田寺大学) Department of Computer Science and Electronics, Gadjah Mada University(计算机科学与电子系,加查马达大学)

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title);分类 cs.CV、cs.RO

AI总结 提出一种紧凑的深度多任务学习模型,通过自适应损失加权和中间传感器融合技术,在单次前向传播中同时处理语义分割、深度估计、激光雷达分割和鸟瞰投影,实现高效自动驾驶感知。

Comments This work has been accepted for publication in IEEE Transactions on Intelligent Transportation Systems. https://ieeexplore.ieee.org/document/9712213

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.01644 2024-05-10 cs.CV cs.RO 87%

OccFusion: Multi-Sensor Fusion Framework for 3D Semantic Occupancy Prediction

Zhenxing Ming, Julie Stephany Berrio, Mao Shan, Stewart Worrall

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title);分类 cs.CV、cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.04058 2023-11-08 cs.CV 85%

mmFUSION: Multimodal Fusion for 3D Objects Detection

Javed Ahmad, Alessio Del Bue

专题命中 自动驾驶多传感器融合 :multimodal fusion(title);multi-modal fusion(abstract);sensor fusion(abstract);multi-sensor fusion(abstract)

Comments 10 pages,

详情

展开后加载摘要…

URL PDF HTML 收藏
2208.12079 2022-11-01 cs.CV 85%

Bridging the View Disparity Between Radar and Camera Features for Multi-modal Fusion 3D Object Detection

Taohua Zhou, Yining Shi, Junjie Chen, Kun Jiang, Mengmeng Yang, Diange Yang

专题命中 自动驾驶多传感器融合 :multi-modal fusion(title,abstract);sensor fusion(abstract);feature-level fusion(abstract);分类 cs.CV

Comments 12 pages,6 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2104.09224 2021-04-20 cs.CV cs.AI cs.LG cs.RO 84%

Multi-Modal Fusion Transformer for End-to-End Autonomous Driving

Aditya Prakash, Kashyap Chitta, Andreas Geiger

专题命中 自动驾驶多传感器融合 :multi-modal fusion(title,abstract);sensor fusion(abstract);分类 cs.CV、cs.RO

Comments CVPR 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2607.00746 2026-07-02 cs.CV cs.AI 新提交 83%

GaussianFusion: Unified 3D Gaussian Representation for Multi-Modal Fusion Perception

GaussianFusion:用于多模态融合感知的统一3D高斯表示

Xiao Zhao, Chang Liu, Mingxu Zhu, Zheyuan Zhang, Linna Song, Qingliang Luo, Chufan Guo, Kuifeng Su

机构 * Tencent, Autonomous Driving Lab(腾讯自动驾驶实验室)

专题命中 自动驾驶多传感器融合 :multi-modal fusion(title,abstract);multimodal fusion(abstract);分类 cs.CV

AI总结 提出基于3D高斯表示的多模态融合框架GaussianFusion,通过连续3D高斯空间统一多模态特征,保留细节,支持多种3D感知任务,在nuScenes上检测NDS提升2.6,占用预测mIoU提升1.55且速度提升450%。

Comments ICLR 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.16408 2025-08-25 cs.CV 83%

SAMFusion: Sensor-Adaptive Multimodal Fusion for 3D Object Detection in Adverse Weather

Edoardo Palladin, Roland Dietze, Praveen Narayanan, Mario Bijelic, Felix Heide

机构 * Torc Robotics(Torc机器人公司) University of Stuttgart(斯图加特大学) Princeton University(普林斯顿大学)

专题命中 自动驾驶多传感器融合 :multimodal fusion(title);sensor fusion(abstract);multi-sensor fusion(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.18522 2025-07-25 cs.CV 83%

GaussianFusionOcc: A Seamless Sensor Fusion Approach for 3D Occupancy Prediction Using 3D Gaussians

Tomislav Pavković, Mohammad-Ali Nikouei Mahani, Johannes Niedermayer, Johannes Betz

机构 * Technical University of Munich(慕尼黑技术大学) BMW Group(宝马集团) Munich Institute of Robotics and Machine Intelligence(慕尼黑机器人与智能机械研究所)

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-modal fusion(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.03280 2025-03-06 cs.CV 83%

BEVMOSNet: Multimodal Fusion for BEV Moving Object Segmentation

Hiep Truong Cong, Ajay Kumar Sigatapu, Arindam Das, Yashwanth Sharma, Venkatesh Satagopan, Ganesh Sistu, Ciaran Eising

专题命中 自动驾驶多传感器融合 :multimodal fusion(title,abstract);sensor fusion(abstract);分类 cs.CV

Comments In Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (2025)

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.07475 2024-12-11 cs.CV 83%

Progressive Multi-Modal Fusion for Robust 3D Object Detection

Rohit Mohan, Daniele Cattaneo, Florian Drews, Abhinav Valada

专题命中 自动驾驶多传感器融合 :multi-modal fusion(title);sensor fusion(abstract);multi-sensor fusion(abstract);分类 cs.CV

Journal ref 8th Annual Conference on Robot Learning, 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2312.16620 2023-12-29 eess.SY cs.SY 82%

Autonomous Driving using Residual Sensor Fusion and Deep Reinforcement Learning

Amin Jalal Aghdasian, Amirhossein Heydarian Ardakani, Kianoush Aqabakee, Farzaneh Abdollahi

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);information fusion(abstract)

Comments Accepted Paper on International Conference on Robotics and Mechatronics (ICROM, 2023)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.05173 2024-09-17 cs.CV cs.AI cs.RO 82%

A Survey on Occupancy Perception for Autonomous Driving: The Information Fusion Perspective

Huaiyuan Xu, Junliang Chen, Shiyu Meng, Yi Wang, Lap-Pui Chau

专题命中 自动驾驶多传感器融合 :information fusion(title,abstract);分类 cs.CV、cs.RO

Journal ref Information Fusion, 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2606.27556 2026-06-29 cs.CV cs.RO 新提交 81%

Radar Guided Camera Verification for Automatic Emergency Braking Rethinking Object Detection in Radar Camera Fusion

雷达引导的自动紧急制动摄像头验证:重新思考雷达摄像头融合中的目标检测

Ram Charan Akula, Sivanathan Kandhasamy, Manikandan Ganesan

机构 * Autonomous Systems Lab, Department of Mechatronics Engineering, SRM Institute of Science and Technology(SRM科学与技术学院机电工程系自主系统实验室) Centre for Electric Mobility, Department of EEE, SRM Institute of Science and Technology(SRM科学与技术学院电气与电子工程系电动出行中心)

专题命中 自动驾驶多传感器融合 :radar camera fusion(title,abstract);分类 cs.CV、cs.RO

AI总结 提出一种雷达引导的边缘密度门控方法,在无需训练数据和GPU的情况下,通过缩小摄像头搜索空间实现高效障碍物验证,在真实车辆测试中达到98.7%的搜索空间缩减和零漏刹。

Comments 8 pages, 8 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.03284 2025-05-07 cs.CV cs.RO 81%

OccCylindrical: Multi-Modal Fusion with Cylindrical Representation for 3D Semantic Occupancy Prediction

Zhenxing Ming, Julie Stephany Berrio, Mao Shan, Yaoqi Huang, Hongyu Lyu, Nguyen Hoang Khoi Tran, Tzu-Yun Tseng, Stewart Worrall

机构 * Australian Centre for Robotics (ACFR) at the University of Sydney(澳大利亚机器人中心(ACFR)于悉尼大学)

专题命中 自动驾驶多传感器融合 :multi-modal fusion(title);sensor fusion(abstract);分类 cs.CV、cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.12552 2024-03-20 cs.CV cs.AI cs.RO 81%

M2DA: Multi-Modal Fusion Transformer Incorporating Driver Attention for Autonomous Driving

Dongyang Xu, Haokun Li, Qingfan Wang, Ziying Song, Lei Chen, Hanming Deng

专题命中 自动驾驶多传感器融合 :multi-modal fusion(title,abstract);分类 cs.CV、cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2207.14024 2022-12-08 cs.CV cs.AI cs.LG cs.RO 81%

Safety-Enhanced Autonomous Driving Using Interpretable Sensor Fusion Transformer

Hao Shao, Letian Wang, RuoBing Chen, Hongsheng Li, Yu Liu

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);分类 cs.CV、cs.RO

Comments Accepted at CoRL 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.15997 2022-06-01 cs.CV cs.AI cs.LG cs.RO 81%

TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving

Kashyap Chitta, Aditya Prakash, Bernhard Jaeger, Zehao Yu, Katrin Renz, Andreas Geiger

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);分类 cs.CV、cs.RO

Comments arXiv admin note: text overlap with arXiv:2104.09224

详情

展开后加载摘要…

URL PDF HTML 收藏
2512.21831 2026-07-29 cs.CV 版本更新 79%

End-to-End 3-D Spatiotemporal Perception with Multimodal Fusion and V2X Collaboration

端到端3D时空感知与多模态融合及V2X协作

Zhenwei Yang, Yibo Ai, Weidong Zhang

机构 * National Center for Materials Service Safety(材料服务安全国家中心) University of Science and Technology Beijing(北京科技大学)

专题命中 自动驾驶多传感器融合 :multimodal fusion(title,abstract);分类 cs.CV

AI总结 XET-V2X通过多模态融合与V2X协作,实现端到端3D时空感知,提升复杂交通场景下的检测与跟踪性能。

Comments 21 pages, 10 figures

Journal ref IEEE Internet of Things Journal, vol. 13, no. 15, pp. 33456-33475, 1 Aug.1, 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2606.09143 2026-06-09 cs.CV 新提交 79%

CAMF-Det: Closure-Aware Multimodal Fusion for LiDAR-Camera 3D Object Detection on UAV Platforms

CAMF-Det: 面向无人机平台的激光雷达-相机闭合感知多模态融合3D目标检测

Yanze Jiang, Yanfeng Gu, Xian Li

机构 * School of Electronics and Information Engineering, Harbin Institute of Technology(哈尔滨工业大学电子与信息工程学院)

专题命中 自动驾驶多传感器融合 :multimodal fusion(title,abstract);分类 cs.CV

AI总结 针对无人机俯视场景中树冠遮挡导致的多模态信息退化问题,提出基于比尔-朗伯定律的闭合感知融合框架CAMF-Det,通过显式建模双模态遮挡强度并注入检测流程,在自建数据集上实现困难级别mAP_BEV提升9.43%和4.88%。

详情

展开后加载摘要…

URL PDF HTML 收藏
2604.04797 2026-04-07 cs.CV cs.LG 79%

Multi-Modal Sensor Fusion using Hybrid Attention for Autonomous Driving

多模态传感器融合使用混合注意力用于自动驾驶

Mayank Mayank, Bharanidhar Duraisamy, Florian Geiß, Abhinav Valada

机构 * Mercedes-Benz AG(梅赛德斯-奔驰集团) University of Freiburg(弗莱堡大学)

专题命中 自动驾驶多传感器融合 :sensor fusion(title);hybrid fusion(abstract);分类 cs.CV

AI总结 本文提出MMF-BEV框架,通过变形注意力实现雷达与摄像头BEV融合,通过传感器贡献分析验证传感器互补性,并在VoD数据集上优于单模态基线。

Comments 9 pages, 8 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.02123 2025-05-06 cs.RO cs.DB 79%

DriveAgent: Multi-Agent Structured Reasoning with LLM and Multimodal Sensor Fusion for Autonomous Driving

Xinmeng Hou, Wuqi Wang, Long Yang, Hao Lin, Jinglun Feng, Haigen Min, Xiangmo Zhao

机构 * Chang’an University(长安大学) Agency for Science, Technology and Research (A*STAR)(科技研究局) University of California, Davis(加州大学戴维斯分校) CCNY Robotics Lab, The City College of New York(纽约城市学院机器人实验室)

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);分类 cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.16121 2024-06-18 cs.CV cs.AI 79%

Uncertainty-Encoded Multi-Modal Fusion for Robust Object Detection in Autonomous Driving

Yang Lou, Qun Song, Qian Xu, Rui Tan, Jianping Wang

专题命中 自动驾驶多传感器融合 :multi-modal fusion(title,abstract);分类 cs.CV

Comments In proceedings of the 26th European Conference on Artificial Intelligence ECAI 2023. 8 pages + 2 appendix pages

详情

展开后加载摘要…

URL PDF HTML 收藏