arXivDaily arXiv每日学术速递 周一至周五更新

视觉与机器人

多模态信息融合

面向图像、视频、多传感器和跨模态感知的信息融合,包括 Image Fusion、红外可见光、遥感、医学影像、LiDAR/雷达/相机和音视频融合。

共收录 4749 信号源:cs.CV, eess.IV, eess.SP, cs.RO, cs.MM

1. 医学影像融合 153 篇

2603.20442 2026-03-24 cs.LG cs.AI 50%

Detecting Neurovascular Instability from Multimodal Physiological Signals Using Wearable-Compatible Edge AI: A Responsible Computational Framework

通过可穿戴设备的边缘AI检测神经血管不稳定性:一种负责任的计算框架

Truong Quynh Hoa, Hoang Dinh Cuong, Truong Xuan Khanh

机构 * H&K Research Studio, Clevix LLC(H&K研究室,Clevix LLC) Department of Cardiology, Hanoi Heart Hospital(心血管科,河内心脏医院)

专题命中 医学影像融合 :multimodal fusion(abstract)

AI总结 本文提出Melaguard框架,通过融合多种生理信号检测神经血管不稳定性,优于单一模态设备,通过三阶段验证提升检测性能。

Comments 11 pages, 8 figures, 6 tables. Submitted to IEEE JBHI. Code: https://github.com/ClevixLab/Melaguard

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.08077 2026-02-10 cs.LG cs.AI 50%

Multimodal normative modeling in Alzheimers Disease with introspective variational autoencoders

在阿尔茨海默病中使用反思变分自编码器的多模态规范建模

Sayantan Kumar, Peijie Qiu, Aristeidis Sotiras

机构 * Washington University in St Louis(华盛顿大学圣路易斯分校) Washington University in St Louis School of Medicine(华盛顿大学圣路易斯医学院)

专题命中 医学影像融合 :multimodal fusion(abstract)

AI总结 本文提出mmSIVAE,通过结合MOPOE聚合提升多模态数据的规范建模效果,提高参考分布保真度和多模态整合能力,用于阿尔茨海默病的偏差分析。

Comments Conference on Health, Inference, and Learning (CHIL)

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.05169 2025-11-10 cs.LG 50%

Multimodal Deep Learning for Prediction of Progression-Free Survival in Patients with Neuroendocrine Tumors Undergoing 177Lu-based Peptide Receptor Radionuclide Therapy

Simon Baur, Tristan Ruhwedel, Ekin Böke, Zuzanna Kobus, Gergana Lishkova, Christoph Wetz, Holger Amthauer, Christoph Roderburg, Frank Tacke, Julian M. Rogasch, Wojciech Samek, Henning Jann, Jackie Ma, Johannes Eschrich

机构 * Department of Artificial Intelligence, Fraunhofer Heinrich Hertz Institute(人工智能部门,弗劳恩霍夫海因里希·赫兹研究所) Department of Nuclear Medicine, Charité—Universitätsmedizin Berlin(核医学部门,柏林查理医院) Department of Hepatology and Gastroenterology, Charité—Universitätsmedizin Berlin(肝病与胃肠病学部门,柏林查理医院) Division of Interventional Radiology, Department of Radiology, Memorial Sloan Kettering Cancer Center(介入放射学部门,纪念斯隆-凯特琳癌症中心) Department of Endocrinology and Metabolism, Charité—Universitätsmedizin Berlin(内分泌与代谢学部门,柏林查理医院) Clinic for Gastroenterology, Hepatology and Infectious Diseases, University Hospital Düsseldorf, Medical Faculty of Heinrich Heine University Düsseldorf(胃肠病、肝病和传染病诊所,杜塞尔多夫大学医院,海因里希·海涅大学医学部) Department of Electrical Engineering and Computer Science, Technische Universität Berlin(电气工程与计算机科学部门,柏林技术大学) Berlin Institute of Health at Charité – Universitätsmedizin Berlin(柏林查理医院健康研究所)

专题命中 医学影像融合 :multimodal fusion(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.07460 2025-08-28 cs.LG cs.AI cs.DB 50%

HoneyBee: A Scalable Modular Framework for Creating Multimodal Oncology Datasets with Foundational Embedding Models

Aakash Tripathi, Asim Waqas, Matthew B. Schabath, Yasin Yilmaz, Ghulam Rasool

专题命中 医学影像融合 :multimodal fusion(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.05435 2024-10-23 cs.LG 50%

One-Versus-Others Attention: Scalable Multimodal Integration for Biomedical Data

Michal Golovanevsky, Eva Schiller, Akira Nair, Eric Han, Ritambhara Singh, Carsten Eickhoff

专题命中 医学影像融合 :information fusion(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.08023 2024-04-15 q-bio.QM cs.LG 50%

Pathology-genomic fusion via biologically informed cross-modality graph learning for survival analysis

Zeyu Zhang, Yuanshen Zhao, Jingxian Duan, Yaou Liu, Hairong Zheng, Dong Liang, Zhenyu Zhang, Zhi-Cheng Li

专题命中 医学影像融合 :multi-modal fusion(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.08749 2023-10-11 cs.CL cs.LG 50%

Utilizing Longitudinal Chest X-Rays and Reports to Pre-Fill Radiology Reports

Qingqing Zhu, Tejas Sudharshan Mathai, Pritam Mukherjee, Yifan Peng, Ronald M. Summers, Zhiyong Lu

专题命中 医学影像融合 :multi-modal fusion(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2012.13619 2022-05-24 cs.LG 50%

On self-supervised multi-modal representation learning: An application to Alzheimer's disease

Alex Fedorov, Lei Wu, Tristan Sylvain, Margaux Luck, Thomas P. DeRamus, Dmitry Bleklov, Sergey M. Plis, Vince D. Calhoun

专题命中 医学影像融合 :multimodal fusion(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏

2. 自动驾驶多传感器融合 261 篇

2404.04629 2024-09-25 cs.CV 89%

DifFUSER: Diffusion Model for Robust Multi-Sensor Fusion in 3D Object Detection and BEV Segmentation

Duy-Tho Le, Hengcan Shi, Jianfei Cai, Hamid Rezatofighi

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title,abstract);multi-modal fusion(abstract);分类 cs.CV

Comments ECCV 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.05329 2024-07-11 cs.CV 89%

OccFusion: Depth Estimation Free Multi-sensor Fusion for 3D Occupancy Prediction

Ji Zhang, Yiran Ding, Zixin Liu

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title,abstract);multi-modal fusion(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.00034 2025-10-29 cs.RO cs.CV 88%

GaussianFusion: Gaussian-Based Multi-Sensor Fusion for End-to-End Autonomous Driving

Shuai Liu, Quanmin Liang, Zefeng Li, Boyang Li, Kai Huang

机构 * School of Computer Science and Engineering, Sun Yat-sen University(计算机科学与工程学院,中山大学)

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title,abstract);分类 cs.CV、cs.RO

Comments Accepted at NeurIPS2025 (Spotlight)

详情

展开后加载摘要…

URL PDF HTML 收藏
2210.15316 2022-10-28 cs.CV cs.LG cs.RO 88%

MSF3DDETR: Multi-Sensor Fusion 3D Detection Transformer for Autonomous Driving

Gopi Krishna Erabati, Helder Araujo

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title,abstract);分类 cs.CV、cs.RO

Comments Accepted at the ICPR 2022 Workshop DLVDR2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.19972 2025-09-24 cs.CV 88%

DAOcc: 3D Object Detection Assisted Multi-Sensor Fusion for 3D Occupancy Prediction

Zhen Yang, Yanpeng Dong, Jiayu Wang, Heng Wang, Lichao Ma, Zijian Cui, Qi Liu, Haoran Pei, Kexin Zhang, Chao Zhang

机构 * Beijing Mechanical Equipment Institute(北京机械设备研究所)

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title,abstract);分类 cs.CV

Comments TCSVT Accepted version (not the final published version)

Journal ref IEEE Transactions on Circuits and Systems for Video Technology, 2025, Print ISSN: 1051-8215, Online ISSN: 1558-2205

详情

展开后加载摘要…

URL PDF HTML 收藏
2504.13420 2025-04-21 cs.RO cs.SE 88%

Testing the Fault-Tolerance of Multi-Sensor Fusion Perception in Autonomous Driving Systems

Haoxiang Tian, Wenqiang Ding, Xingshuo Han, Guoquan Wu, An Guo, Junqi Zhang. Wei Chen, Jun Wei, Tianwei Zhang

机构 * Institute of Software Chinese Academy of Sciences(中国科学院软件研究所) Nanyang Technological University(南洋理工大学) University of CAS, Nanjing(中国科学院大学南京分校) Nanjing Institute of Software Technology, University of CAS, Nanjing(中国科学院南京软件技术研究所) Continental-NTU Corporate Lab(Continental-NTU企业实验室) University of Science and Technology of China(中国科学技术大学)

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title,abstract);分类 cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2501.05997 2025-01-13 cs.CV 88%

Minimizing Occlusion Effect on Multi-View Camera Perception in BEV with Multi-Sensor Fusion

Sanjay Kumar, Hiep Truong, Sushil Sharma, Ganesh Sistu, Tony Scanlan, Eoin Grua, Ciarán Eising

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title,abstract);分类 cs.CV

Comments Accepted form publishing at the Electronic Imaging - Autonomous Vehicles and Machines Conference

详情

展开后加载摘要…

URL PDF HTML 收藏
2106.09249 2021-06-18 cs.CR cs.CV cs.LG 88%

Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attacks

Yulong Cao*, Ningfei Wang*, Chaowei Xiao*, Dawei Yang*, Jin Fang, Ruigang Yang, Qi Alfred Chen, Mingyan Liu, Bo Li

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title,abstract);分类 cs.CV

Comments Accepted by IEEE S&P 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2606.02979 2026-06-03 cs.CV cs.AI cs.RO 87%

Towards Compact Autonomous Driving Perception with Balanced Learning and Multi-sensor Fusion

面向紧凑型自动驾驶感知的平衡学习与多传感器融合

Oskar Natan, Jun Miura

机构 * Department of Computer Science and Engineering, Toyohashi University of Technology(计算机科学与工程系,丰田寺大学) Department of Computer Science and Electronics, Gadjah Mada University(计算机科学与电子系,加查马达大学)

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title);分类 cs.CV、cs.RO

AI总结 提出一种紧凑的深度多任务学习模型,通过自适应损失加权和中间传感器融合技术,在单次前向传播中同时处理语义分割、深度估计、激光雷达分割和鸟瞰投影,实现高效自动驾驶感知。

Comments This work has been accepted for publication in IEEE Transactions on Intelligent Transportation Systems. https://ieeexplore.ieee.org/document/9712213

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.01644 2024-05-10 cs.CV cs.RO 87%

OccFusion: Multi-Sensor Fusion Framework for 3D Semantic Occupancy Prediction

Zhenxing Ming, Julie Stephany Berrio, Mao Shan, Stewart Worrall

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-sensor fusion(title);分类 cs.CV、cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.04058 2023-11-08 cs.CV 85%

mmFUSION: Multimodal Fusion for 3D Objects Detection

Javed Ahmad, Alessio Del Bue

专题命中 自动驾驶多传感器融合 :multimodal fusion(title);multi-modal fusion(abstract);sensor fusion(abstract);multi-sensor fusion(abstract)

Comments 10 pages,

详情

展开后加载摘要…

URL PDF HTML 收藏
2208.12079 2022-11-01 cs.CV 85%

Bridging the View Disparity Between Radar and Camera Features for Multi-modal Fusion 3D Object Detection

Taohua Zhou, Yining Shi, Junjie Chen, Kun Jiang, Mengmeng Yang, Diange Yang

专题命中 自动驾驶多传感器融合 :multi-modal fusion(title,abstract);sensor fusion(abstract);feature-level fusion(abstract);分类 cs.CV

Comments 12 pages,6 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2104.09224 2021-04-20 cs.CV cs.AI cs.LG cs.RO 84%

Multi-Modal Fusion Transformer for End-to-End Autonomous Driving

Aditya Prakash, Kashyap Chitta, Andreas Geiger

专题命中 自动驾驶多传感器融合 :multi-modal fusion(title,abstract);sensor fusion(abstract);分类 cs.CV、cs.RO

Comments CVPR 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2607.00746 2026-07-02 cs.CV cs.AI 新提交 83%

GaussianFusion: Unified 3D Gaussian Representation for Multi-Modal Fusion Perception

GaussianFusion:用于多模态融合感知的统一3D高斯表示

Xiao Zhao, Chang Liu, Mingxu Zhu, Zheyuan Zhang, Linna Song, Qingliang Luo, Chufan Guo, Kuifeng Su

机构 * Tencent, Autonomous Driving Lab(腾讯自动驾驶实验室)

专题命中 自动驾驶多传感器融合 :multi-modal fusion(title,abstract);multimodal fusion(abstract);分类 cs.CV

AI总结 提出基于3D高斯表示的多模态融合框架GaussianFusion,通过连续3D高斯空间统一多模态特征,保留细节,支持多种3D感知任务,在nuScenes上检测NDS提升2.6,占用预测mIoU提升1.55且速度提升450%。

Comments ICLR 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.16408 2025-08-25 cs.CV 83%

SAMFusion: Sensor-Adaptive Multimodal Fusion for 3D Object Detection in Adverse Weather

Edoardo Palladin, Roland Dietze, Praveen Narayanan, Mario Bijelic, Felix Heide

机构 * Torc Robotics(Torc机器人公司) University of Stuttgart(斯图加特大学) Princeton University(普林斯顿大学)

专题命中 自动驾驶多传感器融合 :multimodal fusion(title);sensor fusion(abstract);multi-sensor fusion(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.18522 2025-07-25 cs.CV 83%

GaussianFusionOcc: A Seamless Sensor Fusion Approach for 3D Occupancy Prediction Using 3D Gaussians

Tomislav Pavković, Mohammad-Ali Nikouei Mahani, Johannes Niedermayer, Johannes Betz

机构 * Technical University of Munich(慕尼黑技术大学) BMW Group(宝马集团) Munich Institute of Robotics and Machine Intelligence(慕尼黑机器人与智能机械研究所)

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);multi-modal fusion(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.03280 2025-03-06 cs.CV 83%

BEVMOSNet: Multimodal Fusion for BEV Moving Object Segmentation

Hiep Truong Cong, Ajay Kumar Sigatapu, Arindam Das, Yashwanth Sharma, Venkatesh Satagopan, Ganesh Sistu, Ciaran Eising

专题命中 自动驾驶多传感器融合 :multimodal fusion(title,abstract);sensor fusion(abstract);分类 cs.CV

Comments In Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (2025)

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.07475 2024-12-11 cs.CV 83%

Progressive Multi-Modal Fusion for Robust 3D Object Detection

Rohit Mohan, Daniele Cattaneo, Florian Drews, Abhinav Valada

专题命中 自动驾驶多传感器融合 :multi-modal fusion(title);sensor fusion(abstract);multi-sensor fusion(abstract);分类 cs.CV

Journal ref 8th Annual Conference on Robot Learning, 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2312.16620 2023-12-29 eess.SY cs.SY 82%

Autonomous Driving using Residual Sensor Fusion and Deep Reinforcement Learning

Amin Jalal Aghdasian, Amirhossein Heydarian Ardakani, Kianoush Aqabakee, Farzaneh Abdollahi

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);information fusion(abstract)

Comments Accepted Paper on International Conference on Robotics and Mechatronics (ICROM, 2023)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.05173 2024-09-17 cs.CV cs.AI cs.RO 82%

A Survey on Occupancy Perception for Autonomous Driving: The Information Fusion Perspective

Huaiyuan Xu, Junliang Chen, Shiyu Meng, Yi Wang, Lap-Pui Chau

专题命中 自动驾驶多传感器融合 :information fusion(title,abstract);分类 cs.CV、cs.RO

Journal ref Information Fusion, 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2606.27556 2026-06-29 cs.CV cs.RO 新提交 81%

Radar Guided Camera Verification for Automatic Emergency Braking Rethinking Object Detection in Radar Camera Fusion

雷达引导的自动紧急制动摄像头验证:重新思考雷达摄像头融合中的目标检测

Ram Charan Akula, Sivanathan Kandhasamy, Manikandan Ganesan

机构 * Autonomous Systems Lab, Department of Mechatronics Engineering, SRM Institute of Science and Technology(SRM科学与技术学院机电工程系自主系统实验室) Centre for Electric Mobility, Department of EEE, SRM Institute of Science and Technology(SRM科学与技术学院电气与电子工程系电动出行中心)

专题命中 自动驾驶多传感器融合 :radar camera fusion(title,abstract);分类 cs.CV、cs.RO

AI总结 提出一种雷达引导的边缘密度门控方法,在无需训练数据和GPU的情况下,通过缩小摄像头搜索空间实现高效障碍物验证,在真实车辆测试中达到98.7%的搜索空间缩减和零漏刹。

Comments 8 pages, 8 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.03284 2025-05-07 cs.CV cs.RO 81%

OccCylindrical: Multi-Modal Fusion with Cylindrical Representation for 3D Semantic Occupancy Prediction

Zhenxing Ming, Julie Stephany Berrio, Mao Shan, Yaoqi Huang, Hongyu Lyu, Nguyen Hoang Khoi Tran, Tzu-Yun Tseng, Stewart Worrall

机构 * Australian Centre for Robotics (ACFR) at the University of Sydney(澳大利亚机器人中心(ACFR)于悉尼大学)

专题命中 自动驾驶多传感器融合 :multi-modal fusion(title);sensor fusion(abstract);分类 cs.CV、cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏