arXivDaily arXiv每日学术速递 周一至周五更新

视觉与机器人

多模态信息融合

面向图像、视频、多传感器和跨模态感知的信息融合,包括 Image Fusion、红外可见光、遥感、医学影像、LiDAR/雷达/相机和音视频融合。

共收录 259 信号源:cs.CV, eess.IV, eess.SP, cs.RO, cs.MM

1. 自动驾驶多传感器融合 259 篇

2402.00637 2024-02-02 cs.CV 79%

Fisheye Camera and Ultrasonic Sensor Fusion For Near-Field Obstacle Perception in Bird's-Eye-View

Arindam Das, Sudarshan Paul, Niko Scholz, Akhilesh Kumar Malviya, Ganesh Sistu, Ujjwal Bhattacharya, Ciarán Eising

专题命中 自动驾驶多传感器融合 :sensor fusion(title);multimodal fusion(abstract);分类 cs.CV

Comments 16 pages, 12 Figures, 6 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.13135 2023-12-05 cs.CV 79%

LeTFuser: Light-weight End-to-end Transformer-Based Sensor Fusion for Autonomous Driving with Multi-Task Learning

Pedram Agand, Mohammad Mahdavian, Manolis Savva, Mo Chen

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);分类 cs.CV

Comments 11 pages, 2 figures, 3 tables. CVPR Workshops (VCAD). 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.11888 2023-10-27 cs.RO cs.AI 79%

Penalty-Based Imitation Learning With Cross Semantics Generation Sensor Fusion for Autonomous Driving

Hongkuan Zhou, Aifen Sui, Letian Shi, Yinxian Li

专题命中 自动驾驶多传感器融合 :sensor fusion(title,abstract);分类 cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2208.00919 2023-08-07 cs.CV 79%

Benchmarking Visual-Inertial Deep Multimodal Fusion for Relative Pose Regression and Odometry-aided Absolute Pose Regression

Felix Ott, Nisha Lakshmana Raichur, David Rügamer, Tobias Feigl, Heiko Neumann, Bernd Bischl, Christopher Mutschler

专题命中 自动驾驶多传感器融合 :multimodal fusion(title,abstract);分类 cs.CV

Comments Under review

详情

展开后加载摘要…

URL PDF HTML 收藏
2204.11216 2022-04-26 cs.CV cs.AI 79%

RealNet: Combining Optimized Object Detection with Information Fusion Depth Estimation Co-Design Method on IoT

Zhuohao Li, Fandi Gou, Qixin De, Leqi Ding, Yuanhang Zhang, Yunze Cai

专题命中 自动驾驶多传感器融合 :information fusion(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2106.12449 2021-08-11 cs.CV 79%

FusionPainting: Multimodal Fusion with Adaptive Attention for 3D Object Detection

Shaoqing Xu, Dingfu Zhou, Jin Fang, Junbo Yin, Zhou Bin, Liangjun Zhang

专题命中 自动驾驶多传感器融合 :multimodal fusion(title,abstract);分类 cs.CV

Comments Accepted by ITSC 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2003.13910 2020-04-17 cs.CV 79%

Attention-based Multi-modal Fusion Network for Semantic Scene Completion

Siqi Li, Changqing Zou, Yipeng Li, Xibin Zhao, Yue Gao

专题命中 自动驾驶多传感器融合 :multi-modal fusion(title,abstract);分类 cs.CV

Comments Accepted by AAAI 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2208.11061 2023-08-17 cs.LG 78%

Large-Scale Traffic Congestion Prediction based on Multimodal Fusion and Representation Mapping

Bodong Zhou, Jiahui Liu, Songyi Cui, Yaping Zhao

专题命中 自动驾驶多传感器融合 :multimodal fusion(title,abstract)

Journal ref 2022 IEEE International Conference on Data Science and Advanced Analytics

详情

展开后加载摘要…

URL PDF HTML 收藏
2210.03402 2022-10-10 eess.SY cs.LG cs.SY nlin.AO 78%

Research on Self-adaptive Online Vehicle Velocity Prediction Strategy Considering Traffic Information Fusion

Ziyan Zhang, Junhao Shen, Dongwei Yao, Feng Wu

专题命中 自动驾驶多传感器融合 :information fusion(title,abstract)

Comments 9 pages, 7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
1610.06694 2017-03-14 cs.CR 78%

ODIN: Obfuscation-based privacy preserving consensus algorithm for Decentralized Information fusion in smart device Networks

Moreno Ambrosin, Paolo Braca, Mauro Conti, Riccardo Lazzaretti

专题命中 自动驾驶多传感器融合 :information fusion(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2607.01772 2026-07-03 cs.CV eess.SP 新提交 76%

LLM-Empowered Multimodal Fusion Framework for Autonomous Driving: Semantic Enhancement and Channel-Adaptive Design

LLM赋能的自动驾驶多模态融合框架:语义增强与信道自适应设计

Wen Wang, Yaping Sun, Yejun He, Hao Chen, Zhiyong Chen, Xiaodong Xu, Nan Ma, Shuguang Cui

机构 * National Natural Science Foundation of China(国家自然科学基金) Shenzhen Natural Science Foundation(深圳市自然科学基金) Shenzhen Key Laboratory Evaluation(深圳市重点实验室评估)

专题命中 自动驾驶多传感器融合 :multimodal fusion(title);分类 cs.CV、eess.SP

AI总结 提出LM-SCIP框架,以LLM为核心推理中枢,通过信道自适应语义模块动态融合视觉与雷达特征,实现低信噪比下的视觉主导回退和高信噪比下的协同融合,在nuScenes和VIRAT数据集上显著提升定位精度。

Comments 6 pages, 4 figures. Accepted by 2026 IEEE 37th International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC)

详情

展开后加载摘要…

URL PDF HTML 收藏
2512.02972 2025-12-03 cs.CV cs.RO 76%

BEVDilation: LiDAR-Centric Multi-Modal Fusion for 3D Object Detection

BEVDilation:以LiDAR为中心的多模态融合用于3D目标检测

Guowen Zhang, Chenhang He, Liyi Chen, Lei Zhang

专题命中 自动驾驶多传感器融合 :multi-modal fusion(title);分类 cs.CV、cs.RO

AI总结 BEVDilation提出以LiDAR为中心的多模态融合方法,通过稀疏体素扩张和语义引导BEV扩张模块提升3D目标检测性能,有效缓解深度误差带来的空间错位问题。

Comments Accept by AAAI26

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.08195 2025-08-07 cs.RO cs.AI cs.CV 76%

3DTTNet: Multimodal Fusion-Based 3D Traversable Terrain Modeling for Off-Road Environments

Zitong Chen, Chao Sun, Shida Nie, Chen Min, Changjiu Ning, Haoyu Li, Bo Wang

机构 * Shenzhen Automotive Research Institute, Beijing Institute of Technology, Shenzhen(深圳汽车研究院,北京理工大学,深圳) School of Mechanical Engineering, Beijing Institute of Technology, Beijing(机械工程学院,北京理工大学,北京) Research Center for Intelligent Computing Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing(智能计算系统研究中心,计算技术研究所,中国科学院,北京)

专题命中 自动驾驶多传感器融合 :multimodal fusion(title);分类 cs.CV、cs.RO

Comments 15 pages,13 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.10535 2024-11-19 cs.RO cs.CV 76%

Advancing Autonomous Driving Perception: Analysis of Sensor Fusion and Computer Vision Techniques

Urvishkumar Bharti, Vikram Shahapur

专题命中 自动驾驶多传感器融合 :sensor fusion(title);分类 cs.CV、cs.RO

Comments 7 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2207.02201 2022-07-06 cs.CV cs.RO 76%

Efficient Spatial-Temporal Information Fusion for LiDAR-Based 3D Moving Object Segmentation

Jiadai Sun, Yuchao Dai, Xianjing Zhang, Jintao Xu, Rui Ai, Weihao Gu, Xieyuanli Chen

专题命中 自动驾驶多传感器融合 :information fusion(title);分类 cs.CV、cs.RO

Comments Accepted by IROS2022. Code: https://github.com/haomo-ai/MotionSeg3D

详情

展开后加载摘要…

URL PDF HTML 收藏
2111.14973 2021-12-23 cs.CV cs.AI cs.LG cs.RO 76%

MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Prediction

Balakrishnan Varadarajan, Ahmed Hefny, Avikalp Srivastava, Khaled S. Refaat, Nigamaa Nayakanti, Andre Cornman, Kan Chen, Bertrand Douillard, Chi Pang Lam, Dragomir Anguelov, Benjamin Sapp

专题命中 自动驾驶多传感器融合 :information fusion(title);分类 cs.CV、cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.21885 2026-01-27 cs.CV cs.MM cs.RO 75%

Integrating Multi-Modal Sensors: A Review of Fusion Techniques for Intelligent Vehicles

多模态传感器整合:智能车辆融合技术综述

Chuheng Wei, Ziye Qin, Ziyan Zhang, Guoyuan Wu, Matthew J. Barth

机构 * College of Engineering, Center for Environmental Research and Technology, University of California at Riverside(工程学院、环境研究与技术中心、加州大学河滨分校) School of Transportation and Logistics, Southwest Jiaotong University(交通运输与物流学院、西南交通大学)

专题命中 自动驾驶多传感器融合 :sensor fusion(abstract);multi-sensor fusion(abstract);分类 cs.CV、cs.RO、cs.MM

AI总结 本文综述了多传感器融合技术在自动驾驶中的应用,分析了深度学习方法、多模态数据集及新兴趋势,强调了其提升系统适应性和鲁棒性的潜力。

Comments Accepted by IEEE IV 2025

Journal ref Proceedings of the 2025 IEEE Intelligent Vehicles Symposium (IV), pp. 1817-1824, 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.23151 2025-10-28 cs.CV cs.LG 74%

AG-Fusion: adaptive gated multimodal fusion for 3d object detection in complex scenes

Sixian Liu, Chen Xu, Qiang Wang, Donghai Shi, Yiwen Li

机构 * Yaowu Technology Co., Ltd, Shenzhen, China(深圳优华科技有限公司,深圳,中国)

专题命中 自动驾驶多传感器融合 :multimodal fusion(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.23331 2025-08-01 cs.CV 74%

Contrastive Learning-Driven Traffic Sign Perception: Multi-Modal Fusion of Text and Vision

Qiang Lu, Waikit Xiu, Xiying Li, Shenyu Hu, Shengbo Sun

机构 * School of Intelligent Systems Engineering, Sun Yat-sen University(中山大学智能系统工程学院) Guangdong Provincial Key Laboratory of Intelligent Transportation System(广东省智能交通系统重点实验室)

专题命中 自动驾驶多传感器融合 :multi-modal fusion(title);分类 cs.CV

Comments 11pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.02088 2024-08-28 cs.CV cs.AI 74%

KAN-RCBEVDepth: A multi-modal fusion algorithm in object detection for autonomous driving

Zhihao Lai, Chuanhao Liu, Shihui Sheng, Zhiqiang Zhang

专题命中 自动驾驶多传感器融合 :multi-modal fusion(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2208.03849 2022-08-09 cs.CV cs.AI 74%

RadSegNet: A Reliable Approach to Radar Camera Fusion

Kshitiz Bansal, Keshav Rungta, Dinesh Bharadia

专题命中 自动驾驶多传感器融合 :radar camera fusion(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2202.11231 2022-02-24 cs.CV 74%

Enabling Efficient Deep Convolutional Neural Network-based Sensor Fusion for Autonomous Driving

Xiaoming Zeng, Zhendong Wang, Yang Hu

专题命中 自动驾驶多传感器融合 :sensor fusion(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.07825 2021-06-21 cs.CV cs.AI 74%

Radar Camera Fusion via Representation Learning in Autonomous Driving

Xu Dong, Binnan Zhuang, Yunxiang Mao, Langechuan Liu

专题命中 自动驾驶多传感器融合 :radar camera fusion(title);分类 cs.CV

Journal ref In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1672-1681. 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.05107 2021-03-10 cs.CV cs.LG 74%

Risk Prediction on Traffic Accidents using a Compact Neural Model for Multimodal Information Fusion over Urban Big Data

Wenshan Wang, Su Yang, Weishan Zhang

专题命中 自动驾驶多传感器融合 :information fusion(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2601.09812 2026-01-16 cs.CV cs.RO 73%

LCF3D: A Robust and Real-Time Late-Cascade Fusion Framework for 3D Object Detection in Autonomous Driving

LCF3D: 一种用于自动驾驶中3D物体检测的鲁棒且实时的后期级联融合框架

Carlo Sgaravatti, Riccardo Pieroni, Matteo Corno, Sergio M. Savaresi, Luca Magri, Giacomo Boracchi

专题命中 自动驾驶多传感器融合 :multimodal fusion(abstract);sensor fusion(abstract);分类 cs.CV、cs.RO

AI总结 LCF3D通过结合RGB图像和LiDAR点云的后期级联融合方法,提升自动驾驶中3D物体检测的鲁棒性和实时性。

Comments 35 pages, 14 figures. Published at Pattern Recognition

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.21278 2025-10-27 eess.SP cs.RO 73%

Track-to-Track Association for Collective Perception based on Stochastic Optimization

Laura M. Wolf, Vincent Albert Wolff, Simon Steuernagel, Kolja Thormann, Marcus Baum

机构 * Institute of Computer Science, University of Göttingen(计算机科学研究所,哥廷根大学) Institute of Communications Technology, Leibniz University Hannover(通信技术研究所,莱比锡大学汉诺威分校) University of Göttingen(哥廷根大学)

专题命中 自动驾驶多传感器融合 :sensor fusion(abstract);multi-sensor fusion(abstract);分类 eess.SP、cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.07560 2025-08-12 cs.RO cs.CV 73%

Progressive Bird's Eye View Perception for Safety-Critical Autonomous Driving: A Comprehensive Survey

Yan Gong, Naibang Wang, Jianli Lu, Xinyu Zhang, Yongsheng Gao, Jie Zhao, Zifan Huang, Haozhi Bai, Nanxin Zeng, Nayu Su, Lei Yang, Ziying Song, Xiaoxi Hu, Xinmin Jiang, Xiaojuan Zhang, Susanto Rahardja

机构 * State Key Laboratory of Robotics and System(机器人系统国家重点实验室) Harbin Institute of Technology(哈尔滨工业大学) State Key Laboratory of Intelligent Green Vehicle and Mobility(智能绿色车辆与移动性国家重点实验室) Tsinghua University(清华大学) the School of Mechanical and Aerospace Engineering(机械与航空航天工程学院) Nanyang Technological University(南洋理工大学) Beijing Key Laboratory of Traffic Data Mining and Embodied Intelligence(北京交通数据挖掘与具身智能重点实验室) Beijing Jiaotong University(北京交通大学) the Institute for Infocomm Research(信息通信研究所) A*STAR the Engineering Cluster(工程集群) the Singapore Institute of Technology(新加坡理工学院)

专题命中 自动驾驶多传感器融合 :sensor fusion(abstract);multi-sensor fusion(abstract);分类 cs.CV、cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.23540 2025-08-01 cs.RO cs.AI cs.CV 73%

A Unified Perception-Language-Action Framework for Adaptive Autonomous Driving

Yi Zhang, Erik Leo Haß, Kuo-Yi Chao, Nenad Petrovic, Yinglei Song, Chengdong Wu, Alois Knoll

机构 * Chair of Robotics, Artificial Intelligence and Embedded Systems Technical University of Munich (TUM)(机器人、人工智能与嵌入系统教授席 Technical University of Munich)

专题命中 自动驾驶多传感器融合 :sensor fusion(abstract);multi-sensor fusion(abstract);分类 cs.CV、cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2501.01037 2025-01-03 cs.RO cs.AI cs.CV 73%

MSC-Bench: Benchmarking and Analyzing Multi-Sensor Corruption for Driving Perception

Xiaoshuai Hao, Guanqun Liu, Yuting Zhao, Yuheng Ji, Mengchuan Wei, Haimei Zhao, Lingdong Kong, Rong Yin, Yu Liu

专题命中 自动驾驶多传感器融合 :sensor fusion(abstract);multi-sensor fusion(abstract);分类 cs.CV、cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.08816 2024-05-31 cs.CV cs.RO 73%

The RoboDrive Challenge: Drive Anytime Anywhere in Any Condition

Lingdong Kong, Shaoyuan Xie, Hanjiang Hu, Yaru Niu, Wei Tsang Ooi, Benoit R. Cottereau, Lai Xing Ng, Yuexin Ma, Wenwei Zhang, Liang Pan, Kai Chen, Ziwei Liu, Weichao Qiu, Wei Zhang, Xu Cao, Hao Lu, Ying-Cong Chen, Caixin Kang, Xinning Zhou, Chengyang Ying, Wentao Shang, Xingxing Wei, Yinpeng Dong, Bo Yang, Shengyin Jiang, Zeliang Ma, Dengyi Ji, Haiwen Li, Xingliang Huang, Yu Tian, Genghua Kou, Fan Jia, Yingfei Liu, Tiancai Wang, Ying Li, Xiaoshuai Hao, Yifan Yang, Hui Zhang, Mengchuan Wei, Yi Zhou, Haimei Zhao, Jing Zhang, Jinke Li, Xiao He, Xiaoqiang Cheng, Bingyang Zhang, Lirong Zhao, Dianlei Ding, Fangsheng Liu, Yixiang Yan, Hongming Wang, Nanfei Ye, Lun Luo, Yubo Tian, Yiwei Zuo, Zhe Cao, Yi Ren, Yunfan Li, Wenjie Liu, Xun Wu, Yifan Mao, Ming Li, Jian Liu, Jiayang Liu, Zihan Qin, Cunxi Chu, Jialei Xu, Wenbo Zhao, Junjun Jiang, Xianming Liu, Ziyan Wang, Chiwei Li, Shilong Li, Chendong Yuan, Songyue Yang, Wentao Liu, Peng Chen, Bin Zhou, Yubo Wang, Chi Zhang, Jianhang Sun, Hai Chen, Xiao Yang, Lizhong Wang, Dongyi Fu, Yongchun Lin, Huitong Yang, Haoang Li, Yadan Luo, Xianjing Cheng, Yong Xu

专题命中 自动驾驶多传感器融合 :sensor fusion(abstract);multi-sensor fusion(abstract);分类 cs.CV、cs.RO

Comments ICRA 2024; 32 pages, 24 figures, 5 tables; Code at https://robodrive-24.github.io/

详情

展开后加载摘要…

URL PDF HTML 收藏