arXivDaily arXiv每日学术速递 周一至周五更新

视觉与机器人

多模态信息融合

面向图像、视频、多传感器和跨模态感知的信息融合,包括 Image Fusion、红外可见光、遥感、医学影像、LiDAR/雷达/相机和音视频融合。

共收录 152 信号源:cs.CV, eess.IV, eess.SP, cs.RO, cs.MM

1. 医学影像融合 152 篇

2308.13883 2023-08-29 eess.IV cs.CV 76%

ReFuSeg: Regularized Multi-Modal Fusion for Precise Brain Tumour Segmentation

Aditya Kasliwal, Sankarshanaa Sagaram, Laven Srivastava, Pratinav Seth, Adil Khan

专题命中 医学影像融合 :multi-modal fusion(title);分类 cs.CV、eess.IV

Comments Accepted at 9th edition of the Brain Lesion (BrainLes) workshop, MICCAI 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.07714 2023-03-15 eess.IV cs.CV 76%

Freehand 2D Ultrasound Probe Calibration for Image Fusion with 3D MRI/CT

Yogesh Langhe, Katrin Skerl, Adrien Bartoli

专题命中 医学影像融合 :image fusion(title);分类 cs.CV、eess.IV

详情

展开后加载摘要…

URL PDF HTML 收藏
2203.05784 2022-03-14 eess.IV cs.AI cs.CV 76%

AI-enabled Automatic Multimodal Fusion of Cone-Beam CT and Intraoral Scans for Intelligent 3D Tooth-Bone Reconstruction and Clinical Applications

Jin Hao, Jiaxiang Liu, Jin Li, Wei Pan, Ruizhe Chen, Huimin Xiong, Kaiwei Sun, Hangzheng Lin, Wanlu Liu, Wanghui Ding, Jianfei Yang, Haoji Hu, Yueling Zhang, Yang Feng, Zeyu Zhao, Huikai Wu, Youyi Zheng, Bing Fang, Zuozhu Liu, Zhihe Zhao

专题命中 医学影像融合 :multimodal fusion(title);分类 cs.CV、eess.IV

Comments 30 pages, 6 figures, 3 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2007.06002 2020-07-14 cs.CV cs.LG eess.IV 76%

Multi-Modality Information Fusion for Radiomics-based Neural Architecture Search

Yige Peng, Lei Bi, Michael Fulham, Dagan Feng, Jinman Kim

专题命中 医学影像融合 :information fusion(title);分类 cs.CV、eess.IV

Comments Accepted by MICCAI 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2607.02091 2026-07-03 cs.CV 新提交 74%

Multimodal Fusion for Fine-Grained Classification of Breast Fibroadenoma and Phyllodes Tumors

乳腺纤维腺瘤与叶状肿瘤细粒度分类的多模态融合

Chuxi Nan, Di Wu, Hongming Guo, Ning Cao, Xiaohui Zhu, Zhaoting Shi, Jiawei Li

机构 * School of Integrated Circuits, Wuxi Vocational College of Science and Technology(集成电路学院,无锡科学技术职业技术学院) School of Advanced Technology, Xi’an Jiaotong-Liverpool University(先进科技学院,西安交通大学利物浦大学) Shanghai Gem Science and Technology Co., Ltd.(上海 gems 科技有限公司) Department of Oncology, Shanghai Medical College, Fudan University(肿瘤科,复旦大学上海医学院) Department of Medical Ultrasound, Fudan University Shanghai Cancer Center(医学超声科,复旦大学上海癌症中心)

专题命中 医学影像融合 :multimodal fusion(title);分类 cs.CV

AI总结 针对B超下乳腺纤维腺瘤和叶状肿瘤高度重叠导致误诊的问题,构建FAPT-M多模态数据集,提出临床引导的多模态框架,集成视觉、文本和临床特征,通过自适应调制、跨模态Transformer和双路径表示学习,实现细粒度分类,准确率77.64%,AUC 89.74%。

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.21346 2025-10-27 cs.CV cs.AI 74%

CT-CLIP: A Multi-modal Fusion Framework for Robust Apple Leaf Disease Recognition in Complex Environments

Lemin Liu, Fangchao Hu, Honghua Jiang, Yaru Chen, Limin Liu, Yongliang Qiao

专题命中 医学影像融合 :multi-modal fusion(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2509.18284 2025-09-24 cs.CV 74%

Learning Contrastive Multimodal Fusion with Improved Modality Dropout for Disease Detection and Prediction

Yi Gu, Kuniaki Saito, Jiaxin Ma

机构 * OMRON SINIC X Corporation(OMRON SINIC X公司) Nara Institute of Science and Technology(名取科学技術大學院)

专题命中 医学影像融合 :multimodal fusion(title);分类 cs.CV

Comments MICCAI 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.14346 2024-10-11 cs.CV 74%

Towards Efficient Information Fusion: Concentric Dual Fusion Attention Based Multiple Instance Learning for Whole Slide Images

Yujian Liu, Ruoxuan Wu, Xinjie Shen, Zihuang Lu, Lingyu Liang, Haiyu Zhou, Shipu Xu, Shaoai Cai, Shidang Xu

专题命中 医学影像融合 :information fusion(title);分类 cs.CV

Comments Need for additional experiments

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.09533 2024-04-30 cs.CV cs.AI cs.LG 74%

WiTUnet: A U-Shaped Architecture Integrating CNN and Transformer for Improved Feature Alignment and Local Information Fusion

Bin Wang, Fei Deng, Peifan Jiang, Shuang Wang, Xiao Han, Zhixuan Zhang

专题命中 医学影像融合 :information fusion(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2309.00800 2023-09-06 eess.IV 74%

Enhancing Cardiac MRI Segmentation via Classifier-Guided Two-Stage Network and All-Slice Information Fusion Transformer

Zihao Chen, Xiao Chen, Yikang Liu, Eric Z. Chen, Terrence Chen, Shanhui Sun

专题命中 医学影像融合 :information fusion(title);分类 eess.IV

Comments Accepted by 2023 MICCAI AMAI workshop

详情

展开后加载摘要…

URL PDF HTML 收藏
1908.03958 2019-09-20 eess.IV cs.CV cs.LG 73%

Structural Similarity based Anatomical and Functional Brain Imaging Fusion

Nishant Kumar, Nico Hoffmann, Martin Oelschlägel, Edmund Koch, Matthias Kirsch, Stefan Gumhold

专题命中 医学影像融合 :image fusion(abstract);medical image fusion(abstract);分类 cs.CV、eess.IV

Comments Accepted at MICCAI-MBIA 2019

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.14710 2026-05-15 cs.CV cs.AI 70%

Vision-Core Guided Contrastive Learning for Balanced Multi-modal Prognosis Prediction of Stroke

基于视觉核心的对比学习用于脑卒中平衡多模态预后预测

Liren Chen, Lidong Sun, Mingyan Huang, Junzhe Tang, Yinghui Zhu, Guanjie Wang, Yiqing Xia, Ting Xiao

机构 * School of Information Science and Engineering, East China University of Science and Technology(信息科学与工程学院,东华大学)

专题命中 医学影像融合 :multimodal fusion(abstract);multi-modal fusion(abstract);分类 cs.CV

AI总结 本文提出三模态融合模型,通过大语言模型生成半结构化诊断文本并设计VDAFM模块,提升多模态融合鲁棒性,实现脑卒中预后预测的高精度。

Comments Corresponding author: Ting Xiao

详情

展开后加载摘要…

URL PDF HTML 收藏
2604.03747 2026-04-07 cs.RO 70%

CT-VoxelMap: Efficient Continuous-Time LiDAR-Inertial Odometry with Probabilistic Adaptive Voxel Mapping

CT-VoxelMap:高效的连续时间激光雷达-惯性里程计与概率自适应体素映射

Lei Zhao, Xingyi Li, Tianchen Deng, Chuan Cao, Han Zhang, Weidong Chen

专题命中 医学影像融合 :sensor fusion(abstract);multi-sensor fusion(abstract);分类 cs.RO

AI总结 本文提出CT-VoxelMap,通过概率自适应体素映射提升移动机器人在快速运动或粗糙地形中的定位稳定性与准确性,采用B-样条基方法优化连续时间表示,改进雅可比推导并增强系统鲁棒性。

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.14269 2025-10-27 eess.IV cs.CV eess.SP 67%

Guided MRI Reconstruction via Schrödinger Bridge

Yue Wang, Yuanbiao Yang, Zhuo-xu Cui, Tian Zhou, Bingsheng Huang, Hairong Zheng, Dong Liang, Yanjie Zhu

机构 * Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(拉特伯研究中心生物医学成像,深圳先进技术研究所,中国科学院) School of Artificial Intelligence, the University of Chinese Academy of Sciences(人工智能学院,中国科学院大学) Research Center for Medical AI, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(医学人工智能研究中心,深圳先进技术研究所,中国科学院) Pazhou Lab, Guangzhou, China(琶洲实验室,广州,中国) School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China(生物医学工程学院,深圳大学医学院,深圳大学,深圳,中国)

专题命中 医学影像融合 :feature-level fusion(abstract);分类 cs.CV、eess.IV、eess.SP

详情

展开后加载摘要…

URL PDF HTML 收藏
2601.10386 2026-06-25 cs.CV cs.AI cs.MM 62%

Handling Missing Modalities in Multimodal Survival Prediction for Non-Small Cell Lung Cancer

多模态生存预测中缺失模态的处理:非小细胞肺癌的应用

Filippo Ruffini, Camillo Maria Caruso, Claudia Tacconi, Lorenzo Nibid, Francesca Miccolis, Marta Lovino, Carlo Greco, Edy Ippolito, Michele Fiore, Alessio Cortellini, Bruno Beomonte Zobel, Giuseppe Perrone, Bruno Vincenzi, Claudio Marrocco, Alessandro Bria, Elisa Ficarra, Sara Ramella, Valerio Guarrasi, Paolo Soda

机构 * Unit of Artificial Intelligence and Computer Systems, Department of Engineering(人工智能与计算机系统单位,工程系) Università Campus Bio-Medico di Roma(罗马生物医学大学) Department of Diagnostics and Intervention, Radiation Physics, Biomedical Engineering(诊断与介入部门,辐射物理,生物医学工程) Umeå University(乌梅学院) Research Unit of Radiation Oncology, Department of Medicine and Surgery(放射肿瘤研究单位,医学与外科部门) Fondazione Policlinico Universitario Campus Bio-Medico(生物医学大学附属医院基金会) Anatomical Pathology Operative Research Unit(解剖病理学操作研究单位) Research Unit of Anatomical Pathology, Department of Medicine and Surgery(解剖病理学研究单位,医学与外科部门) Department of Medicine and Surgery(医学与外科部门)

专题命中 医学影像融合 :multimodal fusion(abstract);分类 cs.CV、cs.MM

AI总结 本文提出一种缺失感知的多模态生存框架,结合CT、WSI和临床数据,通过基础模型提取特征并融合,提升NSCLC生存预测的准确性与临床适用性。

详情

展开后加载摘要…

URL PDF HTML 收藏
2604.16104 2026-04-20 eess.IV cs.AI cs.CV 62%

Dual-Modal Lung Cancer AI: Interpretable Radiology and Microscopy with Clinical Risk Integration

双模肺癌AI:结合可解释放射学与显微镜的临床风险整合

Baramee Sukumal, Aueaphum Aueawatthanaphisut

机构 * Hatyaiwittayalai School(哈雅维泰莱学校) School of Information, Computer, and Communication Technology(信息、计算机与通信技术学院) Sirindhorn International Institute of Technology(Sirindhorn国际技术学院) Thammasat University(泰国朱拉大学) Pathum Thani, Thailand(帕亨他尼,泰国)

专题命中 医学影像融合 :multimodal fusion(abstract);分类 cs.CV、eess.IV

AI总结 本文提出整合CT放射学与H&E病理学的双模AI框架,利用卷积神经网络提取特征并融合临床数据,通过可解释AI技术提升诊断性能,实现肺癌亚型分类。

Comments 16 pages, 6 figures, 3 tables, 8 equations

详情

展开后加载摘要…

URL PDF HTML 收藏
2601.14337 2026-03-04 eess.IV cs.CV 62%

Unsupervised Deformable Image Registration with Local-Global Attention and Image Decomposition

无监督可变形图像配准与局部-全局注意力及图像分解

Zhengyong Huang, Xingwen Sun, Xuting Chang, Ning Jiang, Yao Wang, Jianfei Sun, Hongbin Han, Yao Sui

机构 * Institute of Medical Technology, Peking University Health Science Center(北京大学医学部医学技术研究所) National Institute of Health Data Science, Peking University(北京大学国家健康数据科学研究院) Department of Radiology, Peking University Third Hospital(北京大学第三医院放射科) Department of Pediatrics, Peking University First Hospital(北京大学第一医院儿科) Pediatric Epilepsy Center, Peking University First Hospital(北京大学第一医院儿童癫痫中心) School of Biological Science and Medical Engineering, Southeast University(东南大学生物科学与医学工程学院) Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院)

专题命中 医学影像融合 :multi-modal fusion(abstract);分类 cs.CV、eess.IV

AI总结 本文提出LGANet++,通过局部-全局注意力机制和图像分解技术,实现更准确、鲁棒的无监督可变形图像配准。

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.03461 2026-01-29 eess.IV cs.CV 62%

Evaluating the Predictive Value of Preoperative MRI for Erectile Dysfunction Following Radical Prostatectomy

术前MRI对根治性前列腺切除术后勃起功能障碍预测价值的评估

Gideon N. L. Rouwendaal, Daniël Boeke, Inge L. Cox, Henk G. van der Poel, Margriet C. van Dijk-de Haan, Regina G. H. Beets-Tan, Thierry N. Boellaard, Wilson Silva

机构 * University of Amsterdam(阿姆斯特丹大学) Antoni van Leeuwenhoek-Netherlands Cancer Institute(安托尼·范·列文霍克-荷兰癌症研究所) Department of Urology(泌尿科部) AI Technology for Life(人工智能技术生命) Utrecht University(乌特勒支大学) GROW School for Oncology and Developmental Biology(GROW肿瘤学与发育生物学学院)

专题命中 医学影像融合 :multimodal fusion(abstract);分类 cs.CV、eess.IV

AI总结 本研究评估了术前MRI对根治性前列腺切除术后勃起功能障碍预测价值,发现MRI模型在某些方面略优于传统方法,但未超越临床特征。

Comments 13 pages, 5 figures, 2 tables. Accepted at PRedictive Intelligence in MEdicine workshop @ MICCAI 2025 (PRIME-MICCAI). This is the submitted manuscript with added link to github repo, funding acknowledgements and authors' names and affiliations. No further post submission improvements or corrections were integrated. Final version not published yet

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.19319 2025-08-28 eess.IV cs.AI cs.CV 62%

MedVQA-TREE: A Multimodal Reasoning and Retrieval Framework for Sarcopenia Prediction

Pardis Moradbeiki, Nasser Ghadiri, Sayed Jalal Zahabi, Uffe Kock Wiil, Kristoffer Kittelmann Brockhattingen, Ali Ebrahimi

机构 * Department of Electrical and Computer Engineering, Isfahan University of Technology(电气与计算机工程系,伊斯法罕技术大学) SDU Health Informatics and Technology, The Maersk Mc-Kinney Moller Institute, University of Southern Denmark(南部丹麦大学健康信息学与技术,马士基麦金尼莫勒研究所) Geriatric Research Unit, Department of Clinical Research, University of Southern Denmark(老年医学研究单元,临床研究系,南部丹麦大学)

专题命中 医学影像融合 :feature-level fusion(abstract);分类 cs.CV、eess.IV

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.01577 2025-08-05 eess.IV cs.CV 62%

Tractography-Guided Dual-Label Collaborative Learning for Multi-Modal Cranial Nerves Parcellation

Lei Xie, Junxiong Huang, Yuanjing Feng, Qingrun Zeng

机构 * Zhejiang University of Technology(浙江工业大学)

专题命中 医学影像融合 :multi-modal fusion(abstract);分类 cs.CV、eess.IV

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.22041 2025-06-30 eess.IV cs.CV 62%

Towards Scalable and Robust White Matter Lesion Localization via Multimodal Deep Learning

Julia Machnio, Sebastian Nørgaard Llambias, Mads Nielsen, Mostafa Mehdipour Ghazi

机构 * Pioneer Centre for AI(先锋人工智能中心) University of Copenhagen(哥本哈根大学)

专题命中 医学影像融合 :multimodal fusion(abstract);分类 cs.CV、eess.IV

Comments 2nd Sorbonne-Heidelberg Workshop on AI in medicine: Machine Learning for multi-modal data

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.01124 2025-06-23 eess.IV cs.CV 62%

Cross-modality Attention Adapter: A Glioma Segmentation Fine-tuning Method for SAM Using Multimodal Brain MR Images

Xiaoyu Shi, Shurong Chai, Yinhao Li, Jingliang Cheng, Jie Bai, Guohua Zhao, Yen-Wei Chen

专题命中 医学影像融合 :multimodal fusion(abstract);分类 cs.CV、eess.IV

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.12719 2025-06-17 eess.IV cs.CV 62%

GM-LDM: Latent Diffusion Model for Brain Biomarker Identification through Functional Data-Driven Gray Matter Synthesis

Hu Xu, Yang Jingling, Jia Sihan, Bi Yuda, Calhoun Vince

机构 * Anhui University, Hefei, China(安徽大学) TReNDS Center (GSU, Gatech, Emory), Atlanta, GA, USA(TReNDS中心)

专题命中 医学影像融合 :multimodal fusion(abstract);分类 cs.CV、eess.IV

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.06054 2025-06-09 eess.IV cs.AI cs.CV 62%

FPDANet: A Multi-Section Classification Model for Intelligent Screening of Fetal Ultrasound

Minglang Chen, Jie He, Caixu Xu, Bocheng Liang, Shengli Li, Guannan He, Xiongjie Tao

机构 * Guangxi Key Laboratory of Machine Vision and Intelligent Control, Wuzhou University(广西机器视觉与智能控制重点实验室,梧州大学) College of Computer Science and Electronic Engineering, Hunan University(湖南大学计算机科学与电子工程学院) Department of Ultrasound, Shenzhen Maternal and Child Healthcare Hospital(深圳妇幼保健医院超声科) Department of Ultrasound, Sichuan Provincial Maternity and Child Healthcare Hospital(四川省妇幼保健院超声科) Faculty of Humanities and Arts, Macau University of Science and Technology(澳门科技大学人文艺术学院)

专题命中 医学影像融合 :information fusion(abstract);分类 cs.CV、eess.IV

详情

展开后加载摘要…

URL PDF HTML 收藏
2407.07372 2025-05-20 eess.IV cs.CV 62%

Multi-modal MRI Translation via Evidential Regression and Distribution Calibration

Jiyao Liu, Shangqi Gao, Yuxin Li, Lihao Liu, Xin Gao, Zhaohu Xing, Junzhi Ning, Yanzhou Su, Xiao-Yong Zhang, Junjun He, Ningsheng Xu, Xiahai Zhuang

机构 * Fudan University(复旦大学) University of Cambridge(剑桥大学) Shanghai Artificial Intelligence Laboratory(上海人工智能实验室) The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)) Fuzhou University(福州市大学) Shanghai Jiao Tong University(上海交通大学)

专题命中 医学影像融合 :multi-modal fusion(abstract);分类 cs.CV、eess.IV

Comments Early accepted by MICCAI 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.00525 2025-05-02 eess.IV cs.CV cs.LG 62%

A Methodological and Structural Review of Parkinsons Disease Detection Across Diverse Data Modalities

Abu Saleh Musa Miah, taro Suzuki, Jungpil Shin

专题命中 医学影像融合 :multimodal fusion(abstract);分类 cs.CV、eess.IV

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.06314 2025-05-01 eess.IV cs.AI cs.CV 62%

CAD-Unet: A Capsule Network-Enhanced Unet Architecture for Accurate Segmentation of COVID-19 Lung Infections from CT Images

Yijie Dang, Weijun Ma, Xiaohu Luo, Huaizhu Wang

机构 * School of Information Engineering, Ningxia University(宁夏大学信息工程学院) Ningxia Key Laboratory of Artificial Intelligence and Information Security for Channeling Computing Resources from the East to the West, Ningxia University(宁夏人工智能与信息安全重点实验室) School of Mathematics and Computer Science, Ningxia Normal University(宁夏师范学院数学与计算机科学学院) School of Advanced Interdisciplinary Studies, Ningxia University(宁夏大学先进交叉学科学院)

专题命中 医学影像融合 :information fusion(abstract);分类 cs.CV、eess.IV

Comments Published in Medical Image Analysis, Volume 103, 2025, Pages 103583. DOI: 10.1016/j.media.2025.103583 This is the author's pre-print version prior to final journal edits. Final published version available at: https://www.sciencedirect.com/science/article/pii/S1361841525001306

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.00586 2025-03-04 eess.IV cs.CV q-bio.QM 62%

Cross-Attention Fusion of MRI and Jacobian Maps for Alzheimer's Disease Diagnosis

Shijia Zhang, Xiyu Ding, Brian Caffo, Junyu Chen, Cindy Zhang, Hadi Kharrazi, Zheyu Wang

专题命中 医学影像融合 :multimodal fusion(abstract);分类 cs.CV、eess.IV

Comments Submitted to MICCAI 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2502.00712 2025-02-04 eess.IV cs.AI cs.CV 62%

Registration-Enhanced Segmentation Method for Prostate Cancer in Ultrasound Images

Shengtian Sang, Hassan Jahanandish, Cynthia Xinran Li, Indrani Bhattachary, Jeong Hoon Lee, Lichun Zhang, Sulaiman Vesal, Pejman Ghanouni, Richard Fan, Geoffrey A. Sonn, Mirabela Rusu

专题命中 医学影像融合 :multimodal fusion(abstract);分类 cs.CV、eess.IV

详情

展开后加载摘要…

URL PDF HTML 收藏
2501.11276 2025-01-22 eess.IV cs.CV 62%

ITCFN: Incomplete Triple-Modal Co-Attention Fusion Network for Mild Cognitive Impairment Conversion Prediction

Xiangyang Hu, Xiangyu Shen, Yifei Sun, Xuhao Shan, Wenwen Min, Liyilei Su, Xiaomao Fan, Ahmed Elazab, Ruiquan Ge, Changmiao Wang, Xiaopeng Fan

专题命中 医学影像融合 :multimodal fusion(abstract);分类 cs.CV、eess.IV

Comments 5 pages, 1 figure, accepted by IEEE ISBI 2025

详情

展开后加载摘要…

URL PDF HTML 收藏