多模态信息融合 - arXivDaily 专题

2404.02394 2024-12-30 eess.IV cs.CV 62%

Cohort-Individual Cooperative Learning for Multimodal Cancer Survival Analysis

Huajun Zhou, Fengtao Zhou, Hao Chen

专题命中医学影像融合：multimodal fusion(abstract)；分类 cs.CV、eess.IV

Comments 10 pages, 9 figures

2411.15233 2024-12-10 eess.IV cs.CV 62%

Learning Volumetric Neural Deformable Models to Recover 3D Regional Heart Wall Motion from Multi-Planar Tagged MRI

Meng Ye, Bingyu Xin, Bangwei Guo, Leon Axel, Dimitris Metaxas

专题命中医学影像融合：information fusion(abstract)；分类 cs.CV、eess.IV

2403.06801 2024-07-08 eess.IV cs.CV 62%

CT2Rep: Automated Radiology Report Generation for 3D Medical Imaging

Ibrahim Ethem Hamamci, Sezgin Er, Bjoern Menze

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

2405.01658 2024-05-06 eess.IV cs.CV 62%

MMIST-ccRCC: A Real World Medical Dataset for the Development of Multi-Modal Systems

Tiago Mota, M. Rita Verdelho, Alceu Bissoto, Carlos Santiago, Catarina Barata

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

Comments Accepted in DCA in MI Workshop@CVPR2024

2404.07473 2024-04-12 eess.IV cs.CV cs.LG 62%

LUCF-Net: Lightweight U-shaped Cascade Fusion Network for Medical Image Segmentation

Songkai Sun, Qingshan She, Yuliang Ma, Rihui Li, Yingchun Zhang

专题命中医学影像融合：information fusion(abstract)；分类 cs.CV、eess.IV

2404.00144 2024-04-02 eess.IV cs.CV 62%

An Interpretable Cross-Attentive Multi-modal MRI Fusion Framework for Schizophrenia Diagnosis

Ziyu Zhou, Anton Orlichenko, Gang Qu, Zening Fu, Vince D Calhoun, Zhengming Ding, Yu-Ping Wang

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

2306.16324 2024-03-29 eess.IV cs.CV 62%

DoseDiff: Distance-aware Diffusion Model for Dose Prediction in Radiotherapy

Yiwen Zhang, Chuanpu Li, Liming Zhong, Zeli Chen, Wei Yang, Xuetao Wang

专题命中医学影像融合：information fusion(abstract)；分类 cs.CV、eess.IV

2311.10798 2023-11-21 cs.LG cs.AI cs.CV eess.IV 62%

INSPECT: A Multimodal Dataset for Pulmonary Embolism Diagnosis and Prognosis

Shih-Cheng Huang, Zepeng Huo, Ethan Steinberg, Chia-Chun Chiang, Matthew P. Lungren, Curtis P. Langlotz, Serena Yeung, Nigam H. Shah, Jason A. Fries

专题命中医学影像融合：multimodal fusion(abstract)；分类 cs.CV、eess.IV

2311.01308 2023-11-03 eess.IV cs.CV 62%

Hybrid-Fusion Transformer for Multisequence MRI

Jihoon Cho, Jinah Park

专题命中医学影像融合：hybrid fusion(abstract)；分类 cs.CV、eess.IV

Comments 10 pages, 4 figures

2310.02690 2023-10-05 eess.IV cs.CV 62%

Multi-Dimension-Embedding-Aware Modality Fusion Transformer for Psychiatric Disorder Clasification

Guoxin Wang, Xuyang Cao, Shan An, Fengmei Fan, Chao Zhang, Jinsong Wang, Feng Yu, Zhiren Wang

专题命中医学影像融合：information fusion(abstract)；分类 cs.CV、eess.IV

2307.07807 2023-07-18 eess.IV cs.CV 62%

MUVF-YOLOX: A Multi-modal Ultrasound Video Fusion Network for Renal Tumor Diagnosis

Junyu Li, Han Huang, Dong Ni, Wufeng Xue, Dongmei Zhu, Jun Cheng

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

Comments MICCAI 2023

2307.00873 2023-07-04 eess.IV cs.CV 62%

End-To-End Prediction of Knee Osteoarthritis Progression With Multi-Modal Transformers

Egor Panfilov, Simo Saarakkala, Miika T. Nieminen, Aleksei Tiulpin

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

2304.02883 2023-04-07 eess.IV cs.CV 62%

GA-HQS: MRI reconstruction via a generically accelerated unfolding approach

Jiawei Jiang, Yuchao Feng, Honghui Xu, Wanjun Chen, Jianwei Zheng

专题命中医学影像融合：information fusion(abstract)；分类 cs.CV、eess.IV

2302.03537 2023-02-08 eess.IV cs.CV 62%

Aligning Multi-Sequence CMR Towards Fully Automated Myocardial Pathology Segmentation

Wangbin Ding, Lei Li, Junyi Qiu, Sihan Wang, Liqin Huang, Yinyin Chen, Shan Yang, Xiahai Zhuang

专题命中医学影像融合：information fusion(abstract)；分类 cs.CV、eess.IV

2302.01788 2023-02-06 eess.IV cs.CV 62%

IMPORTANT-Net: Integrated MRI Multi-Parameter Reinforcement Fusion Generator with Attention Network for Synthesizing Absent Data

Tianyu Zhang, Tao Tan, Luyi Han, Xin Wang, Yuan Gao, Jonas Teuwen, Regina Beets-Tan, Ritse Mann

专题命中医学影像融合：information fusion(abstract)；分类 cs.CV、eess.IV

2209.02126 2022-09-07 eess.IV cs.CV 62%

Domain Generalization for Prostate Segmentation in Transrectal Ultrasound Images: A Multi-center Study

Sulaiman Vesal, Iani Gayo, Indrani Bhattacharya, Shyam Natarajan, Leonard S. Marks, Dean C Barratt, Richard E. Fan, Yipeng Hu, Geoffrey A. Sonn, Mirabela Rusu

专题命中医学影像融合：image fusion(abstract)；分类 cs.CV、eess.IV

Comments Accepted to the journal of Medical Image Analysis (MedIA)

2208.14876 2022-09-01 eess.IV cs.CV 62%

NestedFormer: Nested Modality-Aware Transformer for Brain Tumor Segmentation

Zhaohu Xing, Lequan Yu, Liang Wan, Tong Han, Lei Zhu

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

Comments MICCAI2022

2207.02094 2022-07-06 eess.IV cs.CV 62%

Is a PET all you need? A multi-modal study for Alzheimer's disease using 3D CNNs

Marla Narazani, Ignacio Sarasua, Sebastian Pölsterl, Aldana Lizarraga, Igor Yakushev, Christian Wachinger

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

2206.14746 2022-06-30 eess.IV cs.CV 62%

Placenta Segmentation in Ultrasound Imaging: Addressing Sources of Uncertainty and Limited Field-of-View

Veronika A. Zimmer, Alberto Gomez, Emily Skelton, Robert Wright, Gavin Wheeler, Shujie Deng, Nooshin Ghavami, Karen Lloyd, Jacqueline Matthew, Bernhard Kainz, Daniel Rueckert, Joseph V. Hajnal, Julia A. Schnabel

专题命中医学影像融合：image fusion(abstract)；分类 cs.CV、eess.IV

Comments 21 pages (18 + appendix), 13 figures (9 + appendix)

2112.04984 2021-12-10 eess.IV cs.CV cs.LG 62%

Robust Weakly Supervised Learning for COVID-19 Recognition Using Multi-Center CT Images

Qinghao Ye, Yuan Gao, Weiping Ding, Zhangming Niu, Chengjia Wang, Yinghui Jiang, Minhao Wang, Evandro Fei Fang, Wade Menpes-Smith, Jun Xia, Guang Yang

专题命中医学影像融合：information fusion(abstract)；分类 cs.CV、eess.IV

Comments 32 pages, 8 figures, Applied Soft Computing

2111.11665 2021-11-30 eess.IV cs.CV 62%

RadFusion: Benchmarking Performance and Fairness for Multimodal Pulmonary Embolism Detection from CT and EHR

Yuyin Zhou, Shih-Cheng Huang, Jason Alan Fries, Alaa Youssef, Timothy J. Amrhein, Marcello Chang, Imon Banerjee, Daniel Rubin, Lei Xing, Nigam Shah, Matthew P. Lungren

专题命中医学影像融合：multimodal fusion(abstract)；分类 cs.CV、eess.IV

Comments RadFusion dataset: https://stanfordaimi.azurewebsites.net/datasets/3a7548a4-8f65-4ab7-85fa-3d68c9efc1bd

2011.00694 2020-11-03 cs.CV eess.IV 62%

Multi-Modal Active Learning for Automatic Liver Fibrosis Diagnosis based on Ultrasound Shear Wave Elastography

Lufei Gao, Ruisong Zhou, Changfeng Dong, Cheng Feng, Zhen Li, Xiang Wan, Li Liu

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

2002.05322 2020-02-18 eess.IV cs.CV cs.LG 62%

Physical Accuracy of Deep Neural Networks for 2D and 3D Multi-Mineral Segmentation of Rock micro-CT Images

Ying Da Wang, Mehdi Shabaninejad, Ryan T. Armstrong, Peyman Mostaghimi

专题命中医学影像融合：hybrid fusion(abstract)；分类 cs.CV、eess.IV

Comments 16 figures

2002.05000 2020-02-13 cs.CV eess.IV 62%

Hi-Net: Hybrid-fusion Network for Multi-modal MR Image Synthesis

Tao Zhou, Huazhu Fu, Geng Chen, Jianbing Shen, Ling Shao

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV、eess.IV

Comments has been accepted by IEEE TMI

2509.22874 2026-08-06 cs.CV 版本更新 57%

Deformable Medical Image Registration with KAN-based Implicit Neural Representations

基于KAN的隐式神经表示的可变形医学图像配准

Nikita Drozdov, Marat Zinovev, Dmitry Sorokin

机构 * Lomonosov Moscow State University（罗蒙诺索夫莫斯科国立大学）

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV

AI总结提出基于KAN的INR框架KAN-IDIR与RandKAN-IDIR，用于无需数据集级训练的逐对优化可变形医学图像配准，在多模态医学图像上实现高准确性、低开销与稳定性，适用于临床研究。

Comments Accepted at Machine Learning and Knowledge Extraction

2607.07091 2026-07-09 cs.CV cs.AI 新提交 57%

AT-Attn: Temporal-Aware Cross-Attention for Longitudinal Multimodal Alzheimer's Disease Diagnosis

AT-Attn：用于纵向多模态阿尔茨海默病诊断的时间感知交叉注意力机制

Xinyue Du, Yibo Liu, Zhenglei Zhou, Xuancheng Yao, Weimin Zhong, Qiuhui Chen

机构 * Xinyue Du1, Yibo Liu2, Zhenglei Zhou3, Xuancheng Yao2, Weimin Zhong1, Qiuhui Chen14（未知）

专题命中医学影像融合：multimodal fusion(abstract)；分类 cs.CV

AI总结研究针对纵向AD诊断中多模态信息整合难题，提出AT-Attn框架，结合多种技术整合MRI与临床信息，在患者级五折交叉验证中，该模型多项指标优于单模态和简单融合基线，为AD诊断提供临床相关补充信息。

Comments Submitted to IEEE BIBM 2026. 8 pages, 4 figures

2607.07027 2026-07-09 cs.LG cs.AI cs.CV 新提交 57%

Latent graph encoding of multimodal neuroimaging features with generative AI architectures

基于生成式人工智能架构的多模态神经影像特征的潜在图编码

Ishaan Batta, Meenu Ajith, Vince Calhoun

机构 * Center for Translational Research in Neuroimaging and Data Science (TReNDS)（转化神经影像与数据科学研究中心）

专题命中医学影像融合：multimodal fusion(abstract)；分类 cs.CV

AI总结研究旨在设计多模态生成框架用于神经影像特征分析，通过评估多种策略和模型，利用GMV和sFNC特征分析多个生成框架，提出的gMMVAE在多指标上超替代变体，有潜力用于稳健的多模态神经影像分析。

Comments 6 pages, accepted in IEEE International Conference on Image Processing (ICIP) 2026

2604.10702 2026-06-25 cs.CV cs.AI 版本更新 57%

Backbone-Conditional Behavior of Modality Gating in Multi-Modal Prostate MRI Segmentation: A 5-Fold Cross-Validation and Gate Mechanism Analysis

模态隔离门控融合：用于稳健多模态前列腺MRI分割的架构无关方法

Yongbo Shu, Wenzhao Xie, Shanhu Yao, Zirui Xin, Luo Lei, Kewen Chen, Aijing Luo

机构 * The Second Xiangya Hospital of Central South University（中南大学湘雅医学院第二医院）； The Third Xiangya Hospital of Central South University（中南大学湘雅医学院第三医院）； School of Life Sciences, Central South University（中南大学生命科学学院）； Hunan Provincial Key Laboratory of Medical Information Research (Central South University)（湖南省医学信息研究重点实验室（中南大学））； Hunan Provincial Clinical Medical Research Center for Cardiovascular Intelligent Medicine（湖南省心血管智能医学临床医学研究中心）

专题命中医学影像融合：multi-modal fusion(abstract)；分类 cs.CV

AI总结本文提出模态隔离门控融合（MIGF）方法，通过独立编码流和门控阶段提升多模态前列腺MRI分割的鲁棒性，实验表明其在不同模态缺失和伪影情况下均有效。

Comments Major revision. Single-fold analysis replaced by 5-fold cross-validation (180 trained models) plus a direct gate-mechanism analysis; conclusions updated to show that modality gating is backbone-conditional. Supersedes v1

2606.22487 2026-06-23 cs.CV 新提交 57%

FetSelect: Task-Specific Architectures and Self-Supervised Learning for Automated Fetal Ultrasound Frame Selection

FetSelect: 面向自动化胎儿超声帧选择的任务特定架构与自监督学习

Mahmood Alzubaidi, Raden Muaz, Uzair Shah, Mohammed Ammar, Khalid Alyafei, Mowafa Househ, Marco Agus

机构 * College of Science and Engineering, Hamad Bin Khalifa University（哈马德·本·哈利法大学科学与工程学院）； LIST Laboratory Department of Electrical Systems Engineering, University of Boumerdes（布迈德斯大学电气系统工程系LIST实验室）； Sidra Medicine（锡德拉医学）

专题命中医学影像融合：hybrid fusion(abstract)；分类 cs.CV

AI总结提出FetSelect框架，结合冻结视觉基础骨干与混合多头设计（任务门控分类头+检测派生质量头），通过BYOL自监督预训练，在四个胎儿测量目标上实现高AUROC与质量相关性。

Comments Accepted in 30th Conference on Medical Image Understanding and Analysis

2606.06867 2026-06-08 cs.CV 新提交 57%

Multi-FRuGaL: Multimodal Flexible Redundancy-aware Decomposed Gated Learning for Cancer Diagnosis and Prognosis

Multi-FRuGaL：面向癌症诊断与预后的多模态灵活冗余感知分解门控学习

Sanket Kachole, Siddhesh Thakur, Shubham Innani, Sanyukta Adap, Suhang You, Carla Pitarch-Abaigar, Spyridon Bakas

机构 * Division of Computational Pathology, Department of Pathology and Laboratory Medicine, Indiana University School of Medicine（计算病理学部，病理学与实验室医学部，印第安纳大学医学院）； IU Melvin and Bren Simon Comprehensive Cancer Center（印第安纳大学Melvin和Bren Simon综合癌症中心）； Departments of Biostatistics and Health Data Science（生物统计学与健康数据科学部）； Radiology and Imaging Sciences（放射学与影像科学部）； Neurological Surgery（神经外科）； Indiana University School of Medicine（印第安纳大学医学院）； Department of Computer Science, Luddy School of Informatics, Computing, and Engineering（计算机科学部，Luddy信息、计算与工程学院）

专题命中医学影像融合：multimodal fusion(abstract)；分类 cs.CV

AI总结提出Multi-FRuGaL框架，通过分解感知自适应门控中间融合，在缺失模态下学习模态级表示，分离冗余与互补信号，提升癌症诊断与预后性能。

1. 医学影像融合 152 篇

Cohort-Individual Cooperative Learning for Multimodal Cancer Survival Analysis

Learning Volumetric Neural Deformable Models to Recover 3D Regional Heart Wall Motion from Multi-Planar Tagged MRI

CT2Rep: Automated Radiology Report Generation for 3D Medical Imaging

MMIST-ccRCC: A Real World Medical Dataset for the Development of Multi-Modal Systems

LUCF-Net: Lightweight U-shaped Cascade Fusion Network for Medical Image Segmentation

An Interpretable Cross-Attentive Multi-modal MRI Fusion Framework for Schizophrenia Diagnosis

DoseDiff: Distance-aware Diffusion Model for Dose Prediction in Radiotherapy

INSPECT: A Multimodal Dataset for Pulmonary Embolism Diagnosis and Prognosis

Hybrid-Fusion Transformer for Multisequence MRI

Multi-Dimension-Embedding-Aware Modality Fusion Transformer for Psychiatric Disorder Clasification

MUVF-YOLOX: A Multi-modal Ultrasound Video Fusion Network for Renal Tumor Diagnosis

End-To-End Prediction of Knee Osteoarthritis Progression With Multi-Modal Transformers

GA-HQS: MRI reconstruction via a generically accelerated unfolding approach

Aligning Multi-Sequence CMR Towards Fully Automated Myocardial Pathology Segmentation

IMPORTANT-Net: Integrated MRI Multi-Parameter Reinforcement Fusion Generator with Attention Network for Synthesizing Absent Data

Domain Generalization for Prostate Segmentation in Transrectal Ultrasound Images: A Multi-center Study

NestedFormer: Nested Modality-Aware Transformer for Brain Tumor Segmentation

Is a PET all you need? A multi-modal study for Alzheimer's disease using 3D CNNs

Placenta Segmentation in Ultrasound Imaging: Addressing Sources of Uncertainty and Limited Field-of-View

Robust Weakly Supervised Learning for COVID-19 Recognition Using Multi-Center CT Images

RadFusion: Benchmarking Performance and Fairness for Multimodal Pulmonary Embolism Detection from CT and EHR

Multi-Modal Active Learning for Automatic Liver Fibrosis Diagnosis based on Ultrasound Shear Wave Elastography

Physical Accuracy of Deep Neural Networks for 2D and 3D Multi-Mineral Segmentation of Rock micro-CT Images

Hi-Net: Hybrid-fusion Network for Multi-modal MR Image Synthesis

Deformable Medical Image Registration with KAN-based Implicit Neural Representations

AT-Attn: Temporal-Aware Cross-Attention for Longitudinal Multimodal Alzheimer's Disease Diagnosis

Latent graph encoding of multimodal neuroimaging features with generative AI architectures

Backbone-Conditional Behavior of Modality Gating in Multi-Modal Prostate MRI Segmentation: A 5-Fold Cross-Validation and Gate Mechanism Analysis

FetSelect: Task-Specific Architectures and Self-Supervised Learning for Automated Fetal Ultrasound Frame Selection

Multi-FRuGaL: Multimodal Flexible Redundancy-aware Decomposed Gated Learning for Cancer Diagnosis and Prognosis