医学 AI - arXivDaily 专题

2512.16145 2026-03-30 cs.CL cs.AI 67%

MRG-R1: Reinforcement Learning for Clinically Aligned Medical Report Generation

MRG-R1：用于临床对齐的医学报告生成的强化学习

Pengyu Wang, Shuchang Ye, Usman Naseem, Jinman Kim

机构 * The University of Sydney（悉尼大学）； Macquarie University（麦考瑞大学）

专题命中医疗多模态：medical image(abstract)；radiology(abstract)

AI总结本文提出MRG-R1框架，通过语义驱动的强化学习提升医学报告的临床准确性，改进了生成报告中相关发现的准确性和覆盖范围。

Comments 10 pages

2410.00046 2025-09-19 eess.IV cs.CV cs.LG 67%

Mixture of Multicenter Experts in Multimodal AI for Debiased Radiotherapy Target Delineation

Yujin Oh, Sangjoon Park, Xiang Li, Pengfei Jin, Yi Wang, Jonathan Paly, Jason Efstathiou, Annie Chan, Jun Won Kim, Hwa Kyung Byun, Ik Jae Lee, Jaeho Cho, Chan Woo Wee, Peng Shu, Peilong Wang, Nathan Yu, Jason Holmes, Jong Chul Ye, Quanzheng Li, Wei Liu, Woong Sub Koom, Jin Sung Kim, Kyungsang Kim

机构 * Center for Advanced Medical Computing and Analysis (CAMCA), Department of Radiology, Massachusetts General Hospital (MGH) and Harvard Medical School（先进医学计算与分析中心（CAMCA）、放射科、麻省总医院（MGH）和哈佛医学院）； Department of Radiation Oncology, Yonsei University College of Medicine（燕京大学医学院放射肿瘤科）； Institute for Innovation in Digital Healthcare, Yonsei University（数字医疗创新研究所、燕京大学）； Department of Radiation Oncology, Massachusetts General Hospital（麻省总医院放射肿瘤科）； Department of Radiation Oncology, Gangnam Severance Hospital（江南松云医院放射肿瘤科）； Department of Radiation Oncology, Yongin Severance Hospital（永兴松云医院放射肿瘤科）； School of Computing, University of Georgia（佐治亚大学计算机学院）； Department of Radiation Oncology, Mayo Clinic（梅奥诊所放射肿瘤科）； Kim Jaechul Graduate School of AI, Korea Advanced Institute of Science and Technology（金 Jaechul人工智能研究生院、韩国科学技术院）

专题命中医疗多模态：medical AI(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments 12 pages, 5 figures, 4 tables, 1 supplementary material

2509.12287 2025-09-17 eess.IV cs.CV cs.LG 67%

Enhancing Radiographic Disease Detection with MetaCheX, a Context-Aware Multimodal Model

Nathan He, Cody Chen

专题命中医疗多模态：radiology(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments All authors contributed equally, 5 pages, 2 figures, 1 table

2507.05520 2025-08-27 cs.AI 67%

Architecting Clinical Collaboration: Multi-Agent Reasoning Systems for Multimodal Medical VQA

Karishma Thakrar, Shreyas Basavatia, Akshay Daftardar

机构 * Georgia Institute of Technology Atlanta, GA, USA（佐治亚理工学院）

专题命中医疗多模态：medical AI(abstract)；diagnosis(abstract)

2508.02951 2025-08-06 cs.AI 67%

MedBLINK: Probing Basic Perception in Multimodal Language Models for Medicine

Mahtab Bigverdi, Wisdom Ikezogwo, Kevin Zhang, Hyewon Jeong, Mingyu Lu, Sungjae Cho, Linda Shapiro, Ranjay Krishna

机构 * University of Washington（华盛顿大学）； Massachusetts Institute of Technology（麻省理工学院）； Seoul National University（首尔国立大学）

专题命中医疗多模态：medical image(abstract)；CT(abstract)

2504.14692 2025-04-22 cs.CL 67%

OmniV-Med: Scaling Medical Vision-Language Model for Universal Visual Understanding

Songtao Jiang, Yuan Wang, Sibo Song, Yan Zhang, Zijie Meng, Bohan Lei, Jian Wu, Jimeng Sun, Zuozhu Liu

机构 * Zhejiang University（浙江大学）； Alibaba Group（阿里巴巴集团）； UIUC（伊利诺伊大学香槟分校）

专题命中医疗多模态：medical image(abstract)；CT(abstract)

2503.07667 2025-03-21 cs.LG cs.AI cs.CV eess.SP 67%

CLIMB: Data Foundations for Large Scale Multimodal Clinical Foundation Models

Wei Dai, Peilin Chen, Malinda Lu, Daniel Li, Haowen Wei, Hejie Cui, Paul Pu Liang

专题命中医疗多模态：clinical AI(abstract)；分类 cs.CV、cs.LG、eess.SP

2503.14377 2025-03-19 eess.IV cs.CV cs.LG 67%

Advancing Medical Representation Learning Through High-Quality Data

Negin Baghbanzadeh, Adibvafa Fallahpour, Yasaman Parhizkar, Franklin Ogidi, Shuvendu Roy, Sajad Ashkezari, Vahid Reza Khazaie, Michael Colacci, Ali Etemad, Arash Afkanpour, Elham Dolatabadi

专题命中医疗多模态：medical AI(abstract)；分类 cs.CV、cs.LG、eess.IV

2503.07094 2025-03-11 cs.CL 67%

A Novel Ophthalmic Benchmark for Evaluating Multimodal Large Language Models with Fundus Photographs and OCT Images

Xiaoyi Liang, Mouxiao Bian, Moxin Chen, Lihao Liu, Junjun He, Jie Xu, Lin Li

专题命中医疗多模态：medical image(abstract)；diagnosis(abstract)

2503.00210 2025-03-04 cs.LG cs.AI cs.CV eess.SP 67%

Foundation-Model-Boosted Multimodal Learning for fMRI-based Neuropathic Pain Drug Response Prediction

Wenrui Fan, L. M. Riza Rizky, Jiayang Zhang, Chen Chen, Haiping Lu, Kevin Teh, Dinesh Selvarajah, Shuo Zhou

专题命中医疗多模态：MRI(abstract)；分类 cs.CV、cs.LG、eess.SP

2407.08410 2025-02-26 cs.AI 67%

Specialized curricula for training vision-language models in retinal image analysis

Robbie Holland, Thomas R. P. Taylor, Christopher Holmes, Sophie Riedl, Julia Mai, Maria Patsiamanidi, Dimitra Mitsopoulou, Paul Hager, Philip Müller, Hendrik P. N. Scholl, Hrvoje Bogunović, Ursula Schmidt-Erfurth, Daniel Rueckert, Sobha Sivaprasad, Andrew J. Lotery, Martin J. Menten

专题命中医疗多模态：medical image(abstract)；diagnosis(abstract)

Comments Under review at npj Digital Medicine

2502.02438 2025-02-05 cs.CR cs.AI 67%

Medical Multimodal Model Stealing Attacks via Adversarial Domain Alignment

Yaling Shen, Zhixiong Zhuang, Kun Yuan, Maria-Irina Nicolae, Nassir Navab, Nicolas Padoy, Mario Fritz

专题命中医疗多模态：medical image(abstract)；radiology(abstract)

Comments Accepted at AAAI 2025

2501.08585 2025-01-16 eess.SP cs.AI cs.CV cs.LG 67%

A Systematic Review of Machine Learning Methods for Multimodal EEG Data in Clinical Application

Siqi Zhao, Wangyang Li, Xiru Wang, Stevie Foglia, Hongzhao Tan, Bohan Zhang, Ameer Hamoodi, Aimee Nelson, Zhen Gao

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV、cs.LG、eess.SP

Comments This paper includes 4 figures, 6 tables, and totals 18 pages

2411.13855 2024-11-22 eess.IV cs.CV cs.LG 67%

A Multimodal Approach to The Detection and Classification of Skin Diseases

Allen Yang, Edward Yang

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV、cs.LG、eess.IV

2410.13647 2024-10-18 cs.CE cs.MM 67%

Multimodal growth and development assessment model

Ying Li, Zichen Song, Zijie Gong, Sitan Huang, Jiewei Ge

专题命中医疗多模态：diagnosis(abstract)；radiology(abstract)

Comments 7 Pages 7 Figures

2409.00543 2024-10-11 cs.CV cs.CL cs.LG eess.IV 67%

How Does Diverse Interpretability of Textual Prompts Impact Medical Vision-Language Zero-Shot Tasks?

Sicheng Wang, Che Liu, Rossella Arcucci

专题命中医疗多模态：medical image(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments Accepted by NeurIPS'24 Advancements In Medical Foundation Models: Explainability, Robustness, Security, and Beyond Workshop

2406.00667 2024-06-05 eess.IV cs.AI cs.CL cs.CV cs.LG 67%

An Early Investigation into the Utility of Multimodal Large Language Models in Medical Imaging

Sulaiman Khan, Md. Rafiul Biswas, Alina Murad, Hazrat Ali, Zubair Shah

专题命中医疗多模态：medical image(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments Accepted in Fifth IEEE Workshop on Artificial Intelligence for HealthCare, IEEE 25th International Conference on Information Reuse and Integration for Data Science

2405.12963 2024-05-22 eess.IV cs.CV cs.LG 67%

Comprehensive Multimodal Deep Learning Survival Prediction Enabled by a Transformer Architecture: A Multicenter Study in Glioblastoma

Ahmed Gomaa, Yixing Huang, Amr Hagag, Charlotte Schmitter, Daniel Höfler, Thomas Weissmann, Katharina Breininger, Manuel Schmidt, Jenny Stritzelberger, Daniel Delev, Roland Coras, Arnd Dörfler, Oliver Schnell, Benjamin Frey, Udo S. Gaipl, Sabine Semrau, Christoph Bert, Rainer Fietkau, Florian Putz

专题命中医疗多模态：MRI(abstract)；分类 cs.CV、cs.LG、eess.IV

2404.17779 2024-04-30 cs.CL 67%

Medical Vision-Language Pre-Training for Brain Abnormalities

Masoud Monajatipoor, Zi-Yi Dou, Aichi Chien, Nanyun Peng, Kai-Wei Chang

专题命中医疗多模态：clinical AI(abstract)；medical image(abstract)

2310.01912 2023-10-04 eess.IV cs.CV cs.LG 67%

Improved Automatic Diabetic Retinopathy Severity Classification Using Deep Multimodal Fusion of UWF-CFP and OCTA Images

Mostafa El Habib Daho, Yihao Li, Rachid Zeghlache, Yapo Cedric Atse, Hugo Le Boité, Sophie Bonnin, Deborah Cosette, Pierre Deman, Laurent Borderie, Capucine Lepicard, Ramin Tadayoni, Béatrice Cochener, Pierre-Henri Conze, Mathieu Lamard, Gwenolé Quellec

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments Accepted preprint for presentation at MICCAI-OMIA 20023, Vancouver, Canada

2306.16034 2023-06-29 cs.AI cs.NI 67%

Stone Needle: A General Multimodal Large-scale Model Framework towards Healthcare

Weihua Liu, Yong Zuo

专题命中医疗多模态：medical image(abstract)；diagnosis(abstract)

2305.07167 2023-05-15 cs.CV cs.CL cs.LG eess.IV 67%

OneCAD: One Classifier for All image Datasets using multimodal learning

Shakti N. Wadekar, Eugenio Culurciello

专题命中医疗多模态：medical image(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments 8 pages, 6 figures

2209.00979 2022-09-07 eess.IV cs.CV cs.LG 67%

Multimodal Information Fusion for Glaucoma and DR Classification

Yihao Li, Mostafa El Habib Daho, Pierre-Henri Conze, Hassan Al Hajj, Sophie Bonnin, Hugang Ren, Niranchana Manivannan, Stephanie Magazzeni, Ramin Tadayoni, Béatrice Cochener, Mathieu Lamard, Gwenolé Quellec

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments Accepted preprint for presentation at MICCAI-OMIA

2007.05597 2021-01-19 eess.IV cs.CV cs.LG 67%

EMIXER: End-to-end Multimodal X-ray Generation via Self-supervision

Siddharth Biswal, Peiye Zhuang, Ayis Pyrros, Nasir Siddiqui, Sanmi Koyejo, Jimeng Sun

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV、cs.LG、eess.IV

2006.06325 2021-01-14 cs.CV cs.LG eess.IV 67%

CoMIR: Contrastive Multimodal Image Representation for Registration

Nicolas Pielawski, Elisabeth Wetzer, Johan Öfverstedt, Jiahao Lu, Carolina Wählby, Joakim Lindblad, Nataša Sladoje

专题命中医疗多模态：biomedical(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments 21 pages, 11 figures

Journal ref NeurIPS 2020

2005.14107 2020-05-29 cs.CV cs.LG eess.IV 67%

Unsupervised learning of multimodal image registration using domain adaptation with projected Earth Move's discrepancies

Mattias P Heinrich, Lasse Hansen

专题命中医疗多模态：MRI(abstract)；分类 cs.CV、cs.LG、eess.IV

Comments Medical Imaging with Deep Learning (accepted short paper) https://openreview.net/forum?id=wbZM-DcJB9

2110.04903 2026-02-06 eess.IV cs.LG 66%

Normative Modeling using Multimodal Variational Autoencoders to Identify Abnormal Brain Structural Patterns in Alzheimer Disease

基于多模态变分自编码器的规范建模用于识别阿尔茨海默病异常脑结构模式

Sayantan Kumar, Philip Payne, Aristeidis Sotiras

专题命中医疗多模态：MRI(abstract)；分类 cs.LG、eess.IV；diagnosis(journal_ref)

AI总结本文提出基于多模态变分自编码器的规范建模框架，用于识别阿尔茨海默病中异常脑结构模式，通过联合分布建模提高疾病阶段检测的敏感性和准确性。

Comments Medical Imaging Meets NeurIPS workshop in NeurIPS 2022

Journal ref Proc. SPIE 12465, Medical Imaging 2023: Computer-Aided Diagnosis, 1246503 (7 April 2023)

2402.01311 2024-02-05 cs.CV eess.IV 66%

Deep Multimodal Fusion of Data with Heterogeneous Dimensionality via Projective Networks

José Morano, Guilherme Aresta, Christoph Grechenig, Ursula Schmidt-Erfurth, Hrvoje Bogunović

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV、eess.IV；biomedical(comments)

Comments Accepted for publication in the IEEE Journal of Biomedical and Health Informatics (JBHI)

2203.10095 2022-03-22 eess.IV cs.CV 66%

AlignTransformer: Hierarchical Alignment of Visual Regions and Disease Tags for Medical Report Generation

Di You, Fenglin Liu, Shen Ge, Xiaoxia Xie, Jing Zhang, Xian Wu

专题命中医疗多模态：medical image(abstract,comments)；分类 cs.CV、eess.IV

Comments Accepted by MICCAI 2021 (the 24th International Conference on Medical Image Computing and Computer Assisted Intervention)

2202.06076 2022-02-15 cs.CV cs.LG 66%

Indication as Prior Knowledge for Multimodal Disease Classification in Chest Radiographs with Transformers

Grzegorz Jacenków, Alison Q. O'Neil, Sotirios A. Tsaftaris

专题命中医疗多模态：radiology(abstract)；分类 cs.CV、cs.LG；biomedical(comments)

Comments Accepted at the IEEE International Symposium on Biomedical Imaging (ISBI) 2022 as an oral presentation

1. 医疗多模态 966 篇

MRG-R1: Reinforcement Learning for Clinically Aligned Medical Report Generation

Mixture of Multicenter Experts in Multimodal AI for Debiased Radiotherapy Target Delineation

Enhancing Radiographic Disease Detection with MetaCheX, a Context-Aware Multimodal Model

Architecting Clinical Collaboration: Multi-Agent Reasoning Systems for Multimodal Medical VQA

MedBLINK: Probing Basic Perception in Multimodal Language Models for Medicine

OmniV-Med: Scaling Medical Vision-Language Model for Universal Visual Understanding

CLIMB: Data Foundations for Large Scale Multimodal Clinical Foundation Models

Advancing Medical Representation Learning Through High-Quality Data

A Novel Ophthalmic Benchmark for Evaluating Multimodal Large Language Models with Fundus Photographs and OCT Images

Foundation-Model-Boosted Multimodal Learning for fMRI-based Neuropathic Pain Drug Response Prediction

Specialized curricula for training vision-language models in retinal image analysis

Medical Multimodal Model Stealing Attacks via Adversarial Domain Alignment

A Systematic Review of Machine Learning Methods for Multimodal EEG Data in Clinical Application

A Multimodal Approach to The Detection and Classification of Skin Diseases

Multimodal growth and development assessment model

How Does Diverse Interpretability of Textual Prompts Impact Medical Vision-Language Zero-Shot Tasks?

An Early Investigation into the Utility of Multimodal Large Language Models in Medical Imaging

Comprehensive Multimodal Deep Learning Survival Prediction Enabled by a Transformer Architecture: A Multicenter Study in Glioblastoma

Medical Vision-Language Pre-Training for Brain Abnormalities

Improved Automatic Diabetic Retinopathy Severity Classification Using Deep Multimodal Fusion of UWF-CFP and OCTA Images

Stone Needle: A General Multimodal Large-scale Model Framework towards Healthcare

OneCAD: One Classifier for All image Datasets using multimodal learning

Multimodal Information Fusion for Glaucoma and DR Classification

EMIXER: End-to-end Multimodal X-ray Generation via Self-supervision

CoMIR: Contrastive Multimodal Image Representation for Registration

Unsupervised learning of multimodal image registration using domain adaptation with projected Earth Move's discrepancies

Normative Modeling using Multimodal Variational Autoencoders to Identify Abnormal Brain Structural Patterns in Alzheimer Disease

Deep Multimodal Fusion of Data with Heterogeneous Dimensionality via Projective Networks

AlignTransformer: Hierarchical Alignment of Visual Regions and Disease Tags for Medical Report Generation

Indication as Prior Knowledge for Multimodal Disease Classification in Chest Radiographs with Transformers