医学 AI

From Classification to Cross-Modal Understanding: Leveraging Vision-Language Models for Fine-Grained Renal Pathology

Zhenhao Guo, Rachit Saluja, Tianyuan Yao, Quan Liu, Junchao Zhu, Haibo Wang, Daniel Reisenbüchler, Yuankai Huo, Benjamin Liechty, David J. Pisapia, Kenji Ikemura, Steven Salvatoree, Surya Seshane, Mert R. Sabuncu, Yihe Yang, Ruining Deng

机构 * New York University（纽约大学） ； Cornell Tech（康奈尔科技） ； Vanderbilt University（范德比大学） ； Carnegie Mellon University（卡内基梅隆大学） ； University of Regensburg（莱茵河畔大学） ； Weill Cornell Medicine（韦尔·科恩医学中心） ； Northwell Health（北well健康） 纠错

专题命中 医疗多模态 ：pathology(title,abstract)；分类 cs.CV

Normal and Abnormal Pathology Knowledge-Augmented Vision-Language Model for Anomaly Detection in Pathology Images

Jinsol Song, Jiamu Wang, Anh Tien Nguyen, Keunho Byeon, Sangjeong Ahn, Sung Hak Lee, Jin Tae Kwak

机构 * Korea University（韩国大学） ； The Catholic University of Korea（韩国天主大学） 纠错

专题命中 医疗多模态 ：pathology(title,abstract)；分类 cs.CV

Comments Accepted to ICCV 2025. Code is available at: https://github.com/QuIIL/ICCV2025_Ano-NAViLa

SpineBench: Benchmarking Multimodal LLMs for Spinal Pathology Analysis

Chenghanyu Zhang, Zekun Li, Peipei Li, Xing Cui, Shuhan Xia, Weixiang Yan, Yiqiao Zhang, Qianyu Zhuang

机构 * Beijing University of Posts and Telecommunications（北京邮电大学） ； University of California, Santa Barbara（加州大学圣巴巴拉分校） ； Peking Union Medical College Hospital（北京佑安医学大学医院） 纠错

专题命中 医疗多模态 ：pathology(title)；diagnosis(abstract)；分类 cs.CV

Comments Proceedings of the 33rd ACM International Conference on Multimedia,ACMMM 2025 Dataset Track

RadVLM: A Multitask Conversational Vision-Language Model for Radiology

Nicolas Deperrois, Hidetoshi Matsuo, Samuel Ruipérez-Campillo, Moritz Vandenhirtz, Sonia Laguna, Alain Ryser, Koji Fujimoto, Mizuho Nishio, Thomas M. Sutter, Julia E. Vogt, Jonas Kluckert, Thomas Frauenfelder, Christian Blüthgen, Farhad Nooralahzadeh, Michael Krauthammer

机构 * Department of Radiology, Kobe University（金泽大学放射科） ； Department of Computer Science, ETH Zurich（苏黎世联邦理工学院计算机科学系） ； Department of Advanced Imaging in Medical Magnetic Resonance, Kyoto University（京都大学医学磁共振高级成像部门） ； Department of Quantitative Biomedicine, University of Zurich（苏黎世大学定量生物医学系） ； Diagnostic and Interventional Radiology, University Hospital Zurich（苏黎世大学医院诊断与介入放射科） 纠错

专题命中 医疗多模态 ：radiology(title,abstract)；分类 cs.CV

Comments 21 pages, 15 figures

No Tokens Wasted: Leveraging Long Context in Biomedical Vision-Language Models

Min Woo Sun, Alejandro Lozano, Javier Gamazo Tejero, Vishwesh Nath, Xiao Xiao Sun, James Burgess, Yuhui Zhang, Kun Yuan, Robert Tibshirani, Sean Huver, Serena Yeung-Levy

机构 * Stanford University（斯坦福大学） ； NVIDIA USA（NVIDIA公司） 纠错

专题命中 医疗多模态 ：biomedical(title,abstract)；分类 cs.CV

DentVLM: A Multimodal Vision-Language Model for Comprehensive Dental Diagnosis and Enhanced Clinical Practice

Zijie Meng, Jin Hao, Xiwei Dai, Yang Feng, Jiaxiang Liu, Bin Feng, Huikai Wu, Xiaotang Gai, Hengchuan Zhu, Tianxiang Hu, Yangyang Wu, Hongxia Xu, Jin Li, Jun Xiao, Xiaoqiang Liu, Joey Tianyi Zhou, Fudong Zhu, Zhihe Zhao, Lunguo Xia, Bing Fang, Jimeng Sun, Jian Wu, Zuozhu Liu

机构 * Stomatology Hospital, School of Stomatology, Zhejiang University School of Medicine, Zhejiang University, Hangzhou（牙科医院，口腔医学院，浙江大学医学院，浙江大学，杭州） ； College of Computer Science and Technology, Zhejiang University-University of Illinois Urbana-Champaign Institute, Zhejiang University, Hangzhou（计算机科学与技术学院，浙江大学-伊利诺伊大学 Urbana-Champaign 院，浙江大学，杭州） ； Department of Orthodontics, Shanghai Ninth People’s Hospital, College of Stomatology, Shanghai Jiao Tong University School of Medicine（正畸科，上海第九人民医院，口腔医学院，上海交通大学医学院） ； Angelalign Technology Inc.（Angelalign 技术公司） 纠错

专题命中 医疗多模态 ：diagnosis(title,abstract)；分类 cs.CV

LLaVA-RadZ: Can Multimodal Large Language Models Effectively Tackle Zero-shot Radiology Recognition?

Bangyan Li, Wenxuan Huang, Zhenkun Gao, Yeqiang Wang, Yunhang Shen, Jingzhong Lin, Ling You, Yuxiang Shen, Shaohui Lin, Wanli Ouyang, Yuling Sun

机构 * East China Normal University（华东师范大学） ； The Chinese University of Hong Kong（香港中文大学） ； Northwest A&F University（西北农林科技大学） ； Tencent Youtu Lab（腾讯优图实验室） ； Xiamen University（厦门大学） 纠错

专题命中 医疗多模态 ：radiology(title)；medical image(abstract)；分类 cs.CV

Simulating Clinical AI Assistance using Multimodal LLMs: A Case Study in Diabetic Retinopathy

Nadim Barakat, William Lotter

机构 * Dana-Farber Cancer Institute & Tufts University School of Medicine（达纳-法伯癌症研究所及塔夫茨大学医学院） ； Dana-Farber Cancer Institute Brigham and Women’s Hospital & Harvard Medical School（达纳-法伯癌症研究所布里特妇女医院及哈佛医学院） 纠错

专题命中 医疗多模态 ：clinical AI(title,abstract)；分类 cs.CV

From Learning to Unlearning: Biomedical Security Protection in Multimodal Large Language Models

Dunyuan Xu, Xikai Yang, Yaoqian Li, Jinpeng Li, Pheng-Ann Heng

专题命中 医疗多模态 ：biomedical(title,abstract)；分类 cs.CV

Rethinking Multimodality: Optimizing Multimodal Deep Learning for Biomedical Signal Classification

Timothy Oladunni, Alex Wong

专题命中 医疗多模态 ：biomedical(title,abstract)；分类 cs.LG

On the Risk of Misleading Reports: Diagnosing Textual Biases in Multimodal Clinical AI

David Restrepo, Ira Ktena, Maria Vakalopoulou, Stergios Christodoulidis, Enzo Ferrante

机构 * MICS, CentraleSupélec - Université Paris-Saclay, France（MICS，中央圣艾尔布兰大学-巴黎萨克雷大学，法国） ； Google DeepMind, London, UK（谷歌DeepMind，伦敦，英国） ； CONICET, Universidad de Buenos Aires, Argentina（CONICET，布宜诺斯艾利斯大学，阿根廷） 纠错

专题命中 医疗多模态 ：clinical AI(title)；medical image(abstract)；分类 cs.CV

Comments Accepted to MICCAI 2025 1st Workshop on Multimodal Large Language Models (MLLMs) in Clinical Practice

BMDetect: A Multimodal Deep Learning Framework for Comprehensive Biomedical Misconduct Detection

Yize Zhou, Jie Zhang, Meijie Wang, Lun Yu

专题命中 医疗多模态 ：biomedical(title,abstract)；分类 cs.LG

On the Importance of Text Preprocessing for Multimodal Representation Learning and Pathology Report Generation

Ruben T. Lucassen, Tijn van de Luijtgaarden, Sander P. J. Moonemans, Gerben E. Breimer, Willeke A. M. Blokx, Mitko Veta

机构 * Dept. of Pathology, University Medical Center Utrecht（病理学系，乌得勒支大学医学中心） ； Dept. of Biomedical Engineering, Eindhoven University of Technology（生物医学工程系，埃因霍温理工大学） ； Dept. of Mathematics and Computer Science, Eindhoven University of Technology（数学与计算机科学系，埃因霍温理工大学） 纠错

专题命中 医疗多模态 ：pathology(title,abstract)；分类 cs.CV

Comments 11 pages, 1 figure

Robust Fairness Vision-Language Learning for Medical Image Analysis

Sparsh Bansal, Mingyang Wu, Xin Wang, Shu Hu

机构 * Purdue University（普渡大学） ； University at Albany, State University of New York（纽约州立大学阿尔巴尼分校） 纠错

专题命中 医疗多模态 ：medical image(title,abstract)；分类 cs.CV

DART: Disease-aware Image-Text Alignment and Self-correcting Re-alignment for Trustworthy Radiology Report Generation

Sang-Jun Park, Keun-Soo Heo, Dong-Hee Shin, Young-Han Son, Ji-Hye Oh, Tae-Eui Kam

专题命中 医疗多模态 ：radiology(title,abstract)；分类 cs.CV

Comments The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2025

Pathology Report Generation and Multimodal Representation Learning for Cutaneous Melanocytic Lesions

Ruben T. Lucassen, Sander P. J. Moonemans, Tijn van de Luijtgaarden, Gerben E. Breimer, Willeke A. M. Blokx, Mitko Veta

专题命中 医疗多模态 ：pathology(title,abstract)；分类 cs.CV

Comments 11 pages, 2 figures. arXiv admin note: text overlap with arXiv:2502.19285

FaultGPT: Industrial Fault Diagnosis Question Answering System by Vision Language Models

Jiao Chen, Ruyi Huang, Zuohong Lv, Jianhua Tang, Weihua Li

专题命中 医疗多模态 ：diagnosis(title,abstract)；分类 eess.SP

HC-LLM: Historical-Constrained Large Language Models for Radiology Report Generation

Tengfei Liu, Jiapu Wang, Yongli Hu, Mingjie Li, Junfei Yi, Xiaojun Chang, Junbin Gao, Baocai Yin

专题命中 医疗多模态 ：radiology(title,abstract)；分类 cs.CV

Comments Accepted by AAAI2025

MMDS: A Multimodal Medical Diagnosis System Integrating Image Analysis and Knowledge-based Departmental Consultation

Yi Ren, HanZhi Zhang, Weibin Li, Jun Fu, Diandong Liu, Tianyi Zhang, Jie He, Licheng Jiao

专题命中 医疗多模态 ：diagnosis(title)；medical image(abstract)；分类 cs.CV

HEALNet: Multimodal Fusion for Heterogeneous Biomedical Data

Konstantin Hemker, Nikola Simidjievski, Mateja Jamnik

专题命中 医疗多模态 ：biomedical(title,abstract)；分类 cs.LG

Comments NeurIPS 2024

Multi-SIGATnet: A multimodal schizophrenia MRI classification algorithm using sparse interaction mechanisms and graph attention networks

Yuhong Jiao, Jiaqing Miao, Jinnan Gong, Hui He, Ping Liang, Cheng Luo, Ying Tan

专题命中 医疗多模态 ：MRI(title)；biomedical(abstract)；分类 cs.CV

TRRG: Towards Truthful Radiology Report Generation With Cross-modal Disease Clue Enhanced Large Language Model

Yuhao Wang, Chao Hao, Yawen Cui, Xinqi Su, Weicheng Xie, Tao Tan, Zitong Yu

专题命中 医疗多模态 ：radiology(title,abstract)；分类 cs.CV

FITA: Fine-grained Image-Text Aligner for Radiology Report Generation

Honglong Yang, Hui Tang, Xiaomeng Li

专题命中 医疗多模态 ：radiology(title,abstract)；分类 cs.CV

Comments 11 pages, 3 figures

MAIRA-1: A specialised large multimodal model for radiology report generation

Stephanie L. Hyland, Shruthi Bannur, Kenza Bouzid, Daniel C. Castro, Mercy Ranjit, Anton Schwaighofer, Fernando Pérez-García, Valentina Salvatelli, Shaury Srivastav, Anja Thieme, Noel Codella, Matthew P. Lungren, Maria Teodora Wetscherek, Ozan Oktay, Javier Alvarez-Valle

专题命中 医疗多模态 ：radiology(title,abstract)；分类 cs.CV

Comments 18 pages, 9 tables, 5 figures. v2 adds test IDs and image encoder citation. v3 fixes error in NPV/specificity

Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing

Shruthi Bannur, Stephanie Hyland, Qianchu Liu, Fernando Pérez-García, Maximilian Ilse, Daniel C. Castro, Benedikt Boecking, Harshita Sharma, Kenza Bouzid, Anja Thieme, Anton Schwaighofer, Maria Wetscherek, Matthew P. Lungren, Aditya Nori, Javier Alvarez-Valle, Ozan Oktay

专题命中 医疗多模态 ：biomedical(title,abstract)；分类 cs.CV

Comments To appear in CVPR 2023

A Foundational Multimodal Vision Language AI Assistant for Human Pathology

Ming Y. Lu, Bowen Chen, Drew F. K. Williamson, Richard J. Chen, Kenji Ikamura, Georg Gerber, Ivy Liang, Long Phi Le, Tong Ding, Anil V Parwani, Faisal Mahmood

专题命中 医疗多模态 ：pathology(title,abstract)；分类 cs.CV

BioFact-MoE: Biologically Factorized Mixture of Experts for Vision-Language Prognostic Modeling in Hepatocellular Carcinoma

BioFact-MoE：基于生物学因子分解的混合专家模型用于肝细胞癌的视觉-语言预后建模

Junlin Yang, Tian Yu, Nicha C. Dvornek, Yuexi Du, Peiyu Duan, Annabella Shewarega, Lawrence H. Staib, James S. Duncan, Julius Chapiro

机构 * Department of Radiology \& Biomedical Imaging, Department of Biomedical Engineering, Department of Electrical Engineering, Department of Statistics \& Data Science Yale University, New Haven, CT, 06510, USA 纠错

专题命中 医疗多模态 ：MRI(abstract,abstract_cn)；radiology(abstract)；分类 cs.CV、cs.LG

AI总结 提出BioFact-MoE框架，通过生物学监督的混合专家模型显式分解肝脏和肿瘤因子，在肝细胞癌预后预测中提升准确性和生物学可解释性。

Comments Early accepted at MICCAI 2026

Vision-Language Models Encode Clinical Guidelines for Concept-Based Medical Reasoning

视觉-语言模型编码临床指南以实现基于概念的医学推理

Mohamed Harmanani, Bining Long, Zhuoxin Guo, Paul F. R. Wilson, Amirhossein Sabour, Minh Nguyen Nhat To, Gabor Fichtinger, Purang Abolmaesumi, Parvin Mousavi

机构 * Queen’s University（女王大学） ； University of British Columbia（不列颠哥伦比亚大学） ； McMaster University（麦马斯特大学） ； Vector Institute（向量研究所） 纠错

专题命中 医疗多模态 ：medical image(abstract)；pathology(abstract)；diagnosis(abstract)；分类 cs.CV、cs.LG

AI总结 MedCBR通过整合临床指南与视觉-语言模型，提升医学影像诊断的可解释性和决策支持能力。

Comments CVPR 2026 Findings

AMRG: Extend Vision Language Models for Automatic Mammography Report Generation

Nak-Jun Sung, Donghyun Lee, Bo Hwa Choi, Chae Jung Park

机构 * Research Institute, National Cancer Center Korea（韩国国家癌症中心研究所） ； Department of Radiology, National Cancer Center Korea（韩国国家癌症中心放射科） 纠错

专题命中 医疗多模态 ：medical AI(abstract)；clinical AI(abstract)；radiology(abstract)；分类 cs.CV、eess.IV

MeD-3D: A Multimodal Deep Learning Framework for Precise Recurrence Prediction in Clear Cell Renal Cell Carcinoma (ccRCC)

Hasaan Maqsood, Saif Ur Rehman Khan

机构 * Skolkovo Institute of Science and Technology (Skoltech)（斯克罗夫诺科学与技术学院（Skoltech）） ； German Research Center for Artificial Intelligence (DFKI)（德国人工智能研究中心（DFKI）） 纠错

专题命中 医疗多模态 ：MRI(abstract)；CT(abstract)；radiology(abstract)；分类 cs.CV、eess.IV