医学 AI

Rescind: Countering Image Misconduct in Biomedical Publications with Vision-Language and State-Space Modeling

Rescind: 通过视觉-语言和状态空间建模对抗生物医学出版物中的图像不当行为

Soumyaroop Nandi, Prem Natarajan

专题命中 医疗多模态 ：biomedical(title,abstract)；medical image(abstract)；分类 cs.CV

AI总结 Rescind通过视觉-语言和状态空间建模方法，提出首个生物医学图像伪造生成与检测框架，实现高精度伪造定位与验证。

How to make Medical AI Systems safer? Simulating Vulnerabilities, and Threats in Multimodal Medical RAG System

如何使医疗AI系统更安全？在多模态医疗RAG系统中模拟漏洞和威胁

Kaiwen Zuo, Zelin Liu, Raman Dutt, Ziyang Wang, Zhongtian Sun, Fan Mo, Pietro Liò

专题命中 医疗多模态 ：medical AI(title,abstract)；medical image(abstract)；分类 cs.LG

AI总结 本文提出MedThreatRAG框架，通过模拟攻击环境揭示医疗RAG系统漏洞，展示跨模态冲突注入对系统性能的严重影响。

Comments Sumbitted to 2026 ICASSP

Synthetic Vasculature and Pathology Enhance Vision-Language Model Reasoning

合成血管和病理增强视觉-语言模型推理

Chenjun Li, Cheng Wan, Laurin Lux, Alexander Berger, Richard B. Rosen, Martin J. Menten, Johannes C. Paetzold

机构 * Cornell University（康奈尔大学） ； Weill Cornell Medicine（韦尔·康奈尔医学） ； Technical University of Munich（慕尼黑技术大学） ； New York Eye and Ear Infirmary of Mount Sinai（圣文森特医院） ； Cornell Tech（康奈尔科技） 纠错

专题命中 医疗多模态 ：pathology(title,abstract)；diagnosis(abstract)；分类 cs.CV

AI总结 本研究提出合成血管推理框架，通过生成具有糖尿病视网膜病变特征的图像和文本，提升视觉-语言模型在OCTA图像诊断中的推理能力与病理定位精度。

Comments 23 pages, 8 figures, 6 tables. Full paper under review for MIDL 2026 (Medical Imaging with Deep Learning)

Vision-Language Models for Automated 3D PET/CT Report Generation

用于自动化3D PET/CT报告生成的视觉-语言模型

Wenpei Jiao, Kun Shang, Hui Li, Ke Yan, Jiajin Zhang, Guangjie Yang, Lijuan Guo, Yan Wan, Xing Yang, Dakai Jin, Zhaoheng Xie

机构 * Institute of Medical Technology and National Biomedical Imaging Center, Peking University（北京大学医学技术研究院和国家生物医学成像中心） ； Peking University People’s Hospital（北京大学人民医院） ； Peking University Third Hospital（北京大学第三医院） ； DAMO Academy, Alibaba Group（阿里巴巴集团达摩院） ； The Affiliated Hospital of Qingdao University（青岛大学附属医院） ； The First Affiliated Hospital of Henan Medical University（河南医科大学第一附属医院） ； Jiujiang City Key Laboratory of Cell Therapy, Jiu Jiang NO.1 People’s Hospital（九江市细胞治疗重点实验室，九江市第一人民医院） 纠错

专题命中 医疗多模态 ：CT(title,abstract)；MRI(abstract)；分类 cs.CV

AI总结 本文提出PETRG-3D模型，通过3D双分支框架和风格适应提示，提升PET/CT报告生成的自动化水平，实验显示其在自然语言和临床指标上均优于现有方法。

Abn-BLIP: Abnormality-aligned Bootstrapping Language-Image Pre-training for Pulmonary Embolism Diagnosis and Report Generation from CTPA

Zhusi Zhong, Yuli Wang, Lulu Bi, Zhuoqi Ma, Sun Ho Ahn, Christopher J. Mullin, Colin F. Greineder, Michael K. Atalay, Scott Collins, Grayson L. Baird, Cheng Ting Lin, Webster Stayman, Todd M. Kolb, Ihab Kamel, Harrison X. Bai, Zhicheng Jiao

机构 * Department of Diagnostic Imaging, Brown University Health（布朗大学健康中心诊断影像科） ； Warren Alpert Medical School of Brown University（布朗大学沃伦·阿尔珀特医学院） ； Department of Biomedical Engineering, Johns Hopkins University School of Medicine（约翰霍普金斯大学医学院生物医学工程系） ； Department of Radiology and Radiological Sciences, Johns Hopkins University School of Medicine（约翰霍普金斯大学医学院放射科） ； Johns Hopkins University Division of Pulmonary and Critical Care Medicine（约翰霍普金斯大学肺科与重症医学科） ； Department of Radiology, University of Colorado School of Medicine（科罗拉多大学医学院放射科） 纠错

专题命中 医疗多模态 ：diagnosis(title,abstract)；radiology(abstract)；分类 cs.CV

Sim4Seg: Boosting Multimodal Multi-disease Medical Diagnosis Segmentation with Region-Aware Vision-Language Similarity Masks

Lingran Song, Yucheng Zhou, Jianbing Shen

机构 * Lingran Song, Yucheng Zhou, Jianbing Shen（作者） 纠错

专题命中 医疗多模态 ：diagnosis(title,abstract)；medical image(abstract)；分类 cs.CV

Comments AAAI 2026

The Impact of Image Resolution on Biomedical Multimodal Large Language Models

Liangyu Chen, James Burgess, Jeffrey J Nirschl, Orr Zohar, Serena Yeung-Levy

机构 * Stanford University（斯坦福大学） ； Institute for Computational and Mathematical Engineering (ICME)（计算与数学工程研究所） 纠错

专题命中 医疗多模态 ：biomedical(title,abstract)；medical image(abstract)；分类 cs.CV

Comments Proceedings of the 10th Machine Learning for Healthcare Conference, PMLR 298, 2025

RegionMed-CLIP: A Region-Aware Multimodal Contrastive Learning Pre-trained Model for Medical Image Understanding

Tianchen Fang, Guiru Liu

专题命中 医疗多模态 ：medical image(title,abstract)；diagnosis(abstract)；分类 cs.CV

Comments Upon further review, we identified that our dataset requires optimization to ensure research reliability and accuracy. Additionally, considering the target journal's latest submission policies, we believe comprehensive manuscript revisions are necessary

Point, Detect, Count: Multi-Task Medical Image Understanding with Instruction-Tuned Vision-Language Models

Sushant Gautam, Michael A. Riegler, Pål Halvorsen

机构 * Simula Metropolitan Center for Digital Engineering (SimulaMet), Norway（Simula数字工程中心（SimulaMet）） ； Oslo Metropolitan University (OsloMet), Norway（奥斯陆 Metropolitan 大学（OsloMet）） ； Simula Research Laboratory, Norway（Simula研究实验室） 纠错

专题命中 医疗多模态 ：medical image(title,abstract)；medical AI(abstract)；分类 cs.CV

Comments Accepted as a full paper at the 38th IEEE International Symposium on Computer-Based Medical Systems (CBMS) 2025

Biomed-DPT: Dual Modality Prompt Tuning for Biomedical Vision-Language Models

Wei Peng, Kang Liu, Jianchen Hu, Meng Zhang

机构 * School of Future Technology（未来技术学院） ； Xi’an Jiaotong University（西安交通大学） ； School of Automation Science and Engineering（自动化科学与工程学院） 纠错

专题命中 医疗多模态 ：biomedical(title,abstract)；medical image(abstract)；分类 cs.CV

An Explainable Biomedical Foundation Model via Large-Scale Concept-Enhanced Vision-Language Pre-training

Yuxiang Nie, Sunan He, Yequan Bie, Yihui Wang, Zhixuan Chen, Shu Yang, Zhiyuan Cai, Hongmei Wang, Xi Wang, Luyang Luo, Mingxiang Wu, Xian Wu, Ronald Cheong Kin Chan, Yuk Ming Lau, Yefeng Zheng, Pranav Rajpurkar, Hao Chen

机构 * Shenzhen People’s Hospital（深圳人民医院） ； The Chinese University of Hong Kong（香港中文大学） 纠错

专题命中 医疗多模态 ：biomedical(title,abstract)；medical image(abstract)；分类 cs.CV

Interpretable Bilingual Multimodal Large Language Model for Diverse Biomedical Tasks

Lehan Wang, Haonan Wang, Honglong Yang, Jiaji Mao, Zehong Yang, Jun Shen, Xiaomeng Li

专题命中 医疗多模态 ：biomedical(title)；medical AI(abstract)；medical image(abstract)；分类 cs.CV

Comments Accepted in ICLR 2025

GMAI-VL & GMAI-VL-5.5M: A Large Vision-Language Model and A Comprehensive Multimodal Dataset Towards General Medical AI

Tianbin Li, Yanzhou Su, Wei Li, Bin Fu, Zhe Chen, Ziyan Huang, Guoan Wang, Chenglong Ma, Ying Chen, Ming Hu, Yanjun Li, Pengcheng Chen, Xiaowei Hu, Zhongying Deng, Yuanfeng Ji, Jin Ye, Yu Qiao, Junjun He

专题命中 医疗多模态 ：medical AI(title)；medical image(abstract)；diagnosis(abstract)；分类 cs.CV

UniCrossAdapter: Multimodal Adaptation of CLIP for Radiology Report Generation

Yaxiong Chen, Chuang Du, Chunlei Li, Jingliang Hu, Yilei Shi, Shengwu Xiong, Xiao Xiang Zhu, Lichao Mou

专题命中 医疗多模态 ：radiology(title,abstract)；medical image(abstract)；分类 cs.CV

Comments MICCAI 2024 Workshop

BiomedCoOp: Learning to Prompt for Biomedical Vision-Language Models

Taha Koleilat, Hojat Asgariandehkordi, Hassan Rivaz, Yiming Xiao

专题命中 医疗多模态 ：biomedical(title,abstract)；medical image(abstract)；分类 cs.CV

Comments Accepted to CVPR 2025

A Survey of Deep Learning-based Radiology Report Generation Using Multimodal Data

Xinyi Wang, Grazziela Figueredo, Ruizhe Li, Wei Emma Zhang, Weitong Chen, Xin Chen

专题命中 医疗多模态 ：radiology(title,abstract)；medical image(abstract)；分类 cs.CV

BioD2C: A Dual-level Semantic Consistency Constraint Framework for Biomedical VQA

Zhengyang Ji, Shang Gao, Li Liu, Yifan Jia, Yutao Yue

专题命中 医疗多模态 ：biomedical(title,abstract)；diagnosis(abstract)；分类 cs.CV

Expert-level vision-language foundation model for real-world radiology and comprehensive evaluation

Xiaohong Liu, Guoxing Yang, Yulin Luo, Jiaji Mao, Xiang Zhang, Ming Gao, Shanghang Zhang, Jun Shen, Guangyu Wang

专题命中 医疗多模态 ：radiology(title,abstract)；CT(abstract)；分类 cs.CV

A Comparison of Pre-trained Vision-and-Language Models for Multimodal Representation Learning across Medical Images and Reports

Yikuan Li, Hanyin Wang, Yuan Luo

专题命中 医疗多模态 ：medical image(title,abstract)；biomedical(abstract)；分类 cs.CV

Comments 10 pages, 3 figures, submitted to BIBM2020

Anatomy-VLM: A Fine-grained Vision-Language Model for Medical Interpretation

Difei Gu, Yunhe Gao, Mu Zhou, Dimitris Metaxas

机构 * Rutgers University（新泽西罗格斯大学） ； Stanford University（斯坦福大学） 纠错

专题命中 医疗多模态 ：medical image(abstract)；pathology(abstract)；diagnosis(abstract)；radiology(abstract)

Comments Accepted to Winter Conference on Applications of Computer Vision (WACV) 2026

MultiMed: Massively Multimodal and Multitask Medical Understanding

Shentong Mo, Paul Pu Liang

专题命中 医疗多模态 ：medical AI(abstract)；pathology(abstract)；diagnosis(abstract)；biomedical(abstract)

EviAgent: Evidence-Driven Agent for Radiology Report Generation

EviAgent：基于证据的放射学报告生成代理

Tuoshi Qi, Shenshen Bu, Yingfei Xiang, Zhiming Dai

专题命中 医疗多模态 ：radiology(title,abstract)；diagnosis(abstract)

AI总结 EviAgent通过引入多维视觉专家和检索机制，解决放射学报告生成中的透明性与证据支持问题，实验表明其在多个数据集上优于通用和专用模型。

Exploring General-Purpose Autonomous Multimodal Agents for Pathology Report Generation

探索通用型自主多模态代理用于病理报告生成

Marc Aubreville, Taryn A. Donovan, Christof A. Bertram

专题命中 医疗多模态 ：pathology(title,abstract)；diagnosis(abstract)

AI总结 研究探索通用型自主多模态代理在病理报告生成中的应用，发现其在无额外信息时诊断准确率较低，但提供形态学描述时表现更佳，但仍不及人类专家。

Comments 6 pages, 1 figure, accepted paper for BVM 2026

Journal ref BVM 2026, https://bvm-conf.org

Vision-Language Models for Acute Tuberculosis Diagnosis: A Multimodal Approach Combining Imaging and Clinical Data

Ananya Ganapthy, Praveen Shastry, Naveen Kumarasami, Anandakumar D, Keerthana R, Mounigasri M, Varshinipriya M, Kishore Prasath Venkatesh, Bargava Subramanian, Kalyan Sivasailam

专题命中 医疗多模态 ：diagnosis(title,abstract)；分类 cs.CV、cs.LG、eess.IV

Comments 11 pages, 3 figures

Towards a Holistic Framework for Multimodal Large Language Models in Three-dimensional Brain CT Report Generation

Cheng-Yi Li, Kao-Jung Chang, Cheng-Fu Yang, Hsin-Yu Wu, Wenting Chen, Hritik Bansal, Ling Chen, Yi-Ping Yang, Yu-Chun Chen, Shih-Pin Chen, Jiing-Feng Lirng, Kai-Wei Chang, Shih-Hwa Chiou

专题命中 医疗多模态 ：CT(title,abstract)；radiology(abstract)

Comments 6 figures, 5 supplementary figures, 8 supplementary tables

Journal ref Nature Communications 16, 2258 (2025)

RE-tune: Incremental Fine Tuning of Biomedical Vision-Language Models for Multi-label Chest X-ray Classification

Marco Mistretta, Andrew D. Bagdanov

专题命中 医疗多模态 ：biomedical(title,abstract)；diagnosis(abstract)

Comments Accepted for publication at Medical Imaging meets NeurIPS (NeurIPS23)

Exploring the Feasibility of Multimodal Chatbot AI as Copilot in Pathology Diagnostics: Generalist Model's Pitfall

Mianxin Liu, Jianfeng Wu, Fang Yan, Hongjun Li, Wei Wang, Shaoting Zhang, Zhe Wang

专题命中 医疗多模态 ：pathology(title,abstract)；medical image(abstract)

PA-LLaVA: A Large Language-Vision Assistant for Human Pathology Image Understanding

Dawei Dai, Yuanhui Zhang, Long Xu, Qianlan Yang, Xiaojing Shen, Shuyin Xia, Guoyin Wang

专题命中 医疗多模态 ：pathology(title,abstract)；medical image(abstract)

Comments 8 pages, 4 figs

Astra: a generalizable report generation foundation model for 3D computed tomography

Astra：一种用于三维计算机断层扫描的通用报告生成基础模型

Zhuhao Wang, Fang Chen, Chaohui Yu, Zihan Li, Yuchao Zheng, Jing Wang, Xuan Yang, Jia Guo, Zhenlu Yang, Xingju Zheng, Yihua Sun, Haojie Han, Xiaoxiao Qin, Zhan Feng, Wenbo Xiao, Chao Zhu, Yuehua Li, Shipeng Zhang, Hao Luo, Yunsong Peng, Fan Wang, Hongen Liao

机构 * School of Biomedical Engineering, Tsinghua University（清华大学生物医学工程学院） ； School of Biomedical Engineering, Shanghai Jiao Tong University（上海交通大学生物医学工程学院） ； DAMO Academy, Alibaba Group（阿里云达摩院） ； Hupan Laboratory（壶辰实验室） ； Department of Biomedical Engineering, National University of Singapore（新加坡国立大学生物医学工程系） ； Department of Radiology, Guizhou Provincial People’s Hospital（贵州省级人民医院放射科） ； Department of Radiology, The First Affiliated Hospital, Zhejiang University School of Medicine（浙江大学医学院附属第一医院放射科） ； Department of Radiology, Shanghai Sixth People’s Hospital Affiliated to Shanghai Jiao Tong University School of Medicine（上海交通大学医学院附属第六人民医院放射科） ； College of Computer Science and Technology, Zhejiang University（浙江大学计算机科学与技术学院） 纠错

专题命中 医疗多模态 ：CT(summary_cn,abstract)；分类 cs.CV

AI总结 提出Astra模型，通过风格统一和强化学习，在8个器官系统的CT报告生成中实现高精度，平均细粒度诊断指标提升44.1%，并加速临床工作流。

Multimodal Integrated Knowledge Transfer to Large Language Models through Preference Optimization with Biomedical Applications

通过偏好优化整合多模态知识以增强大语言模型的多模态知识转移（生物医学应用）

Zhanliang Wang, Da Wu, Quan Nguyen, Zhuoran Xu, Kai Wang

专题命中 医疗多模态 ：biomedical(title,abstract)；分类 cs.CV、cs.LG、q-bio

AI总结 MINT通过偏好优化整合多模态知识，提升大语言模型在生物医学任务中的表现，特别是在罕见遗传疾病预测和组织类型分类中取得显著成效。