医学 AI - arXivDaily 专题

2505.18538 2025-05-27 eess.IV cs.LG 62%

Mind Your Vision: Multimodal Estimation of Refractive Disorders Using Electrooculography and Eye Tracking

Xin Wei, Huakun Liu, Yutaro Hirao, Monica Perusquia-Hernandez, Katsutoshi Masai, Hideaki Uchiyama, Kiyoshi Kiyokawa

机构 * Nara Institute of Science and Technology（奈良科学技術大學）； Kyushu University（九州大學）

专题命中医疗多模态：diagnosis(abstract)；分类 cs.LG、eess.IV

2505.08838 2025-05-20 eess.IV cs.AI cs.CV 62%

Ultrasound Report Generation with Multimodal Large Language Models for Standardized Texts

Peixuan Ge, Tongkun Su, Faqin Lv, Baoliang Zhao, Peng Zhang, Chi Hong Wong, Liang Yao, Yu Sun, Zenan Wang, Pak Kin Wong, Ying Hu

机构 * Shenzhen Institutes of Advanced Technology（深圳先进技术研究院）； University of Macau（澳门大学）； Chinese PLA General Hospital（中国人民解放军总医院）； Macau University of Science and Technology（澳门科学技术大学）

专题命中医疗多模态：CT(abstract)；分类 cs.CV、eess.IV

2504.11777 2025-04-17 cs.CV cs.LG 62%

Bridging the Semantic Gaps: Improving Medical VQA Consistency with LLM-Augmented Question Sets

Yongpei Ma, Pengyu Wang, Adam Dunn, Usman Naseem, Jinman Kim

专题命中医疗多模态：medical image(abstract)；分类 cs.CV、cs.LG

Comments The first two listed authors contributed equally to this work

2411.11912 2025-04-01 cs.CV cs.AI cs.LG 62%

F$^3$OCUS -- Federated Finetuning of Vision-Language Foundation Models with Optimal Client Layer Updating Strategy via Multi-objective Meta-Heuristics

Pramit Saha, Felix Wagner, Divyanshu Mishra, Can Peng, Anshul Thakur, David Clifton, Konstantinos Kamnitsas, J. Alison Noble

专题命中医疗多模态：medical image(abstract)；分类 cs.CV、cs.LG

Comments Accepted in CVPR 2025

2503.01653 2025-03-25 cs.LG cs.AI cs.CV 62%

Distilled Prompt Learning for Incomplete Multimodal Survival Prediction

Yingxue Xu, Fengtao Zhou, Chenyu Zhao, Yihui Wang, Can Yang, Hao Chen

专题命中医疗多模态：pathology(abstract)；分类 cs.CV、cs.LG

Comments Accepted by CVPR2025

2503.03987 2025-03-07 cs.CV cs.AI cs.CL cs.LG 62%

RetinalGPT: A Retinal Clinical Preference Conversational Assistant Powered by Large Vision-Language Models

Wenhui Zhu, Xin Li, Xiwen Chen, Peijie Qiu, Vamsi Krishna Vasa, Xuanzhao Dong, Yanxi Chen, Natasha Lepore, Oana Dumitrascu, Yi Su, Yalin Wang

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV、cs.LG

2502.20560 2025-03-03 cs.LG cs.CL cs.CV 62%

Towards Statistical Factuality Guarantee for Large Vision-Language Models

Zhuohang Li, Chao Yan, Nicholas J. Jackson, Wendi Cui, Bo Li, Jiaxin Zhang, Bradley A. Malin

专题命中医疗多模态：radiology(abstract)；分类 cs.CV、cs.LG

2502.05926 2025-02-11 eess.IV cs.CL cs.CV 62%

A Generative Framework for Bidirectional Image-Report Understanding in Chest Radiography

Nicholas Evans, Stephen Baker, Miles Reed

专题命中医疗多模态：radiology(abstract)；分类 cs.CV、eess.IV

2502.03999 2025-02-07 eess.IV cs.CV 62%

A Self-supervised Multimodal Deep Learning Approach to Differentiate Post-radiotherapy Progression from Pseudoprogression in Glioblastoma

Ahmed Gomaa, Yixing Huang, Pluvio Stephan, Katharina Breininger, Benjamin Frey, Arnd Dörfler, Oliver Schnell, Daniel Delev, Roland Coras, Charlotte Schmitter, Jenny Stritzelberger, Sabine Semrau, Andreas Maier, Siming Bayer, Stephan Schönecker, Dieter H Heiland, Peter Hau, Udo S. Gaipl, Christoph Bert, Rainer Fietkau, Manuel A. Schmidt, Florian Putz

专题命中医疗多模态：MRI(abstract)；分类 cs.CV、eess.IV

2502.02048 2025-02-05 cs.LG cs.CL cs.CV 62%

Efficient Domain Adaptation of Multimodal Embeddings using Constrastive Learning

Georgios Margaritis, Periklis Petridis, Dimitris J. Bertsimas

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV、cs.LG

2501.13985 2025-01-27 cs.LG cs.AI cs.CV 62%

Pilot: Building the Federated Multimodal Instruction Tuning Framework

Baochen Xiong, Xiaoshan Yang, Yaguang Song, Yaowei Wang, Changsheng Xu

专题命中医疗多模态：CT(abstract)；分类 cs.CV、cs.LG

2407.02716 2025-01-09 cs.CV cs.LG 62%

Light-weight Fine-tuning Method for Defending Adversarial Noise in Pre-trained Medical Vision-Language Models

Xu Han, Linghao Jin, Xuezhe Ma, Xiaofeng Liu

专题命中医疗多模态：medical image(abstract)；分类 cs.CV、cs.LG

2408.11227 2024-12-20 eess.IV cs.AI cs.CV 62%

OCTCube-M: A 3D multimodal optical coherence tomography foundation model for retinal and systemic diseases with cross-cohort and cross-device validation

Zixuan Liu, Hanwen Xu, Addie Woicik, Linda G. Shapiro, Marian Blazes, Yue Wu, Verena Steffen, Catherine Cukras, Cecilia S. Lee, Miao Zhang, Aaron Y. Lee, Sheng Wang

专题命中医疗多模态：CT(abstract)；分类 cs.CV、eess.IV

2411.15207 2024-11-26 cs.CV cs.AI cs.CL cs.LG 62%

Uni-Mlip: Unified Self-supervision for Medical Vision Language Pre-training

Ameera Bawazir, Kebin Wu, Wenbin Li

专题命中医疗多模态：medical image(abstract)；分类 cs.CV、cs.LG

Comments 15 pages, 2 figures, accepted by BMVC'24

2008.12410 2024-11-26 cs.LG eess.SP stat.ML 62%

Deep sr-DDL: Deep Structurally Regularized Dynamic Dictionary Learning to Integrate Multimodal and Dynamic Functional Connectomics data for Multidimensional Clinical Characterizations

Niharika Shimona D'Souza, Mary Beth Nebel, Deana Crocetti, Nicholas Wymbs, Joshua Robinson, Stewart H. Mostofsky, Archana Venkataraman

专题命中医疗多模态：MRI(abstract)；分类 cs.LG、eess.SP

2007.01931 2024-11-25 cs.LG eess.SP stat.ML 62%

A Deep-Generative Hybrid Model to Integrate Multimodal and Dynamic Connectivity for Predicting Spectrum-Level Deficits in Autism

Niharika Shimona D'Souza, Mary Beth Nebel, Deana Crocetti, Nicholas Wymbs, Joshua Robinson, Stewart Mostofsky, Archana Venkataraman

专题命中医疗多模态：MRI(abstract)；分类 cs.LG、eess.SP

2411.13754 2024-11-22 cs.LG cs.AI cs.CV 62%

Learning to Reason Iteratively and Parallelly for Complex Visual Reasoning Scenarios

Shantanu Jaiswal, Debaditya Roy, Basura Fernando, Cheston Tan

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV、cs.LG

Comments NeurIPS 2024 camera ready; source code to be released at: https://github.com/shantanuj/IPRM_Iterative_and_Parallel_Reasoning_Mechanism

2411.10888 2024-11-19 eess.IV cs.AI cs.CV 62%

MpoxVLM: A Vision-Language Model for Diagnosing Skin Lesions from Mpox Virus Infection

Xu Cao, Wenqian Ye, Kenny Moise, Megan Coffee

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV、eess.IV

Comments Accepted by ML4H 2024

2404.12634 2024-11-19 cs.CV cs.AI cs.LG 62%

Transformer-Based Classification Outcome Prediction for Multimodal Stroke Treatment

Danqing Ma, Meng Wang, Ao Xiang, Zongqing Qi, Qin Yang

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV、cs.LG

2310.07355 2024-10-31 cs.CV cs.LG 62%

IMITATE: Clinical Prior Guided Hierarchical Vision-Language Pre-training

Che Liu, Sibo Cheng, Miaojing Shi, Anand Shah, Wenjia Bai, Rossella Arcucci

专题命中医疗多模态：medical image(abstract)；分类 cs.CV、cs.LG

Comments Accepted by TMI2024

2110.10156 2024-10-28 eess.IV cs.CV 62%

Cross-Sim-NGF: FFT-Based Global Rigid Multimodal Alignment of Image Volumes using Normalized Gradient Fields

Johan Öfverstedt, Joakim Lindblad, Nataša Sladoje

专题命中医疗多模态：CT(abstract)；分类 cs.CV、eess.IV

Comments 5 pages, 3 figures, 3 tables. This work has been submitted to the IEEE for possible publication

2407.05131 2024-10-18 cs.LG cs.AI cs.CL cs.CV cs.CY 62%

RULE: Reliable Multimodal RAG for Factuality in Medical Vision Language Models

Peng Xia, Kangyu Zhu, Haoran Li, Hongtu Zhu, Yun Li, Gang Li, Linjun Zhang, Huaxiu Yao

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV、cs.LG

Comments EMNLP 2024 main

2405.09798 2024-10-08 cs.LG cs.AI cs.CL cs.CV 62%

Many-Shot In-Context Learning in Multimodal Foundation Models

Yixing Jiang, Jeremy Irvin, Ji Hun Wang, Muhammad Ahmed Chaudhry, Jonathan H. Chen, Andrew Y. Ng

专题命中医疗多模态：medical image(abstract)；分类 cs.CV、cs.LG

2406.19280 2024-10-01 cs.CV cs.AI cs.CL cs.LG 62%

HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale

Junying Chen, Chi Gui, Ruyi Ouyang, Anningzhe Gao, Shunian Chen, Guiming Hardy Chen, Xidong Wang, Ruifei Zhang, Zhenyang Cai, Ke Ji, Guangjun Yu, Xiang Wan, Benyou Wang

专题命中医疗多模态：medical image(abstract)；分类 cs.CV、cs.LG

2307.11986 2024-08-29 cs.CV cs.LG 62%

Expert Knowledge-Aware Image Difference Graph Representation Learning for Difference-Aware Medical Visual Question Answering

Xinyue Hu, Lin Gu, Qiyuan An, Mengliang Zhang, Liangchen Liu, Kazuma Kobayashi, Tatsuya Harada, Ronald M. Summers, Yingying Zhu

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV、cs.LG

2408.07349 2024-08-15 eess.IV cs.CV cs.MM 62%

Automated Retinal Image Analysis and Medical Report Generation through Deep Learning

Jia-Hong Huang

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV、eess.IV

Comments Ph.D. thesis, 124 pages

2407.09088 2024-07-15 eess.IV cs.AI cs.CV 62%

FD-SOS: Vision-Language Open-Set Detectors for Bone Fenestration and Dehiscence Detection from Intraoral Images

Marawan Elbatel, Keyuan Liu, Yanqi Yang, Xiaomeng Li

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV、eess.IV

Comments MICCAI 2024

2403.13658 2024-07-08 cs.LG cs.CV 62%

Multimodal Variational Autoencoder for Low-cost Cardiac Hemodynamics Instability Detection

Mohammod N. I. Suvon, Prasun C. Tripathi, Wenrui Fan, Shuo Zhou, Xianyuan Liu, Samer Alabed, Venet Osmani, Andrew J. Swift, Chen Chen, Haiping Lu

专题命中医疗多模态：MRI(abstract)；分类 cs.CV、cs.LG

2407.03836 2024-07-08 cs.CV cs.LG 62%

ADAPT: Multimodal Learning for Detecting Physiological Changes under Missing Modalities

Julie Mordacq, Leo Milecki, Maria Vakalopoulou, Steve Oudot, Vicky Kalogeiton

专题命中医疗多模态：biomedical(abstract)；分类 cs.CV、cs.LG

Comments Accepted at MIDL 2024

2312.14574 2024-06-28 cs.CV cs.LG 62%

MMGPL: Multimodal Medical Data Analysis with Graph Prompt Learning

Liang Peng, Songyue Cai, Zongqian Wu, Huifang Shang, Xiaofeng Zhu, Xiaoxiao Li

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV、cs.LG

1. 医疗多模态 966 篇

Mind Your Vision: Multimodal Estimation of Refractive Disorders Using Electrooculography and Eye Tracking

Ultrasound Report Generation with Multimodal Large Language Models for Standardized Texts

Bridging the Semantic Gaps: Improving Medical VQA Consistency with LLM-Augmented Question Sets

F$^3$OCUS -- Federated Finetuning of Vision-Language Foundation Models with Optimal Client Layer Updating Strategy via Multi-objective Meta-Heuristics

Distilled Prompt Learning for Incomplete Multimodal Survival Prediction

RetinalGPT: A Retinal Clinical Preference Conversational Assistant Powered by Large Vision-Language Models

Towards Statistical Factuality Guarantee for Large Vision-Language Models

A Generative Framework for Bidirectional Image-Report Understanding in Chest Radiography

A Self-supervised Multimodal Deep Learning Approach to Differentiate Post-radiotherapy Progression from Pseudoprogression in Glioblastoma

Efficient Domain Adaptation of Multimodal Embeddings using Constrastive Learning

Pilot: Building the Federated Multimodal Instruction Tuning Framework

Light-weight Fine-tuning Method for Defending Adversarial Noise in Pre-trained Medical Vision-Language Models

OCTCube-M: A 3D multimodal optical coherence tomography foundation model for retinal and systemic diseases with cross-cohort and cross-device validation

Uni-Mlip: Unified Self-supervision for Medical Vision Language Pre-training

Deep sr-DDL: Deep Structurally Regularized Dynamic Dictionary Learning to Integrate Multimodal and Dynamic Functional Connectomics data for Multidimensional Clinical Characterizations

A Deep-Generative Hybrid Model to Integrate Multimodal and Dynamic Connectivity for Predicting Spectrum-Level Deficits in Autism

Learning to Reason Iteratively and Parallelly for Complex Visual Reasoning Scenarios

MpoxVLM: A Vision-Language Model for Diagnosing Skin Lesions from Mpox Virus Infection

Transformer-Based Classification Outcome Prediction for Multimodal Stroke Treatment

IMITATE: Clinical Prior Guided Hierarchical Vision-Language Pre-training

Cross-Sim-NGF: FFT-Based Global Rigid Multimodal Alignment of Image Volumes using Normalized Gradient Fields

RULE: Reliable Multimodal RAG for Factuality in Medical Vision Language Models

Many-Shot In-Context Learning in Multimodal Foundation Models

HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale

Expert Knowledge-Aware Image Difference Graph Representation Learning for Difference-Aware Medical Visual Question Answering

Automated Retinal Image Analysis and Medical Report Generation through Deep Learning

FD-SOS: Vision-Language Open-Set Detectors for Bone Fenestration and Dehiscence Detection from Intraoral Images

Multimodal Variational Autoencoder for Low-cost Cardiac Hemodynamics Instability Detection

ADAPT: Multimodal Learning for Detecting Physiological Changes under Missing Modalities

MMGPL: Multimodal Medical Data Analysis with Graph Prompt Learning