医学 AI - arXivDaily 专题

2405.10301 2024-11-06 stat.ML cs.AI cs.LG 57%

Conformal Alignment: Knowing When to Trust Foundation Models with Guarantees

Yu Gui, Ying Jin, Zhimei Ren

专题命中医疗多模态：radiology(abstract)；分类 cs.LG

2404.18947 2024-11-04 cs.LG cs.AI 57%

Multimodal Fusion on Low-quality Data: A Comprehensive Survey

Qingyang Zhang, Yake Wei, Zongbo Han, Huazhu Fu, Xi Peng, Cheng Deng, Qinghua Hu, Cai Xu, Jie Wen, Di Hu, Changqing Zhang

专题命中医疗多模态：diagnosis(abstract)；分类 cs.LG

Comments Feel free to comment on our manuscript: qingyangzhang@tju$.$edu$.$cn

2410.23822 2024-11-01 cs.CV cs.AI 57%

Parameter-Efficient Fine-Tuning Medical Multimodal Large Language Models for Medical Visual Grounding

Jinlong He, Pengfei Li, Gang Liu, Shenjun Zhong

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

2410.21969 2024-10-30 cs.CV 57%

BenchX: A Unified Benchmark Framework for Medical Vision-Language Pretraining on Chest X-Rays

Yang Zhou, Tan Li Hui Faith, Yanyu Xu, Sicong Leng, Xinxing Xu, Yong Liu, Rick Siow Mong Goh

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

Comments Accepted to NeurIPS24 Datasets and Benchmarks Track

2410.15881 2024-10-22 cs.CV cs.AI 57%

MI-VisionShot: Few-shot adaptation of vision-language models for slide-level classification of histopathological images

Pablo Meseguer, Rocío del Amor, Valery Naranjo

专题命中医疗多模态：pathology(abstract)；分类 cs.CV

Comments Manuscript accepted for oral presentation at KES-InnovationInMedicine 2024 held on Madeira, Portugal

2410.15642 2024-10-22 cs.CL cs.AI cs.CV 57%

Resource-Efficient Medical Report Generation using Large Language Models

Abdullah, Ameer Hamza, Seong Tae Kim

专题命中医疗多模态：radiology(abstract)；分类 cs.CV

2406.00977 2024-10-16 cs.CV cs.AI 57%

Dragonfly: Multi-Resolution Zoom-In Encoding Enhances Vision-Language Models

Rahul Thapa, Kezhen Chen, Ian Covert, Rahul Chalamala, Ben Athiwaratkun, Shuaiwen Leon Song, James Zou

专题命中医疗多模态：biomedical(abstract)；分类 cs.CV

2410.05361 2024-10-10 cs.LG cs.AI cs.SD eess.AS 57%

RespLLM: Unifying Audio and Text with Multimodal LLMs for Generalized Respiratory Health Prediction

Yuwei Zhang, Tong Xia, Aaqib Saeed, Cecilia Mascolo

专题命中医疗多模态：diagnosis(abstract)；分类 cs.LG

2410.04521 2024-10-08 cs.CV 57%

MC-CoT: A Modular Collaborative CoT Framework for Zero-shot Medical-VQA with LLM and MLLM Integration

Lai Wei, Wenkai Wang, Xiaoyu Shen, Yu Xie, Zhihao Fan, Xiaojin Zhang, Zhongyu Wei, Wei Chen

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

Comments 21 pages, 14 figures, 6 tables

2404.12372 2024-10-08 cs.CV 57%

MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationale

Xiaotang Gai, Chenyi Zhou, Jiaxiang Liu, Yang Feng, Jian Wu, Zuozhu Liu

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

2409.17055 2024-10-02 cs.AI cs.LG 57%

DRIM: Learning Disentangled Representations from Incomplete Multimodal Healthcare Data

Lucas Robinet, Ahmad Berjaoui, Ziad Kheil, Elizabeth Cohen-Jonathan Moyal

专题命中医疗多模态：MRI(abstract)；分类 cs.LG

2409.19684 2024-10-01 cs.CV 57%

MedViLaM: A multimodal large language model with advanced generalizability and explainability for medical data understanding and generation

Lijian Xu, Hao Sun, Ziyu Ni, Hongsheng Li, Shaoting Zhang

专题命中医疗多模态：radiology(abstract)；分类 cs.CV

2305.10415 2024-09-10 cs.CV 57%

PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answering

Xiaoman Zhang, Chaoyi Wu, Ziheng Zhao, Weixiong Lin, Ya Zhang, Yanfeng Wang, Weidi Xie

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

2404.10237 2024-09-04 cs.CV cs.CL 57%

Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models

Songtao Jiang, Tuo Zheng, Yan Zhang, Yeying Jin, Li Yuan, Zuozhu Liu

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

2408.16769 2024-08-30 cs.CV cs.CR 57%

PromptSmooth: Certifying Robustness of Medical Vision-Language Models via Prompt Learning

Noor Hussein, Fahad Shamshad, Muzammal Naseer, Karthik Nandakumar

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

Comments Accepted to MICCAI 2024

2408.14723 2024-08-28 cs.CV cs.IR 57%

Snap and Diagnose: An Advanced Multimodal Retrieval System for Identifying Plant Diseases in the Wild

Tianqi Wei, Zhi Chen, Xin Yu

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV

2311.14902 2024-08-27 cs.CV 57%

Parkinson's Disease Classification Using Contrastive Graph Cross-View Learning with Multimodal Fusion of SPECT Images and Clinical Features

Jun-En Ding, Chien-Chin Hsu, Feng Liu

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

2408.06357 2024-08-14 cs.CV cs.AI 57%

Algorithm Research of ELMo Word Embedding and Deep Learning Multimodal Transformer in Image Description

Xiaohan Cheng, Taiyuan Mei, Yun Zi, Qi Wang, Zijun Gao, Haowei Yang

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

2407.14277 2024-07-23 cs.CV 57%

Patch-based Intuitive Multimodal Prototypes Network (PIMPNet) for Alzheimer's Disease classification

Lisa Anita De Santi, Jörg Schlötterer, Meike Nauta, Vincenzo Positano, Christin Seifert

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV

Comments Accepted "late-breaking work" at XAI-2024

2407.07582 2024-07-11 cs.CV 57%

TIP: Tabular-Image Pre-training for Multimodal Classification with Incomplete Data

Siyi Du, Shaoming Zheng, Yinsong Wang, Wenjia Bai, Declan P. O'Regan, Chen Qin

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

Comments 28 pages (including 9 pages of supplementary materials), accepted by ECCV 2024

2406.14098 2024-07-08 cs.CV 57%

HeartBeat: Towards Controllable Echocardiography Video Synthesis with Multimodal Conditions-Guided Diffusion Models

Xinrui Zhou, Yuhao Huang, Wufeng Xue, Haoran Dou, Jun Cheng, Han Zhou, Dong Ni

专题命中医疗多模态：MRI(abstract)；分类 cs.CV

Comments Accepted by MICCAI 2024

2407.00535 2024-07-02 cs.CE cs.CV 57%

AI-powered multimodal modeling of personalized hemodynamics in aortic stenosis

Caglar Ozturk, Daniel H. Pak, Luca Rosalia, Debkalpa Goswami, Mary E. Robakowski, Raymond McKay, Christopher T. Nguyen, James S. Duncan, Ellen T. Roche

专题命中医疗多模态：diagnosis(abstract)；分类 cs.CV

Comments CO and DHP contributed equally to this work. JSD and ETR are corresponding authors

2401.05163 2024-06-21 cs.CV cs.AI 57%

MISS: A Generative Pretraining and Finetuning Approach for Med-VQA

Jiawei Chen, Dingkang Yang, Yue Jiang, Yuxuan Lei, Lihua Zhang

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

Comments ICANN, 2024

2406.00631 2024-06-04 cs.CV 57%

MGI: Multimodal Contrastive pre-training of Genomic and Medical Imaging

Jiaying Zhou, Mingzhou Jiang, Junde Wu, Jiayuan Zhu, Ziyue Wang, Yueming Jin

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

2405.15728 2024-05-27 cs.CV 57%

Disease-informed Adaptation of Vision-Language Models

Jiajin Zhang, Ge Wang, Mannudeep K. Kalra, Pingkun Yan

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

Comments Early Accepted by MICCAI 2024

2312.02233 2024-05-13 cs.CV 57%

MedXChat: A Unified Multimodal Large Language Model Framework towards CXRs Understanding and Generation

Ling Yang, Zhanyu Wang, Zhenghao Chen, Xinyu Liang, Luping Zhou

专题命中医疗多模态：medical image(abstract)；分类 cs.CV

2405.04175 2024-05-08 cs.CV 57%

Topicwise Separable Sentence Retrieval for Medical Report Generation

Junting Zhao, Yang Zhou, Zhihao Chen, Huazhu Fu, Liang Wan

专题命中医疗多模态：radiology(abstract)；分类 cs.CV

2404.16802 2024-04-26 eess.IV 57%

Transformer-Based Local Feature Matching for Multimodal Image Registration

Remi Delaunay, Ruisi Zhang, Filipe C. Pedrosa, Navid Feizi, Dianne Sacco, Rajni Patel, Jayender Jagadeesan

专题命中医疗多模态：CT(abstract)；分类 eess.IV

Comments Accepted to SPIE Medical Imaging 2024

2404.03618 2024-04-05 cs.CV 57%

DeViDe: Faceted medical knowledge for improved medical vision-language pre-training

Haozhe Luo, Ziyu Zhou, Corentin Royer, Anjany Sekuboyina, Bjoern Menze

专题命中医疗多模态：radiology(abstract)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:2208.04060 by other authors

2403.15485 2024-03-26 cs.CL cs.AI cs.LG 57%

MOGAM: A Multimodal Object-oriented Graph Attention Model for Depression Detection

Junyeop Cha, Seoyun Kim, Dongjae Kim, Eunil Park

专题命中医疗多模态：diagnosis(abstract)；分类 cs.LG

Comments 12 pages, 3 figures, 4 tables

1. 医疗多模态 966 篇

Conformal Alignment: Knowing When to Trust Foundation Models with Guarantees

Multimodal Fusion on Low-quality Data: A Comprehensive Survey

Parameter-Efficient Fine-Tuning Medical Multimodal Large Language Models for Medical Visual Grounding

BenchX: A Unified Benchmark Framework for Medical Vision-Language Pretraining on Chest X-Rays

MI-VisionShot: Few-shot adaptation of vision-language models for slide-level classification of histopathological images

Resource-Efficient Medical Report Generation using Large Language Models

Dragonfly: Multi-Resolution Zoom-In Encoding Enhances Vision-Language Models

RespLLM: Unifying Audio and Text with Multimodal LLMs for Generalized Respiratory Health Prediction

MC-CoT: A Modular Collaborative CoT Framework for Zero-shot Medical-VQA with LLM and MLLM Integration

MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationale

DRIM: Learning Disentangled Representations from Incomplete Multimodal Healthcare Data

MedViLaM: A multimodal large language model with advanced generalizability and explainability for medical data understanding and generation

PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answering

Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models

PromptSmooth: Certifying Robustness of Medical Vision-Language Models via Prompt Learning

Snap and Diagnose: An Advanced Multimodal Retrieval System for Identifying Plant Diseases in the Wild

Parkinson's Disease Classification Using Contrastive Graph Cross-View Learning with Multimodal Fusion of SPECT Images and Clinical Features

Algorithm Research of ELMo Word Embedding and Deep Learning Multimodal Transformer in Image Description

Patch-based Intuitive Multimodal Prototypes Network (PIMPNet) for Alzheimer's Disease classification

TIP: Tabular-Image Pre-training for Multimodal Classification with Incomplete Data

HeartBeat: Towards Controllable Echocardiography Video Synthesis with Multimodal Conditions-Guided Diffusion Models

AI-powered multimodal modeling of personalized hemodynamics in aortic stenosis

MISS: A Generative Pretraining and Finetuning Approach for Med-VQA

MGI: Multimodal Contrastive pre-training of Genomic and Medical Imaging

Disease-informed Adaptation of Vision-Language Models

MedXChat: A Unified Multimodal Large Language Model Framework towards CXRs Understanding and Generation

Topicwise Separable Sentence Retrieval for Medical Report Generation

Transformer-Based Local Feature Matching for Multimodal Image Registration

DeViDe: Faceted medical knowledge for improved medical vision-language pre-training

MOGAM: A Multimodal Object-oriented Graph Attention Model for Depression Detection