医学 AI

Medical visual question answering using joint self-supervised learning

Yuan Zhou, Jing Mei, Yiqin Yu, Tanveer Syeda-Mahmood

专题命中 医疗多模态 ：medical image(abstract)；分类 cs.CV

Self-supervised vision-language pretraining for Medical visual question answering

Pengfei Li, Gang Liu, Lin Tan, Jinying Liao, Shenjun Zhong

专题命中 医疗多模态 ：medical image(abstract)；分类 cs.CV

Comments 5 pages, 3 figures

Integrated multimodal artificial intelligence framework for healthcare applications

Luis R. Soenksen, Yu Ma, Cynthia Zeng, Leonard D. J. Boussioux, Kimberly Villalobos Carballo, Liangyuan Na, Holly M. Wiberg, Michael L. Li, Ignacio Fuentes, Dimitris Bertsimas

专题命中 医疗多模态 ：pathology(abstract)；分类 cs.LG

Journal ref Nature npj Digital Medicine, 2022

A Medical Semantic-Assisted Transformer for Radiographic Report Generation

Zhanyu Wang, Mingkang Tang, Lei Wang, Xiu Li, Luping Zhou

专题命中 医疗多模态 ：medical image(abstract)；分类 cs.CV

Comments MICCAI 2022

Cross-modal Clinical Graph Transformer for Ophthalmic Report Generation

Mingjie Li, Wenjia Cai, Karin Verspoor, Shirui Pan, Xiaodan Liang, Xiaojun Chang

专题命中 医疗多模态 ：biomedical(abstract)；分类 cs.CV

Comments CVPR 2022 (Poster)

Multimodal Machine Learning in Precision Health

Adrienne Kline, Hanyin Wang, Yikuan Li, Saya Dennis, Meghan Hutch, Zhenxing Xu, Fei Wang, Feixiong Cheng, Yuan Luo

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.LG

DeepPAMM: Deep Piecewise Exponential Additive Mixed Models for Complex Hazard Structures in Survival Analysis

Philipp Kopper, Simon Wiegrebe, Bernd Bischl, Andreas Bender, David Rügamer

专题命中 医疗多模态 ：biomedical(abstract)；分类 cs.LG

Comments 13 pages, 2 figures, This work has been accepted by the 26th Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD2022)

A Multimodal Approach for Automatic Mania Assessment in Bipolar Disorder

Pınar Baki

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.LG

Trustworthy Multimodal Regression with Mixture of Normal-inverse Gamma Distributions

Huan Ma, Zongbo Han, Changqing Zhang, Huazhu Fu, Joey Tianyi Zhou, Qinghua Hu

专题命中 医疗多模态 ：CT(abstract)；分类 cs.LG

Comments Accepted to NeurIPS 2021

MUFASA: Multimodal Fusion Architecture Search for Electronic Health Records

Zhen Xu, David R. So, Andrew M. Dai

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.LG

Comments Accepted for publication at the Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI-21)

Writing by Memorizing: Hierarchical Retrieval-based Medical Report Generation

Xingyi Yang, Muchao Ye, Quanzeng You, Fenglong Ma

专题命中 医疗多模态 ：medical image(abstract)；分类 cs.CV

Comments Accepted by ACL 2021, Camera-ready version

Oversampling errors in multimodal medical imaging are due to the Gibbs effect

Davide Poggiali, Diego Cecchin, Cristina Campi, Stefano De Marchi

专题命中 医疗多模态 ：medical image(abstract)；分类 cs.CV

MARL: Multimodal Attentional Representation Learning for Disease Prediction

Ali Hamdi, Amr Aboeleneen, Khaled Shaban

专题命中 医疗多模态 ：CT(abstract)；分类 cs.CV

Comments 8 pages, submitted to IEEE-FUZZ'2021

Unimodal Cyclic Regularization for Training Multimodal Image Registration Networks

Zhe Xu, Jiangpeng Yan, Jie Luo, William Wells, Xiu Li, Jayender Jagadeesan

专题命中 医疗多模态 ：CT(abstract)；分类 cs.CV

Comments 5 pages, 5 figures

Multimodal Depression Severity Prediction from medical bio-markers using Machine Learning Tools and Technologies

Shivani Shimpi, Shyam Thombre, Snehal Reddy, Ritik Sharma, Srijan Singh

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.LG

Comments The paper content has one major problem in a section that is needs more attention and some work, and is agreed by all authors. The change is necessary in terms of correctness and completeness of the paper. Hence, requesting for the withdrawal to allow for the changes

A Dynamic Deep Neural Network For Multimodal Clinical Data Analysis

Maria Hügle, Gabriel Kalweit, Thomas Huegle, Joschka Boedecker

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.LG

Comments Accepted at the AAAI 2020 International Workshop on Health Intelligence

Automated Radiological Report Generation For Chest X-Rays With Weakly-Supervised End-to-End Deep Learning

Shuai Zhang, Xiaoyan Xin, Yang Wang, Yachong Guo, Qiuqiao Hao, Xianfeng Yang, Jun Wang, Jian Zhang, Bing Zhang, Wei Wang

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV

Multimodal Medical Volume Colorization from 2D Style

Aradhya Neeraj Mathur, Apoorv Khattar, Ojaswa Sharma

专题命中 医疗多模态 ：MRI(abstract)；分类 eess.IV

The dynamics of the stomatognathic system from 4D multimodal data

Agnieszka A. Tomaka, Leszek Luchowski, Dariusz Pojda, Michał Tarnawski, Krzysztof Domino

专题命中 医疗多模态 ：biomedical(abstract)；分类 cs.CV

Comments Chapter 3 in A.Gadomski (ed.): Multiscale Locomotion: Its Active-Matter Addressing Physical Principles; UTP University of Science & Technology

Multimodal Registration of Retinal Images Using Domain-Specific Landmarks and Vessel Enhancement

Álvaro S. Hervella, José Rouco, Jorge Novo, Marcos Ortega

专题命中 医疗多模态 ：diagnosis(abstract)；分类 cs.CV

Fast Predictive Multimodal Image Registration

Xiao Yang, Roland Kwitt, Martin Styner, Marc Niethammer

专题命中 医疗多模态 ：MRI(abstract)；分类 cs.CV

Comments Accepted as a conference paper for ISBI 2017

Robust Multimodal Graph Matching: Sparse Coding Meets Graph Matching

Marcelo Fiori, Pablo Sprechmann, Joshua Vogelstein, Pablo Musé, Guillermo Sapiro

专题命中 医疗多模态 ：biomedical(abstract)；分类 cs.LG

Comments NIPS 2013

Deep histological synthesis from mass spectrometry imaging for multimodal registration

Kimberley M. Bird, Xujiong Ye, Alan M. Race, James M. Brown

机构 * University of Lincoln（林肯大学） ； University of Exeter（埃克塞特大学） ； AstraZeneca Computational Pathology GmbH（阿斯利康计算病理学 GmbH） 纠错

专题命中 医疗多模态 ：分类 cs.CV、cs.LG、eess.IV；medical image(comments)

Comments Medical Image Understanding and Analysis (MIUA) 2025 Extended Abstract Submission

Contrastive Cross-Modal Pre-Training: A General Strategy for Small Sample Medical Imaging

Gongbo Liang, Connor Greenwell, Yu Zhang, Xiaoqin Wang, Ramakanth Kavuluru, Nathan Jacobs

专题命中 医疗多模态 ：分类 cs.CV、cs.LG、eess.IV；biomedical(comments)

Comments This work is accepted to the IEEE Journal of Biomedical and Health Informatics

Real-time multimodal image registration with partial intraoperative point-set data

Zachary M C Baum, Yipeng Hu, Dean C Barratt

专题命中 医疗多模态 ：分类 cs.CV、cs.LG、eess.IV；medical image(comments)

Comments Accepted manuscript in Medical Image Analysis

Brain Harmony: A Multimodal Foundation Model Unifying Morphology and Function into 1D Tokens

Zijian Dong, Ruilin Li, Joanna Su Xian Chong, Niousha Dehestani, Yinghui Teng, Yi Lin, Zhizhou Li, Yichi Zhang, Yapei Xie, Leon Qi Rong Ooi, B. T. Thomas Yeo, Juan Helen Zhou

专题命中 医疗多模态 ：MRI(abstract)；分类 q-bio

Comments NeurIPS 2025. The first two authors contributed equally

VIGIL: Vision-Language Guided Multiple Instance Learning Framework for Ulcerative Colitis Histological Healing Prediction

Zhengxuan Qiu, Bo Peng, Xiaoying Tang, Jiankun Wang, Qin Guo

专题命中 医疗多模态 ：diagnosis(abstract)；分类 q-bio

Multimodal Data Integration for Precision Oncology: Challenges and Future Directions

Huajun Zhou, Fengtao Zhou, Chenyu Zhao, Yingxue Xu, Luyang Luo, Hao Chen

专题命中 医疗多模态 ：diagnosis(abstract)；分类 q-bio

Comments 15 pages, 4 figures

Multimodal Radiomics Model for Predicting Gold Nanoparticles Accumulation in Mouse Tumors

Jiajia Tang, Jie Zhang, Jiulou Zhang, Yuxia Tang, Hao Ni, Shouju Wang

专题命中 医疗多模态 ：CT(abstract)；分类 q-bio

Multimodal Representation Learning via Maximization of Local Mutual Information

Ruizhi Liao, Daniel Moyer, Miriam Cha, Keegan Quigley, Seth Berkowitz, Steven Horng, Polina Golland, William M. Wells

专题命中 医疗多模态 ：medical image(comments,journal_ref)；分类 cs.CV、eess.IV

Comments In Proceedings of International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 2021

Journal ref In International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 273-283. Springer, Cham, 2021