UniMod: Enhancing Multi-Modal Medical Diagnosis through Cross-Modality and Within-Modality Alignment
UniMod:通过跨模态与模态内对齐增强多模态医学诊断
机构 * University of Central Florida(中佛罗里达大学) ; University of Rochester(罗切斯特大学) ; Harvard Medical School(哈佛医学院) ; University of Virginia(弗吉尼亚大学)
AI总结 UniMod框架通过要求各模态独立预测诊断缓解多模态医学诊断的捷径学习,添加跨模态与模态内对齐,在两个数据集上优于基线方法,还可扩展至多标签5分类诊断。
Comments Accepted to ACM Multimedia 2026 (MM '26). 10 pages, 7 figures, 5 tables. Code: https://github.com/futurespyhi/UniMod