PRIMA: Pre-Training with Risk-Integrated Image--Metadata Alignment for Medical Diagnosis with LLM-Based Feature Aggregation
PRIMA:通过大语言模型进行风险集成图像-元数据对齐的医学诊断预训练
机构 * Department of Biomedical Engineering, Duke University(杜克大学生物医学工程系) ; Department of Ophthalmology and Visual Sciences, University of Michigan(密歇根大学眼科与视觉科学系)
专题命中 多模态RAG :retrieval-augmented generation(abstract);RAG(abstract)
AI总结 提出PRIMA框架,通过检索增强生成策展风险-疾病关联专家语料库优化文本编码器,用双编码器预训练策略及四个互补损失函数弥合模态差距,融合特征用于疾病分类,性能优于其他方法。