Predicting Immune Biomarkers with MultiModal Mixture-of-Expert Pathology Foundation Models Empowers Precision Oncology
使用多模态混合专家病理基础模型预测免疫生物标志物,赋能精准肿瘤学
机构 * Program of Computational Biology and Bioinforamtics, Yale University(耶鲁大学计算生物学与生物信息学项目) ; Broad Institute of MIT and Harvard(麻省理工学院与哈佛大学博德研究所) ; Department of Statistics and Data Science, Northwestern University(西北大学统计与数据科学系) ; Department of Computer Science, Northeastern University(东北大学计算机科学系) ; Department of Computer Science, Harvard University(哈佛大学计算机科学系) ; Department of Pathology, Yale University(耶鲁大学病理学系) ; Department of Anatomic Pathology and Laboratory Medicine, Hospital of the University of Pennsylvania(宾夕法尼亚大学医院解剖病理学与检验医学系) ; Department of Pathology and Laboratory Medicine, University of California, San Francisco(加州大学旧金山分校病理学与检验医学系) ; Department of Pathology and Laboratory Medicine, KK Women’s and Children’s Hospital(竹脚妇幼医院病理学与检验医学系) ; Department of Biostatistics, Epidemiology and Informatics, Perelman School of Medicine, University of Pennsylvania(宾夕法尼亚大学佩雷尔曼医学院生物统计学、流行病学与信息学系)
AI总结 提出MixTIME多模态基础模型,采用混合专家架构整合不同模态的病理基础模型,从HE全切片图像预测多重免疫荧光蛋白表达,在17个蛋白标记物上达到最优性能,并增强空间域识别、生存预测等下游任务。
Comments 5 figures