MuellerPT: Decomposition Driven Pretraining for Dense Learning in Mueller Polarimetry
MuellerPT: 穆勒偏振测量中密集学习的分解驱动预训练
Adam Tlemsani, Yingdian Li, Maxime Giot, Naim Slim, Christopher J. Peters, Abhijeet Ghosh, Daniel S. Elson
AI总结 该研究提出了一种名为 MuellerPT 的物理引导预训练方法,用于解决穆勒偏振成像在生物医学组织分析中因标注稀缺和领域差异导致的监督学习难题。通过从每个像素的 4x4 穆勒矩阵预测 Lu-Chipman 分解图,该方法学习到具有迁移能力的密集表征,并在少样本分割和分类任务中表现出显著提升。实验表明,MuellerPT 在标签效率和跨样本迁移能力方面优于无预训练的模型,为高效标注的穆勒偏振成像应用提供了新思路。
详情
- Comments
- Accepted to 29th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2026)
穆勒矩阵成像为生物医学组织分析提供了丰富、物理上有意义的对比度,但监督学习受到稀疏密集标注和跨样本及采集设置强域偏移的阻碍。我们提出MuellerPT,一种物理引导的预训练方法,通过从逐像素4x4穆勒矩阵预测Lu-Chipman分解图来学习可迁移的密集表示。为了扩展预训练,我们收集了新的多光谱动物偏振器官数据集(MAP-Org)。预训练编码器通过分割头适应于羔羊脑灰质与白质分割,并使用分类头进行结直肠癌与非癌分类。分割和分类均在少样本学习场景下评估。在分割中,与无预训练模型相比,MuellerPT提高了标签效率和跨样本迁移,在使用5%训练数据时,相比从头训练的基线实现了超过20%的绝对DICE增益。在分类中,MuellerPT也增强了标签效率,在使用1%训练数据时,相比基线总体准确率提高了8%。我们通过对离体人类食管样本预测的Lu-Chipman图进行定性评估,证明了MuellerPT对域偏移的鲁棒性。这些结果表明,预测Lu-Chipman分解是从穆勒偏振测量中进行鲁棒生物医学推断的有效且实用的预文本任务,并为未来标签高效穆勒成像的工作铺平了道路。
Mueller matrix imaging provides rich, physically meaningful contrast for biomedical tissue analysis, but supervised learning is hindered by scarce dense annotations and strong domain shifts across specimens and acquisition settings. We introduce MuellerPT, a physics guided pre-training approach that learns transferable dense representations by predicting Lu-Chipman decomposition maps from per-pixel 4x4 Mueller matrices. To scale pre-training, we collected a new large Multispectral Animal Polarimetric Organ dataset (MAP-Org). The pre-trained encoder is adapted with a segmentation head for grey vs. white matter segmentation in lamb brain. A classification head is used for colorectal cancer vs. non-cancer classification. Both segmentation and classification are evaluated across few-shot learning scenarios. In segmentation, MuellerPT improves label efficiency and cross specimen transfer compared to models without pre-training, achieving an absolute DICE gain of over 20% compared to the baseline trained from scratch when using 5% of the training data. In classification, MuellerPT also enhances label efficiency, improving overall accuracy by 8% compared to the baseline when using 1% of the training data. We demonstrate MuellerPT's robustness to domain shift with a qualitative evaluation of its predicted Lu-Chipman maps on an ex vivo human oesophagus sample. These results suggest that predicting Lu-Chipman decomposition is an effective and practical pretext task for robust biomedical inference from Mueller polarimetry and can pave the way for future work on label efficient Mueller imaging.