TUNI: Unifying Pre-training and Fine-tuning with Modality-Aware Mutual Learning and Rectification for RGB-T Semantic Segmentation
TUNI:基于模态感知互学习和矫正的RGB-T语义分割统一预训练与微调框架
机构 * School of Automation, Beijing Institute of Technology(自动化学院,北京理工大学) ; School of Computer Science, Wuhan University(计算机学院,武汉大学) ; Great Wall Motor(长城汽车) ; School of Information and Electronic Engineering, Zhejiang University of Science and Technology(信息电子工程学院,浙江理工大学)
AI总结 提出TUNI框架,通过模态感知互学习与矫正统一预训练和微调,解决RGB-T语义分割中多模态特征提取融合、模态依赖不平衡及热信息利用不足问题,在五个数据集上优于15种SOTA模型。
Comments This paper is an extended version of the authors' work previously presented at the ICRA conference. To appear in IEEE Transactions on Circuits and Systems for Video Technology. DOl: 10.1109/TCSVT.2026.3701706