CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughts
CoLT: 教会多模态模型通过潜在思维链进行思考
机构 * Nanyang Technological University(南洋理工大学) ; Shanghai Jiao Tong University(上海交通大学) ; NKIARI ; AAIS & VCIP, Nankai University(南开大学AAIS & VCIP) ; Tianjin University(天津大学)
AI总结 提出CoLT框架,用潜在思维链代替文本推理,通过前向和后向解码器监督及内部监督实现高效多模态推理,在8个基准上优于现有方法,推理时间减少10.1倍。
Comments Accepted by ECCV2026. Code is available at https://github.com/hulianyuyy/CoLT