Enhancing Foundation VLM Robustness to Missing Modality: Scalable Diffusion for Bi-directional Feature Restoration
增强基础视觉语言模型对缺失模态的鲁棒性:可扩展的扩散用于双向特征恢复
机构 * Department of Electronics ; Information \ 'an Jiaotong University Xi'an China ; School of Information ; Communications Engineering \ 'an Jiaotong University Xi'an China ; School of Mathematics ; Statistics \ 'an Jiaotong University Xi'an China ; Information \ 'an Jiaotong University ; Communications Engineering \ 'an Jiaotong University ; Statistics \ 'an Jiaotong University
专题命中 扩散模型 :diffusion(title,abstract)
AI总结 本文提出一种通用缺失模态恢复策略,通过增强扩散模型实现双向特征对齐,提升视觉语言模型在模态缺失情况下的鲁棒性和可扩展性。
Comments 10 pages, 8 figures, 6 tables. Experiments and some details have been updated