Self-supervised Dynamic Heterogeneous Degradation Modeling for Unified Zero-Shot Image Restoration
自监督动态异质退化建模用于统一零样本图像恢复
XiaoWan Hu, Jing Yang, HeNan Liu, HuaQiu Li, Mai Xu
AI总结 提出统一物理零样本图像恢复框架,通过将异质退化重参数化为同质分布并引入动态质量细化策略,实现单/混合退化下的最优性能。
详情
零样本图像恢复提供了一种灵活的方式来处理各种退化,无需特定任务的训练。然而,现有方法通常依赖堆叠层或预训练特征来增强退化表达,同时忽略了物理一致的先验。不充分的退化提示在零样本扩散过程中带来了沉重的训练负担和高采样成本。此外,固定的推理轨迹在复杂损坏下往往收敛到次优解。我们观察到异质退化可以重参数化为一个最小物理一致参数集以实现紧凑表示。基于这一见解,我们首先提出一个统一的物理零样本图像恢复(UP-ZeroIR)框架,该框架将异质退化显式建模为同质全分布。该分布可以在潜在空间中直接优化,从而实现原则性的解探索和有效的提示适应。此外,我们引入了一种动态质量细化策略,自适应调整扩散轨迹以实现鲁棒的全局最优收敛。大量实验表明,我们的方法在单一和混合退化下均达到了最先进的性能。我们的代码可在 https://github.com/yangjinglyy/UP-ZeroIR 获取。
Zero-shot image restoration provides a flexible way to handle diverse degradations without task-specific training. However, existing methods typically rely on stacked layers or pre-trained features to enhance degradation expression, while overlooking physically consistent priors. The insufficient degradation prompts impose the heavy training burden and high sampling costs during zero-shot diffusion. Moreover, the fixed inference trajectory often collapses to suboptimal solutions under complex corruptions. We observe that heterogeneous degradations can be reparameterized into a minimal set of physically coherent parameters for compact representation. Based on this insight, we first propose a unified physical zero-shot image restoration (UP-ZeroIR) framework that explicitly models heterogeneous degradations into a homogeneous all-in-one distribution. The distribution can be optimized directly in the latent space, enabling principled solution exploration and effective prompt adaptation. Besides, we introduce a dynamic quality-refinement strategy that adaptively adjusts the diffusion trajectory for robust globally optimal convergence. Extensive experiments demonstrate that our method achieves state-of-the-art performance across both single and mixed degradations. Our code is available at https://github.com/yangjinglyy/UP-ZeroIR