arXivDaily arXiv每日学术速递 周一至周五更新

大厂专区

Kuaishou

2026-07-16 至 2026-07-16 收录 2
2607.13460 2026-07-16 cs.CV 新提交

LPM: Industrial-Scale Generative Video Restoration

LPM:工业规模的生成式视频修复

Bichuan Zhu, Fulin Li, Jiachao Gong, Jinhua Hao, Kai Zhao, Kun Yuan, Pengcheng Xu, Qiang Wang, Qiao Mo, Yanlong Yuan, Yizhen Shao, Yuxiao Hu, Zixi Tuo, Ming Sun, Chao Zhou, Bin Chen, Bin Yu

发表机构 * Kuaishou Technology(快手科技)

AI总结 研究提出工业规模的LPM用于视频修复,通过统一系统解决UGC退化问题,含数据工程、模型训练和推理。其架构等机制实现高保真修复,已在快手生产应用,节省带宽成本,还能集成产品,证明该方法实用、可扩展且具成本效益。

Comments 21 pages, 7 figures

详情
AI中文摘要

我们提出了大型处理模型(LPM),这是一个基于扩散的生成框架,用于在复杂的自然退化情况下进行逼真的视频修复。据我们所知,LPM是第一个在工业规模上部署的生成式视频修复模型。LPM通过一个统一的系统来解决用户生成内容(UGC)中的各种退化问题,该系统包括大规模数据工程、基础模型训练和高效推理。其增强的架构、渐进训练策略和时间金字塔推理机制共同实现了对UGC平台上广泛内容分布中任意长视频的高保真、时间一致的修复。LPM已在快手投入生产,模型处理的视频占总观看时间的约45%,在关键体验质量指标上持续改进。除了感知增强,LPM还带来了显著的系统级效益:在可比的感知质量下,相对于快手内部编解码器,它将比特率降低了20%,每年节省数亿带宽成本。其低服务成本还使其能够集成到Kling等产品中,表明生成式修复对于大规模视频处理可以是实用、可扩展且具有成本效益的。

英文摘要

We present the Large Processing Model (LPM), a diffusion-based generative framework for photorealistic video restoration under complex, in-the-wild degradations. To our knowledge, LPM is the first generative video restoration model deployed at industrial scale. LPM addresses the diverse degradations in user-generated content (UGC) through a unified system encompassing large-scale data engineering, foundation-model training, and efficient inference. Its enhanced architecture, progressive training strategy, and temporal-pyramid inference mechanism jointly enable high-fidelity, temporally consistent restoration of arbitrarily long videos across the broad content distribution encountered on UGC platforms. LPM has been deployed in production at Kuaishou, where videos processed by the model account for approximately 45% of total viewing time, delivering consistent improvements across key quality-of-experience metrics. Beyond perceptual enhancement, LPM delivers substantial system-level benefits: at comparable perceptual quality, it reduces bitrate by 20% relative to Kuaishou's in-house codec, yielding annual bandwidth cost savings on the order of hundreds of millions. Its low serving cost also enables integration into products such as Kling, demonstrating that generative restoration can be practical, scalable, and cost-effective for large-scale video processing.

URL PDF HTML
2606.13061 2026-07-16 cs.CV 版本更新

LaME: Learning to Think in Latent Space for Multimodal Embedding via Information Bottleneck

LaME: 通过信息瓶颈在潜在空间中进行多模态嵌入的推理学习

Peixi Wu, Biao Yang, Feipeng Ma, Bosong Chai, Bo Lin, Wei Yuan, Fan Yang, Tingting Gao, Hebei Li, Xiaoyan Sun

发表机构 * University of Science and Technology of China(中国科学技术大学) Kuaishou Technology(快手科技) Zhejiang University(浙江大学) Tsinghua University(清华大学)

AI总结 提出LaME方法,将面向嵌入的潜在推理建模为弱监督信息瓶颈,使用可学习推理令牌在单次前向传播中完成推理,避免显式CoT的高计算成本和标注依赖,实现60倍加速。

详情
AI中文摘要

基于推理的通用多模态嵌入通过将思维链(CoT)推理引入嵌入流程取得了快速进展。尽管在通用和复杂任务上表现强劲,该范式存在两个核心限制:(i) 自回归CoT推理计算成本高,使其不适用于低延迟检索;(ii) 嵌入性能与CoT标注质量高度耦合,导致大规模训练不可靠。这些引出了基本问题:文本CoT是否是嵌入的最优推理形式,以及有效的嵌入推理能否在潜在空间中完成?为此,我们提出LaME(潜在推理多模态嵌入),将面向嵌入的潜在推理建模为弱监督信息瓶颈。LaME采用K个可学习推理令牌作为固定容量瓶颈,在单次前向传播中完成所有推理。两个弱监督信号在结构上解耦了对比目标和自回归目标,消除了对CoT标注的依赖,而两阶段训练流程确保了稳定收敛。在MMEB-v2和MRMR上的实验表明,LaME达到了有竞争力的性能,超越了某些显式CoT模型,同时推理速度比显式CoT方法快60倍,比潜在基线快2倍,吞吐量与判别式嵌入模型相当。代码将开源。

英文摘要

Reasoning-driven universal multimodal embedding has advanced rapidly by introducing Chain-of-Thought (CoT) reasoning into the embedding pipeline. Despite the strong performance across both general and complex tasks, this paradigm suffers from two core limitations: (i) autoregressive CoT reasoning incurs high computational cost, making it impractical for low-latency retrieval; and (ii) embedding performance is heavily coupled with CoT annotation quality, making large-scale training unreliable. These raise fundamental questions: Is textual CoT the optimal form of reasoning for embedding, and can effective embedding reasoning be accomplished in latent space? To this end, we propose LaME (Latent Reasoning Multimodal Embedding), which formulates embedding-oriented latent reasoning as a weakly supervised information bottleneck. LaME employs K learnable reason tokens as a fixed-capacity bottleneck, completing all reasoning within a single forward pass. The two weak supervision signals structurally decouple contrastive from autoregressive objectives and eliminate dependence on CoT annotations, while a two-stage training pipeline ensures stable convergence. Experiments on MMEB-v2 and MRMR show that LaME achieves competitive performance, surpassing some explicit CoT-based models, while delivering 60x faster inference than explicit CoT methods and 2x faster than latent baselines with throughput comparable to discriminative embedding models. Code is available at https://github.com/PeppaWu/LaME.

URL PDF HTML