arXivDaily arXiv每日学术速递 周一至周五更新

大厂专区

Huawei

2026-07-16 至 2026-07-16 收录 5
2607.13927 2026-07-16 cs.CV 新提交

Cyclone: Diffusion Model for Cycle-Consistent Weather Editing from Unpaired Driving Data

Cyclone:基于未配对驱动数据的循环一致天气编辑扩散模型

Thang-Anh-Quan Nguyen, Moussab Bennehar, Luis Guillermo Roldao Jimenez, Nathan Piasco, Dzmitry Tsishkou, Laurent Caraffa, Jean-Philippe Tarel, Roland Brémond

发表机构 * Huawei Paris Research Center(华为巴黎研究中心) Gustave Eiffel University(古斯塔夫·埃菲尔大学) IGN-ENSG(法国国家地理信息与森林和环境信息研究所)

AI总结 针对自动驾驶系统在不同天气条件下可靠感知的挑战,提出Cyclone框架,基于潜在扩散,利用循环一致约束和图像-文本模型知识,无需配对数据生成多种天气条件,实验表明其输出更优,还可提炼为视频扩散模型。

Comments Project page: https://ntaquan0125.github.io/weather-cyclone/

详情
AI中文摘要

在不同天气条件下的可靠感知仍然是自动驾驶系统的一个主要挑战。一种提高鲁棒性的常见策略是为训练感知模型合成不利天气条件,或应用天气去除技术来恢复干净的输入。然而,现有方法通常依赖于合成数据增强或基于物理的特定任务模型,这些模型需要配对的训练数据,并且往往难以生成逼真的天气效果或稳健地推广到域外场景。针对这个问题,我们提出了Cyclone,一个基于潜在扩散的天气编辑统一框架,配备了循环一致约束和来自图像-文本模型的知识。Cyclone能够在不同场景中生成多种天气条件,同时无需配对数据。实验结果表明,我们的方法比现有基线产生更逼真、保留结构的输出,并在几个下游驾驶感知任务中带来一致的改进。此外,我们证明Cyclone可以提炼为一个用于时间一致天气编辑的视频扩散模型。

英文摘要

Reliable perception under diverse weather conditions remains a major challenge for autonomous driving systems. A common strategy to improve robustness is either to synthesize adverse weather conditions for training perception models or to apply weather-removal techniques to recover clean inputs. However, existing approaches typically rely on synthetic data augmentation or physics-based, task-specific models that require paired training data and often struggle to generate realistic weather effects or generalize robustly to out-of-domain scenarios. Toward this problem, we present Cyclone, a unified framework for weather editing based on latent diffusion, equipped with cycle-consistent constraints and knowledge from image-text models. Cyclone enables the generation of multiple weather conditions across diverse scenes while eliminating the need for paired data. Experimental results show that our approach produces more realistic, structure-preserving outputs than existing baselines and leads to consistent improvements across several downstream driving perception tasks. Furthermore, we demonstrate that Cyclone can be distilled to a video diffusion model for temporally consistent weather editing.

URL PDF HTML
2607.13770 2026-07-16 cs.AR cs.AI 新提交

Kaleido: Algorithm-Hardware Co-Design for Video Diffusion Transformers by Exploiting Latent Space Correlations

Kaleido:通过利用潜在空间相关性对视频扩散变压器进行算法-硬件协同设计

Wenxuan Miao, Haosong Liu, Weiming Hu, Zihan Liu, Aiyue Chen, Jianlin Yu, Yiwu Yao, Yiming Gan, Jieru Zhao, Jingwen Leng, Minyi Guo, Yu Feng

发表机构 * Shanghai Jiao Tong University(上海交通大学) Shanghai Jiao Tong University, Shanghai Qi Zhi Institute(上海交通大学、上海颀智研究所) Huawei Technologies(华为技术有限公司) ICT, Chinese Academy of Sciences(信息科技研究所、中国科学院)

AI总结 针对视频扩散变压器计算成本高的问题,提出Kaleido算法-硬件协同设计,利用潜在空间通道级时空相关性加速操作,有轻量级重用算法,设计了加速器,实验表明其相比现有加速器有显著加速和节能效果。

详情
AI中文摘要

视频扩散变压器(vDiTs)能生成高质量视频,但由于扩散时间步长和自注意力计算,计算成本极高。随着扩散时间步长减少,自注意力计算成本成为主要瓶颈。现有加速方法大多继承大语言模型的稀疏注意力技术,未考虑视频数据独特的时空相关性。本文提出Kaleido,一种算法-硬件协同设计,通过利用潜在空间中的通道级时空相关性加速vDiTs中的所有操作。基于此,提出轻量级通道级重用算法,在保留比现有方法更高生成质量(>17dB)的同时跳过冗余计算。还设计了具有可重构处理元件的脉动阵列加速器和轻量级数据调度器。对三个主流vDiT模型的评估表明,Kaleido比现有加速器加速高达5.9倍,节能16.0倍。

英文摘要

Video diffusion transformers (vDiTs) generate high quality video but introduce extremely high compute cost due to the long diffusion timesteps and self attention computation. As diffusion timesteps are reduced, the computation cost of self attention becomes the dominant bottleneck. Existing acceleration approaches largely inherit sparse attention techniques from large language models, which fail to consider the unique spatiotemporal correlation of video data. This paper presents Kaleido, an algorithm hardware codesign that accelerates all operations in vDiTs by exploiting channel-wise spatiotemporal correlations in latent space. Based on this insight, we propose a lightweight channelwise reuse algorithm that skips redundant computations by reusing partial results while preserving higher generative quality than prior methods (>17 dB). To efficiently support this algorithm, we design a systolic array like accelerator with reconfigurable processing elements and a lightweight data dispatcher to mitigate irregular sparsity and data access patterns introduced by our reuse algorithm. Evaluations across three mainstream vDiT models show that Kaleido achieves up to 5.9x speedup and 16.0x energy savings over state of the art accelerators.

URL PDF HTML
2607.13428 2026-07-16 cs.LG 新提交

PUe: Biased Positive-Unlabeled Learning Enhancement by Causal Inference

PUe:基于因果推断的有偏正无标记学习增强

Xutao Wang, Hanting Chen, Tianyu Guo, Yunhe Wang

发表机构 * Huawei Noah’s Ark Lab(华为诺亚方舟实验室)

AI总结 研究正无标记学习问题,基于SAR-PU倾向加权框架提出PUe框架,运用归一化倾向得分和NIPW,有归一化逆概率加权风险公式等贡献,在多个数据集实验中,在非均匀标签分布下优于多个PU基线。

Comments Extended arXiv version of the NeurIPS 2023 paper; includes additional discussion of related SAR-PU work

详情
AI中文摘要

正无标记(PU)学习旨在利用有限的标记正例和大量未标记例实现高精度二分类。现有基于成本敏感的方法常依赖强假设,即观察到正标记的示例是完全随机选择的。但实际中标签分布不均,存在选择偏差。基于Bekker等人的SAR-PU倾向加权框架,研究使用归一化倾向得分和归一化逆概率加权(NIPW)的PU学习增强(PUe)框架。其主要贡献包括归一化逆概率加权的PU风险公式、偏差标记下归一化样本权重误差和常见PU估计器的理论分析、正则化深度倾向得分估计、与现代成本敏感PU方法集成以及对选择性标记负类的支持。在MNIST、CIFAR-10和ADNI上的实验表明,在非均匀标签分布下优于多个PU基线。

英文摘要

Positive-Unlabeled (PU) learning aims to achieve high-accuracy binary classification with limited labeled positive examples and numerous unlabeled ones. Existing cost-sensitive-based methods often rely on strong assumptions that examples with an observed positive label were selected entirely at random. In fact, the uneven distribution of labels is prevalent in real-world PU problems, indicating that most actual positive and unlabeled data are subject to selection bias. Building on the SAR-PU propensity-weighted framework of Bekker et al., we study a PU learning enhancement (PUe) framework using normalized propensity scores and normalized inverse probability weighting (NIPW). PUe's main contributions are a normalized inverse-probability-weighted PU risk formulation; additional theoretical analyses of normalized sample-weight error and common PU estimators under biased labeling; regularized deep propensity-score estimation; integration with modern cost-sensitive PU methods; and support for selectively labeled negative classes. Experiments on MNIST, CIFAR-10, and ADNI demonstrate improvements over several PU baselines under non-uniform label distributions.

URL PDF HTML
2606.30248 2026-07-16 cs.CV cs.LG 版本更新

Your Data Manifold is Secretly a Reward Model: Shell-LCC for Text-to-Video Generation

你的数据流形实际上是一个奖励模型:Shell-LCC 用于文本到视频生成

Shihao Zhang, Yunzhi Li, Yuguang Yan, Junzhe Zhang, Wei Zhao, Bohan Wang, Hanwang Zhang

发表机构 * Huawei Central Research Institute(华为中央研究院) Guangdong University of Technology(广东技术大学)

AI总结 提出 Shell-LCC 方法,通过建模高质量 SFT 数据的流形结构,提供密集、可微且几乎零成本的奖励信号,以提升文本到视频生成质量,减少低层失真。

Comments ECCV 2026

详情
AI中文摘要

最近的文本到视频(T2V)扩散模型严重依赖辅助奖励信号(例如通过奖励模型或DPO)来使生成内容与人类美学对齐并提高真实感。然而,这些信号会带来大量的计算开销,需要昂贵的人工标注,并且通常在细粒度局部细节上改进有限。在本文中,我们认为你的数据流形实际上是一个奖励模型。通过显式建模高质量监督微调(SFT)数据的流形结构,并鼓励视频潜在变量位于该流形上,我们推导出密集、可微且几乎零成本的奖励信号,显著提高了视频质量,特别是在减轻低层失真方面。我们的建模基于局部坐标编码(LCC),它捕捉流形的“骨架”。然而,直接应用LCC会遭受均值回归,将潜在变量拉向几何均值并丢失高频细节。因此,我们将其扩展为壳局部坐标编码(Shell-LCC),它将流形“表面”建模为各向同性壳,以与真正的高密度区域对齐。实验表明,我们的方法提高了真实感,增强了高频细节,减少了过度平滑伪影,并减轻了运动模糊。

英文摘要

Recent text-to-video (T2V) diffusion models rely heavily on auxiliary reward signals (e.g., via reward models or DPO) to align generated content with human aesthetics and improve realism. These signals, however, incur substantial computational overhead, require costly human annotations, and often yield limited improvement in fine-grained local details. In this paper, we argue that your data manifold is secretly a reward model. By explicitly modeling the manifold structure of high-quality Supervised Fine-Tuning (SFT) data and encouraging video latents to lie on this manifold, we derive dense, differentiable, and nearly cost-free reward signals that significantly improve video quality, particularly in mitigating low-level distortions. Our modeling builds upon Local Coordinate Coding (LCC), which captures the `skeleton' of the manifold. However, directly applying LCC suffers from mean regression, pulling latents toward the geometric mean and losing high-frequency details. We therefore extend it to Shell Local Coordinate Coding (Shell-LCC), which models the manifold `surface' as an isotropic shell to align with the true high-density region. Experiments demonstrate that our approach improves realism, enhances high-frequency details, reduces over-smoothing artifacts, and alleviates motion blur.

URL PDF HTML
2510.24803 2026-07-16 cs.MA cs.AI 版本更新

MASPRM: Multi-Agent System Process Reward Model

MASPRM:多智能体系统过程奖励模型

Milad Yazdani, Mahdi Mostajabdaveh, Zirui Zhou, Ying Xiong

发表机构 * Department of Electrical and Computer Engineering, University of British Columbia(英属哥伦比亚大学电气与计算机工程系) Huawei Technologies Canada(华为技术加拿大公司)

AI总结 MASPRM通过过程奖励模型在多智能体系统推理中提升搜索效率和质量,提高Hit@1和排序质量。

详情
AI中文摘要

多智能体系统(MAS)的实用部署需要在测试时具有强大的性能,这推动了在推理过程中引导搜索并选择性地花费计算资源以提高质量的方法。我们提出了多智能体系统过程奖励模型(MASPRM)。该模型为每个动作和每个智能体对部分智能体转录文本分配值,并在推理过程中充当控制器。MASPRM通过将回报传播到局部目标,从多智能体蒙特卡洛树搜索(MCTS)的回放中进行训练,仅使用终端结果奖励进行标记,而不需要人类的步骤级注释。在推理过程中,MASPRM指导步骤级束搜索(SBS)和MCTS,将计算重点放在有希望的分支上,并修剪不值得的分支。我们跨不同的任务和领域训练和测试MASPRM,使用GSM8K、MATH、MMLU和LogiQA作为基准。在这些基准的平均表现中,MASPRM将Hit@1超过策略似然度提高了多达+13.4个点,并提高了排序质量,将Hit@1→Hit@5的差距减少了多达10.3个点。MASPRM通过评分中间路由的转录文本来补充推理时间的搜索,以引导具有固定时间表的MAS的回放。代码:https://github.com/milad1378yz/MASPRM

英文摘要

Inference-time search over multi-agent systems (MAS) wastes compute when it cannot identify which agent's intermediate message advanced progress. We present the Multi-Agent System Process Reward Model (MASPRM), which scores routed transcripts (ordered sequences of messages between agents) and acts as an inference controller for step-level beam search (SBS) and Monte Carlo Tree Search (MCTS). MASPRM is trained from multi-agent MCTS rollouts labeled only with terminal outcome rewards, without human step-level annotations. We evaluate on GSM8K, MATH, MMLU, and LogiQA. Under matched scorer size and comparable MCTS budget, MASPRM exceeds a size-matched ORM by $+2.0$ to $+3.0$ points at 1.5B and $+4.1$ to $+14.5$ at 7B across all four benchmarks, with additional scorer-scaling gains over policy likelihood at 7B (avg $+13.4$ under MCTS). MASPRM also improves ranking quality, reducing Hit@1 to Hit@5 gaps by up to $10.3$ points, with the largest gains under stepwise search that uses intermediate decisions. Code: https://github.com/milad1378yz/MASPRM

URL PDF HTML