arXivDaily arXiv每日学术速递 周一至周五更新
全部学科分类 1922
专题追踪
大厂专区
全部
2607.14088 2026-07-16 cs.CV 新提交

VideoRAE: Taming Video Foundation Models for Generative Modeling via Representation Autoencoders

VideoRAE:通过表示自动编码器驯服用于生成建模的视频基础模型

Zhihao Xie, Junfeng Wu, Xinting Hu, Junchao Huang, Li Jiang

发表机构 * The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)) Huazhong University of Science and Technology(华中科技大学) Shenzhen Loop Area Institute(深圳环宇研究院) University of Science and Technology of China(中国科学技术大学)

AI总结 研究视频生成模型潜在空间问题,提出VideoRAE,利用冻结视频基础编码器特征经1D自注意力投影仪压缩,支持多种潜在空间,通过多码本高维量化等实现强大重建,收敛快,验证了冻结VFM表示的有效性。

Comments Home page: https://zhxie0117.github.io/VideoRAE

详情
AI中文摘要

视频生成模型通常依赖于由3D变分自动编码器(3D-VAE)学习的潜在空间。然而,传统的3D-VAE主要针对像素级重建进行优化,这可能会限制其潜在空间捕获的语义和时空结构。同时,诸如V-JEPA 2和VideoMAEv2等视频基础模型(VFM)显示出强大的视频理解能力,但其冻结表示能否转换为紧凑、具有重建能力且对生成友好的视频潜在空间在很大程度上仍未得到探索。我们通过VideoRAE回答了这个问题,它是一种表示自动编码器,利用冻结视频基础编码器的多尺度分层特征,并通过轻量级1D自注意力投影仪对其进行压缩。VideoRAE通过多码本高维量化支持扩散变压器的连续潜在空间和自回归模型的离散令牌。在解码过程中,表示自动编码器通过冻结的VFM教师改进语义保留并实现无KL正则化的训练。实验表明,VideoRAE在连续和离散模式下均实现了强大的重建。在UCF-101上,它分别使用AR和DiT生成器获得了40和93的最新类到视频gFVD,同时收敛速度比竞争的自动编码器基线快约5倍。在受控的2B规模文本到视频研究中,在可比设置下,用VideoRAE替换LTX-VAE会导致更快的收敛。这些结果验证了冻结的VFM表示作为通用且对生成友好的视频潜在空间。模型和代码将在这个https URL上发布。

英文摘要

Video generative models commonly rely on latent spaces learned by 3D Variational Autoencoders (3D-VAEs). However, conventional 3D-VAEs are mainly optimized for pixel-level reconstruction, which can limit the semantic and spatio-temporal structure captured by their latents. Meanwhile, Video Foundation Models (VFMs) such as V-JEPA 2 and VideoMAEv2 show strong video understanding capabilities, yet whether their frozen representations can be transformed into compact, reconstruction-capable, and generation-friendly video latents remains largely unexplored. We answer this question with VideoRAE, a representation autoencoder that leverages multi-scale hierarchical features from a frozen video foundation encoder and compresses them with a lightweight 1D self-attention projector. VideoRAE supports both continuous latents for Diffusion Transformers and discrete tokens for autoregressive models via multi-codebook high-dimensional quantization. During decoding, a local-and-global representation alignment objective with the frozen VFM teacher improves semantic preservation and enables training without KL regularization. Experiments show that VideoRAE achieves strong reconstruction in both continuous and discrete regimes. On UCF-101, it obtains state-of-the-art class-to-video gFVDs of 40 and 93 with AR and DiT generators, respectively, while converging approximately 5x faster than competing autoencoder baselines. In a controlled 2B-scale text-to-video study, replacing LTX-VAE with VideoRAE leads to faster convergence under comparable settings. These results validate frozen VFM representations as versatile and generation-friendly video latents. The model and code will be released on https://zhxie0117.github.io/VideoRAE.

URL PDF HTML
2607.14081 2026-07-16 cs.LG stat.ML 新提交

Linear Independent Component Analysis via Optimal Transport

通过最优传输进行线性独立成分分析

Ashutosh Jha, Michel Besserve, Simon Buchholz

发表机构 * University of Tübingen(图宾根大学) Max Planck Institute for Intelligent Systems, Tübingen(图宾根马克斯·普朗克智能系统研究所) Institute of Artificial Intelligence TU Braunschweig(布伦瑞克工业大学人工智能研究所)

AI总结 研究如何从线性混合信号中恢复独立源信号,提出用平方瓦瑟斯坦距离衡量非高斯性,基于此构建OT - ICA算法,实验表明该算法在不同分布上优于传统方法,且可用于无分布假设的应用ICA任务。

详情
AI中文摘要

线性独立成分分析(ICA)从线性混合信号中恢复联合独立的源信号。经典ICA算法通过最大化由负熵衡量的非高斯性来实现,负熵通过信息理论与独立性相关。由于精确的负熵优化难以处理,它们依赖代理对比函数,如四阶累积量和参数对数似然。本文提出用与标准高斯分布的平方瓦瑟斯坦距离$W_2^2$来衡量非高斯性。证明当投影恢复独立成分时,标准正态分布与数据线性投影之间的瓦瑟斯坦距离最大。基于此提出OT - ICA算法,通过基于梯度的优化找到该投影。对模拟数据的实证评估表明,OT - ICA在潜在变量的不同分布上优于基于代理的方法。在脑电伪迹去除和计量经济学价格发现中的应用证实了OT - ICA可用于无分布假设的应用ICA任务。

英文摘要

Linear Independent Component Analysis (ICA) recovers jointly independent source signals from their linear mixtures. To achieve this, classical ICA algorithms attempt to maximize non-Gaussianity, measured by negentropy, which is linked to independence by information theory. Because exact negentropy optimization is intractable, they rely on proxy contrast functions, such as fourth-order cumulants, and parametric log-likelihoods. We propose instead to measure non-Gaussianity using the squared Wasserstein distance $W_2^2$ to a standard Gaussian. We prove that the Wasserstein distance between a standard normal distribution and linear projections of the data is maximized when the projection recovers an independent component. Based on this observation, we propose the OT-ICA algorithm which finds this projection by gradient-based optimization. Empirical evaluation on simulated data shows that OT-ICA outperforms proxy-based methods for different distributions of the latent variables. Application to EEG artifact removal and econometric price discovery confirm OT-ICA can be used for applied ICA tasks without distributional assumptions.

URL PDF HTML
2607.14076 2026-07-16 cs.CV 新提交

From Pixels to States: Rethinking Interactive World Models as Game Engines

从像素到状态:将交互式世界模型重新思考为游戏引擎

Zhen Li, Zian Meng, Shuwei Shi, Mingliang Zhai, Jiaming Tan, Chuanhao Li, Kaipeng Zhang

发表机构 * Alaya Lab(阿亚实验室)

AI总结 本文从玩家动作控制等四个维度审视交互式游戏世界建模,分析现有方法优缺点,还为《黑神话:悟空》提供可扩展数据引擎,收集相关游戏资源用于状态感知建模,助力推动交互式游戏世界发展。

详情
AI中文摘要

构建能连贯响应玩家动作的交互式世界一直是计算机图形学、游戏和人工智能的共同目标。近期视频生成模型通过预测基于用户动作的未来观察为实现此目标提供了数据驱动路径,且渐被视为潜在的下一代游戏引擎。然而,要实现真正交互式游戏世界,需满足诸多条件。本文以循环动作 - 状态 - 观察循环为视角,从玩家动作控制、游戏状态动态、状态 - 观察持久性和实时交互式生成这四个维度审视交互式游戏世界建模,分析各维度现有方法的优缺点。此外,还为《黑神话:悟空》提供了一个可扩展数据引擎,收集了超90小时带有帧对齐玩家动作、真实游戏状态、视觉观察及结构化和语义注释的游戏玩法,作为状态感知游戏世界建模的资源,希望推动交互式游戏世界发展。

英文摘要

Building interactive worlds that respond coherently to player actions has long been a shared goal of computer graphics, games, and artificial intelligence. Recent video generative models provide a data-driven route toward this goal by predicting future observations conditioned on user actions, and are increasingly regarded as potential next-generation game engines. Realizing a genuinely interactive game world, however, requires interaction outcomes that follow rules over evolving game conditions, consequences that persist over long horizons, and a generation loop that operates in real time. Conventional game engines realize these properties through a recurrent action-state-observation loop, in which player actions update an explicit game state according to predefined rules and observations are rendered from the resulting state. Taking this loop as an organizing lens, this paper examines interactive game world modeling along four dimensions: player action control, game state dynamics, state-observation persistence, and real-time interactive generation. For each dimension, we start from the capabilities required by an interactive game world, group existing approaches into representative families, and discuss the strengths and trade-offs of each family. Complementing this analysis, we present a scalable data engine for Black Myth: Wukong that collects over 90 hours of gameplay with frame-aligned player actions, ground-truth game states, and visual observations, together with structured and semantic annotations, as a resource for state-aware game world modeling. We hope this paper offers a clear picture of where the field stands and fosters progress toward interactive game worlds.

URL PDF HTML
2607.14051 2026-07-16 cs.CL 新提交

Hindcast: Replaying Prediction Markets to Evaluate LLM Forecasters

回溯:重放预测市场以评估大语言模型预测器

Xiao Ye, Jacob Dineen, Evan Zhu, Shijie Lu, Kevin Song, Ben Zhou

发表机构 * School of Computing and Augmented Intelligence, Arizona State University(亚利桑那州立大学计算与增强智能学院)

AI总结 研究针对大语言模型预测器评估中答案泄露问题,提出Hindcast方法,通过设定特定过去日期评分,重放预测市场与Reddit快照,让模型读取特定时间前帖子并评分,解决泄露问题,且能随模型改进在新市场重新评估,明确检索在不同情况的作用。

详情
AI中文摘要

预测器通过回测进行评估,即重放已解决的问题并对系统在结果已知之前给出的概率评分。对于大语言模型,有两个渠道会将答案泄露到这个测试中。我们引入了回溯方法(Hindcast),它通过在结果在两个渠道都不存在时,将模型视为处于选定的过去日期\(t_0\)来评分,从而关闭这两个泄露渠道。回溯方法重放已解决的Polymarket预测市场与Reddit的固定快照,让模型只读取在\(t_0\)之前撰写的帖子,并根据实际发生的情况和\(t_0\)时市场自身的价格对每个预测进行评分。由于截止日期是按市场设置的且快照不变,随着模型改进,评估可以在新市场上重新运行而不会过时。关闭泄露渠道后,检索对大多数模型仍有帮助,但仅在Reddit事先讨论过该事件的地方。在存档仅包含猜测的地方,检索会产生负面影响。

英文摘要

Forecasters are evaluated by backtesting, which replays resolved questions and grades the probability the system would have assigned before the outcome was known. For LLMs, two channels leak the answer into this test. A model that retrieves can surface reports written after the event, turning forecasting into a lookup, and each new model is trained on data closer to the event, so a question that lay in the future for last year's models sits inside this year's training data. Either way, the test grades recall while claiming to grade foresight. We introduce Hindcast, which closes both leaks by grading a model as if it stood at a chosen past date $t_0$, before the outcome existed in either channel. Hindcast replays resolved Polymarket prediction markets against a frozen snapshot of public Reddit, lets the model read only posts written before $t_0$, and scores each forecast against both what happened and the market's own price at $t_0$, itself a human forecast made from the same past information. Because the cutoff is set per market and the snapshot never changes, the evaluation re-runs on new markets as models improve, without going stale. Once the leak is closed, retrieval still helps most models, but only where Reddit discussed the event beforehand. Where the archive carried only speculation, retrieval hurts.

URL PDF HTML
2607.14049 2026-07-16 cs.AI 新提交

Deep Interaction: An Efficient Human-AI Interaction Method for Large Reasoning Models

深度交互:一种用于大型推理模型的高效人机交互方法

Hefeng Zhou, Jinxuan Zhang, Jiong Lou, Yuxin Liu, Chaochao Lu, Jingjing Qu, Jie Li

发表机构 * Shanghai Artificial Intelligence Laboratory(上海人工智能实验室) Shanghai Jiao Tong University(上海交通大学)

AI总结 针对大语言模型推理出错时现有交互方法的问题,提出深度交互机制,可直接编辑原始响应并提炼精炼提示引导模型,在STEM任务推理中纠正成功率大幅提升,令牌使用量显著减少。

详情
AI中文摘要

思维链(CoT)推理的出现显著增强了大语言模型(LLMs)处理复杂多步任务的能力。然而,当出现错误时,当前交互方法通常涉及重新生成可能再次出错的另一个响应,或者用户费力地在后续轮次中标记错误步骤,这可能会得到类似“你是对的,我在这里犯了错误”的回复,随后类似错误会再次出现。为解决此问题,我们提出一种用于精确纠正LLMs推理错误的高效人工干预机制,称为深度交互。我们的方法能够直接编辑原始响应,在保留准确推理步骤的同时纠正错误部分。我们将编辑后的CoT提炼为一个精炼提示,然后引导LLM沿着纠正后的推理路径进行。实验结果表明,与基线方法相比,我们的方法在STEM任务推理中的纠正成功率提高了25%以上,令牌使用量减少了约40%。

英文摘要

The emergence of Chain-of-Thought (CoT) reasoning has significantly enhanced the ability of large language models (LLMs) to tackle complex, multi-step tasks. However, when errors occur, current interaction approaches typically involve re-generating another response that may make mistakes again, or users laboriously flag the faulty step in follow-up turns that may get responses <You are right, I made a mistake here> followed by similar errors recurring. To address this issue, we propose an efficient human intervention mechanism for precisely correcting reasoning errors in LLMs, termed Deep Interaction. Our approach enables direct editing of the original response, allowing erroneous parts to be corrected while preserving accurate reasoning steps. We refine the edited CoT into a distilled prompt, which then steers the LLM along the corrected reasoning path. Experimental results show that our method achieves over a 25% improvement in correction success rate and reduces token usage by approximately 40% on STEM tasks reasoning compared to baseline approaches.

URL PDF HTML
2607.14047 2026-07-16 cs.RO cs.HC cs.SY eess.SY 新提交

PhysClaw-0: A Symbiotic Agentic System for Robot Autonomy via Language Corrections

PhysClaw-0:一种通过语言修正实现机器人自主的共生智能体系统

Boyuan Wang, Zhenyuan Zhang, Zhiqin Yang, Peijun Gu, Shuya Wang, Xiaofeng Wang, Xianghui Ze, Yifan Chang, Guosheng Zhao, Jiangnan Shao, Guan Huang, Hengyu Liu, Yonggang Zhang, Wei Xue, Chunyuan Guan, Chenglin Pu, Yike Guo, Xingang Wang, Zheng Zhu

发表机构 * GigaAI(字节跳动人工智能实验室) University of Chinese Academy of Sciences(中国科学院大学) Hong Kong University of Science and Technology(香港科技大学) University of Leeds(利兹大学) Cornell University(康奈尔大学) Tsinghua University(清华大学) Nanjing University of Science and Technology(南京理工大学) The Chinese University of Hong Kong(香港中文大学) FAWTD(一汽技术开发部)

AI总结 研究针对自主数据收集问题,提出PhysClaw-0共生智能体系统,通过跨轮保留和重用修正、自主收集验证等方式,在真实机器人测试中减少人力时间,提高成功率,并提升验证者与人类一致性。

Comments WebPage: https://open-gigaai.github.io/PhysClaw

详情
AI中文摘要

自主数据收集决定了用于操作策略学习的真实世界轨迹的数量和质量。现有流程通过自我重置、VLM验证或语言引导修正来减少人力,但相同故障复发时需重新进行情节范围内的修复,监督成本随会话长度而非不同问题数量增长。我们提出PhysClaw-0,这是一种人机共生智能体系统,修正可跨轮保留和重用。收集循环自主收集、验证和重置,仅在阶段耗尽明确重试预算时暂停以等待远程操作员。LLM解析器将自然语言话语映射到存储在纠正记忆中的结构化调整,因此相同条件下已解决的故障模式通常无需再次修正。在真实机器人桌面清理测试平台上,PhysClaw-0在将人类工作时间减少到16%的同时,达到了遥操作情节成功率。语言修正提高了所有四种评估设置下验证者与人类的一致性,并将平均单次尝试成功率从12.5%提高到47.5%(手臂选择方面从20.)

英文摘要

Autonomous data collection governs the volume and quality of real-world trajectories for manipulation policy learning. Existing pipelines reduce human effort via self-resetting, VLM verification, or language-guided correction, yet episode-scoped fixes must be reissued whenever the same failure recurs, so oversight cost grows with session length rather than with the number of distinct problems. We present PhysClaw-0, a human-robot symbiotic agentic system in which corrections are retained and reused across rounds. The collection loop collects, verifies, and resets autonomously, pausing for a remote operator only when a phase exhausts an explicit retry budget. An LLM parser maps each natural-language utterance to a structured adjustment stored in Corrective Memory, so addressed failure modes typically need not be corrected again under the same conditions. On a real-robot desktop-clearing testbed, PhysClaw-0 matches teleoperation episode success while reducing human working time to 16%. Language corrections improve verifier-human agreement in all four evaluated settings and raise average single-attempt success from 12.5% to 47.5% (arm-selection: 20.0% to 50.0%). Policies fine-tuned on PhysClaw-0 data match teleoperation-trained policy success at a fraction of collection human cost.

URL PDF HTML
2607.14041 2026-07-16 cs.CV cs.AI cs.LG 新提交

Multi-Expert Routing for Multi-Domain Low-Resource OCR: A Manchu Case Study

多域低资源光学字符识别的多专家路由:以满文为例

Zhan Chen, Jiqiao Ma, Chih-wen Kuo

发表机构 * Institute of Advanced Studies, Beijing Normal University(北京师范大学高等研究院) Faculty of Humanities and Social Sciences, Beijing Normal University–Hong Kong Baptist University United International College (UIC)(北京师范大学-香港浸会大学联合国际学院人文与社会科学学部) Department of Applied History, National Chiayi University(国立嘉义大学应用历史系)

AI总结 针对满文OCR中书写风格多样且标注数据有限的问题,提出多专家系统,复用微调检查点为专家,用图像分类器分配页面,缺专家时额外训练,在测试集上有高精度匹配,报告相关内容使比较可重复。

Comments 14 pages, 6 figures, 3 tables

详情
AI中文摘要

历史满文光学字符识别(OCR)必须处理各种视觉上不同的书写风格,包括楷书、行书和用于宫廷奏折的半草书,尽管标注数据有限。我们研究了一种多专家系统,该系统将迭代微调过程中的检查点作为领域专家重复使用,并使用轻量级页面级图像分类器按视觉风格分配页面。当检查点池缺少合适的专家时,我们为该领域训练额外的专家。在三个冻结测试集上,路由系统在两位小数精度上与每种风格的选定专家匹配:楷书的字符错误率(CER)为0.30%,奏折为1.57%,行书为4.83%。路由器实现了99.3%的页面级领域准确率,并以相同精度与领域标签预言机匹配。三个选定专家中的两个并非专门针对其最终领域进行训练;只有行书专家是以该领域为目标进行训练的。我们报告了评估协议、路由器设计和每页预测,以使比较具有可重复性。

英文摘要

Historical Manchu OCR must accommodate various visually distinct writing styles, including regular script, running script, and the semi-cursive chancery hand used in palace memorials, despite limited labeled data. We study a multi-expert system that reuses checkpoints from an iterative fine-tuning process as domain specialists and uses a lightweight page-level image classifier to dispatch pages by visual style. When the checkpoint pool lacks a suitable specialist, we train an additional expert for that domain. On three frozen test sets, the routed system matches the selected specialist for each style at two-decimal precision: 0.30 percent CER on regular script, 1.57 percent on memorials, and 4.83 percent on running script. The router achieves 99.3 percent page-level domain accuracy and matches the domain-label oracle at the same precision. Two of the three selected specialists were not trained specifically for their final domain; only the running-script expert was trained with that domain as its target. We report the evaluation protocol, router design, and per-page predictions to make the comparison reproducible.

URL PDF HTML
2607.14024 2026-07-16 cs.LG cs.AI 新提交

Improving Wind and Solar Power Prediction with Efficient Wrapper-based Feature Selection: An Empirical Study

基于高效包装器的特征选择改进风能和太阳能预测:实证研究

Daniel Grillmeyer, Marius Hadry, Michael Stenger, Vanessa Borst, Veronika Lesch, Samuel Kounev

发表机构 * University of Würzburg(维尔茨堡大学) Baden-Wuerttemberg Cooperative State University Mosbach(巴登-符腾堡双元制应用技术大学莫斯巴赫分校)

AI总结 研究可再生能源预测问题,提出基于聚类的顺序特征选择(CSFS)方法,通过结构化文献综述分析特征选择现状,经实证评估,该方法能在可再生能源预测中实现高效可靠的特征选择,性能与SFS相当且降低计算成本。

Comments 17 pages, 5 figures

详情
AI中文摘要

随着全球能源需求上升以及对气候变化及其影响的认识不断提高,可再生能源在全球能源结构中的占比持续增长。由于其依赖环境条件,可再生能源输出难以像传统发电那样稳定控制,可靠的能源产量预测至关重要。本文报告了两项关于可再生能源预测任务的结构化文献综述结果,涵盖风力涡轮机功率曲线建模和光伏发电预测。分析发现特征选择方法有限且不系统。为此提出基于聚类的顺序特征选择(CSFS)方法,它是一种新颖的、与模型无关的、基于聚类的包装器方法,并在GitHub上提供开源实现。通过实证评估,结果表明基于包装器的方法总体上能提供更好的特征选择,CSFS性能与SFS相当且平均降低计算成本21%。

英文摘要

With rising global energy demand and growing awareness of climate change and its impacts, the share of renewable energies in the global energy mix continues to grow. Unlike conventional power generation, the output of renewable energy sources cannot be controlled as consistently due to their dependence on environmental conditions. Therefore, reliable prediction of current and future energy production is essential. In this paper, we report findings from two structured literature reviews on real-world renewable energy prediction tasks: wind turbine power curve modeling and photovoltaic power prediction. For the former, we conducted a comprehensive literature review ourselves, while for the latter, we synthesize the key findings regarding frequently selected input features based on an existing survey. Across both domains, our analysis reveals that despite the large number of available monitoring and environmental variables, only limited or unsystematic methods for feature selection exist. To address this gap, we propose Cluster-based Sequential Feature Selection (CSFS), a novel, model-agnostic, clustering-based wrapper method for automatic, efficient, and reliable feature selection in renewable energy prediction pipelines. To support reproducibility and reuse, we provide an open-source implementation of CSFS on GitHub. We empirically evaluate the proposed approach on both use cases and compare it with established feature selection techniques such as wrapper-based sequential feature selection (SFS), filter-based methods, and Random Forest's embedded feature importance. The results show that the wrapper-based methods overall provide better-performing selections of features. CSFS achieves a predictive performance comparable to SFS while reducing computational cost by an average of 21%.

URL PDF HTML
2607.14021 2026-07-16 cs.RO 新提交

Industrial Dexterity Benchmark: A Hardware-Software Benchmarking Platform for Industrial Dexterous Manipulation

工业灵巧性基准测试:一个用于工业灵巧操作的硬件-软件基准测试平台

Honglu He, Jacob Laufer, Zhiwu Zheng, David Elkan-gonzalez, Raman Goyal, Xinyi Li, Su Lu, Mishek Musa, Berke Saat, Nicolas Tan, Colm Prendergast

发表机构 * Analog Devices, Inc.(亚德诺半导体技术有限公司)

AI总结 针对工业灵巧操作瓶颈,提出从经典流程到端到端多模态模仿学习框架的转变,介绍了IDB板、DAG-ROS框架和AG-iDP3策略框架,通过数据中心电缆操作实验表明新策略在多方面优于传统方法,推动向可扩展机器人自动化发展。

详情
AI中文摘要

灵巧操作仍是工业自动化的关键瓶颈,如电缆布线等任务仍依赖人工。本文从经典模块化机器人流程向工业灵巧操作的端到端多模态模仿学习框架发展。贡献包括:一套工业灵巧性基准测试(IDB)板;可扩展模仿学习框架(DAG-ROS);多模态扩散策略框架(AG-iDP3)。以数据中心电缆操作为例评估,最佳配置多模态扩展扩散策略(DP)的抓取和插入组合任务成功率达78%,远超单相机RGB DP基线的36%,且每个任务阶段仅需约100次遥控演示。结果表明正确学习的策略在多方面优于传统方法,有利于向可扩展机器人自动化转变。

英文摘要

Dexterous manipulation remains a critical bottleneck in industrial automation; tasks such as cable routing, connector insertion, and precision assembly still rely heavily on manual labor despite decades of robotics research. This work presents a progression from classical, modular robotics pipelines toward an end-to-end multimodal imitation-learning framework for industrial dexterous manipulation. As a part of this work, we introduce three key contributions: a set of Industrial Dexterity Benchmark (IDB) boards aimed to mimic datacenter cable management, automotive cable harnesses, and gearbox assembly tasks; a scalable imitation learning framework (DAG-ROS); and a multimodal diffusion-based policy framework (AG-iDP3) that creates models fusing RGB images, point clouds, joint positions, and wrist-frame wrench data. Focusing on the datacenter cable manipulation board, we evaluate the performance of a task involving cleaning a single cable over variations of an end-to-end AI policy using 48 trials per configuration. The best performing configuration, a multimodal expansion Diffusion Policy (DP), includes a multi-view RGB image source passed through an R3M encoder and reaches a 78% grasp and insert combined task success rate. This performance marks a significant improvement over the 36% observed from the single-camera RGB DP baseline. Each of the tested configurations requires only approximately 100 teleoperated demonstrations per task phase. These results indicate that the correct learned policy can outperform classical vision and control robotic methods in robustness, generalization, and deployment efficiency, justifying a shift toward scalable robotic automation for high up-time industrial environments.

URL PDF HTML
2607.14018 2026-07-16 cs.LG cs.AI 新提交

Transforming Rank: How Architecture Navigates the Spectral Pathologies of Depth

变换秩:架构如何在深度的谱病态中导航

Katie Everett

发表机构 * MIT CSAIL(麻省理工学院计算机科学与人工智能实验室)

AI总结 研究Transformer前馈块架构设计组件在初始化时如何确定跨深度的秩保留,通过重新解释跳跃连接和归一化等,揭示架构各方面对秩的影响,将深度网络架构设计视为在秩崩溃、集成行为和参数数量间的权衡。

Comments 40 pages. Code: https://github.com/everettk/transforming-rank-paper

详情
AI中文摘要

我们研究了Transformer前馈块架构设计的每个组件如何在初始化时确定跨深度保留多少秩。我们将长期以来被理解为控制幅度的跳跃连接和归一化重新解释为跨深度保留梯度秩的机制,因为使网络具有表现力的矩阵乘法和非线性激活也会降低秩。我们表明,跳跃连接在秩崩溃和类似集成的行为之间进行权衡,由分支和跳跃的相对比例控制:跳跃连接将梯度绕过秩丢失的残差分支,而不是沿着鼓励层组合的长梯度路径。归一化层的位置通过设置跨深度的分支与跳跃比率来控制相同的权衡,统一了许多归一化位置和深度缩放文献,特别是为什么后归一化会导致秩崩溃而前归一化会使秩平稳。架构的其他方面,如扩展和收缩宽度的双矩阵结构,使用额外参数来保留表示或分支雅可比秩。第二个矩阵去相关一个连贯的平均尖峰,否则它会在具有单个矩阵和非中心激活的块中增长,防止残差表示崩溃。两个矩阵之间的宽度扩展保持分支雅可比满秩:在这个扩展空间中应用降低秩的激活会留下足够的方向来跨越原始空间,宽度遵循马尔琴科 - 帕斯特尔定律。输入 - 输出雅可比的初始化秩预测哪些网络在CIFAR - 10上训练。总之,我们将深度网络的架构设计重新塑造为在秩崩溃、类似集成的行为和参数数量之间进行内在权衡。

英文摘要

We investigate how each component of the Transformer feedforward block architecture design determines how much rank survives across depth at initialization. We reinterpret skip connections and normalization, long understood as controlling magnitude, as mechanisms for preserving gradient rank across depth, since the very matrix multiplications and nonlinear activations that make the network expressive also reduce the rank. We show that skip connections trade off rank collapse against ensemble-like behavior, controlled by the relative scales of the branch and the skip: skip connections route the gradient around the residual branch, where rank is lost, rather than along the long gradient paths that encourage the layers to compose. The placement of the normalization layer controls this same tradeoff by setting the branch-to-skip ratio across depth, unifying much of the normalization placement and depth scaling literature, in particular why rank collapses for Post-Norm but plateaus for Pre-Norm. Other aspects of the architecture, like the two-matrix structure that expands and contracts the width, use additional parameters to preserve the representation or branch Jacobian rank. The second matrix decorrelates a coherent mean spike that would grow across blocks with a single matrix and uncentered activation, preventing the residual representation from collapsing. The width expansion between the two matrices keeps the branch Jacobian full rank: applying the rank-reducing activation in this expanded space leaves enough directions to span the original, at a width that follows a Marchenko--Pastur law. The initialization rank of the input--output Jacobian predicts which networks train on CIFAR-10. Taken together, we recast architecture design for deep networks as navigating an intrinsic tradeoff among rank collapse, ensemble-like behavior, and parameter count.

URL PDF HTML
2607.14008 2026-07-16 cs.LG cs.AR 新提交

Lighthouse RL: Sample-Efficient Circuit Optimization via Strategic Reset Points

灯塔强化学习:通过策略性重置点实现样本高效的电路优化

Mustafa Emre Gürsoy, Stefan Uhlich, Ryoga Matsuo, Yağız Gençer, Arun Venkitaraman, Chia-Yu Hsieh, Andrea Bonetti, Eisaku Ohbuchi, Lorenzo Servadei

发表机构 * Sony Group Corporation(索尼集团公司) EPFL(洛桑联邦理工学院) Sony Semiconductor Solutions(索尼半导体解决方案公司) TU Munich(慕尼黑工业大学)

AI总结 研究针对模拟电路规模确定问题,提出灯塔强化学习方法,通过策略性重置策略,从高性能配置初始化情节引导探索,相比其他方法在样本效率、优化性能、通用性等方面显著提升,可增强基于强化学习的优化方法。

详情
AI中文摘要

本文介绍了灯塔强化学习(Lighthouse RL),一种用于模拟电路规模确定的样本高效强化学习方法。传统方法在不同性能目标间缺乏通用性,标准强化学习方法会在无前景区域浪费资源。我们的方法通过策略性重置策略解决这些低效问题,该策略从训练中发现的高性能配置(即“灯塔”)初始化情节。这些更接近目标的状态引导探索向有前景区域。与文献中的强化学习和贝叶斯优化方法相比,在二维基准问题和两个模拟电路上展示了方法的有效性,在样本效率、优化性能、通用性和目标最大化方面有显著提升。这种效率对计算昂贵的黑箱优化问题尤其有价值,重置策略可作为基于强化学习的优化方法的即插即用增强。

英文摘要

In this paper, we introduce Lighthouse RL, a sample-efficient reinforcement learning (RL) approach for analog circuit sizing. Traditional methods lack generalization across different performance targets, while standard RL approaches waste resources exploring unpromising regions. Our method addresses these inefficiencies through a strategic reset strategy that initializes episodes from high-performing configurations discovered during training, called "lighthouses". These states, which are closer to the target objectives, guide exploration toward promising regions. When compared to RL and Bayesian optimization methods from the literature, we demonstrate the effectiveness of our approach on a 2D benchmark problem and on two analog circuits, showing significant improvements in sample efficiency (up to 1.72x faster), optimization performance (100% vs. 0-87% success rate), generalization (75% vs. 0-50% extrapolation success), and objective maximization. This efficiency is particularly valuable for computationally expensive black-box optimization problems, and our reset strategy can be used as a plug-and-play enhancement for any RL-based optimization approach.

URL PDF HTML
2607.13988 2026-07-16 cs.LG 新提交

TRACE: Turn-level Reward Assignment via Credit Estimation for Long-Horizon Agents

TRACE:通过信用估计进行长期奖励分配的回合级奖励分配

Leitian Tao, Baolin Peng, Wenlin Yao, Tao Ge, Hao Cheng, Mike Hang Wang, Jianfeng Gao, Sharon Li

发表机构 * University of Wisconsin–Madison(威斯康星大学麦迪逊分校) Microsoft Research(微软研究院)

AI总结 研究针对多轮智能体训练后的信用分配难题,提出TRACE方法,通过特定状态转换、对数概率获取及转换等步骤进行奖励分配。该方法无需额外训练,在长期复杂搜索任务中显著提升基础模型工具使用能力,在基准测试中表现良好且学习曲线更佳。

Comments 26 pages

详情
AI中文摘要

多轮智能体通过一系列工具交互来解决复杂任务,这使得训练后的信用分配成为一个基本挑战。结果奖励对短期推理提供可靠监督,但随着轨迹增长会变得稀疏且方差大,还可能产生误导。我们提出TRACE,一种用于智能体强化学习的密集信用分配方法。TRACE将展开表示为工具调用边界处的状态转换,从冻结的参考模型获取黄金答案对数概率,将其转换为对数比率状态值,并将每个动作的奖励推导为这些值的时间差分变化。这无需额外的评论家或过程标签训练,其单步对数比率TD组件可跨冗余工具调用进行伸缩。在长期复杂搜索中,TRACE通过纯强化学习显著提高了基础模型的工具使用能力,在封闭网络BrowseComp-Plus基准测试中提升了Qwen3-4B和Qwen3-30B-A3B的性能,且学习行为可转移到开放网络基准测试,学习曲线显示在强化学习训练中更早改进和更快收敛。

英文摘要

Multi-turn agents solve complex tasks through extended sequences of tool interactions before producing a final answer, making credit assignment a fundamental challenge during post-training. Outcome rewards provide reliable supervision for short-horizon reasoning, but become sparse and high-variance as trajectories grow to tens or hundreds of tool calls. They can also be misleading: a failed rollout may contain many useful actions that move the agent closer to the goal, yet outcome-only training assigns them the same negative advantage as the eventual mistake. We propose TRACE (Turn-level Reward Assignment via Credit Estimation), a dense credit-assignment method for agentic reinforcement learning. TRACE represents rollouts as state transitions at tool-call boundaries, obtains gold-answer log-probabilities from a frozen reference model, transforms them into log-ratio state values, and derives per-action rewards as Temporal-Difference changes in those values. This requires no additional critic or process-label training, and its one-step log-ratio TD component telescopes across redundant tool calls. On long-horizon complex search, TRACE substantially improves base-model tool-use ability using pure RL, without a cold-start supervised fine-tuning stage, an agentic mid-training stage, or training on live-web data. On the closed-web BrowseComp-Plus benchmark, it raises Qwen3-4B from $7.2$ to $35.6$ and Qwen3-30B-A3B from $8.4$ to $42.6$. The learned search behavior also transfers to open-web benchmarks, and the learning curves show earlier improvement and faster convergence during RL training.

URL PDF HTML
2607.13986 2026-07-16 cs.CV 新提交

Task-Specific Feature Fusion Method for Multi-Task Affective Behavior Analysis

用于多任务情感行为分析的特定任务特征融合方法

Jiajun Sun, Zhe Gao

发表机构 * Shanghai Normal University(上海师范大学)

AI总结 针对ABAW11多任务情感行为分析,先适配预训练视觉骨干提取特征,再系统比较多种方法,最终选择特定任务融合和预测策略,在验证集上取得较好成绩,证明该策略简单有效。

Comments Extended arXiv version with an appendix. Code will be made publicly available

详情
AI中文摘要

第11届野生情感行为分析(ABAW11)多任务学习挑战要求统一系统从官方s-Aff-Wild2图像预测效价-唤醒、分类表情和面部动作单元。尽管这些任务通过面部行为自然相关,但验证实验表明它们受益于不同视觉特征等。本文研究ABAW11多任务情感行为分析的任务自适应特征融合。先在外部面向表情的面部图像集上适配两个预训练视觉骨干并冻结以从ABAW11官方数据提取互补帧级特征,然后系统比较多种预测头、时间卷积头等。最终系统选择特定任务融合和预测策略。在ABAW11验证集上取得了一定成绩,结果表明冻结视觉特征的任务自适应融合是一种简单有效的策略。

英文摘要

The 11th Affective Behavior Analysis in-the-wild (ABAW11) Multi-Task Learning Challenge requires a unified system to predict valence-arousal, categorical expressions, and facial action units from the official s-Aff-Wild2 images. Although these tasks are naturally related through facial behavior, our validation experiments show that they benefit from different visual features, temporal processing strategies, fusion mechanisms, and calibration procedures. In this paper, we study task-adaptive feature fusion for ABAW11 multi-task affective behavior analysis. We first adapt two pretrained visual backbones, DINOv2 ViT-L and DINOv3 ConvNeXt-base, on an external expression-oriented facial image set and then freeze them to extract complementary frame-level features from the official ABAW11 data. On top of these frozen features, we systematically compare frame-level prediction heads, temporal convolutional heads, post-hoc temporal smoothing, LightGBM models, feature concatenation, gated fusion, residual fusion, late logit fusion, threshold calibration, and shared MTL structures. The final system selects task-specific fusion and prediction strategies rather than forcing all tasks to share a single architecture. On the ABAW11 validation set, the selected system achieves an EXPR macro-F1 of 0.4222, an AU macro-F1 of 0.5402, and a mean VA CCC of 0.6717, resulting in an overall validation score of 1.6341. The results suggest that task-adaptive fusion of frozen visual features is a simple and effective strategy for ABAW-style multi-task affective behavior analysis.

URL PDF HTML
2607.13983 2026-07-16 cs.CV 新提交

Screening Is Effective for Visual Recognition

筛选对视觉识别有效

Shunya Shimomura, Kazuhiro Hotta

发表机构 * Meijo University(名城大学)

AI总结 研究针对视觉Transformer难以独立评估图像块相关性的问题,提出VisionScreen模型,将筛选机制扩展到视觉识别,通过二维空间域绝对相关性估计,让块选择性聚合相关块,实验证明该方法优于传统ViT,为视觉识别提供新方案。

Comments Exploratory research

详情
AI中文摘要

视觉Transformer(ViT)被广泛用作建模图像块间全局依赖关系的强大框架。但其核心组件自注意力给所有块分配softmax归一化的相对权重,难以独立评估块间相关性。在视觉识别中,图像常含背景或冗余块,自注意力无法明确排除无关块,会引入不必要信息。语言建模领域提出筛选,基于查询-键相似性独立评估每个令牌相关性并通过阈值排除低相关性令牌。本文提出VisionScreen,将筛选机制扩展到视觉识别。它将图像块视为二维网格上的令牌,将基于查询-键相似性的绝对相关性估计扩展到二维空间域。实验表明该方法优于传统ViT,说明筛选对视觉识别有效,为基于softmax注意力的相对特征聚合提供了替代方案。

英文摘要

Vision Transformer (ViT) has been widely used as a powerful framework for modeling global dependencies among image patches. However, its core component, self-attention assigns softmax-normalized relative weights to all patches, making it difficult to evaluate the relevance between patches independently. In visual recognition, images often contain many background or redundant patches, yet self-attention cannot explicitly reject such irrelevant patches, which may introduce unnecessary information into feature aggregation. To address this limitation, Screening has been proposed in the field of language modeling, where the relevance of each token is independently evaluated based on query-key similarity and low-relevance tokens are explicitly excluded through thresholding. In this work, we propose VisionScreen, a new vision model that extends Screening mechanism to visual recognition. VisionScreen treats image patches as tokens arranged on a two-dimensional grid and extends absolute relevance estimation based on query-key similarity to the two-dimensional spatial domain. This allows each patch to selectively aggregate only content-wise and spatially relevant patches without relying on competition among patches. Experiments on image classification benchmarks demonstrate that the proposed method outperforms conventional ViT. These results suggest that Screening can be effective for visual recognition, offering an alternative to relative feature aggregation based on softmax attention.

URL PDF HTML
2607.13978 2026-07-16 cs.CV cs.AI 新提交

Music-to-Dance Generation via Atomic Movements

通过原子运动生成音乐驱动的舞蹈

Xinhao Cai, Yixuan Sun, Minghang Zheng, Qingchao Chen, Xin Jin, Song-chun Zhu, Yang Liu

发表机构 * Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机研究所) School of Electronics Engineering and Computer Science, Peking University(北京大学电子工程与计算机科学学院) National Institute of Health Data Science, Peking University(北京大学健康数据科学研究所) State Key Laboratory of General Artificial Intelligence, Peking University(北京大学通用人工智能国家重点实验室) Beijing Institute for General Artificial Intelligence(北京通用人工智能研究院) School of Intelligence Science and Technology, Peking University(北京大学智能科学与技术学院)

AI总结 研究音乐驱动的舞蹈生成问题,提出结构感知框架,将编排建模为原子运动序列,经数据分割、聚类及大语言模型处理得到原子运动注释,设计两阶段生成框架,提升舞蹈生成的结构连贯性、节奏对齐和自然度,增强可解释性与可控编辑性。

详情
AI中文摘要

音乐驱动的舞蹈生成旨在产生与音乐在节奏上同步且语义上一致的人体运动。近期神经方法虽实现了令人印象深刻的视觉真实感,但将运动建模为连续信号,忽视其组成性质,导致生成的舞蹈结构不连贯且难以控制。本文引入一个结构感知框架,将编排建模为原子运动序列,即作为舞蹈构建块的语义可解释运动事件。通过分割大规模舞蹈数据并聚类成原子运动组,再用大语言模型进行语义重新标记和细化,得到可解释且可复用的原子运动。基于这些注释,设计了一个两阶段生成框架,在原子运动规划阶段预测原子运动的类型、持续时间和时间,在完成阶段生成平滑且风格连贯的运动。实验表明,该方法生成的舞蹈在结构连贯性、节奏对齐和感知自然度方面有显著提升,同时通过显式结构表示增强了可解释性和可控编辑性。

英文摘要

Music-driven dance generation aims to produce human motion that is both rhythmically synchronized and semantically consistent with music. While recent neural approaches have achieved impressive visual realism, they typically model motion as a continuous signal and neglect its compositional nature, making generated dances structurally incoherent and difficult to control. In this work, we introduce a structure-aware framework that models choreography as a sequence of atomic movements-semantically interpretable motion events that serve as the building blocks of dance. To construct this atomic movement vocabulary, we first segment large-scale dance data and cluster them into atomic movement groups. We then employ a large language model to semantically relabel and refine the clusters, yielding a set of interpretable and reusable atomic movements. Based on these atomic movement annotations, we design a two-stage generation framework that mirrors the human choreography process. In the atomic movement planning stage, the model predicts the type, duration, and timing of atomic movements conditioned on the input music, forming a symbolic dance allocation. In the completion stage, a transition-aware generator synthesizes smooth and stylistically coherent motion conditioned on the planned structure. Extensive experiments demonstrate that our method produces dances with significantly improved structural coherence, rhythmic alignment, and perceptual naturalness compared to existing baselines, while providing enhanced interpretability and controllable editing through explicit structural representation.

URL PDF HTML
2607.13977 2026-07-16 cs.CL 新提交

Constraint-Aware Counterfactual Editing for Aspect-Based Sentiment Analysis

基于方面的情感分析的约束感知反事实编辑

S M Rafiuddin, Vamsi Krishna Pavuluri, Atriya Sen

发表机构 * Oklahoma State University(俄克拉荷马州立大学)

AI总结 研究基于方面的情感分析中的反事实评估难题,提出CAVE-ABSA框架,通过定位观点跨度、可控重写、修复优化、多维度过滤等生成和验证方面级反事实,用于数据集构建及测试模型情感推理能力。

Comments 15 pages, 1 figure, and 5 tables. Accepted for presentation at the 2nd International Workshop on Informing ML with Knowledge Engineering for Hybrid Intelligent Systems (HHAI-KEML 2026), Brussels, Belgium

详情
AI中文摘要

基于方面的情感分析(ABSA)要求模型识别对特定方面的情感,而非依赖句子的全局极性。这使得反事实评估极具挑战性:有效的反事实应翻转一个目标方面的情感,同时保留所有非目标方面的情感、语义含义、流畅性和事实一致性。现有反事实生成方法常聚焦句子级标签翻转且可能产生方面无效、语义漂移或矛盾的编辑。为解决此局限,我们提出CAVE-ABSA,一个用于生成和验证方面级反事实的约束感知验证编辑框架。CAVE-ABSA定位与目标方面相关的观点跨度,进行可控的反事实重写,通过修复模块优化候选,并使用方面级验证、语义相似性、AMR引导的结构保留、编辑最小化、流畅性和矛盾检测进行过滤。该框架旨在构建用于鲁棒性评估和数据增强且经过验证的反事实ABSA数据集。通过明确分离生成与验证,CAVE-ABSA为生成有意义的方面局部反事实以及测试ABSA模型是否真正依赖基于方面的情感推理提供了原则性方法。

英文摘要

Aspect-Based Sentiment Analysis (ABSA) requires models to identify sentiment toward specific aspects rather than relying on the global polarity of a sentence. This makes counterfactual evaluation especially challenging: a valid counterfactual should flip the sentiment of one target aspect while preserving the sentiment of all non-target aspects, semantic meaning, fluency, and factual consistency. Existing counterfactual generation methods often focus on sentence-level label flipping and may produce edits that are fluent but aspect-invalid, semantically drifting, or contradictory. To address this limitation, we propose CAVE-ABSA, a Constraint-Aware Validated Editing framework for generating and validating aspect-level counterfactuals. CAVE-ABSA localizes the opinion span associated with the target aspect, performs controlled counterfactual rewriting, refines candidates through a repair module, and filters them using aspect-level verification, semantic similarity, AMR-guided structural preservation, edit minimality, fluency, and contradiction detection. The framework is designed to construct validated counterfactual ABSA datasets for robustness evaluation and data augmentation. By explicitly separating generation from validation, CAVE-ABSA provides a principled approach for producing meaningful aspect-local counterfactuals and for testing whether ABSA models truly rely on aspect-grounded sentiment reasoning.

URL PDF HTML
2607.13967 2026-07-16 cs.CL 新提交

DeltaMerge-LowRes: Composing Language and Task Deltas for Low-Resource Adaptation

DeltaMerge-LowRes:为低资源适应组合语言和任务增量

Son Ha Xuan, Xuan-Bach Le, Phat T. Tran-Truong

发表机构 * RMIT University(皇家墨尔本理工大学) Faculty of Computer Science and Engineering, Ho Chi Minh City University of Technology (HCMUT), VNU-HCM(胡志明市理工大学计算机科学与工程学院,越南胡志明市国家大学)

AI总结 研究如何在低资源下将多语言编码器适应新语言和任务,提出DeltaMergeLowRes方法,分别学习语言和任务增量并通过多种规则组合。实验表明跨轴TIES能提升摘要任务表现,稀疏感知合并可降低分类ECE,组合规则影响模型特性。

详情
AI中文摘要

在自然语言处理中,将多语言编码器适应新语言和新任务,同时仅有几百个标注示例,这是常见的低资源设置。然而,通常通过昂贵的语言 - 任务微调来融合两者。本文提出能否分别训练并在权重空间中重新组合。DeltaMergeLowRes从无标注单语文本学习语言增量ΔL,从标注英语数据学习任务增量ΔT,在推理时通过加法、激活引导、稀疏感知和新的跨轴TIES这四种规则组合它们。在四个任务族和四种非洲语言上进行实验,结果表明跨轴TIES在3/4的语言上的摘要任务中表现出色,提升了问答任务的F1和EM,稀疏感知合并在相同宏观F1下将分类ECE降低了36%。组合规则显著改变了合并模型保留、抑制和校准的内容。最后还发布了所有JSON跟踪和声明账本。

英文摘要

Adapting a multilingual encoder to a new language \emph{and} a new task with only a few hundred gold examples is a common low-resource NLP setting, yet the two axes are usually fused via an expensive language--task fine-tuning run. We ask whether they can instead be trained separately and recombined in weight space. \DeltaMergeLowRes{} learns a language delta $Δ_L$ from unlabeled monolingual text and a task delta $Δ_T$ from labeled English data, then composes them at inference under one of four rules: additive, activation-guided, sparsity-aware, and a novel \emph{cross-axis TIES}. The new rule adapts the TIES-Merging steps of trimming, sign election, and merging to the language and task axes rather than to two task axes. Holding $(Δ_L,Δ_T)$ fixed across rules on four task families and four African languages ($158$ evaluated cells, $10{,}000$-sample paired bootstrap per cell), we find: (i) cross-axis TIES wins summarisation on $3/4$ languages by $+4$ to $+7$ chrF (chrF $18.59$ vs.\ $13.80$ task-only); (ii) it improves QA F1 by $+2.32$ and EM by $+2.91$; and (iii) sparsity-aware merging cuts classification ECE by $36\%$ at parity macro-F1. The composition rule materially changes what the merged model preserves, suppresses, and calibrates. We release all JSON traces and a claim ledger.

URL PDF HTML
2607.13960 2026-07-16 cs.RO 新提交

GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearch

GigaWorld-Policy-0.5:由自动研究赋能的更快更强的世界行动模型

GigaWorld Team, Angen Ye, Angyuan Ma, Boyuan Wang, Chaojun Ni, Fangzheng Ye, Guan Huang, Guo Li, Guosheng Zhao, Haodong Yan, Hengtao Li, Jiwen Lu, Kai Wang, Mingming Yu, Qitang Hu, Qiuping Deng, Songling Liu, Xiaoyu Tian, Xiaofeng Wang, Xinyu Zhou, Xiuwei Xu, Xinze Chen, Yang Wang, Yejun Zeng, Yifan Chang, Yun Ye, Zhenyu Wu, Zhanqian Wu, Zheng Zhu

发表机构 * GigaAI(字节跳动人工智能实验室) Tsinghua University(清华大学)

AI总结 研究旨在改进机器人策略学习,提出GigaWorld-Policy-0.5这一增强型以动作中心的WAM。预训练采用混合策略加强视觉与动作耦合,推理引入新架构提升效率,还用自动研究管道搜索训练配置,有效提升了机器人控制推理效率并保留训练优势。

Comments project page: https://open-gigaai.github.io/giga-world-policy/

详情
AI中文摘要

世界行动模型(WAMs)通过联合对动作和未来视觉观察进行建模,利用未来场景演变作为物理基础动作生成的密集监督,来改进机器人策略学习。然而,现有WAMs的常见设计是在推理时显式生成未来视频,这会带来大量计算开销并阻碍实时闭环部署。GigaWorld-Policy以以动作中心的公式解决此问题,训练时使用未来视觉动态,推理时仅使用动作解码。在此框架基础上,提出了GigaWorld-Policy-0.5,一种为更高效机器人控制设计的增强型以动作中心的WAM。预训练时,采用混合动作条件世界建模(AC-WM)和WAM训练策略,加强视觉动态与机器人动作之间的耦合,提高动作表示对下游策略学习的可迁移性。为实现高效推理,引入了Transformer混合架构,将视觉动态建模和动作生成分离为专门的专家,减少仅动作推理期间的主动计算,在本地RTX 4090设置上实现85毫秒的推理延迟。此外,采用基于代理的自动研究管道系统地搜索训练配置,更高效地识别最佳实验设置,减少超参数调整所需的时间和人工干预。实验和消融表明,GigaWorld-Policy-0.5在提高机器人控制推理效率的同时,保留了未来视觉动态的训练优势。

英文摘要

World Action Models (WAMs) improve robot policy learning by jointly modeling actions and future visual observations, using future scene evolution as dense supervision for physically grounded action generation. However, a common design in existing WAMs is to explicitly generate future videos at inference time, incurring substantial computational overhead and hindering real-time closed-loop deployment. GigaWorld-Policy addresses this issue with an action-centered formulation, where future visual dynamics are used during training while action-only decoding is used at inference time. Building upon this framework, we present GigaWorld-Policy-0.5, an enhanced action-centered WAM designed for more efficient robot control. During pretraining, GigaWorld-Policy-0.5 adopts a mixed Action-Conditioned World Modeling (AC-WM) and WAM training strategy. This strengthens the coupling between visual dynamics and robot actions and improves the transferability of action representations for downstream policy learning. For efficient inference, GigaWorld-Policy-0.5 introduces a Mixture-of-Transformers architecture that separates visual dynamics modeling and action generation into specialized experts, reducing active computation during action-only inference and achieving 85 ms inference latency on a local RTX 4090 setup. In addition, we employ an agent-based AutoResearch pipeline to systematically search training configurations, enabling more efficient identification of optimal experimental setups while reducing the time and manual intervention required for hyperparameter tuning. Experiments and ablations show that GigaWorld-Policy-0.5 preserves the training benefits of future visual dynamics while improving inference efficiency for robot control.

URL PDF HTML
2607.13941 2026-07-16 cs.CV 新提交

Peak-End-Net: A Peak-End Rule Inspired Framework for Generalizable Video Aesthetic Assessment

峰值-结尾网络:一种受峰值-结尾规则启发的通用视频美学评估框架

Geng Li, Haiwen Li, Rui Chen, Jing Tang, Lei Sun, Xiangxiang Chu

发表机构 * Alibaba Group(阿里巴巴集团) Beijing University of Posts and Telecommunications(北京邮电大学)

AI总结 研究视频美学评估问题,提出受峰值-结尾规则启发的Peak-End-Net框架,通过引入预训练IAA头部、设计美学节奏编码器和动态门控融合机制,基于冻结ViT实现,在实验中取得最优性能。

Comments Accepted to ACM MM 2026, Code: https://github.com/AMAP-ML/Peak-End-Net

详情
AI中文摘要

视频美学评估(VAA)旨在预测视频的美学吸引力,但与其他视觉评估任务相比,其探索较少。其进展受到大规模基准稀缺以及美学判断内在主观性的阻碍。本文从心理学角度重新审视VAA,提出了受峰值-结尾规则启发的轻量级且可解释的框架Peak-End-Net。通过引入预训练的图像美学评估(IAA)头部来生成逐帧美学先验,设计美学节奏编码器以及动态门控融合机制,该方法基于冻结的视觉Transformer(ViT),参数少且可扩展。在两个现有VAA基准上的大量实验表明其达到了当前最优性能。

英文摘要

Video aesthetic assessment (VAA) aims to predict how aesthetically pleasing a video is, yet remains far less explored than other visual assessment tasks. Its progress is hindered not only by the scarcity of large-scale benchmarks, but also by the intrinsic subjectivity of aesthetic judgment, which is shaped by human perception. In this paper, we revisit VAA from a psychological perspective and propose \textit{Peak-End-Net}, a lightweight and interpretable framework inspired by the \textit{peak-end rule}, which suggests that people tend to judge a temporal experience mainly according to its salient moments and the ending. Building on this intuition, we first transfer knowledge from image aesthetic assessment (IAA) to VAA by introducing a pretrained IAA head to produce frame-wise aesthetic priors, which serve as surrogate signals for identifying aesthetically salient moments and guiding \textit{peak-end rule}-based temporal aggregation. To further capture how a video evolves aesthetically over time, we design an aesthetic rhythm encoder that models temporal progression beyond isolated moments. Additionally, we refine the overall assessment through a dynamic gated fusion mechanism to improve robustness under distribution shift. Our method is built on a frozen vision transformer (ViT) and requires only a small number of trainable parameters, making it scalable and parameter-efficient. Extensive experiments on two existing VAA benchmarks, including in-domain evaluation on VADB and cross-domain testing on DIVIDE-3K, demonstrate that our approach achieves state-of-the-art performance, affirming the value of psychologically grounded modeling for VAA. Our code and models are available at https://github.com/AMAP-ML/Peak-End-Net.

URL PDF HTML
2607.13940 2026-07-16 cs.AI 新提交

A Self-Evolving Agent for Longitudinal Personal Health Management

一种用于纵向个人健康管理的自我进化智能体

Haoran Li, Jiebi Deng, Tong Jin, Jinghong Han, Yuxin Wang, Zexin Wang, Qingyi Si, Weikang Gong, Xiahai Zhuang, Jia You, Wei Cheng, Jianfeng Feng, Hongcheng Guo

发表机构 * School of Data Science, Fudan University(复旦大学数据科学学院) School of Life Sciences, Beijing University of Chinese Medicine(北京中医药大学生命科学学院) Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University(复旦大学脑科学与智能技术研究院) School of Computer Science and Technology, Huazhong University of Science and Technology(华中科技大学计算机科学与技术学院) JD.com, Inc.(京东公司) Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, Fudan University, Ministry of Education(复旦大学计算神经科学与类脑智能教育部重点实验室) Department of Neurology, Huashan Hospital, Fudan University(复旦大学附属华山医院神经内科)

AI总结 研究针对多数健康AI系统孤立处理请求的问题,开发开源智能体架构HealthClaw,通过自我进化更新支持,经合成基准和生物医学任务评估,在准确率、隐私性及任务指标增益上表现出色,支持纵向个人健康智能体的自我进化记忆。

Comments 20 pages, 4 figures, 6 supplementary tables. Code: https://github.com/HC-Guo/HealthClaw

详情
AI中文摘要

个人健康管理是在反复接触中展开的,但大多数健康人工智能系统孤立地处理每个请求。我们开发了HealthClaw,这是一种开源智能体架构,它会随着个人日常、偏好、测量和风险的变化更新支持。它将共享安全规则和医学知识与包含个人资料事实、可重复使用程序和情景痕迹的私人纵向记忆分开。每次事件后,归纳法决定应更新个人资料、修订程序、保留情景还是排除。我们用合成的一年期基准和九个200例生物医学任务评估了HealthClaw。在900次纵向支持探测中,答案准确率从当前查询提示的0.2%提高到HealthClaw的45.7%,同时提示侧上下文暴露比全历史提示低71.7%。在100次隐私探测中,HealthClaw产生了更高的隐私感知答案质量和更少的不安全披露。在生物医学任务中,特定任务主要指标的平均绝对增益为27.0个百分点,经过错误发现率校正后,七个增益仍然显著。这些离线基准支持纵向个人健康智能体的受治理、自我进化记忆,尽管临床有效性需要前瞻性评估。HealthClaw可在这个https网址公开获取。

英文摘要

Personal health management unfolds over repeated encounters, yet most health AI systems treat each request in isolation. We developed HealthClaw, an open-source agent architecture that updates support as a person's routines, preferences, measurements and risks change. It separates shared safety rules and medical knowledge from private longitudinal memory containing profile facts, reusable procedures and episodic traces. After each episode, induction determines what should update the profile, revise a procedure, remain episodic or be excluded. We evaluated HealthClaw with a synthetic year-long benchmark and nine 200-case biomedical tasks. Across 900 longitudinal support probes, answer accuracy increased from 0.2% with current-query prompting to 45.7% with HealthClaw, while prompt-side context exposure was 71.7% lower than with full-history prompting. In 100 privacy probes, HealthClaw produced higher privacy-aware answer quality and fewer unsafe disclosures than both baselines. Across the biomedical tasks, the mean absolute gain in the task-specific primary metric was 27.0 percentage points, and seven gains remained significant after false-discovery-rate correction. These offline benchmarks support governed, self-evolving memory for longitudinal personal health agents, although clinical effectiveness requires prospective evaluation. HealthClaw is publicly available at https://github.com/HC-Guo/HealthClaw.

URL PDF HTML
2607.13938 2026-07-16 cs.RO 新提交

Discriminative Barrier Functions for Safe Adversarial Imitation Learning from Observation

用于从观察中进行安全对抗模仿学习的判别障碍函数

Anubhav Vishwakarma, Bhaumik Mehta, Caleb Hsu, Byron Boots, Karen Leung, Tyler Han

发表机构 * University of Washington(华盛顿大学)

AI总结 研究针对逆强化学习不安全及控制障碍函数设计难的问题,通过将奖励函数候选限制在CBF空间,实现安全在线控制与经验改进,能从无标签观察中恢复障碍函数,模拟实验显示其安全性能提升,并研究了不同IRL方法的权衡。

Comments 20 pages, 5 figures

详情
AI中文摘要

逆强化学习(IRL)算法是从专家示范中学习和泛化的强大工具,但通常依赖无约束探索,对实际部署不安全。同时,控制障碍函数(CBF)可保证控制系统安全,但其解析设计耗时且深奥。本文通过在IRL中将奖励函数候选限制在CBF空间来共同解决这些限制,实现具有持续经验改进的安全在线控制。关键是,该框架能直接从无标签专家观察中数据驱动恢复障碍函数。实验表明,恢复的障碍函数对专家数据中完全不存在的不安全状态具有鲁棒性,在模拟导航环境中安全性能优于标准IRL基线,并研究了基于规划与基于策略的IRL方法在模拟和现实世界避障任务中的权衡。

英文摘要

Inverse Reinforcement Learning (IRL) algorithms are powerful tools for learning from and generalizing expert demonstrations, but they often rely on unconstrained exploration, rendering them unsafe for real-world deployment. Meanwhile, Control Barrier Functions (CBFs) can guarantee the safety of control systems, but the analytical design of CBFs can be time-consuming and esoteric. In this work, we address these limitations jointly by constraining reward function candidacy during IRL to the space of CBFs, yielding a formulation that exhibits safe online control with continuous experiential improvement. Crucially, this framework enables the data-driven recovery of barrier functions directly from unlabeled expert observations. We demonstrate that the recovered barrier function is robust to unsafe states entirely absent from the expert data. Furthermore, we benchmark our method against standard IRL baselines in a simulated navigation environment, demonstrating improved safety performance. Finally, we investigate the trade-offs of planning-based versus policy-based IRL methods across both simulation and a real world obstacle avoidance task.

URL PDF HTML
2607.13931 2026-07-16 cs.CV 新提交

SIVA-RL: Sensitivity-Invariance Visual Alignment for Multimodal Reinforcement Learning

SIVA-RL:用于多模态强化学习的灵敏度不变视觉对齐

Cheng Tang, Junzhi Ning, Min Cen, Wei Li, Xinyi Zeng, Pinxian Zeng, Rongbin Li, Qiming Zhu, Yuqiang Li, Junjun He, Yirong Chen, Ming Hu

发表机构 * Shanghai Artificial Intelligence Laboratory(上海人工智能实验室) Shanghai Jiao Tong University(上海交通大学) Sichuan University(四川大学) The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)) University of Macau(澳门大学)

AI总结 研究多模态强化学习中视觉语言模型预测与视觉证据结合问题,提出SIVA-RL框架,通过特定方法构建局部干预并以奖励下降为权重驱动对齐,在多基准测试中相比基线改进了模型。

Comments 27 pages, 11 figures

详情
AI中文摘要

具有可验证奖励的强化学习(RLVR)推动多模态推理,但答案级别的正确性并不能保证视觉语言模型的预测基于视觉证据。现有的视觉干预方法对比原始图像和修改后图像上的策略行为,但按干预类型而非观察到的效果分配监督。我们提出了SIVA-RL,一种灵敏度不变视觉对齐框架,用逐样本、基于结果的监督取代基于算子的正则化。SIVA-RL通过令牌对齐、距离受限的图像内PatchSwap构建局部干预。然后,一个冻结的审计策略对每个干净-干预对进行评分,观察到的奖励下降成为软路由权重。大下降对驱动灵敏度对齐,小下降对驱动干净锚定的不变性对齐,模糊对权重降低。该设计将干预构建与监督分配解耦,与GRPO和DAPO主干兼容。在九个多模态推理基准测试中,SIVA-RL在每种设置下都比匹配的RL基线改进了3B和7B模型。在基于视觉的推理上提高了8.79个百分点,在所有四种基于GRPO和DAPO的配置中总体相对提高了14.9%。

英文摘要

Reinforcement learning with verifiable rewards (RLVR) drives multimodal reasoning, but answer-level correctness does not guarantee that a vision-language model grounds its predictions in visual evidence. Existing visual-intervention methods contrast policy behavior on original and modified images, yet assign supervision by the type of intervention rather than its observed effect. This assumption fails: identical operators produce heterogeneous outcomes across samples. We propose SIVA-RL, a Sensitivity-Invariance Visual Alignment framework that replaces operator-conditioned regularization with sample-wise, outcome-conditioned supervision. SIVA-RL constructs localized interventions through token-aligned, distance-constrained within-image PatchSwap. A frozen audit policy then scores each clean-intervention pair, and the observed reward drop becomes soft routing weights. Large-drop pairs drive sensitivity alignment, low-drop pairs drive clean-anchored invariance alignment, and ambiguous pairs are down-weighted. This design decouples intervention construction from supervision assignment and is compatible with both GRPO and DAPO backbones. Across nine multimodal reasoning benchmarks spanning mathematical, logical, and vision-dependent tasks, SIVA-RL improves 3B and 7B models over matched RL baselines in every setting. It yields an 8.79 percentage-point gain on vision-dependent reasoning and up to 14.9% relative overall improvement across all four GRPO- and DAPO-based configurations.

URL PDF HTML
2607.13927 2026-07-16 cs.CV 新提交

Cyclone: Diffusion Model for Cycle-Consistent Weather Editing from Unpaired Driving Data

Cyclone:基于未配对驱动数据的循环一致天气编辑扩散模型

Thang-Anh-Quan Nguyen, Moussab Bennehar, Luis Guillermo Roldao Jimenez, Nathan Piasco, Dzmitry Tsishkou, Laurent Caraffa, Jean-Philippe Tarel, Roland Brémond

发表机构 * Huawei Paris Research Center(华为巴黎研究中心) Gustave Eiffel University(古斯塔夫·埃菲尔大学) IGN-ENSG(法国国家地理信息与森林和环境信息研究所)

AI总结 针对自动驾驶系统在不同天气条件下可靠感知的挑战,提出Cyclone框架,基于潜在扩散,利用循环一致约束和图像-文本模型知识,无需配对数据生成多种天气条件,实验表明其输出更优,还可提炼为视频扩散模型。

Comments Project page: https://ntaquan0125.github.io/weather-cyclone/

详情
AI中文摘要

在不同天气条件下的可靠感知仍然是自动驾驶系统的一个主要挑战。一种提高鲁棒性的常见策略是为训练感知模型合成不利天气条件,或应用天气去除技术来恢复干净的输入。然而,现有方法通常依赖于合成数据增强或基于物理的特定任务模型,这些模型需要配对的训练数据,并且往往难以生成逼真的天气效果或稳健地推广到域外场景。针对这个问题,我们提出了Cyclone,一个基于潜在扩散的天气编辑统一框架,配备了循环一致约束和来自图像-文本模型的知识。Cyclone能够在不同场景中生成多种天气条件,同时无需配对数据。实验结果表明,我们的方法比现有基线产生更逼真、保留结构的输出,并在几个下游驾驶感知任务中带来一致的改进。此外,我们证明Cyclone可以提炼为一个用于时间一致天气编辑的视频扩散模型。

英文摘要

Reliable perception under diverse weather conditions remains a major challenge for autonomous driving systems. A common strategy to improve robustness is either to synthesize adverse weather conditions for training perception models or to apply weather-removal techniques to recover clean inputs. However, existing approaches typically rely on synthetic data augmentation or physics-based, task-specific models that require paired training data and often struggle to generate realistic weather effects or generalize robustly to out-of-domain scenarios. Toward this problem, we present Cyclone, a unified framework for weather editing based on latent diffusion, equipped with cycle-consistent constraints and knowledge from image-text models. Cyclone enables the generation of multiple weather conditions across diverse scenes while eliminating the need for paired data. Experimental results show that our approach produces more realistic, structure-preserving outputs than existing baselines and leads to consistent improvements across several downstream driving perception tasks. Furthermore, we demonstrate that Cyclone can be distilled to a video diffusion model for temporally consistent weather editing.

URL PDF HTML
2607.13926 2026-07-16 cs.RO 新提交

S-squared-VLA: Decoupling Semantic and Spatial Streams in Vision-Language-Action Models for Autonomous Driving

S平方-VLA:自动驾驶视觉-语言-动作模型中语义与空间流的解耦

Jianguo Yu, Rukang Wang, Duanfeng Chu, Chen Wang, Renju Feng, Liping Lu

发表机构 * School of Mechanical and Electronic Engineering, Wuhan University of Technology(武汉理工大学机电工程学院) Intelligent Transportation Systems Research Center, Wuhan University of Technology(武汉理工大学智能交通系统研究中心) School of Computer Science and Artificial Intelligence, Wuhan University of Technology(武汉理工大学计算机科学与人工智能学院)

AI总结 研究针对自动驾驶中视觉语言模型生成低级控制动作的局限,提出S平方-VLA解耦语义和空间流,语义流用于意图推理,空间流保留空间特征并赋予先验,双流规划适配器融合二者,在基准测试中取得新的最先进水平,优于基线。

详情
AI中文摘要

视觉语言模型(VLMs)在自动驾驶高级推理中潜力显著,但在生成精确低级控制动作上存在局限,源于离散语言令牌与连续轨迹规划的不匹配导致的语义-物理差距。视觉语言动作(VLA)架构试图弥合差距,却造成新瓶颈,标准VLA存在空间表示崩溃。为此提出S平方-VLA,解耦语义和空间流。语义流利用分层桥接提取多尺度VLM特征进行意图推理,空间流绕过自回归语言瓶颈,保留视觉编码器的未压缩空间特征,通过辅助感知监督赋予模型丰富空间和几何先验,双流规划适配器融合语义意图与空间约束。在NAVSIM闭环基准测试中,S平方-VLA在纯监督微调设置下取得新的VLA模型最先进水平,缓解了传统VLMs的空间表示崩溃,显著优于基线。

英文摘要

Vision-Language Models (VLMs) have demonstrated remarkable potential for high-level reasoning in autonomous driving, yet they fundamentally struggle to generate precise, low-level control actions. This limitation is rooted in a semantic-physical gap caused by the inherent mismatch between discrete language tokens and continuous trajectory planning. While Vision-Language-Action (VLA) architectures attempt to bridge this gap by unifying perception and control into a single policy, this entanglement creates a new bottleneck. Standard VLAs experience a severe spatial representation collapse, which irreversibly degrades the fine-grained spatial and geometric priors essential for safe, boundary-aware navigation. To address this limitation, we propose the S-squared-VLA, which explicitly decouples the semantic and spatial streams in Vision-Language-Action models. The semantic stream leverages hierarchical bridging to extract multi-scale VLM features for robust intent reasoning. In parallel, an independent spatial stream bypasses the autoregressive language bottleneck, directly preserving uncompressed spatial features from the visual encoder. By integrating auxiliary perception supervision, this stream explicitly equips the model with rich spatial and geometric priors. Finally, a dual-stream planning adapter fuses high-level semantic intent with precise spatial constraints via cascaded attention mechanisms. Evaluations on the NAVSIM closed-loop benchmark show that S-squared-VLA achieves a Predictive Driver Model Score (PDMS) of 87.1, establishing a new state-of-the-art for VLA models under a purely supervised fine-tuning (SFT) setting. By mitigating the spatial representation collapse of traditional VLMs, our framework significantly outperforms baselines, achieving the highest No Collision (NC) rate of 98.4 among all evaluated methods.

URL PDF HTML
2607.13925 2026-07-16 cs.CV 新提交

Thresholded Cross-Attention for Reliable Intensity-Chromaticity Fusion in Low-Light Image Enhancement

用于低光图像增强中可靠强度-色度融合的阈值交叉注意力

Yanyi Wu, Xu Zhang, Junkai Chen, Laibin Chang, Jiaqi Ma, Shi Chen, Linwei Zhu, Jianglei Di, Huan Zhang

发表机构 * School of Information Engineering, Guangdong University of Technology(广东工业大学信息工程学院) School of Computer Science, Wuhan University(武汉大学计算机科学学院) Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学) Department of Computer Science, University of Macau(澳门大学计算机科学系) Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院)

AI总结 研究低光图像增强中强度与色度融合问题,提出TCA-Net网络,核心为阈值交叉注意力,通过固定置信度阈值自适应保留高置信度跨流交互,还有互补设计及正则化,实验证明该网络在恢复精度、颜色保真度和参数大小方面表现出色。

详情
AI中文摘要

低光图像增强需要在噪声抑制、颜色保真度和效率之间谨慎平衡。基于HVI的方法通过解耦强度和色度来减轻颜色纠缠,但两流再次融合的可靠性是一个被忽视的因素,很大程度上决定了最终质量。我们发现跨流注意力的置信度强烈依赖层,因此Top-K稀疏注意力的固定配额选择与之不匹配。基于此,我们提出TCA-Net,围绕阈值交叉注意力构建,以在HVI空间中实现可靠的强度-色度融合。其核心是用固定置信度阈值取代刚性Top-K配额,保留高置信度跨流交互。此外还有两个互补设计以及尺度感知一致性正则化。实验表明TCA-Net具有竞争力的恢复精度、更高的颜色保真度和紧凑的参数大小。

英文摘要

Low-Light Image Enhancement (LLIE) requires a careful balance among noise suppression, color fidelity, and efficiency. Recent HVI-based methods alleviate color entanglement by decoupling intensity and chromaticity, yet how reliably the two streams are fused again is an overlooked factor that largely determines the final quality. We observe that the confidence of cross-stream attention is strongly layer-dependent, so the fixed-quota selection of Top-K sparse attention is mismatched to it, discarding informative dependencies in some layers while retaining noisy ones in others. Motivated by this observation, we propose TCA-Net, a network built around Thresholded Cross-Attention that targets reliable intensity-chromaticity fusion in the HVI space rather than introducing yet another color representation. At its core, TCA replaces the rigid Top-K quota with a fixed confidence threshold whose retained cardinality is input- and layer-adaptive, retaining only high-confidence cross-stream interactions while suppressing unreliable ones. Around this core, two complementary designs clean up the fusion before and after it: a Phase-guided Fourier Interaction Module provides a structure-aware brightness initialization for the intensity stream prior to fusion, and a Decoupled Dual-Stream Guidance Module constructs residual intensity features to suppress chromaticity leakage during reconstruction. A Scale-Aware Consistency Regularization further improves structural robustness under scale perturbations during training. Extensive experiments on LOL-v1, LOL-v2, Sony-Total-Dark, and LSRW-Huawei demonstrate that TCA-Net delivers competitive restoration accuracy, improved color fidelity, and a compact parameter size.

URL PDF HTML
2607.13919 2026-07-16 cs.LG 新提交

An Efficient Newton Algorithm for Nonnegative Matrix Factorization with the Kullback-Leibler Divergence

一种基于Kullback-Leibler散度的非负矩阵分解高效牛顿算法

Damien Lesens, Jérémy E. Cohen, Bora Uçar

发表机构 * ENS de Lyon(里昂高等师范学校) CNRS and LIP (UMR5668, Université de Lyon - ENS de Lyon - UCBL - CNRS - Inria)(法国国家科学研究中心和里昂信息学实验室(联合研究单位5668,里昂大学 - 里昂高等师范学校 - 里昂中央理工学院 - 法国国家科学研究中心 - 法国国家信息与自动化研究所))

AI总结 研究非负矩阵分解,针对多数KL-NMF算法用可分离主元找迭代已达极限的问题,提出用损失的二阶泰勒展开,通过推广HALS算法最小化不可分离替代函数,得到高效且收敛的KL-NMF算法,在多数据集上表现良好。

Comments 35 pages, 8 figures

详情
AI中文摘要

非负矩阵分解(NMF)是无监督学习中的一个基本工具,它通过两个低秩非负因子的乘积来近似一个非负矩阵。当分解的数据样本服从泊松分布时,Kullback-Leibler(KL)散度最适合衡量数据与模型的差异,这在词项-文档矩阵或图像等计数数据集的情况下成立。文献中的大多数KL-NMF算法通过最小化损失的可分离主元来找到下一次迭代。我们认为这种方法已达到极限,建议改为使用损失的二阶泰勒展开,从而得到一种牛顿型方法。我们通过提出著名的HALS算法的推广来最小化这个不可分离的替代函数。这产生了一种高效的KL-NMF算法,该算法可证明收敛,并且在各种数据集上与现有算法相比具有优势。

英文摘要

Nonnegative Matrix Factorization (NMF) is a fundamental tool in unsupervised learning, which approximates a nonnegative matrix by the product of two low-rank nonnegative factors. The Kullback-Leibler (KL) divergence is best suited to measure the data to model discrepancy when the decomposed data sample follows a Poisson distribution, which is the case for count datasets such as term-document matrices or images. Most KL-NMF algorithms in the literature minimize a separable majorant of the loss to find their next iterate. We argue that this method has reached its limits and propose to use instead the second-order Taylor expansion of the loss, leading to a Newton-type method. We minimize this non-separable surrogate by proposing a generalization of the well-known HALS algorithm. This yields an efficient KL-NMF algorithm which provably converges and which competes favorably with state-of-the-art algorithms on a large variety of datasets.

URL PDF HTML
2607.13905 2026-07-16 cs.CV cs.LG 新提交

The 2nd International StepUP Competition for Biometric Footstep Recognition: From Steps to Strides

第二届生物特征足迹识别国际StepUP竞赛:从单步到跨步

Robyn Larracy, Anant Gupta, Gourav Gupta, Ethan Eddy, Maxime Devanne, Cyril Meyer, Jin-Chern Chiou, Yueh-Shan Lee, Zong-Han Lu, Aaron Tabor, Erik Scheme

发表机构 * University of New Brunswick(新不伦瑞克大学) ArogyaPandit Private Limited(阿罗吉亚潘迪特私人有限公司) Institute of Electrical and Control Engineering, National Yang Ming Chiao Tung University(国立阳明交通大学电气与控制工程研究所)

AI总结 第二届生物特征足迹识别国际StepUP竞赛利用大规模数据集应对三项关键挑战,吸引26个注册者。ArogyaPandit研究团队用时空卷积神经网络结合集成评分策略获8.00%最佳等错误率,顶级方案展示相关策略价值,不过识别未知个人鞋类用户仍具挑战。

Comments Accepted to the 2026 IEEE International Joint Conference on Biometrics (IJCB)

详情
AI中文摘要

国际StepUP竞赛系列旨在通过标准化且具挑战性的评估框架推动基于压力的足迹生物特征识别研究。第二届竞赛使用大规模StepUP - P150数据集及未发布测试集,应对三项关键挑战:有限注册数据下对未知用户的泛化、鞋类和步行速度变化导致的域转移鲁棒性、左右配对足迹的有效融合。竞赛吸引26个来自学术界和行业的注册者,ArogyaPandit研究团队采用时空卷积神经网络结合基于集成的评分策略取得8.00%的最佳等错误率。顶级解决方案展示了利用时间模式及纳入推理时归一化和校准策略以改进评分的价值,但结果也表明识别未知个人鞋类中的用户仍是挑战,尤其是存在具有相似特征的干扰因素时。

英文摘要

The International StepUP Competition Series was launched to advance research in pressure-based footstep biometrics through a standardized and challenging evaluation framework. Using the large-scale StepUP-P150 dataset (with more than 200,000 high-resolution dynamic footsteps from 150 individuals) and a previously unreleased test set, the 2nd edition of the competition addressed three key challenges: (1) generalization to unseen users with limited enrollment data, (2) robustness to domain shift caused by variations in footwear and walking speed and (3) effective fusion of paired left-right footsteps. While the first two challenges built on the inaugural competition, this edition introduced more extreme cross-domain conditions and moved beyond isolated footsteps to stride-level verification, enabling new opportunities for representation learning and inter-step information fusion. The competition attracted 26 registrants from academia and industry, with a best equal error rate of 8.00% achieved by the ArogyaPandit Research Team using a spatiotemporal CNN combined with an ensemble-based scoring strategy. The top solutions showcase the value of harnessing temporal patterns and of incorporating inference-time normalization and calibration strategies to improve scoring. However, the results also reveal that recognizing users in unseen personal footwear remains a challenge, especially in the presence of distractors with similar characteristics.

URL PDF HTML
2607.13899 2026-07-16 cs.AI 新提交

AIMO Interpretability Challenge

AIMO可解释性挑战

Michal Štefánik, Philipp Mondorf, Andreas Waldis, Qianying Liu, Chuan Yang, Michal Spiegel, Josef Kuchař, Marek Kadlčík, Adam Vawda-Oomerjee, Chaoran Liu, Simon Frieder, Barbara Plank, Fazl Barez, Pontus Stenetorp

发表机构 * National Institute of Informatics(日本国立信息学研究所) Munich Center for Machine Learning / MaiNLP LMU(慕尼黑机器学习中心/慕尼黑大学语言与文学计算研究所) University of Tübingen(图宾根大学) Fuzhou University(福州大学) Masaryk University(马萨里克大学) University College London(伦敦大学学院) University of Oxford(牛津大学)

AI总结 提出AIMO可解释性挑战,基于前沿数学语言模型内部机制区分稳健与虚假推理。利用AIMO问题等资源,提供推理问题、模型访问及鲁棒性评估,助参与者开发识别稳健模型的方法,创建新基准和基线系统,连接可解释性与泛化研究。

Comments Accepted Competition at NeurIPS 2026

详情
AI中文摘要

我们提出了AIMO可解释性挑战,这是一项基于前沿数学语言模型内部机制区分稳健推理和虚假推理的竞赛。该挑战源于标准推理基准的核心局限:高最终答案准确率无法揭示模型是依赖稳定推理机制还是利用脆弱推理捷径。基于人工智能数学奥林匹克(AIMO)问题及提交内容,结合菲尔兹模型计划的资源,竞赛将提供新发布的奥林匹克级数学推理问题及其符号表示、前沿推理模型访问权以及对模型在这些问题上的对抗鲁棒性评估。参与者将利用这些资源及计算基础设施支持,开发识别稳健解决问题模型的方法。竞赛还将创建新的开放鲁棒性基准和基线系统,旨在为数学推理和可解释性的标准基准测试提供持久基础。从科学角度看,竞赛围绕人工智能研究的核心问题连接了可解释性和泛化研究:我们能否确定前沿人工智能模型的决策在多大程度上是可泛化的,从而可靠?

英文摘要

We propose the AIMO Interpretability Challenge, a competition on distinguishing robust from spurious reasoning in frontier mathematical language models based on the models' internal mechanisms. The challenge is motivated by a central limitation of standard reasoning benchmarks: strong final-answer accuracy does not reveal whether a model relies on stable reasoning mechanisms or exploits brittle reasoning shortcuts. Building on AI Mathematical Olympiad (AIMO) problems and submissions, together with resources from the Fields Model Initiative, the competition will provide (1) newly-published olympiad-level math reasoning problems and their symbolic representations, allowing generation of novel functional variants, (2) access to frontier reasoning models, and (3) assessments of models' adversarial robustness on these problems. Participants will use these resources, along with our computing infrastructure support, to develop methods for identifying which models solve problems robustly. Our competition will also create a new, open robustness benchmark and baseline systems, aiming to provide a lasting foundation for standard benchmarking in mathematical reasoning and interpretability. Scientifically, the competition connects interpretability and generalization research around a central question in AI research: can we determine if, and to what extent, the decision-making of frontier AI models is generalizable and thus, reliable?

URL PDF HTML
2607.13897 2026-07-16 cs.LG 新提交

RF Spectrogram Anomaly Detection with Quantum Kitchen Sinks: Architecture, Representation, and Hardware Validation

基于量子随机特征映射的射频频谱图异常检测:架构、表示与硬件验证

Abdallah Aaraba, Alexis Vieloszynski, Remon Polus, Ola Ahmad, Soumaya Cherkaoui

发表机构 * ibm_quebec(IBM魁北克)

AI总结 研究针对无线射频网络异常检测问题,扩展QKS模板并引入消融协议,通过多深度数据重新上传和环纠缠进行评估。结果表明DCT表示优,适度深度纠缠QKS配置强,QKS优于经典基线,提供了实用可重复的无线网络异常检测框架。

Comments Paper accepted to IEEE quantum week 2026

详情
AI中文摘要

无线信道的广播特性使射频网络易受异常和恶意传输影响,异常检测是安全频谱管理的基本要求。量子随机特征映射(QKS)是适用于近期量子设备的轻量级混合量子特征映射,但其在结构化信号数据上的行为尚不清楚。本文通过多深度数据重新上传和环纠缠扩展了标准QKS模板,并在受控射频频谱图异常检测中评估了所得流程。引入了一个验证锁定的五阶段消融协议,系统地分离了浅层架构、重新上传深度、实验预算、输入表示和经典读出的影响。在完整基准测试中,离散余弦变换(DCT)表示始终优于原始和主成分分析(PCA)输入,适度深度的纠缠QKS配置形成最强操作模式,QKS在所有评估的表示 - 读出对上优于匹配的经典直接读出基线,最佳配置在测试集上达到接收器操作特征曲线下面积(AUROC)为0.8778和测试F1为0.799。该研究在数据方面使用实际测量的低于6GHz蜂窝信号,在计算方面在ibm_quebec量子处理单元(QPU)上进行实际设备验证,AUROC偏差相对于模拟低于0.013。这些结果为在无线网络中部署基于QKS的异常检测提供了一个实用、可重复的框架。

英文摘要

The broadcast nature of wireless channels exposes radio-frequency (RF) networks to anomalous and malicious transmissions, making anomaly detection a fundamental requirement for secure spectrum management. Quantum Kitchen Sinks (QKS) offer a lightweight hybrid quantum feature map suitable for near-term quantum devices, yet their behavior on structured signal data remains poorly understood. In this paper, we extend the standard QKS template with multi-depth data re-uploading and ring entanglement, and evaluate the resulting pipeline on controlled RF spectrogram anomaly detection. We introduce a validation-locked five-stage ablation protocol that systematically separates the effects of shallow architecture, re-uploading depth, episode budget, input representation, and classical readout. Across the completed benchmark, Discrete Cosine Transform (DCT) representations consistently dominate raw and Principal Component Analysis (PCA) inputs, moderate-depth entangled QKS configurations form the strongest operating regime, and QKS improves over matched classical direct-readout baselines across all evaluated representation-readout pairs on the held-out test set, with the best configuration reaching a test Area Under the Receiver Operating Characteristic curve (AUROC) of 0.8778 and a test F1 of 0.7995. The study bridges two levels of realism: real measured sub-6\,GHz cellular signals on the data side and real-device validation on the ibm_quebec Quantum Processing Unit (QPU) on the computing side, with AUROC deviations below 0.013 relative to simulation. These results provide a practical, reproducible framework for deploying QKS-based anomaly detection in wireless networks.

URL PDF HTML
2607.13891 2026-07-16 cs.LG cs.CV eess.SP 新提交

PiVoT: A Variational Solution for Real-time Large-scale Multi-object Detection and Tracking under Heavy Clutter

PiVoT:一种用于在严重杂波下实时大规模多目标检测与跟踪的变分解决方案

Runze Gan, Qing Li, Simon J. Godsill, Mike E. Davies, James R. Hopgood

发表机构 * Institute for Imaging, Data and Communications (IDCOM), University of Edinburgh(爱丁堡大学成像、数据与通信研究所(IDCOM)) Department of Engineering, University of Cambridge(剑桥大学工程系) School of Mathematics, University of Edinburgh(爱丁堡大学数学学院)

AI总结 针对数据稀缺雷达应用中多目标检测跟踪难题,PiVoT通过联合推断目标多方面信息,无需外部聚类或检测器,利用变分推断创新实现快速抗杂波跟踪,实验证明其在多方面性能出色,优于现有贝叶斯跟踪器。

详情
AI中文摘要

在许多数据稀缺的雷达应用中,从噪声点云进行多目标检测和跟踪仍然具有挑战性。当前基于泊松测量模型的贝叶斯跟踪器提供了一种无需训练的解决方案,但在严重杂波、大量目标和全分辨率多普勒点云情况下,难以实现准确性和效率。我们使用PiVoT来解决这个问题,它是一种用于位置和多普勒测量的快速、抗杂波多目标跟踪器。PiVoT通过联合推断目标状态、形状、存在概率、数据关联和测量率,对大量且随时间变化的目标进行端到端检测和跟踪,无需外部聚类或检测器。其效率得益于多种变分推断创新,如理论上合理的出生剪枝算法、精确更新的二次到线性复杂度降低以及计算高效的多普勒泊松模型。实验表明,PiVoT在具有挑战性的场景中大大优于现有的贝叶斯跟踪器,同时还展示了对一千个目标的出色可扩展性、对与目标视觉上无法分离的杂波的鲁棒性,以及在全尺寸现代汽车雷达数据集上的实时操作能力,在无需训练的联合检测器和跟踪器方面,其性能可与深度学习检测基准相媲美。

英文摘要

Multi-object detection and tracking from noisy point clouds remain challenging in many data-scarce radar applications. Current Bayesian trackers based on Poisson measurement models offer a training-free solution but struggle to achieve accuracy and efficiency under severe clutter, large object populations, and full-resolution Doppler point clouds. We address this with PiVoT, a fast, clutter-resilient multi-object tracker for both positional and Doppler measurements. PiVoT performs end-to-end detection and tracking of a large and time-varying number of objects without external clustering or detectors, through joint inference of object states, shapes, existence probabilities, data association, and measurement rates. Its efficiency is driven by several variational inference innovations, such as theoretically justified birth pruning, quadratic-to-linear complexity reductions for exact updates, and a computationally efficient Doppler Poisson model. Experiments show that PiVoT substantially outperforms existing Bayesian trackers in challenging scenes, while also demonstrating exceptional scalability to a thousand objects, robustness to clutter visually inseparable from objects, and real-time operation on full-scale modern automotive radar datasets, where it attains performance comparable to a deep-learning detection benchmark as a training-free joint detector and tracker.

URL PDF HTML