arXivDaily arXiv每日学术速递 周一至周五更新

Company Research

大厂专区

按论文发表机构汇总科技公司的最新研究成果。直属研究团队按母公司归类,机构信息由 AI 分析生成,仅供参考。

2026-07-16 至 2026-07-16 收录 45
Alibaba 阿里巴巴 1185 篇 OpenAI 75 篇 Meta 880 篇 Tencent 腾讯 936 篇 ByteDance 字节跳动 438 篇 Google 谷歌 1343 篇 Microsoft 微软 1271 篇 Baidu 百度 263 篇 NVIDIA 英伟达 876 篇 Huawei 华为 995 篇 Amazon 亚马逊 857 篇 Apple 苹果 252 篇 Anthropic 83 篇 Xiaomi 小米 172 篇 Kuaishou 快手 238 篇 JD 京东 34 篇 iFLYTEK 科大讯飞 69 篇 SenseTime 商汤 95 篇 DeepSeek 深度求索 22 篇 Zhipu AI 智谱 21 篇 Moonshot AI 月之暗面 14 篇 MiniMax 稀宇科技 11 篇 StepFun 阶跃星辰 52 篇 Hikvision 海康威视 6 篇 xAI 6 篇 Tesla 特斯拉 1 篇 Adobe 奥多比 419 篇 Salesforce 125 篇 IBM 585 篇 Qualcomm 高通 133 篇
2607.13408 2026-07-16 eess.AS cs.AI cs.CL cs.LG cs.SD 新提交

Improving Text-to-Audio Instruction Following via Fine-Grained Feedback from Audio-Aware Large Language Models

通过音频感知大语言模型的细粒度反馈改进文本到音频的指令跟随

Chun-Yi Kuan, Siwon Kim, Byeonggeun Kim, Suyoun Kim, Bo-Ru Lu, Qinming Tang, Ankur Gandhe, Hung-yi Lee, Chieh-Chi Kao, Chao Wang

发表机构 * National Taiwan University(国立台湾大学) Amazon(亚马逊)

AI总结 研究文本到音频指令跟随问题,提出用音频感知大语言模型作细粒度评判器的框架,经验证后用其反馈构建偏好对优化,引入S3Bench基准,实验证明该方法能提升事件完整性、时间排序和指令跟随准确性,且保持音频质量。

Comments Accepted to the Long Paper Track at Interspeech 2026

详情
AI中文摘要

近期文本到音频模型能生成高质量音频,但在处理涉及多个声音事件和时间顺序的指令时常常失败。现有评估和训练信号主要强调全局相似性或感知质量,对指令级正确性监督有限。我们提出一个指令级框架,利用音频感知大语言模型作为细粒度评判器来验证生成音频中目标事件的存在和时间关系。在基准测试上验证大语言模型的判断并经人工验证后,利用其反馈构建偏好对进行直接偏好优化。我们还引入了S3Bench,一个用于评估多事件时间指令跟随的叙事基准。实验表明,我们的方法在保持音频质量的同时,提高了现有基准和S3Bench上的事件完整性、时间排序和联合指令跟随准确性。

英文摘要

Recent text-to-audio models generate high-quality audio, but often fail to follow instructions involving multiple sound events and temporal order. This gap arises because existing evaluation and training signals mainly emphasize global similarity or perceptual quality, with limited supervision on instruction-level correctness. We propose an instruction-level framework that uses audio-aware large language models (ALLMs) as fine-grained judges to verify target event presence and temporal relations in generated audio. After validating ALLM judgments on benchmarks and through human verification, we use their feedback to construct preference pairs for direct preference optimization. We further introduce S3Bench, a narrative benchmark for evaluating multi-event temporal instruction following. Experiments show that our method improves event completeness, temporal ordering, and joint instruction-following accuracy across existing benchmarks and S3Bench, while maintaining audio quality.

URL PDF HTML
2607.13988 2026-07-16 cs.LG 新提交

TRACE: Turn-level Reward Assignment via Credit Estimation for Long-Horizon Agents

TRACE:通过信用估计进行长期奖励分配的回合级奖励分配

Leitian Tao, Baolin Peng, Wenlin Yao, Tao Ge, Hao Cheng, Mike Hang Wang, Jianfeng Gao, Sharon Li

发表机构 * University of Wisconsin–Madison(威斯康星大学麦迪逊分校) Microsoft Research(微软研究院)

AI总结 研究针对多轮智能体训练后的信用分配难题,提出TRACE方法,通过特定状态转换、对数概率获取及转换等步骤进行奖励分配。该方法无需额外训练,在长期复杂搜索任务中显著提升基础模型工具使用能力,在基准测试中表现良好且学习曲线更佳。

Comments 26 pages

详情
AI中文摘要

多轮智能体通过一系列工具交互来解决复杂任务,这使得训练后的信用分配成为一个基本挑战。结果奖励对短期推理提供可靠监督,但随着轨迹增长会变得稀疏且方差大,还可能产生误导。我们提出TRACE,一种用于智能体强化学习的密集信用分配方法。TRACE将展开表示为工具调用边界处的状态转换,从冻结的参考模型获取黄金答案对数概率,将其转换为对数比率状态值,并将每个动作的奖励推导为这些值的时间差分变化。这无需额外的评论家或过程标签训练,其单步对数比率TD组件可跨冗余工具调用进行伸缩。在长期复杂搜索中,TRACE通过纯强化学习显著提高了基础模型的工具使用能力,在封闭网络BrowseComp-Plus基准测试中提升了Qwen3-4B和Qwen3-30B-A3B的性能,且学习行为可转移到开放网络基准测试,学习曲线显示在强化学习训练中更早改进和更快收敛。

英文摘要

Multi-turn agents solve complex tasks through extended sequences of tool interactions before producing a final answer, making credit assignment a fundamental challenge during post-training. Outcome rewards provide reliable supervision for short-horizon reasoning, but become sparse and high-variance as trajectories grow to tens or hundreds of tool calls. They can also be misleading: a failed rollout may contain many useful actions that move the agent closer to the goal, yet outcome-only training assigns them the same negative advantage as the eventual mistake. We propose TRACE (Turn-level Reward Assignment via Credit Estimation), a dense credit-assignment method for agentic reinforcement learning. TRACE represents rollouts as state transitions at tool-call boundaries, obtains gold-answer log-probabilities from a frozen reference model, transforms them into log-ratio state values, and derives per-action rewards as Temporal-Difference changes in those values. This requires no additional critic or process-label training, and its one-step log-ratio TD component telescopes across redundant tool calls. On long-horizon complex search, TRACE substantially improves base-model tool-use ability using pure RL, without a cold-start supervised fine-tuning stage, an agentic mid-training stage, or training on live-web data. On the closed-web BrowseComp-Plus benchmark, it raises Qwen3-4B from $7.2$ to $35.6$ and Qwen3-30B-A3B from $8.4$ to $42.6$. The learned search behavior also transfers to open-web benchmarks, and the learning curves show earlier improvement and faster convergence during RL training.

URL PDF HTML
2607.13941 2026-07-16 cs.CV 新提交

Peak-End-Net: A Peak-End Rule Inspired Framework for Generalizable Video Aesthetic Assessment

峰值-结尾网络:一种受峰值-结尾规则启发的通用视频美学评估框架

Geng Li, Haiwen Li, Rui Chen, Jing Tang, Lei Sun, Xiangxiang Chu

发表机构 * Alibaba Group(阿里巴巴集团) Beijing University of Posts and Telecommunications(北京邮电大学)

AI总结 研究视频美学评估问题,提出受峰值-结尾规则启发的Peak-End-Net框架,通过引入预训练IAA头部、设计美学节奏编码器和动态门控融合机制,基于冻结ViT实现,在实验中取得最优性能。

Comments Accepted to ACM MM 2026, Code: https://github.com/AMAP-ML/Peak-End-Net

详情
AI中文摘要

视频美学评估(VAA)旨在预测视频的美学吸引力,但与其他视觉评估任务相比,其探索较少。其进展受到大规模基准稀缺以及美学判断内在主观性的阻碍。本文从心理学角度重新审视VAA,提出了受峰值-结尾规则启发的轻量级且可解释的框架Peak-End-Net。通过引入预训练的图像美学评估(IAA)头部来生成逐帧美学先验,设计美学节奏编码器以及动态门控融合机制,该方法基于冻结的视觉Transformer(ViT),参数少且可扩展。在两个现有VAA基准上的大量实验表明其达到了当前最优性能。

英文摘要

Video aesthetic assessment (VAA) aims to predict how aesthetically pleasing a video is, yet remains far less explored than other visual assessment tasks. Its progress is hindered not only by the scarcity of large-scale benchmarks, but also by the intrinsic subjectivity of aesthetic judgment, which is shaped by human perception. In this paper, we revisit VAA from a psychological perspective and propose \textit{Peak-End-Net}, a lightweight and interpretable framework inspired by the \textit{peak-end rule}, which suggests that people tend to judge a temporal experience mainly according to its salient moments and the ending. Building on this intuition, we first transfer knowledge from image aesthetic assessment (IAA) to VAA by introducing a pretrained IAA head to produce frame-wise aesthetic priors, which serve as surrogate signals for identifying aesthetically salient moments and guiding \textit{peak-end rule}-based temporal aggregation. To further capture how a video evolves aesthetically over time, we design an aesthetic rhythm encoder that models temporal progression beyond isolated moments. Additionally, we refine the overall assessment through a dynamic gated fusion mechanism to improve robustness under distribution shift. Our method is built on a frozen vision transformer (ViT) and requires only a small number of trainable parameters, making it scalable and parameter-efficient. Extensive experiments on two existing VAA benchmarks, including in-domain evaluation on VADB and cross-domain testing on DIVIDE-3K, demonstrate that our approach achieves state-of-the-art performance, affirming the value of psychologically grounded modeling for VAA. Our code and models are available at https://github.com/AMAP-ML/Peak-End-Net.

URL PDF HTML
2607.13940 2026-07-16 cs.AI 新提交

A Self-Evolving Agent for Longitudinal Personal Health Management

一种用于纵向个人健康管理的自我进化智能体

Haoran Li, Jiebi Deng, Tong Jin, Jinghong Han, Yuxin Wang, Zexin Wang, Qingyi Si, Weikang Gong, Xiahai Zhuang, Jia You, Wei Cheng, Jianfeng Feng, Hongcheng Guo

发表机构 * School of Data Science, Fudan University(复旦大学数据科学学院) School of Life Sciences, Beijing University of Chinese Medicine(北京中医药大学生命科学学院) Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University(复旦大学脑科学与智能技术研究院) School of Computer Science and Technology, Huazhong University of Science and Technology(华中科技大学计算机科学与技术学院) JD.com, Inc.(京东公司) Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, Fudan University, Ministry of Education(复旦大学计算神经科学与类脑智能教育部重点实验室) Department of Neurology, Huashan Hospital, Fudan University(复旦大学附属华山医院神经内科)

AI总结 研究针对多数健康AI系统孤立处理请求的问题,开发开源智能体架构HealthClaw,通过自我进化更新支持,经合成基准和生物医学任务评估,在准确率、隐私性及任务指标增益上表现出色,支持纵向个人健康智能体的自我进化记忆。

Comments 20 pages, 4 figures, 6 supplementary tables. Code: https://github.com/HC-Guo/HealthClaw

详情
AI中文摘要

个人健康管理是在反复接触中展开的,但大多数健康人工智能系统孤立地处理每个请求。我们开发了HealthClaw,这是一种开源智能体架构,它会随着个人日常、偏好、测量和风险的变化更新支持。它将共享安全规则和医学知识与包含个人资料事实、可重复使用程序和情景痕迹的私人纵向记忆分开。每次事件后,归纳法决定应更新个人资料、修订程序、保留情景还是排除。我们用合成的一年期基准和九个200例生物医学任务评估了HealthClaw。在900次纵向支持探测中,答案准确率从当前查询提示的0.2%提高到HealthClaw的45.7%,同时提示侧上下文暴露比全历史提示低71.7%。在100次隐私探测中,HealthClaw产生了更高的隐私感知答案质量和更少的不安全披露。在生物医学任务中,特定任务主要指标的平均绝对增益为27.0个百分点,经过错误发现率校正后,七个增益仍然显著。这些离线基准支持纵向个人健康智能体的受治理、自我进化记忆,尽管临床有效性需要前瞻性评估。HealthClaw可在这个https网址公开获取。

英文摘要

Personal health management unfolds over repeated encounters, yet most health AI systems treat each request in isolation. We developed HealthClaw, an open-source agent architecture that updates support as a person's routines, preferences, measurements and risks change. It separates shared safety rules and medical knowledge from private longitudinal memory containing profile facts, reusable procedures and episodic traces. After each episode, induction determines what should update the profile, revise a procedure, remain episodic or be excluded. We evaluated HealthClaw with a synthetic year-long benchmark and nine 200-case biomedical tasks. Across 900 longitudinal support probes, answer accuracy increased from 0.2% with current-query prompting to 45.7% with HealthClaw, while prompt-side context exposure was 71.7% lower than with full-history prompting. In 100 privacy probes, HealthClaw produced higher privacy-aware answer quality and fewer unsafe disclosures than both baselines. Across the biomedical tasks, the mean absolute gain in the task-specific primary metric was 27.0 percentage points, and seven gains remained significant after false-discovery-rate correction. These offline benchmarks support governed, self-evolving memory for longitudinal personal health agents, although clinical effectiveness requires prospective evaluation. HealthClaw is publicly available at https://github.com/HC-Guo/HealthClaw.

URL PDF HTML
2607.13927 2026-07-16 cs.CV 新提交

Cyclone: Diffusion Model for Cycle-Consistent Weather Editing from Unpaired Driving Data

Cyclone:基于未配对驱动数据的循环一致天气编辑扩散模型

Thang-Anh-Quan Nguyen, Moussab Bennehar, Luis Guillermo Roldao Jimenez, Nathan Piasco, Dzmitry Tsishkou, Laurent Caraffa, Jean-Philippe Tarel, Roland Brémond

发表机构 * Huawei Paris Research Center(华为巴黎研究中心) Gustave Eiffel University(古斯塔夫·埃菲尔大学) IGN-ENSG(法国国家地理信息与森林和环境信息研究所)

AI总结 针对自动驾驶系统在不同天气条件下可靠感知的挑战,提出Cyclone框架,基于潜在扩散,利用循环一致约束和图像-文本模型知识,无需配对数据生成多种天气条件,实验表明其输出更优,还可提炼为视频扩散模型。

Comments Project page: https://ntaquan0125.github.io/weather-cyclone/

详情
AI中文摘要

在不同天气条件下的可靠感知仍然是自动驾驶系统的一个主要挑战。一种提高鲁棒性的常见策略是为训练感知模型合成不利天气条件,或应用天气去除技术来恢复干净的输入。然而,现有方法通常依赖于合成数据增强或基于物理的特定任务模型,这些模型需要配对的训练数据,并且往往难以生成逼真的天气效果或稳健地推广到域外场景。针对这个问题,我们提出了Cyclone,一个基于潜在扩散的天气编辑统一框架,配备了循环一致约束和来自图像-文本模型的知识。Cyclone能够在不同场景中生成多种天气条件,同时无需配对数据。实验结果表明,我们的方法比现有基线产生更逼真、保留结构的输出,并在几个下游驾驶感知任务中带来一致的改进。此外,我们证明Cyclone可以提炼为一个用于时间一致天气编辑的视频扩散模型。

英文摘要

Reliable perception under diverse weather conditions remains a major challenge for autonomous driving systems. A common strategy to improve robustness is either to synthesize adverse weather conditions for training perception models or to apply weather-removal techniques to recover clean inputs. However, existing approaches typically rely on synthetic data augmentation or physics-based, task-specific models that require paired training data and often struggle to generate realistic weather effects or generalize robustly to out-of-domain scenarios. Toward this problem, we present Cyclone, a unified framework for weather editing based on latent diffusion, equipped with cycle-consistent constraints and knowledge from image-text models. Cyclone enables the generation of multiple weather conditions across diverse scenes while eliminating the need for paired data. Experimental results show that our approach produces more realistic, structure-preserving outputs than existing baselines and leads to consistent improvements across several downstream driving perception tasks. Furthermore, we demonstrate that Cyclone can be distilled to a video diffusion model for temporally consistent weather editing.

URL PDF HTML
2607.13897 2026-07-16 cs.LG 新提交

RF Spectrogram Anomaly Detection with Quantum Kitchen Sinks: Architecture, Representation, and Hardware Validation

基于量子随机特征映射的射频频谱图异常检测:架构、表示与硬件验证

Abdallah Aaraba, Alexis Vieloszynski, Remon Polus, Ola Ahmad, Soumaya Cherkaoui

发表机构 * ibm_quebec(IBM魁北克)

AI总结 研究针对无线射频网络异常检测问题,扩展QKS模板并引入消融协议,通过多深度数据重新上传和环纠缠进行评估。结果表明DCT表示优,适度深度纠缠QKS配置强,QKS优于经典基线,提供了实用可重复的无线网络异常检测框架。

Comments Paper accepted to IEEE quantum week 2026

详情
AI中文摘要

无线信道的广播特性使射频网络易受异常和恶意传输影响,异常检测是安全频谱管理的基本要求。量子随机特征映射(QKS)是适用于近期量子设备的轻量级混合量子特征映射,但其在结构化信号数据上的行为尚不清楚。本文通过多深度数据重新上传和环纠缠扩展了标准QKS模板,并在受控射频频谱图异常检测中评估了所得流程。引入了一个验证锁定的五阶段消融协议,系统地分离了浅层架构、重新上传深度、实验预算、输入表示和经典读出的影响。在完整基准测试中,离散余弦变换(DCT)表示始终优于原始和主成分分析(PCA)输入,适度深度的纠缠QKS配置形成最强操作模式,QKS在所有评估的表示 - 读出对上优于匹配的经典直接读出基线,最佳配置在测试集上达到接收器操作特征曲线下面积(AUROC)为0.8778和测试F1为0.799。该研究在数据方面使用实际测量的低于6GHz蜂窝信号,在计算方面在ibm_quebec量子处理单元(QPU)上进行实际设备验证,AUROC偏差相对于模拟低于0.013。这些结果为在无线网络中部署基于QKS的异常检测提供了一个实用、可重复的框架。

英文摘要

The broadcast nature of wireless channels exposes radio-frequency (RF) networks to anomalous and malicious transmissions, making anomaly detection a fundamental requirement for secure spectrum management. Quantum Kitchen Sinks (QKS) offer a lightweight hybrid quantum feature map suitable for near-term quantum devices, yet their behavior on structured signal data remains poorly understood. In this paper, we extend the standard QKS template with multi-depth data re-uploading and ring entanglement, and evaluate the resulting pipeline on controlled RF spectrogram anomaly detection. We introduce a validation-locked five-stage ablation protocol that systematically separates the effects of shallow architecture, re-uploading depth, episode budget, input representation, and classical readout. Across the completed benchmark, Discrete Cosine Transform (DCT) representations consistently dominate raw and Principal Component Analysis (PCA) inputs, moderate-depth entangled QKS configurations form the strongest operating regime, and QKS improves over matched classical direct-readout baselines across all evaluated representation-readout pairs on the held-out test set, with the best configuration reaching a test Area Under the Receiver Operating Characteristic curve (AUROC) of 0.8778 and a test F1 of 0.7995. The study bridges two levels of realism: real measured sub-6\,GHz cellular signals on the data side and real-device validation on the ibm_quebec Quantum Processing Unit (QPU) on the computing side, with AUROC deviations below 0.013 relative to simulation. These results provide a practical, reproducible framework for deploying QKS-based anomaly detection in wireless networks.

URL PDF HTML
2607.13770 2026-07-16 cs.AR cs.AI 新提交

Kaleido: Algorithm-Hardware Co-Design for Video Diffusion Transformers by Exploiting Latent Space Correlations

Kaleido:通过利用潜在空间相关性对视频扩散变压器进行算法-硬件协同设计

Wenxuan Miao, Haosong Liu, Weiming Hu, Zihan Liu, Aiyue Chen, Jianlin Yu, Yiwu Yao, Yiming Gan, Jieru Zhao, Jingwen Leng, Minyi Guo, Yu Feng

发表机构 * Shanghai Jiao Tong University(上海交通大学) Shanghai Jiao Tong University, Shanghai Qi Zhi Institute(上海交通大学、上海颀智研究所) Huawei Technologies(华为技术有限公司) ICT, Chinese Academy of Sciences(信息科技研究所、中国科学院)

AI总结 针对视频扩散变压器计算成本高的问题,提出Kaleido算法-硬件协同设计,利用潜在空间通道级时空相关性加速操作,有轻量级重用算法,设计了加速器,实验表明其相比现有加速器有显著加速和节能效果。

详情
AI中文摘要

视频扩散变压器(vDiTs)能生成高质量视频,但由于扩散时间步长和自注意力计算,计算成本极高。随着扩散时间步长减少,自注意力计算成本成为主要瓶颈。现有加速方法大多继承大语言模型的稀疏注意力技术,未考虑视频数据独特的时空相关性。本文提出Kaleido,一种算法-硬件协同设计,通过利用潜在空间中的通道级时空相关性加速vDiTs中的所有操作。基于此,提出轻量级通道级重用算法,在保留比现有方法更高生成质量(>17dB)的同时跳过冗余计算。还设计了具有可重构处理元件的脉动阵列加速器和轻量级数据调度器。对三个主流vDiT模型的评估表明,Kaleido比现有加速器加速高达5.9倍,节能16.0倍。

英文摘要

Video diffusion transformers (vDiTs) generate high quality video but introduce extremely high compute cost due to the long diffusion timesteps and self attention computation. As diffusion timesteps are reduced, the computation cost of self attention becomes the dominant bottleneck. Existing acceleration approaches largely inherit sparse attention techniques from large language models, which fail to consider the unique spatiotemporal correlation of video data. This paper presents Kaleido, an algorithm hardware codesign that accelerates all operations in vDiTs by exploiting channel-wise spatiotemporal correlations in latent space. Based on this insight, we propose a lightweight channelwise reuse algorithm that skips redundant computations by reusing partial results while preserving higher generative quality than prior methods (>17 dB). To efficiently support this algorithm, we design a systolic array like accelerator with reconfigurable processing elements and a lightweight data dispatcher to mitigate irregular sparsity and data access patterns introduced by our reuse algorithm. Evaluations across three mainstream vDiT models show that Kaleido achieves up to 5.9x speedup and 16.0x energy savings over state of the art accelerators.

URL PDF HTML
2607.13712 2026-07-16 cs.CV cs.AI cs.CL cs.MM 新提交

Groc-PO: Grounded Context Preference Optimization for Truthful Multimodal LLMs

Groc-PO:用于真实多模态大语言模型的基于上下文的偏好优化

Zhixiao Zheng, Zheren Fu, Zhiyuan Yao, Chunxiao Liu, Dongming Zhang, Zhendong Mao

发表机构 * University of Science and Technology of China(中国科学技术大学) Xiaomi Corporation(小米公司) State Key Laboratory of Communication Content Cognition, People’s Daily Online(人民日报社传播内容认知国家重点实验室)

AI总结 研究针对多模态大语言模型的不真实问题,提出基于上下文的偏好优化框架Groc-PO,构建相关数据集,通过多阶段偏好样本捕捉基础上下文,加强上下文相关推理,减轻跨阶段错误传播,提升模型性能。

Comments Accepted by ACM-MM 2026

详情
AI中文摘要

尽管多模态大语言模型取得了快速进展,但仍存在诸如视觉幻觉、内容编造和推理不准确等不真实问题,削弱了其可靠性和实用性。基于人类偏好的对齐方法如直接偏好优化(DPO)被广泛采用,但多模态推理错误常跨阶段传播,最终答案错误常源于早期基础阶段的错误,而标准DPO通常在最终答案层面进行偏好优化。为解决此问题,我们提出了用于多模态大语言模型的基于上下文的偏好优化框架Groc-PO。我们还构建了基于上下文的偏好数据集(GCPD),围绕对象基础、上下文基础和基于基础的推理三个阶段组织多阶段偏好样本,以捕捉基础上下文的形成、整合和利用。通过在多个基础阶段引入更明确的偏好监督,Groc-PO加强了上下文相关推理并减轻了跨阶段错误传播。大量实验表明,与标准DPO和其他强大基线相比,Groc-PO在减轻幻觉、忠实推理和整体可靠性方面取得了更好的性能,支持了更明确的基础监督对可信多模态推理的价值。

英文摘要

Despite the rapid progress of Multimodal Large Language Models (MLLMs), they still suffer from untruthfulness issues, such as visual hallucinations, content fabrication, and unfaithful reasoning, which substantially undermine their faithfulness and practical utility. Alignment methods based on human preference, such as Direct Preference Optimization (DPO), have been widely adopted to address these issues. However, multimodal reasoning errors often propagate across stages, and final-answer errors can often be traced to mistakes in early grounding stages, yet standard DPO typically applies preference optimization at the final-answer level. This credit-assignment challenge means that supervision for early grounding stages is indirect rather than stage-specific, making it difficult to suppress error propagation arising from grounding drift and context inconsistency. To address this, we propose Grounded Context Preference Optimization (Groc-PO), a grounded preference optimization framework for MLLMs. We further construct the Grounded Context Preference Dataset (GCPD), organizing multi-stage preference samples around three stages of Object Grounding, Contextual Grounding, and Grounded Reasoning, to capture the formation, integration, and utilization of grounded context. By introducing more explicit preference supervision over multiple grounded stages, Groc-PO strengthens context-dependent reasoning and mitigates cross-stage error propagation. Extensive experiments show that, compared with standard DPO and other strong baselines, Groc-PO achieves improved performance in hallucination mitigation, faithful reasoning, and overall reliability, supporting the value of more explicit grounded supervision for trustworthy multimodal reasoning.

URL PDF HTML
2607.13681 2026-07-16 cs.CV 新提交

Towards Spatial Supersensing in the Wild

迈向野外空间超感知

Tianjun Gu, Tianyu Xin, Kuan Zhang, Bowen Yang, Kok-Chung Chua, Peize Li, Xinran Zhang, Yupeng Chen, Qiyue Zhao, Qinlei Xie, Jianhang Liu, Yucheng Lu, Yinan Han, Marco Pavone, Yiming Li

发表机构 * Tsinghua University(清华大学) NVIDIA(英伟达) Stanford University(斯坦福大学)

AI总结 研究针对空间超感知中多模态模型基准测试局限于合成视频和家庭场景的问题,引入VSI-Super-Wild基准,受人类认知启发探究世界状态三元组,通过大量真实视频问答对测试发现模型不足及失败模式,为空间超感知发展指明方向。

Comments Accepted to ECCV 2026. Project page: https://vsi-super-wild.github.io/

详情
AI中文摘要

人类能够有效地解析从数小时到数年的连续感官流,构建一个基于空间推理和预测的内部世界模型。为模仿这种能力,空间超感知挑战多模态模型超越语言理解,实现真正的世界建模。然而,其基准测试依赖合成长视频,多限于家庭场景,对现实世界的连续性和多样性探索不足。为此,我们引入VSI-Super-Wild,一个用于评估野外不同场景中长时间空间超感知的大规模基准。受人类构建经验的认知研究启发,我们系统探究世界状态的三元组:智能体、物体和环境。VSI-Super-Wild包含6980个人工验证的问答对,源自442个跨越8个场景类别的真实世界视频。结果显示,尽管静态图像理解有进展,但模型在需要连贯跟踪世界状态随时间变化的任务上持续失败。我们刻画了性能如何随世界状态复杂性和时间跨度下降,并诊断出四种失败模式。这种分类揭示模型缺乏将物体、智能体和环境绑定成统一空间世界模型的机制,这一根本差距为空间超感知指明了前进方向。

英文摘要

Humans can efficiently parse continuous sensory streams, from hours to years, scaffolding an internal world model that grounds spatial reasoning and prediction. To mimic this capacity, spatial supersensing challenges multimodal models to move beyond linguistic understanding toward true world modeling. However, their benchmark relies on synthetic long videos, formed by concatenating random short clips, and is mostly limited to household scenes, leaving real-world continuity and diversity underexplored. To address the gap, we introduce $\textbf{VSI-Super-Wild}$, a large-scale benchmark for evaluating spatial supersensing over long temporal horizons in diverse in-the-wild scenes. Notably, inspired by cognitive studies on how humans structure experience, we systematically probe the full triad of world state: the agent (observer), objects (scene items), and the environment (places and global layout). In total, VSI-Super-Wild contains $\textbf{6,980}$ human-verified question-answer pairs derived from $\textbf{442}$ real-world videos spanning 8 scene categories, including long-form recordings exceeding 4 hours. Results on VSI-Super-Wild expose a fundamental disconnect: despite advances in static image understanding, models consistently fail at tasks that require coherent world-state tracking over time. We characterize how performance degrades with world-state complexity and temporal horizon, and diagnose four failure modes: spatial collapse, semantic shortcuts, insufficient update, and instance confusion. This taxonomy reveals that models lack mechanisms to bind objects, agents, and environments into a unified spatial world model, a fundamental gap that defines the path forward for spatial supersensing.

URL PDF HTML
2607.13639 2026-07-16 cs.CV cs.AI 新提交

OvisOCR2 Technical Report

OvisOCR2技术报告

Shiyin Lu, Yinglun Li, Yu Xia, Yuhui Chen, An-Yang Ji, Jun-Peng Jiang, Qing-Guo Chen, Jianshan Zhao, En Lin, Haijun Li, Cheng Qin, Zhao Xu, Weihua Luo

发表机构 * Alibaba Group(阿里巴巴集团)

AI总结 介绍拥有8亿参数的OvisOCR2文档解析模型,通过构建数据引擎,采用监督微调、强化学习、策略蒸馏和模型融合等方法训练,在多个基准测试中取得优异成绩,展现出良好的泛化性和鲁棒性。

详情
AI中文摘要

我们介绍了OvisOCR2,一个拥有8亿参数的文档解析模型。它被设计为端到端解析器,给定文档页面图像,能按自然阅读顺序生成Markdown表示,涵盖文本、公式、表格和视觉区域。我们构建了数据引擎,结合了经过筛选的真实文档注释与合成页面。训练方法包括监督微调、在一个拥有40亿参数分支上进行多组件奖励设计的强化学习、策略蒸馏到8亿参数模型以及模型融合。在OmniDocBench v1.6上,OvisOCR2取得了96.58的最优综合得分,在PureDocBench上也取得了75.06的最高Avg3得分。在内部基准测试中,OvisOCR2在比较方法中获得了最佳整体性能,证明了其泛化性和鲁棒性。

英文摘要

We introduce OvisOCR2, a 0.8B document parsing model. OvisOCR2 is designed as an end-to-end parser: given a document page image, it generates a Markdown representation in natural reading order, covering text, formulas, tables, and visual regions. We build a data engine that combines filtered real-document annotations with synthetic pages whose rendered images and Markdown targets are derived from the same HTML source. The training recipe includes supervised fine-tuning, reinforcement learning on a 4B branch with a multi-component reward design, on-policy distillation into the 0.8B model, and model fusion. On OmniDocBench v1.6, OvisOCR2 achieves a state-of-the-art overall score of 96.58, placing an end-to-end model at the top of this leaderboard previously dominated by pipeline methods and highlighting the potential of end-to-end document parsing. On PureDocBench, OvisOCR2 also achieves the highest Avg3 score of 75.06. Beyond these two public benchmarks, we evaluate OvisOCR2 on an in-house benchmark designed to cover a broader set of long-tail and challenging scenarios. OvisOCR2 obtains the best overall performance among the compared methods, providing further evidence of its generalization and robustness. OvisOCR2 is available at https://huggingface.co/ATH-MaaS/OvisOCR2.

URL PDF HTML
2607.13621 2026-07-16 cs.AI 新提交

UESF-Bench: Benchmarking and Probing for Unified Embodied Seeking and Following

UESF-Bench:统一的具身寻找与跟随的基准测试与探究

Kun Yu, Jianhua Yang, Yixiang Chen, Changwei Wang, Hongyuan Yu, Yan Huang, Fushuo Huo, Ya Jing, Zhumin Chen, Keji He

发表机构 * Shandong University(山东大学) Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所) Qilu University of Technology(齐鲁工业大学) Xiaomi Inc(小米公司) Beijing University Of Technology(北京工业大学) Hong Kong Polytechnic University(香港理工大学)

AI总结 研究针对现有具身智能体语言引导人类跟随基准测试的局限,引入UESF-Bench基准,提出SeekFollow-VLA框架,可处理语义引导探索等任务,实验显示该框架在单人和多人环境中比基线有明显改进,为统一具身寻找与跟随建立基线。

详情
AI中文摘要

语言引导的人类跟随是具身智能体的一项重要能力,但现有基准测试通常假设目标人物在情节开始时是可见的。这种设置简化了问题,忽略了一个更现实的要求:智能体通常需要先找到语言描述的目标,然后在动态环境中持续跟随该目标。近期工作虽已开始研究人类搜索,但现有设置通常在特定任务场景中评估,且往往依赖更强的环境先验知识。此外,它们通常将搜索和跟随视为 separate 任务,仍缺乏用于系统评估的统一基准。为解决这些限制,我们引入了统一的具身寻找与跟随基准测试(UESF-Bench),这是一个用于具身人类寻找与跟随的大规模多样化基准测试。该基准要求智能体处理语义引导的探索、可靠的行为切换和恢复以及延迟的身份定位。为此,我们提出了 SeekFollow-VLA,这是一个具有任务驱动路由机制的视觉-语言-行动框架,用于在寻找和跟随之间进行潜在阶段推理和转换建模。实验结果表明,SeekFollow-VLA 在单人和多人环境中均比单头和双头基线有明显改进,为统一的具身寻找与跟随建立了基线。

英文摘要

Language-guided human following is an important capability for embodied agents, but existing benchmarks typically assume that the target person is visible at the start of an episode. This setting simplifies the problem and overlooks a more realistic requirement: an agent often needs to first find a language-described target and then persistently follow that target in a dynamic environment. While recent work has started to study human search, existing settings are typically evaluated in task-specific scenarios and often rely on stronger prior knowledge of the environment. Moreover, they usually treat searching and following as separate tasks and still lack a unified benchmark for systematic evaluation. To address these limitations, we introduce the Unified Embodied Seeking and Following Benchmark (UESF-Bench), a large-scale and diverse benchmark for embodied human seeking and following. The benchmark requires agents to handle semantic-guided exploration, reliable behavior switching and recovery, and delayed identity grounding. To this end, we propose SeekFollow-VLA, a vision-language-action framework with a task-driven routing mechanism for latent phase inference and transition modeling between seeking and following. Experimental results show that SeekFollow-VLA achieves clear improvements over both single-head and dual-head baselines across single-person and multi-person environments, establishing a baseline for unified embodied seek-and-follow.

URL PDF HTML
2607.13460 2026-07-16 cs.CV 新提交

LPM: Industrial-Scale Generative Video Restoration

LPM:工业规模的生成式视频修复

Bichuan Zhu, Fulin Li, Jiachao Gong, Jinhua Hao, Kai Zhao, Kun Yuan, Pengcheng Xu, Qiang Wang, Qiao Mo, Yanlong Yuan, Yizhen Shao, Yuxiao Hu, Zixi Tuo, Ming Sun, Chao Zhou, Bin Chen, Bin Yu

发表机构 * Kuaishou Technology(快手科技)

AI总结 研究提出工业规模的LPM用于视频修复,通过统一系统解决UGC退化问题,含数据工程、模型训练和推理。其架构等机制实现高保真修复,已在快手生产应用,节省带宽成本,还能集成产品,证明该方法实用、可扩展且具成本效益。

Comments 21 pages, 7 figures

详情
AI中文摘要

我们提出了大型处理模型(LPM),这是一个基于扩散的生成框架,用于在复杂的自然退化情况下进行逼真的视频修复。据我们所知,LPM是第一个在工业规模上部署的生成式视频修复模型。LPM通过一个统一的系统来解决用户生成内容(UGC)中的各种退化问题,该系统包括大规模数据工程、基础模型训练和高效推理。其增强的架构、渐进训练策略和时间金字塔推理机制共同实现了对UGC平台上广泛内容分布中任意长视频的高保真、时间一致的修复。LPM已在快手投入生产,模型处理的视频占总观看时间的约45%,在关键体验质量指标上持续改进。除了感知增强,LPM还带来了显著的系统级效益:在可比的感知质量下,相对于快手内部编解码器,它将比特率降低了20%,每年节省数亿带宽成本。其低服务成本还使其能够集成到Kling等产品中,表明生成式修复对于大规模视频处理可以是实用、可扩展且具有成本效益的。

英文摘要

We present the Large Processing Model (LPM), a diffusion-based generative framework for photorealistic video restoration under complex, in-the-wild degradations. To our knowledge, LPM is the first generative video restoration model deployed at industrial scale. LPM addresses the diverse degradations in user-generated content (UGC) through a unified system encompassing large-scale data engineering, foundation-model training, and efficient inference. Its enhanced architecture, progressive training strategy, and temporal-pyramid inference mechanism jointly enable high-fidelity, temporally consistent restoration of arbitrarily long videos across the broad content distribution encountered on UGC platforms. LPM has been deployed in production at Kuaishou, where videos processed by the model account for approximately 45% of total viewing time, delivering consistent improvements across key quality-of-experience metrics. Beyond perceptual enhancement, LPM delivers substantial system-level benefits: at comparable perceptual quality, it reduces bitrate by 20% relative to Kuaishou's in-house codec, yielding annual bandwidth cost savings on the order of hundreds of millions. Its low serving cost also enables integration into products such as Kling, demonstrating that generative restoration can be practical, scalable, and cost-effective for large-scale video processing.

URL PDF HTML
2607.13453 2026-07-16 cs.CR cs.AI 新提交

Adversarial Prompting Framework for AI Safety Assessment

用于人工智能安全评估的对抗性提示框架

Yash Bhatnagar, Kunal Banerjee, Anirban Chatterjee

发表机构 * Microsoft(微软)

AI总结 针对人工智能尤其是生成式人工智能应用增加带来的安全问题,提出对抗性提示框架,通过生成多复杂程度的对抗性提示评估模型弹性,在企业环境中实现自动化测试并获定量指标及差异结果。

Comments 3 pages, 1 figure, presented as a poster at International Conference on Data Science (CODS), December 17-20, 2025, Pune, India

详情
AI中文摘要

近年来,人工智能(AI)尤其是生成式人工智能(GenAI)在各行业的应用显著增加。然而,这些模型的使用也可能使系统面临不同恶意行为者的新型网络攻击,对抗性提示攻击(APA)就是此类威胁中最突出的例子之一。本文提出了一个对抗性提示框架(APF)来全面评估人工智能安全。该框架通过生成多个复杂程度的结构化对抗性提示,从直接有害请求到基于高级编码的攻击,系统地评估人工智能模型的弹性。我们的实现展示了这种方法在企业环境中的实际应用,提供了具有定量安全评估指标的自动化测试能力。结果表明,不同攻击向量下模型漏洞存在显著差异,编码提示在绕过安全机制方面成功率最高。

英文摘要

Artificial Intelligence (AI), especially Generative AI (GenAI), adoption has increased in industries significantly in recent years. However, the use of these models may also expose systems to new forms of cyberattacks by different malicious actors -- adversarial prompt attack (APA) being one of the most prominent examples of such threats. This paper presents the implementation of an Adversarial Prompting Framework (APF) for a comprehensive assessment of AI safety. The framework systematically evaluates the resilience of the AI model through the generation of structured adversarial prompts at multiple sophistication levels, from direct harmful requests to advanced encoding-based attacks. Our implementation demonstrates the practical application of this methodology in enterprise environments, providing automated testing capabilities with quantitative security assessment metrics. The results indicate significant variations in the model vulnerabilities across different attack vectors, with encoded prompts presenting the highest success rates in bypassing safety mechanisms.

URL PDF HTML
2607.13431 2026-07-16 cs.LG cs.AI cs.CL 新提交

Discrete Diffusion Models: A Unified Framework from Tokenization to Generation

离散扩散模型:从词元化到生成的统一框架

Ye Yuan, Weien Li, Rui Song, Zeyu Li, Haochen Liu, Xiangyu Kong, Zixuan Dong, Linfeng Du, Zipeng Sun, Weixu Zhang, Jiaxin Huang, Changjiang Han, Yonghan Yang, Zichen Zhao, Xiuyuan Hu, Haolun Wu, Yankai Chen, Fengran Mo, Jikun Kang, Bowei He, Philip S. Yu, Xue Liu

发表机构 * McGill University(麦吉尔大学) Mila - Quebec AI Institute(米拉-魁北克人工智能研究所) University of Cambridge(剑桥大学) University of Toronto(多伦多大学) MBZUAI - Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学) Tsinghua University(清华大学) Rochester Institute of Technology(罗彻斯特理工学院) Salesforce(Salesforce公司) University of Illinois Chicago(伊利诺伊大学芝加哥分校)

AI总结 研究离散扩散模型,引入统一框架从离散状态空间构建审视该模型,让现有公式成为共同设计空间实例,揭示训练、推理等方面权衡,为未来研究提供方向。

详情
AI中文摘要

离散去噪扩散模型(DDMs)最近成为离散数据自回归建模的有力替代方案,具有并行生成和迭代全局细化能力。与连续扩散不同,离散扩散模型的状态空间由离散状态空间的构建方式决定。本文引入统一概念框架,通过构建底层离散状态空间来审视离散扩散模型。在此框架下,现有公式成为共同设计空间的不同实例,还揭示了训练目标、推理算法等方面的常见权衡,为未来研究指明方向。

英文摘要

Discrete denoising diffusion models (DDMs) have recently emerged as a compelling alternative to autoregressive (AR) modeling for discrete data, offering parallel generation and iterative global refinement capabilities. Unlike continuous diffusion, where the state space is fixed, DDMs are fundamentally shaped by how the discrete state space is constructed: the tokenization scheme, the vocabulary topology, and domain-specific structural alphabets. This work introduces a unified conceptual framework that views discrete diffusion models through the construction of the underlying discrete state space. Within this framework, existing formulations, including transition-matrix, masking/absorbing-state, and score/ratio-based approaches, emerge as different instantiations of a common design space. The framework further exposes common design trade-offs across training objectives, inference algorithms, scaling behavior, systems optimization, and evaluation protocols, suggesting several promising directions for future research.

URL PDF HTML
2607.13428 2026-07-16 cs.LG 新提交

PUe: Biased Positive-Unlabeled Learning Enhancement by Causal Inference

PUe:基于因果推断的有偏正无标记学习增强

Xutao Wang, Hanting Chen, Tianyu Guo, Yunhe Wang

发表机构 * Huawei Noah’s Ark Lab(华为诺亚方舟实验室)

AI总结 研究正无标记学习问题,基于SAR-PU倾向加权框架提出PUe框架,运用归一化倾向得分和NIPW,有归一化逆概率加权风险公式等贡献,在多个数据集实验中,在非均匀标签分布下优于多个PU基线。

Comments Extended arXiv version of the NeurIPS 2023 paper; includes additional discussion of related SAR-PU work

详情
AI中文摘要

正无标记(PU)学习旨在利用有限的标记正例和大量未标记例实现高精度二分类。现有基于成本敏感的方法常依赖强假设,即观察到正标记的示例是完全随机选择的。但实际中标签分布不均,存在选择偏差。基于Bekker等人的SAR-PU倾向加权框架,研究使用归一化倾向得分和归一化逆概率加权(NIPW)的PU学习增强(PUe)框架。其主要贡献包括归一化逆概率加权的PU风险公式、偏差标记下归一化样本权重误差和常见PU估计器的理论分析、正则化深度倾向得分估计、与现代成本敏感PU方法集成以及对选择性标记负类的支持。在MNIST、CIFAR-10和ADNI上的实验表明,在非均匀标签分布下优于多个PU基线。

英文摘要

Positive-Unlabeled (PU) learning aims to achieve high-accuracy binary classification with limited labeled positive examples and numerous unlabeled ones. Existing cost-sensitive-based methods often rely on strong assumptions that examples with an observed positive label were selected entirely at random. In fact, the uneven distribution of labels is prevalent in real-world PU problems, indicating that most actual positive and unlabeled data are subject to selection bias. Building on the SAR-PU propensity-weighted framework of Bekker et al., we study a PU learning enhancement (PUe) framework using normalized propensity scores and normalized inverse probability weighting (NIPW). PUe's main contributions are a normalized inverse-probability-weighted PU risk formulation; additional theoretical analyses of normalized sample-weight error and common PU estimators under biased labeling; regularized deep propensity-score estimation; integration with modern cost-sensitive PU methods; and support for selectively labeled negative classes. Experiments on MNIST, CIFAR-10, and ADNI demonstrate improvements over several PU baselines under non-uniform label distributions.

URL PDF HTML
2607.13416 2026-07-16 cs.LG 新提交

EXPLORE: Exploration with Guided Search for Analog Topology Generation using Language Models

EXPLORE:使用语言模型进行引导搜索以生成模拟拓扑结构

Guanglei Zhou, Chen-Chia Chang, Yikang Shen, Jonathan Ku, Isaac Jacobson, Jingyu Pan, Yiran Chen, Xin Zhang

发表机构 * Duke University(杜克大学) MIT-IBM Watson AI Lab(麻省理工学院-IBM沃森人工智能实验室) IBM T. J. Watson Research Center(IBM T. J. 沃森研究中心)

AI总结 本文针对自动化模拟电路拓扑设计难题,提出EXPLORE框架,集成模拟器引导蒙特卡罗树搜索与基于变压器的解码,利用语言模型先验优化搜索,在6组件基准测试中显著提升成功率、降低均方误差,推动LLM驱动设计自动化。

Comments MLCAD 26' accepted

详情
AI中文摘要

自动化模拟电路拓扑设计对于减少满足日益多样化和定制化应用需求所需的大量人工工作至关重要。最近的进展是在预训练语言模型上应用序列到序列微调,以单次从用户规范直接生成电路拓扑。然而,由于搜索空间呈指数增长且训练数据集有限,这些一次性生成方法无法生成复杂电路。本文提出了EXPLORE,这是一个搜索增强框架,它将模拟器引导的蒙特卡罗树搜索(MCTS)与基于变压器的解码相结合,以实现模拟拓扑生成的测试时扩展。通过利用语言模型先验并绕过高置信度结构令牌,EXPLORE在搜索过程中将昂贵的模拟器预算主要分配给改变拓扑的决策。在公差为0.01的6组件基准测试中,EXPLORE将一次性生成的成功率从12%和采样与过滤基线的33%提高到65%,并在相同搜索预算下相对于采样与过滤将均方误差降低了20%以上。这些结果使EXPLORE成为第一个将结构化测试时搜索与LM解码集成用于模拟拓扑生成的框架,也是迈向扩展LLM驱动设计自动化的实际一步。

英文摘要

Automating analog circuit topology design is essential to reduce the extensive manual effort required to meet increasingly diverse and customized application demands. Recent advances have applied sequence-to-sequence fine-tuning on pretrained language models to directly generate circuit topologies from user specifications in a single pass. However, these one-shot generation methods failed to generate complex circuits due to their exponentially growing search spaces and limited training datasets. In this paper, we present EXPLORE, a search-enhanced framework that integrates simulator-guided Monte Carlo Tree Search (MCTS) with transformer-based decoding to enable test-time scaling for analog topology generation. By leveraging language-model priors and bypassing high-confidence structural tokens, EXPLORE allocates expensive simulator budget primarily toward topology-altering decisions during search. On a 6-component benchmark at a tight tolerance of 0.01, EXPLORE raises the success rate from 12% for one-shot generation and 33% for a sampling-and-filter baseline to 65%, and lowers MSE by over 20% relative to sampling-and-filter under the same search budget. These results establish EXPLORE as the first framework to integrate structured test-time search with LM decoding for analog topology generation, and a practical step toward scaling LLM-driven design automation.

URL PDF HTML
2607.13399 2026-07-16 cs.CL cs.LG 新提交

Demystifying On-Policy Distillation: Roles, Pathologies, and Regulations

揭开在线策略蒸馏的神秘面纱:作用、问题及调控

Rui Wang, Hongru Wang, Yi Chen, Boyang Xue, Tianqing Fang, Wenhao Yu, Kam-Fai Wong

发表机构 * The Chinese University of Hong Kong(香港中文大学) Tencent AI Lab(腾讯人工智能实验室)

AI总结 研究在线策略蒸馏的作用、问题及调控,阐明其为探索催化剂,揭示师生不匹配和长度利用问题,提出优势裁剪和对数尺度压缩调控,实验表明良好调控的信号质量决定OPD中成功探索。

详情
AI中文摘要

在线策略蒸馏(OPD)已成为大语言模型训练后的关键范式,但其训练动态仍未被充分理解。我们进行了一项系统研究,考察OPD的作用、问题及调控。首先阐明OPD作为探索催化剂的作用:通过密集的token级指导引导学生走向正确推理路径,而不提高能力上限。通过表明提示多样性比每个问题的采样数量更重要,且OPD的有效性完全取决于其指导信号的质量来证实这一点。这种依赖性揭示了两种阻碍探索的问题。当师生分布差距大导致指导信号与任务正确性不一致时,会出现师生不匹配,引导探索走向适得其反的方向。当聚合的token级目标产生长度依赖的捷径时,会出现长度利用问题,使学生通过响应截断或冗余填充来操纵奖励格局,探索退化的长度模式而非推理策略。为解决这些问题,我们研究了轻量级信号调控:优势裁剪和对数尺度压缩,确保探索由可靠信号引导。在七个基准上的实验表明,这些调控减轻了长度利用问题并实现了有效蒸馏,稳定超越OPD变体和RLVR基线,从而证实良好调控的信号质量而非仅仅教师规模决定了OPD中成功的探索。

英文摘要

On-policy distillation (OPD) has become a key paradigm in LLM post-training, yet its training dynamics remain poorly understood. We present a systematic study examining the role, pathologies, and regulations of OPD. We first clarify the role of OPD as an exploration catalyst: it steers the student toward correct reasoning paths via dense token-level guidance, without expanding capability ceiling. We confirm this by showing that prompt diversity matters more than per-problem sampling numbers, and critically, that the effectiveness of OPD hinges entirely on the quality of its guiding signal. This dependency exposes two pathologies that derail exploration. The Student-Teacher Mismatch occurs when a large teacher-student distributional gap causes the guiding signal to misalign with task correctness, steering exploration in counterproductive directions. Length Exploitation arises when the aggregated token-level objective creates length-dependent shortcuts, allowing the student to game the reward landscape through response truncation or redundant padding, exploring degenerate length modes rather than reasoning strategies. To tame these pathologies, we investigate lightweight signal regulations: advantage clipping and log-scale compression, ensuring exploration is guided by faithful signals. Experiments across seven benchmarks demonstrate that these regulations alleviate length exploitation and enable effective distillation, stably surpassing OPD variants and RLVR baselines, thereby confirming that well-regulated signal quality, rather than mere teacher scale, governs successful exploration in OPD.

URL PDF HTML
2607.13394 2026-07-16 cs.CL cs.LG 新提交

GFlowRL: Scaling Distribution-Matching RL to Large Language Models

GFlowRL:将分布匹配强化学习扩展到大型语言模型

Xiaodong Liu, Michael Xu, Jack W. Stokes, Paul Smolensky, Doug Burger, Jianfeng Gao

发表机构 * Microsoft Research(微软研究院)

AI总结 研究旨在将GFlowNet风格的RL扩展到大型语言模型,提出GFlowRL算法,去除辅助分区网络,用批内蒙特卡罗估计替代学习的分区函数,并通过两个稳定器实现奖励分布匹配,在多个基准测试中表现出色,能稳定扩展到不同架构。

Comments 31 pages, 8 figures, 17 tables

详情
AI中文摘要

生成流网络(GFlowNets)为大型推理模型提供了一种有前景的替代奖励最大化强化学习(RL)的方法,通过匹配奖励分布鼓励多样化推理路径。近期工作在数学和代码方面有进展,但将GFlowNet风格的RL扩展到现代训练后管道仍困难。经系统分析发现,可由训练所需的展开组计算的批内蒙特卡罗估计替代学习的分区函数。我们提出GFlowRL,一种简化的GFlowNet风格RL算法,去除了辅助分区网络,通过两个稳定器实现奖励分布匹配目标。GFlowRL在数学、代码和对抗性红队基准测试中超越所有对手,在14B规模达到Codeforces评级2048,在AdvBench和HarmBench上获得最高平均ASR@1,优于先前SOTA多轮攻击者。该方法可扩展到高达235B参数的所有评估的混合专家(MoE)配置。据我们所知,GFlowRL是首个能在密集和稀疏架构上稳定扩展的GFlowNet风格RL算法。代码将在:此https URL

英文摘要

Generative Flow Networks (GFlowNets) offer a promising alternative to reward-maximizing reinforcement learning (RL) for large reasoning models, encouraging diverse reasoning paths by matching reward distributions rather than collapsing to dominant modes. Recent work shows promise on math and code, but scaling GFlowNet-style RL to modern post-training pipelines remains difficult: as model size, rollout horizon, reward noise, and distributed-systems complexity grow together, a learned prompt-conditional partition function becomes a source of gradient instability and engineering overhead rather than a useful normalizer. Through systematic analysis, we find that the learned partition function, previously treated as essential, can be replaced by an in-batch Monte Carlo estimate computed from the rollout group already required for training. We propose GFlowRL, a streamlined GFlowNet-style RL algorithm that removes the auxiliary partition network entirely while preserving the reward-distribution-matching objective, completed by two stabilizers: importance-sampling correction for rollout/trainer drift and asymmetric flow-gap clipping for outlier residuals. GFlowRL exceeds all counterparts on math, code, and adversarial red-teaming benchmarks, reaching a Codeforces rating of 2048 at the 14B scale (within 25 Elo of o3-mini) and attaining the highest average ASR@1 on AdvBench and HarmBench, outperforming the previous SOTA multi-turn attacker in a regime where FlowRL, a prior GFlowNet-style method, diverges. The same recipe transfers to all evaluated MoE configurations up to 235B parameters, where FlowRL again fails to converge. To our knowledge, GFlowRL is the first GFlowNet-style RL algorithm to scale stably across both dense and sparse architectures. Code will be at: https://github.com/microsoft/gflowrl

URL PDF HTML
2607.13285 2026-07-16 cs.AI cs.SE 新提交

Harness Handbook: Making Evolving Agent Harnesses Readable,Navigable, and Editable

Harness手册:使不断演进的智能体框架具有可读性、可导航性和可编辑性

Ruhan Wang, Yucheng Shi, Zongxia Li, Zhongzhi Li, Yue Yu, Junyao Yang, Kishan Panaganti, Haitao Mi, Dongruo Zhou, Leoweiliang

发表机构 * Tencent(腾讯) Indiana University(印第安纳大学) University of Maryland, College Park(马里兰大学帕克分校) University of Georgia(佐治亚大学) National University of Singapore(新加坡国立大学)

AI总结 研究智能体框架演进中行为定位难的问题,提出通过Harness手册和行为引导的渐进式披露,以行为为中心自动合成框架表示并辅助规划,提高行为定位和编辑计划质量,助力复杂智能体系统发展。

Comments 29 pages, 6 figures. Project page: https://ruhan-wang.github.io/Harness-Handbook/

详情
AI中文摘要

现代人工智能智能体的能力不仅取决于其基础模型,还取决于其框架,框架用于构建提示、管理状态、调用工具和协调执行。随着模型、API、环境和需求的发展,框架必须不断修改。在进行此类更改之前,开发人员或编码智能体必须识别实现目标行为的所有代码位置。这很困难,因为生产框架庞大、紧密耦合且行为分散,而修改请求描述系统应做什么,存储库按文件和模块组织。代码搜索、存储库索引和长上下文处理便于检查,但仍需手动恢复行为到代码的映射。行为定位因此是框架演进的核心瓶颈。我们引入了Harness手册,这是一种以行为为中心的表示,通过静态分析和LLM辅助结构化从框架代码库自动合成,将每个行为与其相应源链接起来。我们还引入了行为引导的渐进式披露(BGPD),它引导智能体从高级行为到相关实现细节,并根据当前源验证候选位置。在来自两个开源框架的各种修改请求上,手册辅助规划提高了行为定位和编辑计划质量,同时使用更少的规划器令牌,在分散站点、很少执行的路径和跨模块交互方面收益最大。因此,不断发展复杂的智能体系统不仅取决于生成编辑,还取决于确定这些编辑应在何处进行。

英文摘要

The capability of a modern AI agent depends not only on its foundation model but also on its harness, which constructs prompts, manages state, invokes tools, and coordinates execution. As models, APIs, environments, and requirements evolve, the harness must be continually modified. Before such a change can be made, a developer or coding agent must identify all code locations that implement the target behavior. This is difficult because production harnesses are large, tightly coupled, and behaviorally distributed, while modification requests describe what the system should do and repositories are organized by files and modules. Code search, repository indexing, and long-context processing ease inspection, but still leave this behavior-to-code mapping to be recovered by hand. Behavior localization is therefore a central bottleneck in harness evolution. We introduce the Harness Handbook, a behavior-centric representation synthesized automatically from a harness codebase via static analysis and LLM-assisted structuring, linking each behavior to its corresponding source. We also introduce Behavior-Guided Progressive Disclosure (BGPD), which guides agents from high-level behaviors to relevant implementation details and verifies candidate locations against the current source. On diverse modification requests from two open-source harnesses, Handbook-Assisted planning improves behavior localization and edit-plan quality while using fewer planner tokens, with the largest gains on scattered sites, rarely executed paths, and cross-module interactions. Evolving complex agentic systems thus depends not only on generating edits, but also on determining where those edits should be made.

URL PDF HTML
2607.13265 2026-07-16 cs.CV 新提交

Differentiable Polarized Path Tracing

可微偏振路径追踪

Pramod Rao, Jérémy Riviere, Xilong Zhou, Abhijeet Ghosh, Abhimitra Meka, Thabo Beeler, Marc Habermann, Christian Theobalt, Delio Vicini

发表机构 * Max Planck Institute for Informatics(马克斯·普朗克信息研究所) Saarland Informatics Campus(萨尔兰信息学园区) VIA Research Center(VIA研究中心) Google(谷歌)

AI总结 研究逆渲染问题,提出偏振感知的可微路径追踪方法,通过路径重放和局部缓存组合估计无偏梯度,能在复杂场景中高效稳定优化材质和光照参数,拓宽基于物理的逆渲染适用性。

Comments Accepted at ECCV 2026

详情
AI中文摘要

基于物理的可微渲染已被证明是解决逆渲染问题(如三维重建、反射率估计、光照估计)的有力工具。然而,大多数现有方法仅对辐射强度进行操作,丢弃了约束场景几何和材质属性的宝贵偏振线索。虽然通过穆勒-斯托克斯微积分对偏振光进行正向模拟是明确的,但将反向模式微分扩展到该领域面临重大挑战。常见偏振算子(如线性偏振器和漫反射)的秩亏性质违反了路径重放反向传播等标准梯度估计器的可逆性假设,导致数值不稳定。我们提出了一种强大的、偏振感知的可微路径追踪方法来解决此问题。我们的方法通过路径重放和局部缓存的组合来估计无偏梯度。这种公式化使得在复杂场景中对材质和光照参数进行高效稳定的优化成为可能,拓宽了基于物理的逆渲染的适用性。

英文摘要

Physically based differentiable rendering has proven to be a powerful tool for inverse rendering problems (e.g., 3D reconstruction, reflectance estimation, lighting estimation). However, most existing methods operate solely on radiometric intensity, discarding valuable polarization cues that constrain scene geometry and material properties. While forward simulation of polarized light is well-defined via Mueller-Stokes calculus, extending reverse-mode differentiation to this domain presents significant challenges. The rank-deficient nature of common polarimetric operators, such as linear polarizers and diffuse reflections, violates the invertibility assumptions of standard gradient estimators like path replay backpropagation and results in numerical instability. We address this by proposing a robust, polarization-aware differentiable path tracing method. Our approach estimates unbiased gradients through a combination of path replay and local caching. This formulation enables efficient and stable optimization of material and lighting parameters in complex scenes, broadening the applicability of physically based inverse rendering. Project page: https://vcai.mpi-inf.mpg.de/projects/DPPT/

URL PDF HTML
2607.13188 2026-07-16 cs.LG 新提交

Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes

并发图像理解与生成:自校正耦合马尔可夫跳跃过程

Minh-Quan Le, Armand Comas, Alexandros Lattas, Stylianos Moschoglou, Pedro Vélez, Amit Raj, Aaron Germuth, Thabo Beeler, Dimitris Samaras, Di Qiu

发表机构 * Stony Brook University(纽约州立大学石溪分校) Google DeepMind(谷歌深度思维)

AI总结 研究针对人类认知中理解与生成的耦合循环,引入自校正耦合马尔可夫跳跃过程框架及$\texttt{CO}_\texttt{2}\texttt{Jump}$采样器,解决掩码扩散模型跨模态矛盾问题,创建多模态语料库,该方法在图像相关任务中性能优异,且性能随去噪步骤数提升。

Comments Project page: https://coupled-jump.github.io

详情
AI中文摘要

人类认知不会将理解与生成分开。白板前的教师边说边画,两种模态相互塑造。本文将这种耦合循环引入人工系统。掩码扩散模型(MDMs)很适合此任务,但现有采样器要么交错解码文本和图像,要么在仅共享上一步历史的并行分支中独立更新它们,同一步骤内无法共享另一模态的最新决策,且MDMs无法重新掩码,无法检测和修复跨模态矛盾。我们引入自校正耦合马尔可夫跳跃过程(SC-CMJP)框架,其中一种模态的转移率是另一种模态置信度得分的函数,由跨模态注意力加权。此外,当跨模态证据不利时,重新掩码跳跃会撤回先前的决策。结合SC-CMJP,我们引入了$\texttt{CO}_\texttt{2}\texttt{Jump}$(自校正耦合跳跃),一种用于联合多模态生成的无需训练的单通道采样器。为训练和评估,我们创建并将发布三个大规模联合多模态生成语料库:$\text{JEdit-1M}$、$\text{JMaze-200K}$、$\text{JNono-200K}$,以及匹配的分布内和分布外基准。$\texttt{CO}_\texttt{2}\texttt{Jump}$在图像理解、编辑以及视觉推理(迷宫和数独求解)方面实现了最佳联合性能。采样器的性能随去噪步骤数单调增加,证明跨模态耦合的好处在轨迹上是复合的。项目页面:this https URL

英文摘要

Human cognition does not separate understanding and generation. A teacher at a whiteboard speaks and draws $\textit{together}$, each modality reshapes the other. In this paper, we bring this coupled loop to artificial systems. Masked Diffusion Models (MDMs) are ideally suited to this task, yet existing samplers either decode text and image interleavedly or independently update them in parallel branches that share only previous-step history, but not the other modality's latest decisions $\textit{within}$ the same step; combined with MDMs' inability to remask, cross-modal contradictions are neither detected nor repaired. We introduce $\textbf{Self-Correcting Coupled Markov Jump Processes (SC-CMJP)}$, a framework in which one modality's transition rates are functionals of the other modality's confidence score, as weighted by cross-modal attention. Furthermore, a remasking jump retracts commitments the moment cross-modal evidence turns against them. In conjunction with SC-CMJP, we introduce $\texttt{CO}_\texttt{2}\texttt{Jump}$ (Self-$\underline{\text{CO}}$rrecting $\underline{\text{CO}}$upled $\underline{\text{Jump}}$), a novel training-free single-pass sampler for joint multimodal geneneration. For training and evaluation purposes, we have created and will release three large-scale joint multimodal generation corpora: $\text{JEdit-1M}$, $\text{JMaze-200K}$, $\text{JNono-200K}$, with matching in- and out-of-distribution benchmarks. $\texttt{CO}_\texttt{2}\texttt{Jump}$ achieves best joint performance for image understanding and editing as well as visual reasoning (maze and nonogram solving). The performance of the sampler scales monotonically with the number of denoising steps, evidence that the benefits of cross-modal coupling $\textit{compound}$ across the trajectory. Project page: https://coupled-jump.github.io

URL PDF HTML
2607.13158 2026-07-16 cs.CL 新提交

Do LLMs Need Architectural Changes for Simultaneous Speech Translation? A Prefix-to-Prefix Data Driven Approach

语言模型进行同步语音翻译需要架构改变吗?一种前缀到前缀的数据驱动方法

Junkun Chen, Jian Xue, Ming Tang, Abdel Heba, Hoda Gholami, Ruchao Fan, Jinyu Li

发表机构 * Microsoft(微软)

AI总结 研究同步语音翻译中仅解码器语言模型面临的挑战,提出基于固定长度块、回退前缀及教师标记前缀到前缀目标的CSSEL-P2P方法,经实验其在可比延迟下提升了流质量,证明无需架构改变可有效实现同步语音翻译。

详情
AI中文摘要

同步语音翻译(SimulST)需要在严格的延迟约束下进行增量翻译,但对于仅解码器的语言模型系统来说仍然具有挑战性,因为上下文有限和跨语言重新排序。最近的方法通常引入架构改变或明确的读/写策略来控制输出时间,在分割边界不明确的对话语音中可能很脆弱。我们提出了一种简单的数据驱动替代方案:用于累积流解码的固定长度块,带有基于回退的提交前缀,以及带有有限等待的教师标记的前缀到前缀(P2P)目标进行微调,产生CSSEL-P2P,其中CSSEL是我们提出的分块流语音编码器语言模型。在我们的内部对话语音评估中,CSSEL-P2P在可比延迟(平均滞后0.15秒)下比CSSEL流基线的流质量提高了1.54 COMETKiwi,表明通过P2P监督无需架构改变即可实现有效的SimulST。

英文摘要

Simultaneous speech translation (SimulST) requires incremental translation under strict latency constraints, yet remains challenging for decoder-only LLM systems due to limited context and cross-lingual reordering. Recent approaches often introduce architectural changes or explicit read/write policies to control output timing, which can be brittle in conversational speech where segmentation boundaries are ambiguous. We present a simple data-driven alternative: fixed-length chunks for cumulative streaming decoding with a rewind-based committed prefix, and teacher-labeled prefix-to-prefix (P2P) targets with bounded waiting for fine-tuning, yielding CSSEL-P2P, where CSSEL is our proposed chunked streaming speech encoder LLM. In our in-house conversational speech evaluation, CSSEL-P2P improves streaming quality by +1.54 COMETKiwi over the CSSEL streaming baseline at comparable latency (+0.15s Average Lagging), suggesting effective SimulST without architectural changes via P2P supervision.

URL PDF HTML
2607.13124 2026-07-16 cs.LG cs.AI cs.CL 新提交

ShortOPD: Recovering Pruned LLMs with Short-to-Long On-Policy Distillation

ShortOPD:通过短到长的策略蒸馏恢复剪枝后的语言模型

Qingyu Zhang, Qianhao Yuan, Hongyu Lin, Yaojie Lu, Xianpei Han, Le Sun, Xiang Li, Ming Xu, Jiarui Li, Xiuyin Zhao

发表机构 * ByteDance(字节跳动) Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所) University of Chinese Academy of Sciences(中国科学院大学)

AI总结 研究结构化剪枝在语言模型自由形式生成任务中存在的问题,提出ShortOPD方法,通过短到长的策略蒸馏,检测重复后缀,合理分配展开预算,有效提升压缩模型分数,减少训练时间和展开令牌,推动结构化剪枝接近可部署的生成质量。

详情
AI中文摘要

结构化剪枝是一种对硬件友好的语言模型压缩方式,但大多在多项选择识别任务中得到验证,相同的压缩检查点在实际部署所需的自由形式生成任务中可能会崩溃。本文通过两项观察发现了这种差距。首先,贪心的\textsc{pass}@$1$在压缩后几乎消失,但\textsc{pass}@$k$在重复采样下能大幅恢复。其次,可恢复机制主要因后缀重复而失败。因此,恢复应在压缩模型自身的策略状态上进行密集的令牌级监督训练,策略蒸馏(OPD)通过将预压缩模型用作冻结教师来提供这种监督。然而,长时间的策略展开会将早期恢复预算花费在低信息重复后缀上,延迟损失下降。为缓解这种浪费,本文提出了\textbf{\shortopd},一种短到长的OPD调度,它能检测教师确认的重复后缀,将幸存的前缀视为每次展开的有效长度,并将未来的展开预算分配给策略当前可使用的有效长度。在数学、代码和开放式生成任务中,\shortopd\将压缩模型的分数提高到未恢复值的约$9$倍,以及标准恢复方法(无知识蒸馏的监督微调、知识蒸馏和序列知识蒸馏)的$1.6$ - $4.4$倍,并且在两点内匹配固定的$8192$令牌展开范围,使用四分之一的训练时间($8.5$小时对$35.9$小时)和减少$71\%$的展开令牌。希望该方法有助于使结构化剪枝超越在困惑度和多项选择基准上的微小收益,更接近可部署的生成质量。

英文摘要

Structured pruning is a hardware-friendly way to compress LLMs, but it is mostly validated on multiple-choice recognition tasks, while the same compressed checkpoints can collapse on the free-form generation that deployment actually requires. Two observations trace this gap. First, greedy \textsc{pass}@$1$ nearly vanishes after compression, yet \textsc{pass}@$k$ recovers substantially under repeated sampling: useful generations are demoted, not erased. Second, the recoverable regime fails mainly through suffix repetition. Recovery should therefore train on the compressed model's own on-policy states with dense token-level supervision, which On-Policy Distillation (OPD) provides by reusing the pre-compression model as a frozen teacher. However, long on-policy rollouts spend early recovery budget on low-information repetitive suffixes, delaying loss descent. To mitigate this waste, we propose \textbf{\shortopd}, a short-to-long OPD schedule that detects teacher-confirmed repetitive suffixes, treats the surviving prefix as each rollout's effective length, and allocates future rollout budgets to the effective lengths the policy can currently use. Across math, code, and open-ended generation, \shortopd\ raises the compressed model's score to about $9\times$ its unrecovered value and $1.6$--$4.4\times$ standard recovery recipes (SFT w/o KD, KD, and SeqKD), and it matches a fixed $8192$-token rollout horizon within two points using a quarter of the training time ($8.5$ vs.\ $35.9$ hours) and $71\%$ fewer rollout tokens. We hope this recipe helps move structured pruning beyond marginal gains on perplexity and multiple-choice benchmarks, a step closer to deployment-ready generation quality.

URL PDF HTML
2607.13091 2026-07-16 cs.SE cs.AI 新提交

Self-Improving AI Coding Agents Through Accumulated Behavioral Rules: A Closed-Loop Framework

通过累积行为规则实现自我改进的人工智能编码代理:一个闭环框架

Aditya Aggarwal, Nahid Farhady Ghalaty

发表机构 * Microsoft(微软)

AI总结 研究基于大语言模型的编码代理重复犯错问题,提出闭环框架,将审查评论编码为行为规则,经实验验证其能转移审查重点、降低错误复发率且跨接口转移,实现跨会话学习且不更新权重,积累人类工程智慧。

Comments Already presented and accepted in - 32nd ICE IEEE/ITMC Conference (ICE 2026)

详情
AI中文摘要

基于大语言模型的编码代理在不同会话中会重复犯相同类型的错误,因为它们缺乏保留人类审查反馈修正的机制。我们提出了一个闭环框架,其中每个被接受的审查评论都被编码为一个持久的行为规则,逐步扩大代理可以自我检测的错误类集合。该框架将累积的规则集整合到一个版本控制的指令文件中,在代码提交前执行自我审查清单,并进行自动验证以确保规则集在增长时的完整性。在一个35多个服务微服务平台上进行部署时,规则集从5个行为规则、15多个特定语言标准和一个15项自我审查清单增长而来,所有这些都来自实际审查反馈。我们展示了11个记录的工作会话的实证结果,涵盖代码生成、拉取请求审查、事件调查和跨服务重构。我们观察到,累积的规则将审查工作从低级正确性转向设计级验证,实现了针对被裁定错误类别的0%复发率,并能跨异构代理接口转移。我们将我们的方法与经验性大语言模型学习(Reflexion、ExpeL、Voyager)和自动代码审查(CodeReviewer、SWE-bench代理)中的相关工作进行了比较,表明我们的框架在不更新权重的情况下实现了持久的跨会话学习,在生产代码库上运行而非合成基准,并解决了现有基准未测量的正交维度(随时间的行为一致性)。结果是一个编码代理,它在每个审查周期中都能改进,积累其人类合作者的工程智慧而不改变单个模型权重。

英文摘要

LLM-based coding agents repeat the same classes of mistakes across sessions because they lack a mechanism to retain corrections from human review feedback. We present a closed-loop framework in which every accepted review comment is codified as a persistent behavioral rule, progressively expanding the set of error classes the agent can self-detect. The framework combines an accumulating rule set in a version-controlled instruction file, a self-review checklist executed before code submission, and automated validation that ensures rule set integrity as it grows. In deployment across a 35+ service microservices platform, the rule set grew from 5 to 18 behavioral rules, 15+ language-specific standards, and a 15-item self-review checklist, all derived from real review feedback. We present empirical results from 11 recorded working sessions spanning code generation, PR review, incident investigation, and cross service refactoring. We observe that accumulated rules shift review effort from low-level correctness toward design-level validation, achieve a measured 0% recurrence rate for ruled-against error classes, and transfer across heterogeneous agent interfaces. We compare our approach against related work in experiential LLM learning (Reflexion, ExpeL, Voyager) and automated code review (CodeReviewer, SWE-bench agents), showing that our framework achieves persistent cross-session learning without weight updates, operates on production codebases rather than synthetic benchmarks, and addresses an orthogonal dimension (behavioral consistency over time) that existing benchmarks do not measure. The result is a coding agent that improves with every review cycle, accumulating the engineering wisdom of its human collaborators without changing a single model weight.

URL PDF HTML
2607.13035 2026-07-16 cs.CL cs.AI cs.LG cs.SE 新提交

FixItFlow: Automated Troubleshooting Guide Generation from Cloud Incidents

FixItFlow:从云事件中自动生成故障排除指南

Srihari Unnikrishnan, Jaskaran Singh Walia, Drishti Goel, Supriyo Ghosh

发表机构 * Microsoft Research(微软研究院) University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) Inception

AI总结 针对云事件手动创建故障排除指南的问题,提出FixItFlow系统,利用大语言模型从历史事件数据生成指南,能提取诊断模式、合成结构化指南并严格验证,经评估可提升事件响应,减轻团队文档负担。

详情
AI中文摘要

云服务频繁出现需要快速诊断和解决的事件。故障排除指南有助于工程师一致地做出响应,但手动创建指南劳动强度大,导致覆盖不完整和文档过时。我们提出了FixItFlow,这是一个使用大语言模型从历史事件数据生成故障排除指南的自动化系统。该系统从工程师操作中提取诊断模式,合成带有经过验证命令的结构化指南,并进行严格验证以防止虚假内容。在对26名工程师的评估中,生成的指南在清晰度方面获得了61.5%的正面评价,并且对于有相关指南的事件,缓解时间减少了2.3倍。这些结果表明,自动指南生成可以改善事件响应,同时减轻工程团队的文档负担。

英文摘要

Cloud services experience frequent incidents that require rapid diagnosis and resolution. Troubleshooting guides help engineers respond consistently, but creating them manually is labor-intensive, resulting in incomplete coverage and outdated documentation. We present FixItFlow, an automated system that generates troubleshooting guides from historical incident data using large language models. The system extracts diagnostic patterns from engineer actions, synthesizes structured guides with verified commands, and enforces strict validation to prevent fabricated content. In our evaluation with 26 engineers, generated guides achieved 61.5\% positive ratings for clarity and demonstrated a 2.3x reduction in mitigation time for incidents with associated guides. These results indicate that automated guide generation can improve incident response while reducing documentation burden on engineering teams.

URL PDF HTML
2607.12706 2026-07-16 cs.SD 版本更新

AutoSIFT: Automatic Style Sifting for Controllable Speech Generation with Arbitrary Style Infilling

AutoSIFT:用于可控语音生成的自动风格筛选与任意风格填充

Haowei Lou, Junda Wu, Chengkai Huang, Tong Yu, Hye-young Paik, Wen Hu, Lina Yao

发表机构 * UNSW Sydney(新南威尔士大学悉尼分校) University of California San Diego(加利福尼亚大学圣地亚哥分校) Macquarie University(麦考瑞大学) Adobe Research(Adobe 研究院)

AI总结 研究针对TTS模型难以细粒度控制说话风格的问题,提出AutoSIFT框架,将风格分解为可描述和残余两类,通过广义风格解缠器和任意风格填充器,可在保留残余风格时替换指定风格类别,实现高度可定制的语音生成。

详情
AI中文摘要

当前最先进的文本到语音(TTS)模型在自然度和表现力方面表现出色,但对说话风格进行细粒度、解耦控制仍具有挑战性。在电影配音、游戏语音表演和视频内容生成等专业场景中,用户常需修改特定风格类别,同时保留其他风格。现有方法难以联合控制显式语义属性并保留细微的韵律细节。我们提出AutoSIFT,一个用于类别级风格编辑的可控语音生成框架。它将说话风格分解为已知的可文本描述类别和未知的残余风格,通过广义风格解缠器和任意风格填充器,在保留残余语音风格的同时替换文本指定的风格类别,实现自然、富有表现力和高度可定制的语音生成。

英文摘要

State-of-the-art text-to-speech (TTS) models achieve impressive naturalness and expressiveness, yet fine-grained, disentangled control over speaking styles remains challenging. In professional scenarios such as film dubbing, game voice acting, and video content generation, users often need to modify a specific style category, such as emotion, age, or gender, while preserving all others. Existing style-controllable TTS methods typically rely on either text-described styles or speech-reference style transfer, making it difficult to jointly control explicit semantic attributes and preserve subtle, text-undescribed prosodic details. We propose AutoSIFT, a controllable speech generation framework for category-level style editing. AutoSIFT decomposes speaking style into known text-describable categories and unknown residual styles that capture non-verbal prosody and speaker-specific nuances. It consists of a generalized Style Disentangler, which extracts category-aware style prototypes from reference speech, and an Arbitrary Style Infiller, which selectively infills unspecified style categories from the reference. By replacing only text-specified style categories while preserving residual speech-derived styles, AutoSIFT enables natural, expressive, and highly customizable speech generation.

URL PDF HTML
2607.12252 2026-07-16 cs.CL 版本更新

FinResearchBench II: A Deep Research Benchmark with Consensus-Derived Gold Rubrics for Distinguishing Financial Report Quality

金融研究基准II:一个具有共识衍生黄金标准的深度研究基准,用于区分财务报告质量

Beidi Luan, Rui Sun, Sinuo Wang, Yan Gu, Chao Li, Zhenliang Xiong, Jing Li, Zuo Bai

发表机构 * StepFun(步趣) FinStep(鳍步) University of Adelaide(阿德莱德大学) Shanghai Jiao Tong University(上海交通大学)

AI总结 该研究针对深度研究代理生成财务报告的大规模评估瓶颈,提出可扩展管道生成高质量标准。通过构建基准、合成候选标准、比较大语言模型与人类评估,经两个过滤器得出黄金标准集,用于评估10个深度研究系统,实现可扩展的基准评估等研究。

详情
AI中文摘要

深度研究代理越来越多地用于生成长篇财务报告,但大规模评估仍受限于需要人类专家来定义和执行高质量标准。我们通过提出一个可扩展的管道来解决这个问题,该管道在最后环节无需人类专家即可生成高质量标准。我们从104个实际用户查询构建了一个金融深度研究基准,并从模型生成的报告中自动合成了14,450个特定查询的候选标准。为了证明在标准执行中无需人类专家的合理性,我们在一个抽样子集上比较了三位人类专家和一个由三个大语言模型组成的评审小组的标准判断,结果表明基于大语言模型的评估与人类评估足够一致,可用于大规模标准筛选,包括在共同一致的项目上98.67%的标签级一致性。然后,我们通过两个过滤器得出共识衍生的黄金标准:一个严格一致性过滤器,只有当三个大语言模型评审员对同一查询下的每份报告都一致同意时,才保留一个标准;一个区分性过滤器,只有当一个标准在所有评估系统中至少分配一个多数为“是”和至少一个多数为“否”的标签时,才保留该标准。这个过程保留了3,687个通过一致性的标准,其中2,600个仍然具有区分性,形成了最终的共识衍生黄金标准集。使用这个最终标准集,我们在10个深度研究系统中获得了明显不同的排名,项目级通过率从58.58%到22.23%不等。更广泛地说,由于该管道在标准生成和评估中消除了人类专家的执行,它自然可扩展用于基准评估、自动系统比较以及评估驱动的系统改进的未来研究。

英文摘要

Deep research agents are increasingly used to produce long-form financial reports, yet large-scale evaluation remains bottlenecked by the need for human experts to define and execute high-quality rubrics. We address this problem by proposing a scalable pipeline for generating high-quality rubrics without human experts in the final loop. We build a financial deep research benchmark from 104 real-world user queries and automatically synthesize 14,450 query-specific candidate rubrics from model-generated reports. To justify removing human experts from rubric execution, we compare rubric judgments from three human experts with those from a three-LLM judge panel on a sampled subset, and show that LLM-based evaluation is sufficiently consistent with human evaluation to replace it for large-scale rubric screening, including 98.67\% label-level agreement on jointly unanimous items. We then derive consensus-derived gold rubrics through two filters: a strict consistency filter, which keeps a rubric only if the three LLM judges unanimously agree on every report under the same query, and a distinguishability filter, which keeps a rubric only if it assigns at least one majority-yes and at least one majority-no label across the evaluated systems. This process retains 3,687 consistency-passed rubrics, of which 2,600 remain distinguishable and form the final set of consensus-derived gold rubrics. Using this final rubric set, we obtain clearly differentiated rankings across 10 deep research systems, with item-level pass rates ranging from 58.58\% to 22.23\%. More broadly, because the pipeline removes human-expert execution from rubric generation and evaluation, it is naturally scalable for benchmark evaluation, automatic system comparison, and future studies of evaluation-driven system improvement.

URL PDF HTML
2607.11506 2026-07-16 cs.LG cs.CL 版本更新

SCOPE-RL: Optimizing Reasoning Paths Before and After Success

SCOPE-RL:成功前后优化推理路径

Xiaojian Liu, Han Xu, Jianqiang Xia, Zhixuan Li, Ke Xu, Yiwei Dai, Xinran Chen, Changwo Wu, Yuchen Li

发表机构 * Baidu Inc.(百度公司) Shandong University(山东大学)

AI总结 研究针对可验证奖励强化学习中推理路径反馈不足问题,提出SCOPE-RL框架,分两阶段优化,成功前添加奖励,成功后细化轨迹,并经评估协议验证,相比仅结果的GRPO提升准确率、减少推理令牌,且与其他方法互补。

Comments 21 pages, 4 figures

详情
AI中文摘要

可验证奖励的强化学习(RLVR)使用稀疏可验证的最终答案奖励来优化语言模型。这种稀疏锚点能可靠验证轨迹是否成功,但对产生成功的推理路径无直接反馈。成功前,难题的前期进展无奖励信号;成功后,结果奖励无法区分良好组织的正确轨迹与冗余或局部有缺陷的轨迹。我们引入SCOPE-RL,分两阶段强化锚点并保留GRPO更新:成功前,自适应支架式强化学习在答案隐藏子问题链上添加前缀分解可验证奖励;成功后,质量感知过程强化学习应用正确性门控过程形状奖励来优化正确轨迹。专家验证的步骤质量评估协议评估有用步骤密度、错误定位和令牌效率。在Qwen3-8B-Instruct上训练,SCOPE-RL比仅基于结果的GRPO平均准确率提高11.2个百分点,推理令牌减少27.1%,在GSPO和Qwen3-0.6B-Instruct上也有提升,表明奖励信号强化与策略更新级RLVR进展互补。

英文摘要

Reinforcement learning with verifiable rewards (RLVR) optimizes LLMs using sparse verifiable final-answer rewards. This sparse anchor reliably verifies whether a trajectory succeeds but provides no direct feedback on the reasoning path that produced it. Before success, prerequisite progress on hard problems receives no reward signal; after success, outcome rewards cannot distinguish well-organized correct trajectories from redundant or locally flawed ones. We introduce SCOPE-RL (Scaffolded Chain Optimization with Process Efficiency), a two-stage framework that densifies this anchor while retaining the GRPO update: Adaptive Scaffolded RL adds prefix-decomposed verifiable rewards on answer-hidden sub-question chains before success, and Quality-Aware Process RL applies correctness-gated process-shape rewards to refine correct trajectories after success. An expert-validated Step-Quality Evaluation Protocol evaluates useful-step density, error localization, and token efficiency beyond final-answer accuracy. On Qwen3-8B-Instruct trained on DAPO-Math and Big-Math, SCOPE-RL improves average accuracy by up to 11.2 pp and reduces reasoning tokens by up to 27.1% over outcome-only GRPO; the gains hold under GSPO and on Qwen3-0.6B-Instruct, indicating that reward-signal densification is complementary to policy-update-level RLVR advances. Code and data are available at https://github.com/tokencraft-lab/SCOPE-RL.

URL PDF HTML
2607.10057 2026-07-16 quant-ph cs.AI cs.CV cs.LG 交叉投稿

Quantum Circuit Vision: Cost-Aware Evaluation of Visual AI Agents for Quantum Code Generation

量子电路视觉:用于量子代码生成的视觉人工智能代理的成本感知评估

Dongping Liu, Aoyu Zhang, Luyao Zhang

发表机构 * Amazon Web Services(亚马逊网络服务) Duke Kunshan University(杜克昆山大学)

AI总结 研究人工智能代理对量子电路图的理解及代码生成成本,提出量子电路视觉评估框架,构建基准并评估模型,发现中级模型在成本-准确性上平衡最佳,电路深度是失败主因,提出级联路由策略并开源数据集及代码。

详情
AI中文摘要

人工智能代理能否直观理解量子电路图并生成经过验证的可执行代码,且成本如何?我们提出了量子电路视觉,这是一个用于多模态人工智能代理量子电路视觉理解的成本感知评估框架。我们构建了一个包含13个类别的132个电路的基准(1至10个量子比特),带有可执行的亚马逊Braket代码和酉保真度验证。通过对三个不同能力成本层级的前沿Claude系列模型进行n = 5次重复试验评估,我们发现中级模型(Sonnet 4.6,成本为最强模型Opus 4.6每次调用成本的18%)在成本-准确性前沿提供了最有利的平衡:核心子集的通过率为91%,最强模型的准确性优势在统计上不显著(配对t检验:p = 0.083)。逻辑回归证实电路深度而非量子比特数是失败的主要预测因素(p < 0.001)。思维链提示没有统计学上的显著效果(所有p > 0.18,n = 5),这表明对于结构耦合图,视觉模式识别比明确的推理策略更重要。我们提出了一种级联路由策略(从便宜到昂贵的模型),在单模型成本的38%时实现了84%的准确率,表明模型路由作为一种成本杠杆比提示工程更重要。我们在Hugging Face Hub上发布了QCV - 数据集(132个电路,5种模态,1931个文件)作为开放评估基础设施,带有结构化元数据以实现可发现性、互操作性和负责任的人工智能文档,并在GitHub上提供所有评估代码、成本日志和验证脚本以实现完全可重复性。

英文摘要

Can AI agents visually comprehend quantum circuit diagrams and generate verified executable code--and at what cost? We present Quantum Circuit Vision, a cost-aware evaluation framework for multimodal AI agents on quantum circuit visual understanding. We construct a 132-circuit benchmark spanning 13 categories ($1$--$10$ qubits) with executable Amazon Braket code and unitary-fidelity verification. Evaluating three frontier Claude-family models at different capability-cost tiers with $n=5$ repeated trials, we find that the mid-tier model (Sonnet 4.6, $1.30\times$ credits) offers the most favorable balance on the cost-accuracy frontier: 91% pass rate on the core subset at 18% of the per-call cost of the strongest model (Opus 4.6), whose accuracy advantage is not statistically significant (paired $t$: $p=0.083$). Logistic regression confirms that circuit depth--not qubit count--is the primary predictor of failure ($p<0.001$). Chain-of-thought prompting shows no statistically significant effect (all $p>0.18$, $n=5$), suggesting that visual pattern recognition outweighs explicit reasoning strategy for structurally coupled diagrams. We propose a cascade routing strategy (cheap $\rightarrow$ expensive models) that achieves 84% accuracy at 38% of single-model cost, demonstrating that model routing dominates prompt engineering as a cost lever. We release QCV-Dataset (132 circuits, 5 modalities, 1,931 files) on Hugging Face Hub as an open evaluation infrastructure with structured metadata for discoverability, interoperability, and responsible AI documentation, and all evaluation code, cost logs, and verification scripts on GitHub for full reproducibility.

URL PDF HTML
2607.06772 2026-07-16 cs.LG 版本更新

Efficient Long-Horizon Learning for Learned Optimization

用于学习优化的高效长时学习

Xiaolong Huang, Benjamin Thérien, James Harrison, Eugene Belilovsky

发表机构 * Mila - Quebec AI Institute(米拉-魁北克人工智能研究所) Google DeepMind(谷歌深度思维) Concordia University(康考迪亚大学) Université de Montréal(蒙特利尔大学)

AI总结 研究针对学习优化中当前元训练方法的局限,提出高效长时(ELO)学习算法,重新分配计算并实施监督,提升长展开性能和分布外泛化能力,在多任务中表现出色,且元训练所需GPU时长少。

Comments Meta-learning, learned optimization

详情
AI中文摘要

学习优化旨在通过在任务分布上进行元学习小型神经网络优化器来改进手工设计的优化器(如Adam和Muon)。近期工作虽推进了学习优化器(LOs)的架构设计和归纳偏差,但当前元训练方法仍有两个主要困难:无法有效扩展到长时内部问题,且常无法超越手工设计的优化器。为解决这些局限,我们提出高效长时(ELO)学习,它重新分配冗余元训练计算到更长失败阶段以实现高效长时学习,还实施解耦渐进专家监督以提供稳定元学习信号并提升LOs泛化能力。实证研究评估了ELO在按元素和基于矩阵的LOs元训练中的效果。在下游语言建模和图像分类任务中,ELO显著提升了基础LOs的长展开性能和分布外泛化能力。特别是ELO - Celo2在所有评估任务中持续优于调优良好的AdamW,在语言建模上与Muon竞争。值得注意的是,所有ELO基线在元训练时所需的H100 GPU时长不到7小时。

英文摘要

Learned optimization aims to improve upon hand-designed optimizers (e.g., Adam and Muon) by meta-learning small neural network optimizers over a distribution of tasks. While recent work has greatly advanced the architectural design and inductive biases of learned optimizers (LOs), their meta-training remains biased toward short-unroll learning on particular tasks, resulting in redundant computation and leaving LOs often unable to compete with hand-designed optimizers. We introduce Efficient Long-hOrizon (ELO) learning, an efficient meta-training algorithm that (1) reallocates wasted meta-training compute to longer failure regimes, achieving efficient long-horizon learning, and (2) enforces decoupled progressive expert supervision, providing stable meta-learning signals that additionally improve the generalization of LOs. Our empirical study evaluates ELO for meta-training both element-wise and matrix-based LOs. Across downstream language modeling (GPT-2-124M/350M on FineWeb) and image classification (ViT-B/16, ResNet-50 on ImageNet-1K) tasks, ELO substantially improves the long-unroll performance and out-of-distribution generalization of the base LOs. In particular, ELO-Celo2 consistently outperforms well-tuned AdamW across all evaluated tasks, while remaining competitive with Muon on language modeling. \textit{Notably, all ELO baselines require less than 7 H100 GPU-hours for meta-training.}

URL PDF HTML