arXivDaily arXiv每日学术速递 周一至周五更新
全部学科分类 5112
2607.05396 2026-07-07 cs.CV cs.AI cs.LG cs.RO 新提交

From Fixed to Free Cameras: Calibration-Free View-Robust Vision-Language-Action Model

从固定相机到自由相机:无需标定的视图鲁棒视觉-语言-动作模型

Wenhao Li, Xueying Jiang, Quanhao Qian, Deli Zhao, Shijian Lu, Gongjie Zhang, Ran Xu

发表机构 * Nanyang Technological University(南洋理工大学) DAMO Academy, Alibaba Group(阿里巴巴达摩院) HuPan Lab(湖畔实验室) Alibaba Group(阿里巴巴集团)

AI总结 针对真实机器人部署中相机位姿变动问题,提出CamVLA模型,解耦操控控制与相机几何,实现无标定视图鲁棒的机器人任务执行。

详情
AI中文摘要

真实世界的机器人部署几乎不会维持训练阶段的相机设置,相机往往会根据实际场景发生移位或重装。现有视图鲁棒的视觉-语言-动作(VLA)策略仅在显式提供相机外参时才能容忍这类相机变化,导致其鲁棒性差、难以使用,尤其在视图鲁棒性至关重要的场景中。我们认为策略不应被告知相机的位置,而应自主推断。为此,本文提出以相机为中心的VLA(CamVLA)这一新型VLA模型,它通过预测两个分量将操控控制与相机几何解耦:(1)以局部相机坐标系表示的相机中心末端执行器动作,(2)关联相机与机器人基座的6自由度手眼矩阵。通过确定性几何变换可将两个预测结果组合为机器人基座坐标系下的动作。该方法将“我应如何运动”的位姿无关相机中心动作生成,与“我从何处观测”的相机视角几何锚定解分开。最终得到的策略无需标定、无需深度信息且支持单视图输入,部署时仅需单张单目RGB图像作为视觉观测和任务指令。仿真与真实机器人数据集上的评估结果表明,CamVLA在各类未见过的视图下均能持续提升任务成功率。项目页面:本HTTP链接。

英文摘要

Real-world robot deployment rarely maintains the training-stage camera setup, where cameras often experience repositioning or remounting depending on actual scenarios. Existing view-robust Vision-Language-Action (VLA) policies tolerate such camera variations only when the camera extrinsics are explicitly provided, making them fragile and hard to use especially when view robustness is critical. We argue that the policy should not be told where the camera is, but rather figure it out by itself. To this end, we introduce Camera-Centric VLA (CamVLA), a new VLA model that decouples manipulation controls from camera geometry by predicting (i) a camera-centric end-effector action expressed in the local camera frame, and (ii) a 6-DoF hand-eye matrix relating cameras to the robot base. A deterministic geometric transformation composes the two predictions into a robot base-frame action. This disentangles how I should move in pose-independent camera-centric action generation from where I am looking from in camera-perspective geometric grounding. The resulting policy is calibration-free, depth-free, and single-view, requiring only a single monocular RGB image as the visual observation and task instruction at deployment. Evaluations in both simulation and real-world robot data show that CamVLA consistently improves success rates across diverse unseen viewpoints. Project page: https://alibaba-damo-academy.github.io/CamVLA/.

URL PDF HTML
2607.05394 2026-07-07 cs.LG cs.AI cs.CL 新提交

Weak-to-Strong Generalization via Direct On-Policy Distillation

通过直接在线策略蒸馏实现弱到强泛化

Shiyuan Feng, Huan-ang Gao, Haohan Chi, Hanlin Wu, Zhilong Zhang, Zheng Jiang, Bingxiang He, Wei-Ying Ma, Ya-Qin Zhang, Hao Zhou

发表机构 * SIA-Lab of Tsinghua AIR and ByteDance Seed(清华-字节跳动联合研究中心SIA实验室) Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院) Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系) Peking University(北京大学)

AI总结 针对可验证奖励RL在大模型上成本高的问题,提出Direct-OPD方法迁移小模型RL的策略偏移,无需在大模型上跑RL即可实现性能提升。

Comments Project Page: https://bytedtsinghua-sia.github.io/Direct-OPD/

详情
AI中文摘要

带可验证奖励的强化学习(RLVR)是提升语言模型推理能力的有效方案,但由于训练过程中目标模型需要生成大量轨迹,在每款新的强模型上重复执行该流程成本极高。随着模型规模扩大,后训练本身就成为了性能瓶颈。本文研究一种弱到强的替代方案:先在轨迹生成成本更低的小模型上运行RL,再复用该RL流程学到的知识来优化更强的目标模型。直接蒸馏经过RL训练的弱教师模型效果不佳,因为教师的最终策略同时混合了RL带来的有效增益和小模型自身的固有局限。本文提出直接在线策略蒸馏(Direct-OPD)方法,转而迁移教师模型由RL诱导的策略偏移。Direct-OPD将经过RL训练的教师模型与其自身未经过RL训练的参考模型做对比,把二者的对数似然比作为面向学生模型的稠密隐式奖励。通俗来说,这一对检查点可以标识出RL让弱模型更倾向或更不倾向采取的动作,而Direct-OPD会将该信号应用于更强学生模型自身的在线策略状态上。该方法可以直接复用弱模型的RL监督信号,无需训练显式奖励模型,也无需在目标模型上运行稀疏奖励RL。实验表明,Direct-OPD可以稳定地利用更弱的教师模型来提升更强的目标模型性能:值得注意的是,仅需在8张A100 GPU上运行4小时,它就能将Qwen3-1.7B在2024年AIME数据集上的准确率从48.3%提升至62.4%。该方法性能优于步数匹配的直接RL,还支持多轮策略偏移的顺序组合。本文结果表明,RL的产出可以作为隐式奖励信号跨模型规模复用,而不只是作为待模仿的最终模型。

英文摘要

Reinforcement learning with verifiable rewards (RLVR) is a powerful recipe for improving language-model reasoning, but it is expensive to repeat on every new strong model because the target model must generate many rollouts during training. As models scale, post-training itself becomes a bottleneck. We study a weak-to-strong alternative: run RL on a smaller model where rollouts are cheaper, then reuse what that RL run learned to improve a stronger target model. Directly distilling the post-RL weak teacher is not enough, because the teacher's final policy mixes useful RL gains with the limitations of the smaller model. We propose Direct On-Policy Distillation (Direct-OPD), which transfers the teacher's RL-induced policy shift instead. Direct-OPD compares the post-RL teacher with its own pre-RL reference and treats their log-ratio as a dense implicit reward for the student. In plain terms, the checkpoint pair tells us which actions RL made the weak model more or less likely to take, and Direct-OPD applies that signal on the stronger student's own on-policy states. This directly reuses the weak model's RL supervision signal without training an explicit reward model or running sparse-reward RL on the target model. Empirically, Direct-OPD consistently leverages weaker teachers to improve stronger target models; notably, it boosts Qwen3-1.7B from 48.3% to 62.4% on AIME 2024 in just 4 hours on 8 A100 GPUs. It outperforms step-matched direct RL and enables the sequential composition of multiple policy shifts. Our results show that RL outcomes can be reused across model scales as implicit reward signals, not merely as final models to imitate.

URL PDF HTML
2607.05392 2026-07-07 cs.CV 新提交

SynCity 3000: Bootstrapping Scene-Scale 3D Diffusion

SynCity 3000:引导式构建场景级3D扩散模型

Paul Engstler, Iro Laina, Christian Rupprecht, Andrea Vedaldi

发表机构 * Visual Geometry Group, University of Oxford(牛津大学视觉几何组)

AI总结 针对3D场景训练数据稀缺问题,该框架将图像转3D生成器改造为卷积算子,依托新合成数据引擎微调,可生成全局连贯、支持细粒度布局控制的任意规模3D场景。

Comments Project Page: https://research.paulengstler.com/syncity-3k/

详情
AI中文摘要

我们提出SynCity 3000这一3D场景生成框架,可生成具备全局一致性的3D场景,同时支持细粒度布局控制。依托现有图像转3D生成器从单张图像生成复杂3D资产的能力,我们通过将生成器改造为可作为卷积算子使用的模块,将该能力拓展至完整场景尺度。我们通过在新型合成数据引擎生成的类场景数据上微调模型实现上述目标,该引擎用于解决训练用3D场景数据稀缺的问题。随后将卷积生成器应用于由用户提示生成的完整场景二测图,即可得到任意尺寸与复杂度的3D场景。在各类提示与布局下,SynCity 3000均可生成大型、连贯且细节丰富的场景,弥补了现有3D场景生成方案的不足。

英文摘要

We present SynCity 3000, a framework for generating 3D scenes that are globally coherent while enabling fine-grained layout control. Building on the ability of current image-to-3D generators to produce complex 3D assets from a single image, we extend this capability to the scale of entire scenes by adapting the generator to be applicable as a convolutional operator. We achieve this by fine-tuning the model on scene-like data generated by a new synthetic data engine, which we propose to address the scarcity of 3D scene data for training. The convolutional generator is then applied to a dimetric image of the entire scene, generated from the user prompt, resulting in 3D scenes of arbitrary size and complexity. Across diverse prompts and layouts, SynCity 3000 produces large, coherent, and detailed scenes, addressing the shortcomings of prior approaches to 3D scene generation.

URL PDF HTML
2607.05391 2026-07-07 cs.AI cs.CL cs.LG cs.MA cs.RO 新提交

LLM-as-a-Verifier: A General-Purpose Verification Framework

LLM-as-a-Verifier:一种通用验证框架

Jacky Kwok, Shulu Li, Pranav Atreya, Yuejiang Liu, Yixing Jiang, Chelsea Finn, Marco Pavone, Ion Stoica, Azalia Mirhoseini

发表机构 * Stanford University(斯坦福大学) UC Berkeley(加州大学伯克利分校) NVIDIA Research(英伟达研究院)

AI总结 该工作将验证确定方案正确性的能力作为大模型新扩展轴,提出无需额外训练的通用LLM验证框架,生成连续评分,在多基准上取得SOTA性能,还可用于强化学习等场景。

Comments Code: https://github.com/llm-as-a-verifier/llm-as-a-verifier Website: https://llm-as-a-verifier.com

详情
AI中文摘要

扩展预训练、后训练和测试时计算量已成为提升大语言模型LLM能力的核心范式。本研究将验证即判定解决方案正确性的能力确立为一个新的扩展轴。为释放该轴的潜力并验证其有效性,我们提出LLM-as-a-Verifier这一通用验证框架,它无需额外训练即可为智能体任务提供细粒度反馈。不同于提示LLM为候选解决方案生成离散分数的标准大模型裁判方法,LLM-as-a-Verifier通过计算评分token对数几率分布的期望来生成连续分数。该概率化公式让验证可沿三个维度扩展:1 评分粒度、2 重复评估、3 准则分解。我们特别证明,扩展评分粒度可提升正负解决方案的区分度,得到更校准的比较结果;扩展重复评估与准则分解可通过降低方差和复杂度持续提升验证准确率。我们还提出一种高性价比排序算法,利用验证器的连续分数从候选方案中选出最优解。LLM-as-a-Verifier在Terminal-Bench V2准确率86.5%、SWE-Bench Verified准确率78.2%、RoboRewardBench准确率87.4%和MedAgentBench准确率73.3%上均取得当前最优性能。除验证外,LLM-as-a-Verifier输出的细粒度信号还可作为估算任务进度的代理指标。我们为Claude Code搭建了扩展组件,支持开发者监控和优化自有智能体系统。最后,实验表明LLM-as-a-Verifier可为强化学习RL提供密集反馈,提升软Actor-批评家算法SAC和分组相对策略优化算法GRPO在机器人与数学推理基准上的样本效率。

英文摘要

Scaling pre-training, post-training, and test-time compute have become the central paradigms for improving the capabilities of LLMs. In this work, we identify verification, the ability to determine the correctness of a solution, as a new scaling axis. To unlock this and demonstrate its effectiveness, we introduce LLM-as-a-Verifier, a general-purpose verification framework that provides fine-grained feedback for agentic tasks without requiring additional training. Unlike standard LM judges that prompt LLMs to produce discrete scores for candidate solutions, LLM-as-a-Verifier computes the expectation over the distribution of scoring token logits to generate continuous scores. This probabilistic formulation enables verification to scale along multiple dimensions: (1) score granularity, (2) repeated evaluation, and (3) criteria decomposition. In particular, we show that scaling the scoring granularity leads to better separation between positive and negative solutions, resulting in more calibrated comparisons. Moreover, scaling repeated evaluation and criteria decomposition consistently lead to additional gains in verification accuracy through variance and complexity reduction. We further introduce a cost-efficient ranking algorithm for selecting the best solution among candidates using the verifier's continuous scores. LLM-as-a-Verifier achieves state-of-the-art performance on Terminal-Bench V2 (86.5%), SWE-Bench Verified (78.2%), RoboRewardBench (87.4%), and MedAgentBench (73.3%). Beyond verification, the fine-grained signals from LLM-as-a-Verifier can also serve as a proxy for estimating task progress. We build an extension for Claude Code, enabling developers to monitor and improve their own agentic systems. Finally, we show that LLM-as-a-Verifier can provide dense feedback for RL, improving the sample efficiency of SAC and GRPO on robotics and mathematical reasoning benchmarks.

URL PDF HTML
2607.05390 2026-07-07 cs.RO cs.CV 新提交

Deform360: A Massive Multi-view Visuotactile Dataset for Deformable World Models

Deform360:面向可变形世界模型的大规模多视图视觉触觉数据集

Hongyu Li, Wanjia Fu, Xiaoyan Cong, Zekun Li, Binghao Huang, Hanxiao Jiang, Xintong He, Yiqing Liang, Rao Fu, Tao Lu, Srinath Sridhar, Kevin A. Smith, George Konidaris, Yunzhu Li

发表机构 * Brown University(布朗大学) Columbia University(哥伦比亚大学) Massachusetts Institute of Technology(麻省理工学院)

AI总结 针对可变形物体世界建模缺乏大规模真实数据的问题,构建含多视图视觉与触觉信息的Deform360数据集,评估现有主流世界模型,为相关研究提供基准。

Comments Accepted by ECCV 2026

详情
AI中文摘要

预测物体动力学(即世界建模)是机器人操作领域的基础挑战,而对可变形物体进行建模尤为困难,原因在于其高维状态空间与复杂的材料属性。当前世界模型主要通过两种不同范式实现:在2D像素空间上学习动力学,或是在更明确的3D几何空间上学习动力学。由于缺乏多样化的大规模真实世界数据,目前学界仍难以系统性厘清两类范式的相对优势与局限。为解决这一问题,我们提出Deform360这一大型视觉触觉数据集,其包含198个日常物体、1980条交互序列,以及来自41台环绕视图相机和双手触觉夹爪的超过215小时观测数据,可同时捕捉全局运动与接触引发的局部形变。我们利用一种全新的无标记视觉触觉3D跟踪流水线提取密集几何与运动信息,系统性评估当前最先进的世界模型,对2D视频模型与3D粒子模型进行对比。最后,我们通过在可变形物体上执行机器人规划任务,初步验证了该数据集的真实场景适用性。我们的分析揭示了结构先验与可扩展性之间权衡的关键洞见,为后续面向泛化型可变形物体世界建模的研究提供了可靠基准。项目主页:本HTTP链接

英文摘要

Predicting object dynamics (i.e., world modeling) is a fundamental challenge for robotic manipulation, and modeling deformable objects presents a particularly difficult case due to their high-dimensional state spaces and complex material properties. While current world models approach this through two distinct paradigms: learning the dynamics over the 2D pixel space or more explicit 3D geometric space. A systematic understanding of their relative strengths and limitations remains elusive due to the lack of diverse, large-scale real-world data. To address this, we present Deform360, a large-scale visuotactile dataset featuring 198 daily-life objects, 1,980 interaction sequences, and over 215 hours of observations from 41 surround-view cameras and bimanual tactile grippers to capture both global motion and contact-induced local deformations. Leveraging a novel markerless visuotactile 3D tracking pipeline to extract dense geometry and motion, we systematically evaluate current state-of-the-art world models, comparing 2D video models against 3D particle models. Finally, we provide a preliminary demonstration indicating the real-world applicability of our dataset by performing robot planning tasks on deformable objects. Our analysis reveals key insights into the trade-offs between structural priors and scalability, providing a solid benchmark for future research in generalizable deformable object-centric world modeling. Project website: https://deform360.lhy.xyz

URL PDF HTML
2607.05389 2026-07-07 cs.CV 新提交

InFlux++: Real and Synthetic Data for Estimating Dynamic Camera Intrinsics

InFlux++:用于估计动态相机内参的真实与合成数据

Erich Liang, Caleb Kha-Uong, Chinmaya Saran, Sreemanti Dey, David W. Liu, Junhan Ouyang, Benjamin Zhou, Jia Deng

发表机构 * Princeton University(普林斯顿大学)

AI总结 针对动态相机内参估计的训练数据匮乏、评测基准多样性不足问题,构建含大规模合成数据集与真实基准的InFlux++,可提升RGB图像的逐帧内参估计性能。

Comments Accepted to ECCV 2026

详情
AI中文摘要

相机内参对于从2D视频中恢复3D结构至关重要。然而,大多数3D算法假设视频全程内参固定,这一假设在真实野外视频中往往不成立。因此,从RGB图像估计逐帧内参对于让3D方法对含动态内参的视频具备鲁棒性至关重要。此前InFlux通过首个带逐帧内参真值的动态内参真实视频基准推动了该方向研究,但现有方法仍受两个问题制约:(i)训练数据稀缺且内参多样性不足;(ii)包括InFlux在内的基准场景与相机运动多样性有限,难以充分评估方法性能。为解决这两个缺口,本文提出InFlux++,它包含两个组件。InFlux++ Synth是大规模过程式生成的合成视频数据集,含1841个高分辨率视频的44.1万余标注帧,为动态内参预测模型训练提供精准的逐帧内参真值,部分子集还包含逐帧位姿、深度与法向量。该类视频通过相机变焦与对焦变化实现丰富的内参多样性,同时包含动态对象及镜头畸变、散焦模糊等真实渲染效果。InFlux++ Real是大规模真实世界基准,在InFlux基础上新增334个高分辨率视频的51.4万余采集帧,覆盖更广泛的场景与相机运动。在InFlux++ Synth上对现有内参预测方法进行微调,可在InFlux++ Real与InFlux数据集上持续提升焦距估计精度,表明合成监督在基于RGB的内参预测任务中具备应用前景。数据集、基准、代码、视频、提交指南及实时排行榜可访问对应https URL获取。

英文摘要

Camera intrinsics are vital for recovering 3D structure from 2D video. However, most 3D algorithms assume fixed intrinsics throughout a video, an assumption that often fails for real-world in-the-wild videos. Consequently, estimating per-frame intrinsics from RGB images is critical for making 3D methods robust to videos with dynamic intrinsics. InFlux previously advanced this research direction by establishing the first real-world benchmark with per-frame ground truth intrinsics for dynamic intrinsics videos. Nevertheless, existing methods remain inaccurate due to two obstacles: (i) training data is scarce and lacks intrinsics diversity; and (ii) benchmarks, including InFlux, have limited scene and camera motion diversity, making it difficult to properly evaluate methods. To address both gaps, we present InFlux++, consisting of two components. InFlux++ Synth is a large-scale procedurally generated synthetic video dataset with 441K+ annotated frames from 1841 high-resolution videos, providing accurate per-frame ground truth intrinsics for training dynamic intrinsics prediction models; a subset also includes per-frame pose, depth, and normals. The videos feature rich intrinsics diversity through changes in camera zoom and focus, as well as dynamic objects and realistic rendering effects such as lens distortion and defocus blur. InFlux++ Real is a large-scale real-world benchmark that extends InFlux with 514K+ newly captured frames across 334 high-resolution videos, spanning a wider range of scenes and camera motions. Finetuning existing intrinsics prediction methods on InFlux++ Synth consistently improves focal length estimation across both InFlux++ Real and InFlux, suggesting that synthetic supervision is promising for RGB-based intrinsics prediction. For the dataset, benchmark, code, videos, submission instructions, and live leaderboard, please visit https://influx.cs.princeton.edu/ .

URL PDF HTML
2607.05382 2026-07-07 cs.CV cs.AI 新提交

Search Beyond What Can Be Taught: Evolving the Knowledge Boundary in Agentic Visual Generation

超越可教内容的搜索:拓展智能体视觉生成的知识边界

Haozhe Wang, Weijia Feng, Jinpeng Yu, Che Liu, Ping Nie, Fangzhen Lin, Jiaming Liu, Ruihua Huang, Jimmy Lin, Wenhu Chen, Cong Wei

发表机构 * Hong Kong University of Science and Technology(香港科技大学) University of Waterloo(滑铁卢大学) Qwen Applications(通义千问应用) Imperial College London(帝国理工学院)

AI总结 针对视觉生成器的世界知识瓶颈,构建专用数据集与基准,提出教-搜协同训练框架定位动态知识边界,实现知识驱动的可迭代视觉生成性能提升。

详情
AI中文摘要

视觉生成器擅长渲染,但会自信地生成自身并不了解的内容。用户请求是无界、动态演化且高度长尾的:涵盖全新角色、流行实体、训练截止日期之后发生的事件等各类内容。这种世界知识瓶颈是结构性的:生成器基于固定语料训练,而视觉世界是开放的。我们构建了包含20839条提示的SearchGen-20K数据集与SearchGen-Bench基准,覆盖12类失效场景与22个领域,配套预执行的多模态SearchGen-Corpus-1M语料库,为离线可复现研究提供支撑。在SearchGen-Bench上,当前顶尖的开源生成器得分仅为21至28分(满分100),这一40分的性能滑坡在现有基准中完全无法被观测到。自然的解决方案是引入搜索工具,实现智能体视觉生成。但我们发现,朴素搜索方案效果不佳:它会无差别检索内容,向生成器原本可以正确处理的提示中注入噪声。我们将根本原因定位为生成器特有的动态演化知识边界:即生成器可通过训练内化的内容与必须留存于外部上下文的内容之间的分界。尽管该边界难以预先明确指定,我们证明其可通过先教后搜的协同训练框架被探测定位。即使是该协同训练方案的最简版本也能带来性能的单调提升,为可满足世界知识锚定请求的视觉生成递归自优化能力奠定基础。我们公开全部数据集、协同训练语料与搜索语料,作为可复现的工具增强型、世界知识锚定视觉生成研究支撑框架。

英文摘要

Visual generators excel at rendering, but they confidently fabricate what they do not know. User requests are unbounded, evolving, and deeply long-tailed: new characters, trending entities, post-cutoff events, and more. This world-knowledge bottleneck is structural: generators are trained on fixed corpora, but the visual world is open-ended. We construct SearchGen-20K and SearchGen-Bench, with 20,839 prompts spanning twelve failure categories and twenty-two domains, paired with a pre-executed multimodal SearchGen-Corpus-1M to support offline, reproducible research. On SearchGen-Bench, frontier open generators score only 21 to 28 out of 100, a 40-point collapse invisible to existing benchmarks. The natural remedy is to employ search tools, enabling agentic visual generation. However, we find that naive search fails: it retrieves indiscriminately, injecting noise into prompts the generator already handles. We trace the root cause to a generator-specific, evolving knowledge boundary: the divide between what a generator can internalize through training and what must remain in external context. Although this boundary is hard to specify in advance, we show that it is discoverable through a teach-then-search co-training framework. Even a minimal version of this co-training recipe produces monotonic improvement, laying the foundation for recursive self-improvement in visual generation that can meet world-knowledge-grounded requests. We release the full dataset, co-training corpus, and search corpus as a replayable harness for tool-augmented, world-knowledge-grounded visual generation.

URL PDF HTML
2607.05380 2026-07-07 cs.LG 新提交

TabPack: Efficient Hyperparameter Ensembles for Tabular Deep Learning

TabPack:面向表格深度学习的高效超参数集成方法

Yury Gorishniy, Akim Kotelnikov, Ivan Rubachev, Artem Babenko

发表机构 * Yandex HSE University(俄罗斯高等经济大学)

AI总结 针对现有表格数据MLP集成需超参数调优的问题,提出TabPack可并行采样训练多超参数MLP并动态选集成成员,开箱性能优异,大幅降低调优成本与计算资源消耗。

Comments ICML 2026. Code: https://github.com/yandex-research/tabpack

详情
AI中文摘要

在面向表格数据的深度学习领域,多层感知机(MLP)的高效集成近期已成为兼具效果与实用性的架构。这类现有方法对所有底层MLP使用相同的超参数,需要开展超参数调优才能获得最优性能。本工作提出TabPack,这是一种高效的MLP集成方法,具备出色的开箱即用性能,同时降低了对传统调优流程的依赖。仅需单次运行,TabPack即可高效并行采样并训练大量拥有不同超参数的MLP,还能在训练过程中动态选择集成成员。因此TabPack仅需指定用于采样MLP超参数的取值范围,而非精确的超参数数值,自然无需高精度参数设定即可获得良好性能。在中大型公开数据集上的实验表明,采用默认设置的TabPack性能与经过大规模调优的现有方法相当,大幅降低了在表格任务中取得有竞争力结果所需的人力与计算资源。值得注意的是,在现代MacBook上运行默认配置的TabPack,耗时甚至低于在工业级GPU上调优部分基线方法的耗时。

英文摘要

In deep learning for tabular data, efficient ensembles of multilayer perceptrons (MLPs) have recently emerged as effective and practical architectures. Existing methods of this kind use the same hyperparameters for all underlying MLPs, which requires hyperparameter tuning for achieving the best performance. In this work, we introduce TabPack, an efficient MLP ensemble with strong out-of-the-box performance and reduced reliance on traditional tuning. In a single run, TabPack samples and trains many MLPs with different hyperparameters efficiently in parallel and selects ensemble members on the fly during training. Thus, TabPack only requires specifying ranges from which to sample MLP hyperparameter rather than exact hyperparameter values, which naturally demands less precision for good performance. In experiments on medium-to-large public datasets, TabPack with default settings performs on par with extensively tuned prior methods, thus substantially reducing effort and compute resources needed to achieve competitive results on tabular tasks. Notably, running the default TabPack configuration on a modern MacBook took less time than tuning some baselines on an industry-grade GPU.

URL PDF HTML
2607.05378 2026-07-07 cs.LG 新提交

CompactionRL: Reinforcement Learning with Context Compaction for Long-Horizon Agents

CompactionRL:面向长视界智能体的带上下文压缩强化学习

Yujiang Li, Zhenyu Hou, Yi Jing, Jie Tang, Yuxiao Dong

发表机构 * Tsinghua University(清华大学)

AI总结 针对长视界大语言模型智能体受上下文窗口限制的问题,提出结合上下文压缩的强化学习方法,联合优化任务执行与摘要生成,在智能体编码任务上取得显著性能提升。

详情
AI中文摘要

长视界大语言模型智能体正日益受到有限上下文窗口的限制,因为扩展的交互轨迹可能在任务完成前就超出最大上下文长度。上下文压缩通过汇总先前的交互状态并在压缩后的上下文下继续推演提供了一种自然解决方案,但将压缩整合入强化学习的相关研究仍有待探索。本文提出CompactionRL,一种用于训练具备上下文压缩能力的长视界大语言模型智能体的强化学习策略。该方法通过令牌级损失归一化和跨轨迹广义优势估计,联合优化任务执行与摘要生成。该设计使大语言模型智能体能够从压缩后的长视界轨迹中学习。研究团队在开源模型之上训练CompactionRL,并在智能体编码任务上观测到一致的性能提升。CompactionRL使开源GLM-4.5-Air模型(106B-A30B)在SWE-bench Verified上实现66.8%的Pass@1得分,在Terminal-Bench 2.0上实现24.5%的Pass@1得分,绝对提升幅度分别达到7.0和3.1个百分点。基于GLM-4.7-Flash(30B-A3B)构建的CompactionRL将Pass@1得分分别提升5.5和6.8个百分点,在SWE-bench Verified上达到56.0%,在Terminal-Bench 2.0上达到20.2%。CompactionRL因此已被部署至用于训练开源GLM-5.2模型(750B-A40B)的强化学习流水线中。

英文摘要

Long-horizon agentic LLMs are increasingly limited by finite context windows, as extended interaction trajectories can exceed the maximum context length before a task is completed. Context compaction offers a natural solution by summarizing previous interaction states and continuing the rollout under a compressed context, but incorporating compaction into reinforcement learning remains underexplored. We propose CompactionRL, a reinforcement learning strategy to train long-horizon agentic LLMs with context compaction. Our approach jointly optimizes task execution and summary generation with token-level loss normalization and cross-trajectory generalized advantage estimation. This design enables the LLM agents to learn from compacted long-horizon trajectories. We train CompactionRL on top of open models and observe consistent performance gains on agentic coding tasks. CompactionRL enables the open GLM-4.5-Air model (106B-A30B) to achieve Pass@1 scores of 66.8% on SWE-bench Verified and 24.5% on Terminal-Bench 2.0, with absolute gains of 7.0 and 3.1 points, respectively. Built upon GLM-4.7-Flash (30B-A3B), CompactionRL improves Pass@1 by 5.5 and 6.8 points, reaching 56.0% on SWE-bench Verified and 20.2% on Terminal-Bench 2.0, respectively. CompactionRL is thus deployed in the RL pipeline for training the open GLM-5.2 model (750B-A40B).

URL PDF HTML
2607.05376 2026-07-07 cs.CV cs.GR 新提交

MV-Forcing: Long Multi-View Video Generation via 4D-Grounded Spatio-Temporal Self-Forcing

MV-Forcing:基于4D锚定时空自强制的长时长多视角视频生成

Gal Fiebelman, Hadar Averbuch-Elor, Sagie Benaim

发表机构 * The Hebrew University of Jerusalem(耶路撒冷希伯来大学) Cornell University(康奈尔大学)

AI总结 针对动态场景长时多视角一致视频生成难题,提出MV-Forcing框架,融合时序与视角自回归,实现任意时长视角数的高一致性多视角视频生成。

Comments Accepted to ECCV 2026. Project webpage: https://galfiebelman.github.io/mv-forcing/

详情
AI中文摘要

视频扩散模型的最新进展已可通过时序自回归实现长时长单视角生成,或通过双向注意力实现短时长多视角合成。但动态场景的长时长、多视角一致视频生成问题仍未得到解决。本研究提出MV-Forcing框架,通过在序贯生成的视角之间引入4D几何桥接,在单个扩散模型内组合时序与逐视角自回归机制。核心思路是让自回归3D重建模型在自回归生成的不同视角之间自然衔接:给定已完成的源视角,先重建其3D结构并渲染出下一个目标视点的几何先验,再由扩散模型将该先验优化为高质量视频。为突破教师模型固定时序窗口的生成限制,本研究引入联合去噪机制,训练过程中两个视角槽均从噪声初始化,支持无边界的时序生成。研究通过带时空自强制的分布匹配蒸馏对模型进行蒸馏,消除了时序与视角序贯自回归过程中的训练-推理暴露偏差。在合成数据与真实世界数据上开展的大量实验表明,MV-Forcing仅需单步少步学生模型,即可生成任意时长、任意视角数的几何一致动态场景多视角视频。

英文摘要

Recent advances in video diffusion models have enabled either long single-view generation through temporal autoregression, or short multi-view synthesis through bidirectional attention. However, generating long, multi-view consistent videos of dynamic scenes remains unsolved. In this work, we present MV-Forcing, a framework that composes temporal and view-wise autoregression within a single diffusion model by introducing a 4D geometric bridge between sequentially generated views. Our key insight is that an autoregressive 3D reconstruction model naturally interfaces between autoregressively generated views. Given a completed source view, we reconstruct its 3D structure and render a geometric prior of the next target viewpoint, which the diffusion model refines into a high-quality video. To extend generation beyond the teacher's fixed temporal window, we introduce a joint denoising regime where both view slots are initialized from noise during training, enabling temporally unbounded generation. We distill the model via Distribution Matching Distillation with Spatio-Temporal Self-Forcing, closing the train-inference exposure bias gap for both temporal and view-sequential autoregression. Extensive experiments on both synthetic and real-world data demonstrate that MV-Forcing produces geometrically consistent multi-view videos of dynamic scenes at arbitrary lengths and viewpoint counts using a single few-step student model.

URL PDF HTML
2607.05373 2026-07-07 cs.CV 新提交

PixWorld: Unifying 3D Scene Generation and Reconstruction in Pixel Space

PixWorld:在像素空间中统一3D场景生成与重建

Sensen Gao, Zhaoqing Wang, Qihang Cao, Dongdong Yu, Changhu Wang, Jia-Wang Bian

发表机构 * Nanyang Technological University(南洋理工大学) AISphere(人工智能领域)

AI总结 针对3D场景生成与重建原有范式存在信息损失等缺陷,提出像素空间统一扩散框架PixWorld,引入几何感知损失,无需预训练自编码器,性能优于现有方法。

Comments Project page: https://sensengao.github.io/PixWorld/

详情
AI中文摘要

3D重建与生成通常采用不同的范式实现:基于像素的回归用于重建任务,隐空间扩散用于生成任务。近期研究尝试在隐空间中统一两类任务,但存在明显缺陷:扩散目标基于隐特征而非底层3D表征定义,两个任务分支都会遭遇隐编码引入的信息损失,且需要依赖预训练的变分自编码器(VAE)或表征自编码器(RAE)。本文将这两类任务重构到统一的像素空间扩散范式下,提出PixWorld这一可同时处理3D重建与生成任务的单模型。通过直接对渲染图像施加扩散监督,PixWorld消除了上述限制,使优化过程与3D场景保真度对齐。针对仅在2D图像层面生效、缺乏3D几何感知的光度监督与感知监督的不足,本文进一步提出几何感知损失,在预训练3D基础模型的几何感知特征空间中对齐渲染视图与其真值,提供3D结构监督。PixWorld的性能持续优于现有隐空间生成方法,且与当前最先进的重建方法性能相当,证明了像素空间统一方法的优越性。

英文摘要

3D reconstruction and generation are commonly tackled by separate paradigms: pixel-based regression for reconstruction, and latent diffusion for generation. Recent works attempt to unify them in latent space, but with notable drawbacks: the diffusion objective is defined on latent features rather than the underlying 3D representation, and both branches suffer from information loss introduced by latent encoding, while requiring a pretrained Variational Autoencoder (VAE) or Representation Autoencoder (RAE). In this paper, we reformulate these two tasks under a unified pixel-space diffusion paradigm and introduce PixWorld, a single model that jointly addresses 3D reconstruction and generation. By supervising diffusion directly on rendered images, PixWorld removes the above limitations and aligns optimization with 3D scene fidelity. Beyond photometric and perceptual supervision that operates at the 2D image level and lacks 3D geometric awareness, we further introduce a geometry perception loss that aligns rendered views with their ground truth in the geometry-aware feature space of a pretrained 3D foundation model, providing 3D structural supervision. PixWorld consistently outperforms prior latent-space generation methods and matches state-of-the-art reconstruction methods, demonstrating the superiority of a unified pixel-space approach.

URL PDF HTML
2607.05369 2026-07-07 cs.RO cs.AI cs.CL cs.LG 新提交

GaP: A Graph-as-Policy Multi-Agent Self-Learning Harness For Variational Automation Tasks

GaP:面向变分自动化任务的图即策略多智能体自学习框架

Kaiyuan Chen, Shuangyu Xie, Letian Fu, Justin Yu, William Pacini, Sandeep Bajamahal, Hudson Kim, Jaimyn Drake, Daehwa Kim, Haoru Xue, Jonathan Francis, Christian Juette, Peter Schaldenbrand, Muhammet Yunus Seker, Ruwan Wickramarachchi, Uksang Yoo, Guanzhi Wang, Adithyavairavan Murali, Balakumar Sundaralingam, S. Shankar Sastry, Spencer Huang, Yuke Zhu, Linxi "Jim" Fan, Ken Goldberg

发表机构 * University of California, Berkeley(加利福尼亚大学伯克利分校) NVIDIA(英伟达) Carnegie Mellon University(卡内基梅隆大学) Bosch(博世)

AI总结 针对变分自动化任务无模型策略可靠性不足问题,提出图即策略多智能体编码框架GaP,通过生成计算图并行迭代优化,在虚实8项基准上表现远超基线。

详情
AI中文摘要

为了让机器人在商业和工业应用中可靠工作,智能体编码系统的最新进展能否将可解释的机器人编程与无模型策略的开放世界适应性相结合?我们聚焦于“变分自动化”(VA)这类任务,其对象几何和位姿的变化比固定自动化任务更大。无模型策略通常难以弥合VA任务的可靠性差距,而这类任务必须在商业和工业场景中持续可靠执行。受任务与运动规划(TAMP)和机器人操作系统(ROS)的前期工作启发,我们提出图即策略(GaP),这是一种多智能体编码框架,可从模块化开放机器人技能库(MORSL)生成包含感知、规划和控制节点的有向计算图。GaP随后生成内部仿真环境,并行用不同图演练任务实例,迭代优化图结构和参数以提升成功率和吞吐率。在8个全新开放VA任务基准(4个仿真内、4个真实世界)上的评估表明,GaP实现的成功率显著优于基线方法。详情、代码和数据可访问在线链接:此https URL。

英文摘要

For robots to work reliably in commercial and industrial applications, can recent advances in agentic coding systems combine interpretable robot programming with the open-world adaptability of model-free policies? We focus on "Variational Automation" (VA), a class of tasks that have larger variations in object geometry and pose than fixed automation. Model-free policies often struggle to close the reliability gap for VA tasks, which must be executed persistently and reliably in commercial and industrial applications. Motivated by prior work on Task and Motion Planning (TAMP) and the Robot Operating System (ROS), we introduce Graph-as-Policy (GaP), a multi-agent coding harness that generates directed computation graphs with perception, planning, and control nodes from a Modular Open Robot Skill Library (MORSL). GaP then generates an internal simulation environment to rehearse task instances with different graphs in parallel to iteratively refine the graph structure and parameters to improve success rates and throughput. Evaluation with 8 new open VA task benchmarks, 4 in-simulation and 4 in real-world, suggests that GaP can achieve success rates that significantly outperform baselines. Details, code, and data can be found online: https://graph-robots.github.io/gap

URL PDF HTML
2607.05365 2026-07-07 cs.CL cs.AI eess.AS 新提交

SPEARBench: A Benchmark for Naturalness Evaluation in Streaming Speech-to-Speech Language Models

SPEARBench:面向流式语音转语音语言模型的自然度评估基准

Thomas Thebaud, Yuzhe Wang, Hao Zhang, Sathvik Manikantan Napa Ugandhar, Ashish Hallur, Georgi Tinchev, Venkatesh Ravichandran, Laureano Moro-Velazquez

发表机构 * Department of Electrical and Computer Engineering, Johns Hopkins University(约翰霍普金斯大学电气与计算机工程系) Amazon Inc.(亚马逊公司)

AI总结 针对现有基准无法评估流式语音转语音模型对话自然度的问题,构建多维度评估基准SPEARBench,可从多维度评测模型,发现当前模型在多类对话行为维度仍与人类存在差距。

Comments Corresponding Website: https://thomasthebaud.github.io/SPEAR-benchmark-website/#welcome

详情
AI中文摘要

流式语音转语音语言模型旨在直接用合成语音回应口语查询。但标准语音与文本基准无法衡量这类系统在对话中的自然表现,而对话中的时机、话轮转换、韵律、人际立场、语言与方言一致性、关系适配性会共同影响感知质量。本文提出SPEARBench,这一基准用于从问答交互维度评估语音转语音语言模型的自然度。SPEARBench从Seamless Interaction语料库构建受控对话提示,在多个模型上运行推理,采用覆盖响应延迟、中断情况、语音质量、ASR鲁棒性、语言与方言一致性、情绪自然度、人际立场以及可解释分布基线的多维度协议评估生成答案。该基准包含人类原始回答作为参考对照,已公布多款主流模型的测试结果。结果表明,当前模型可实现高信号级质量与低ASR错误率,但在延迟、重叠、方言留存、情绪适配以及人际立场动态性方面仍与人类对话行为存在差异。

英文摘要

Streaming speech-to-speech language models aim to answer spoken queries directly with synthetic speech. However, standard speech and text benchmarks do not capture whether these systems behave naturally in conversations, where timing, turn-taking, prosody, interpersonal stance, language and dialect consistency, and relationship-aware appropriateness jointly shape perceived quality. We introduce SPEARBench, a benchmark for evaluating naturalness in speech-to-speech language models from question-answer interactions. SPEARBench constructs controlled dialogue prompts from the Seamless Interaction corpus, runs inference across multiple models, and evaluates generated answers using a multidimensional protocol that covers response latency, interruptions, speech quality, ASR robustness, language and dialect consistency, emotional naturalness, interpersonal stance, and explainable distributional baselines. The benchmark includes original human answers as a reference condition and reports results for several contemporary models. Results show that current models can achieve high signal-level quality and low ASR error while still differing from human conversational behavior in latency, overlap, dialect preservation, emotional adaptation, and interpersonal stance dynamics.

URL PDF HTML
2607.05364 2026-07-07 cs.CL cs.AI cs.SD 新提交

REDDIT: Correcting Model-Generated Timestamp Drift in ASR without Forgetting via Replay-Based Distribution Editing

REDDIT:基于回放的分布编辑在无遗忘条件下校正ASR的模型生成时间戳漂移

Cheng-Kang Chou, Ming-To Chuang, Ke-Han Lu, Chan-Jan Hsu, Hung-yi Lee

发表机构 * National Taiwan University(台湾大学) Carnegie Mellon University(卡内基梅隆大学) NTU Artificial Intelligence Center of Research Excellence (NTU AI-CoRE)(国立清华大学人工智能研究中心(NTU AI-CoRE))

AI总结 针对自回归ASR的非语音区间时间戳漂移问题,提出REDDIT两阶段后训练框架,仅用少量数据和参数更新校正时间戳,避免普通微调的灾难性遗忘。

详情
AI中文摘要

现代自回归自动语音识别(ASR)系统可将时间戳作为解码令牌输出,无需帧级对齐器或推理时后处理即可生成带时间戳的转录结果。本文发现这类生成的时间戳会在长非语音区间发生漂移:转录内容可能仍合理,但解码出的时间轴会与音频实际时间偏离。我们基于自建的间隙与长间隙基准测试集,在15个可生成时间戳的ASR及音频语言系统上研究了这种非语音引发的时间戳漂移问题。朴素的时间戳校正微调可提升对齐效果,但会严重损害非目标ASR的性能,存在遗忘问题。本文提出REDDIT(基于回放的分布编辑),一种轻量级两阶段后训练框架,可在校正时间戳的同时避免灾难性遗忘:首先在模型自身回放的解码器上下文下编辑时间戳目标,同时在非时间戳令牌上匹配冻结的基础分布,随后执行简短的编辑前缀精调阶段。该框架结合经语音活动检测(VAD)裁剪的语音区间、插入的非语音间隙与已知拼接偏移量,无需人工转录或人工时间戳标注即可构建校正监督信号。在Whisper-tiny模型上,仅使用34.9小时的目标校正音频、更新1.6%的模型参数,即可将长间隙交并比均值(mIoU)从38.7%提升至95.0%,将混合间隙域外平均绝对偏移量(AAS)从2752毫秒降至223毫秒,同时将CV-en的词错误率(MER)维持在41.3%,而普通监督微调(SFT)解码器调优的该指标高达524.2%。

英文摘要

Modern autoregressive ASR systems can emit timestamps as decoded tokens, enabling timestamped transcription without frame-level aligners or inference-time post-processing. We show that these generated timestamps can drift across long non-speech spans: the transcript may remain plausible, but the decoded time axis drifts away from the audio. We study this non-speech-induced timestamp drift with self-built gap and long-gap benchmarks across 15 evaluated timestamp-producing ASR and audio-language systems. Naive timestamp-corrected fine-tuning improves alignment but can severely degrade non-target ASR behavior, exposing a forgetting problem. We propose REDDIT(REplay-based Distribution eDITing), a lightweight two-stage post-training framework that corrects timestamps while avoiding this catastrophic forgetting: it first edits timestamp targets under the model's own replayed decoder context while matching the frozen base distribution on non-timestamp tokens, then applies a short edited-prefix refinement stage. In this framework, we construct correction supervision without human transcripts or human timestamp annotations by combining VAD-trimmed speech spans with inserted non-speech gaps and known concatenation offsets. On Whisper-tiny, 34.9 hours of targeted correction audio used and only 1.6% of model parameters updated, raising long-gap mIoU from 38.7% to 95.0% and reducing mixed-gap out-of-domain AAS from 2752 ms to 223 ms while preserving CV-en MER at 41.3% (versus 524.2% for ordinary SFT decoder tuning).

URL PDF HTML
2607.05363 2026-07-07 cs.AI 新提交

SovereignPA-Bench: Evaluating User-Owned Personal Agents under Evolving Intent, Platform Mediation, and Consent Constraints

SovereignPA-Bench:在演化意图、平台中介与同意约束下评估用户自有个人智能体

Dylan Zongmin Liu

发表机构 * Stanford University(斯坦福大学)

AI总结 针对现有基准未考量个人智能体用户主权保护的问题,提出可执行基准SovereignPA-Bench,从多维度评估智能体主权能力,验证全主权框架可显著降低隐私泄露等风险。

详情
AI中文摘要

个人智能体正逐步成为持久的用户自有中介:它们记忆用户偏好、过滤平台中介信息、调用工具并与各类服务协商。现有基准可评估工具使用、网页导航、桌面控制、个性化、推荐系统及上下文演化能力,但很少关注智能体是否能维护用户主权——即在尊重隐私、知情同意、证据有效性、用户负担要求的同时推进用户当前利益,且能抵御诱导性操纵。本文提出SovereignPA-Bench这一可执行基准,用于在演化意图、平台中介、隐私边界、同意约束、证据要求及负担权衡的场景下评估用户自有个人智能体。该基准将智能体可见的可观测状态与仅评估方可访问的隐藏标签分离,输出任务成功率、对齐度、隐私合规性、同意合规性、证据有效性、抗操纵性、用户负担及可审计性的分项指标,同时保留配对场景顺序以支持模型与策略的横向对比。研究覆盖4类模型家族与8种基线策略的120个主权压力测试场景,生成3840条固定提示词轨迹,包含原始提示词、模型输出、服务商返回响应、解析后动作、可复算指标、预设分析结果、定性案例,以及由3名标注员对240个样本完成的盲审结果。全主权脚手架方案相比直接执行、仅依赖记忆、仅遵循同意规则、仅依赖证据、ReAct/工具调用、安全提示词、裁判防护等基线方案,可提升主权得分,同时降低隐私泄露、同意违规、过度让步及被操纵捕获的风险。人工审计结果显示,标注员对隐私与同意合规性的判定一致性较高,对操纵行为的判定一致性较低,明确了平台诱导判定的主观边界。上述结果表明,个人智能体评估必须跳出仅关注任务完成度的局限,转向覆盖代表性场景、具备同意感知能力、基于证据支撑的动作评估体系。

英文摘要

Personal agents are becoming persistent user-owned intermediaries: they remember preferences, filter platform-mediated information, use tools, and negotiate with services. Existing benchmarks evaluate tool use, web navigation, desktop control, personalization, recommendation, and evolving context, but rarely ask whether an agent preserves user sovereignty: advancing the user's current interests while respecting privacy, consent, evidence, user burden, and resistance to manipulative incentives. We introduce SovereignPA-Bench, an executable benchmark for evaluating user-owned personal agents under evolving intent, platform mediation, privacy boundaries, consent constraints, evidence requirements, and burden tradeoffs. The benchmark separates agent-visible ObservableState from evaluator-only HiddenLabels, reports component metrics for task success, alignment, privacy, consent, evidence, manipulation, burden, and auditability, and preserves paired scenario ordering for model and policy comparisons. We evaluate 120 sovereignty stress scenarios across 4 model families and 8 policy baselines, yielding 3,840 frozen-prompt trajectories with raw prompts, outputs, provider-form responses, parsed actions, recomputable metrics, hard-set analyses, qualitative cases, and a blinded 3-annotator audit over 240 items. Full-sovereign scaffolding improves sovereignty score over direct, memory-only, consent-only, evidence-only, ReAct/tool-use, safety-prompt, and judge-guard baselines while reducing privacy leakage, consent violation, over-concession, and manipulation capture. Human audit shows high agreement on privacy and consent and lower agreement on manipulation, identifying the subjective frontier of platform-persuasion judgments. These results show that personal-agent evaluation must move beyond task completion toward representative, consent-aware, evidence-grounded action.

URL PDF HTML
2607.05359 2026-07-07 cs.AI 新提交

Graph Sparse Sampling: Breaking the Curse of the Horizon in Continuous MDP Planning

图稀疏采样:打破连续MDP规划中的视界诅咒

Idan Lev-Yehudi, Vadim Indelman

发表机构 * Technion Autonomous Systems Program (TASP), Technion – Israel Institute of Technology(以色列理工学院自主系统计划(TASP),以色列理工学院) Stephen B. Klein Faculty of Aerospace Engineering, Technion – Israel Institute of Technology(以色列理工学院斯蒂芬·B·克莱因航空航天工程学院) Faculty of Data and Decision Sciences, Technion – Israel Institute of Technology(以色列理工学院数据与决策科学学院)

AI总结 针对连续域不确定规划的视界指数增长难题,提出图稀疏采样算法跨决策共享采样未来,得到多项式视界依赖的性能保证,长视界下性能远超树型规划器。

详情
AI中文摘要

连续域下的不确定规划对自主系统至关重要,但计算量极大。蒙特卡洛树搜索等基于树的搜索方法应用广泛,但其分支结构在最坏情况下的采样预算会随前瞻深度指数增长。从树的视角看,连续状态或动作空间的规划难度极高,因为规划器必须在无限分支层级中确定搜索位置。本文提出图稀疏采样(GSS)这一在线规划算法,跨多个候选决策共享采样得到的未来轨迹,而非为每个候选动作采样独立的后继节点。该无分支图可生成适配GPU的大规模批处理,同时借助启发式方法聚焦计算资源。本文通过平滑回溯,证明了GSS针对满秩或低秩生成模拟器、离散或采样连续动作空间的有限样本性能保证。在满足重叠性、正则性和动作覆盖条件下,该界对规划视界呈多项式依赖关系,明确了共享未来轨迹可避免树型稀疏采样的指数级视界依赖的适用场景。连续控制仿真实验表明,GSS在长视界场景下性能大幅超越树型规划器,或可达到近优性能,证实无分支图规划可作为在线控制的补充设计原则。

英文摘要

Planning under uncertainty in continuous domains is essential for autonomous systems, yet computationally demanding. Tree-based search methods such as Monte Carlo Tree Search (MCTS) remain popular, but their branching structure can require sampling budgets that grow exponentially with lookahead depth in the worst case. From a tree perspective, continuous state or action spaces become especially challenging, since the planner must decide where to search in an infinite branching hierarchy. We propose Graph Sparse Sampling (GSS), an online planning algorithm that shares sampled futures across many candidate decisions, rather than sampling separate successors for each candidate action. This branch-free graph exposes large GPU-friendly batches, while using heuristics to focus computation. We prove finite-sample performance guarantees for GSS covering full-rank or low-rank generative simulators via smoothed backups, and discrete or sampled continuous action spaces. Under suitable overlap, regularity, and action-coverage conditions, these bounds have polynomial dependence on the planning horizon, formalizing when shared futures can avoid the exponential horizon dependence of tree-shaped sparse sampling. We demonstrate continuous-control simulations where GSS substantially outperforms tree-based planners on long horizons or achieves near-optimal performance, supporting no-branching graph planning as a complementary design principle for online control.

URL PDF HTML
2607.05356 2026-07-07 cs.CV 新提交

ReCal3R: Reliability-Calibrated Learning Rates for Streaming 3D Reconstruction

ReCal3R:面向流式3D重建的可靠性校准学习率

Xinze Li, Yiyuan Wang, Pengxu Chen, Wentao Fan, Weifeng Su, Weisi Lin, Wentao Cheng

发表机构 * Beijing Normal-Hong Kong Baptist University(北京师范大学-香港浸会大学联合国际学院) Hong Kong Baptist University(香港浸会大学) Jilin University(吉林大学) Guangdong Provincial Key Laboratory of Interdisciplinary Research and Application for Data Science(广东省数据科学交叉研究与应用重点实验室) Nanyang Technological University(南洋理工大学)

AI总结 针对流式3D重建中循环场景状态易被噪声观测破坏的问题,提出可靠性校准学习率方法ReCal3R,在不增加额外开销的前提下大幅提升长序列重建精度。

Comments 23 pages, 7 figures. Project Page: https://powertony102.github.io/recal3r.github.io/

详情
AI中文摘要

流式3D重建依赖紧凑的循环场景状态,以线性时间和有界内存处理长图像流。但重复更新会逐步破坏该状态,导致可靠历史信息被噪声或模糊观测覆盖。本文提出面向循环3D重建的可靠性校准学习率方法ReCal3R,该方法不直接使用候选学习率,而是从维护的场景状态中估计状态token的可靠性,以此校准由token对齐度、状态重建残差和近期更新压力推导得到的候选学习率。最终得到的逐token学习率在保守基准率和候选率之间插值,既抑制对不可靠token的激进更新,又保留对有效帧的适配能力。将其作为无训练校准规则应用于CUT3R后,ReCal3R在长序列的位姿、深度及重建质量上取得优异表现,绝对轨迹误差ATE降低3.7倍,同时保持相当的运行时间和内存占用。代码可访问:此https URL。

英文摘要

Streaming 3D reconstruction relies on a compact recurrent scene state to process long image streams in linear time and bounded memory. However, repeated updates can gradually corrupt this state, causing reliable historical information to be overwritten by noisy or ambiguous observations. We introduce ReCal3R, a reliability-calibrated learning rate method for recurrent 3D reconstruction. Instead of directly applying a candidate learning rate, our method estimates state token reliability from the maintained scene state and uses it to calibrate a candidate learning rate derived from token alignment, state reconstruction residual, and recent update pressure. The resulting token-wise learning rate interpolates between a conservative base rate and the candidate rate, suppressing aggressive updates on unreliable tokens while preserving adaptation to informative frames. Applied to CUT3R as a training-free calibration rule, ReCal3R reaches strong performance on long sequences in pose, depth, and reconstruction quality, including a 3.7$\times$ reduction in ATE, with comparable runtime and memory. Code is available at: https://github.com/Powertony102/ReCal3R.

URL PDF HTML
2607.05352 2026-07-07 cs.CV cs.AI cs.LG 新提交

Multiplayer Interactive World Models with Representation Autoencoders

基于表示自编码器的多智能体交互世界模型

Anthony Hu, Václav Volhejn, Adrien Ramanana Rahary, Chris Mulder, Aditya Makkar, Amélie Royer, Manu Orsini, Alyx Liao, Adam Jelley, Eloi Alonso, Florian Laurent, Fredrik Norén, James Swingos, Jan Hünermann, Kent Rollins, Lucas Hosseini, Matthieu Le Cauchois, Maxim Peter, Pim de Witte, Tim Brown, Vincent Micheli, Moritz Böhle, Gabriel de Marmiesse, Viktoriia Sharmanska, Lucia Specia, Michael Black, Patrick Pérez

发表机构 * Epic Games École nationale des ponts et chaussées(法国国家桥梁与道路学院)

AI总结 针对复杂物理交互的高动态环境,该研究提出首个多智能体世界模型,以多智能体动作流为条件训练隐扩散模型,可实时生成稳定长时四智能体对局,开源相关资源。

Comments Technical report

详情
AI中文摘要

我们提出首个面向由复杂物理交互主导的高动态环境的多智能体世界模型。单智能体世界模型将其他智能体视为环境的一部分,而我们的模型以多智能体的动作流为条件进行训练,学习将场景变化归因于对应智能体,并在任意动作组合下保持场景一致性。我们在具有快速强耦合动力学特性、玩家同时存在竞争与协作行为的《火箭联盟》游戏中开展研究。基于公开机器人采集的10000小时游戏数据训练后,我们的50亿参数隐扩散模型可实时生成四智能体对局,在单张Nvidia B200 GPU上实现每秒20帧的生成速度。尽管仅使用短片段数据训练,其推演过程的稳定性远超训练视界:分布质量在我们实测的最长5分钟视界内保持稳定,实际观测中推演可连续运行数小时无崩溃迹象。我们系统研究了核心设计选择:视频编解码器、生成目标与多智能体条件方案。此外,我们分析了模型性能随模型规模与数据规模的变化规律,包括涌现能力与持续存在的失效模式。我们进一步开发了针对性评估方案,用于探测模型的物理理解能力而非仅评估视觉表现。为支撑多智能体世界模型的后续研究,我们开源了数据集、完整训练与推理代码库及在线演示。

英文摘要

We introduce the first multiplayer world model for highly dynamic environments governed by complex physical interactions. Whereas single-player world models treat the other agents as part of the environment, ours conditions on the action streams of multiple agents, learning to attribute changes in the scene to the correct player and to stay coherent under arbitrary combinations of their actions. We study this problem in the game of Rocket League, where players compete and cooperate under fast, tightly coupled dynamics. Trained on 10,000 hours of gameplay collected with publicly available bots, our 5-billion-parameter latent diffusion model generates four-player matches in real time, producing 20 frames per second on a single Nvidia B200 GPU. Although trained only on short clips, its rollouts stay stable far beyond the training horizon: distributional quality holds steady out to five minutes, the longest horizon we measure, and in practice we observe rollouts continuing for hours with no sign of collapse. We systematically investigate the central design choices: the video codec, the generative objective, and the multiplayer conditioning scheme. In addition, we characterize how behavior changes with model and data scale, including the capabilities that emerge and the failure modes that persist. We further develop targeted evaluations that probe the model's physical understanding rather than visual appearance alone. To support continued research on multiplayer world models, we release our dataset, our full training and inference codebase, and a live demo.

URL PDF HTML
2607.05348 2026-07-07 cs.CV cs.RO 新提交

Beyond Isolated Objects: Relationship-aware Open Vocabulary Scene Understanding via 3D Scene Graph Analysis

超越孤立对象:基于3D场景图分析的关系感知开放词汇场景理解

Xianhao Chen, Jiarui Hu, Yuanbo Yang, Xiyu Zhang, Tengyue Wang, Hujun Bao, Guofeng Zhang, Zhaopeng Cui

发表机构 * State Key Lab of CAD&CG, Zhejiang University(浙江大学计算机辅助设计与图形学国家重点实验室) Zhejiang University(浙江大学)

AI总结 针对现有开放词汇3D理解方法忽略对象关系的问题,提出RelGraphOV框架,通过3D场景图与自适应门控双流式图注意力网络,提升场景理解性能与泛化性。

Comments Project Page: https://cxavireh.github.io/relgraphov-projectpage

详情
AI中文摘要

开放词汇3D场景理解旨在通过迁移视觉语言模型的语义知识,分割预定义类别之外的3D场景。现有方法通过将语言对齐的2D特征提升至3D推进了该任务,但这类方法通常依赖于上下文无关的语义表示,未充分探索对象关系以实现上下文优化。本文提出RelGraphOV,一种利用3D场景图增强开放词汇3D理解的关系感知框架。该方法无需人工关系标注,借助视觉语言推理推断对象关系并修剪几何上不可信的连接,从多视图观测中构建关系场景图。为聚合关系上下文同时避免特征干扰,本文引入自适应门控双流上下文图注意力网络,分离密集几何特征与语义CLIP嵌入,执行边引导的消息传递并自适应融合互补语义。分层对比目标进一步提升了实例级一致性与类别级区分度。在ScanNetV2、ScanNet200、ScanNet++和Replica数据集上的实验证明了该方法的优异性能与泛化能力。项目页面:本HTTPS URL。

英文摘要

Open-vocabulary 3D scene understanding aims to segment 3D scenes beyond predefined categories by transferring semantic knowledge from vision-language models. Existing methods have advanced this task by lifting language-aligned 2D features into 3D, yet they often rely on context-independent semantic representations, leaving object relationships underexplored for contextual refinement. We propose RelGraphOV, a relationship-aware framework that uses 3D scene graphs to enhance open-vocabulary 3D understanding. Our method constructs relational scene graphs from multi-view observations by leveraging vision-language reasoning to infer object relationships and prune geometrically implausible connections, without manual relationship annotations. To aggregate relational context while avoiding feature interference, we introduce an Adaptive Gated Dual-Stream Contextual GAT that separates dense geometric features and semantic CLIP embeddings, performs edge-guided message passing, and adaptively fuses complementary semantics. A hierarchical contrastive objective further promotes instance-level consistency and category-level discrimination. Experiments on ScanNetV2, ScanNet200, ScanNet$++$, and Replica demonstrate strong performance and generalization ability. Project Page: https://cxavireh.github.io/relgraphov-projectpage

URL PDF HTML
2607.05347 2026-07-07 cs.CV 新提交

WildSplat: Feedforward Gaussian Splatting from Unposed In-the-Wild Images

WildSplat:基于无位姿野外图像的前向高斯溅射方法

Xiyu Zhang, Jingyu Zhuang, Hongjia Zhai, Zizheng Yan, Jinwei Chen, Guofeng Zhang, Qingnan Fan

发表机构 * State Key Lab of CAD&CG, Zhejiang University(浙江大学计算机辅助设计与图形学国家重点实验室) vivo BlueImage Lab(vivo蓝河图像实验室)

AI总结 针对前向3D重建在光照变化场景下性能不佳的问题,提出双分支解耦架构的WildSplat框架,实现单步前向的野外新视角合成与外观编辑SOTA性能。

Comments 22 pages, 9 figures; Accepted by ECCV 2026. Project page: https://zju3dv.github.io/wildsplat/

详情
AI中文摘要

尽管前向3D重建在高效新视角合成方面表现出色,但在面对光照变化的场景时通常会失效。为此,我们提出WildSplat,这是首个可针对无位姿野外图像实现外观条件化新视角合成的前向3D高斯溅射框架。为处理不一致的光度条件,我们提出一种双分支架构,将几何与外观显式解耦。几何分支提取不受外观影响的3D结构,同时预测相机位姿。为控制渲染外观,外观分支通过全局预调制交叉注意力机制将目标外观线索注入内容特征。为进一步避免特征纠缠,我们引入联合多参考训练策略以稳定训练过程。大量实验表明,WildSplat优于现有基于优化的方法和前向方法,仅需单次前向传播即可在稀疏输入的野外新视角合成与外观编辑任务中达到当前最优性能。

英文摘要

While feedforward 3D reconstruction excels at efficient novel view synthesis, it typically falters when faced with scenes under varying illumination. To this end, we introduce WildSplat, the first feedforward 3D Gaussian Splatting framework capable of appearance-conditioned novel-view synthesis for unposed in-the-wild images. To handle inconsistent photometric conditions, we propose a dual-branch architecture that explicitly decouples geometry from appearance. The geometry branch extracts an appearance-invariant 3D structure and jointly predicts camera poses. To govern the rendering appearance, the appearance branch injects target appearance cues into the content features via a globally pre-modulated cross-attention mechanism. To further prevent feature entanglement, we introduce a joint multi-reference training strategy that stabilizes the training process. Extensive experiments show that WildSplat surpasses existing optimization-based and feedforward methods, achieving state-of-the-art performance in in-the-wild novel view synthesis and appearance editing from sparse inputs in a single forward pass.

URL PDF HTML
2607.05346 2026-07-07 cs.AI cs.MA 新提交

OptiAgent: End-to-End Optimization Modeling via Multi-Agent Iterative Refinement

OptiAgent:基于多智能体迭代精化的端到端优化建模

Adriana Laurindo Monteiro, Nayse Fagundes, Gabriel Mattos Langeloh, Gustavo de Oliveira Kanno, Priscila Louise Aguirre, Thiago Costa Rizuti da Rocha, Victor Leme Beltran

发表机构 * Instituto de Ciência e Tecnologia do Itaú(伊塔乌科技学院)

AI总结 针对运筹学问题自然语言描述转可求解数学形式与可执行代码的需求,OptiAgent采用多智能体迭代自校正与多回路验证架构,在多数优化任务基准上取得SOTA性能,建模过程可审计。

详情
AI中文摘要

我们提出OptiAgent这一多智能体框架,其可在接收运筹学问题的自然语言描述后,输出可直接供求解器使用的数学公式表述以及可执行代码。该架构将数学建模步骤作为核心优先环节,由专属智能体提取决策变量、约束等结构,支持迭代自校正。我们引入了具备四类专用反馈机制的新型多回路验证架构,每类机制分别针对不同的失效模式,包括语义误读、结构缺陷、数学不一致性、验证失败与代码错误。除精度外,该模块化设计通过提升透明度优化了优化问题的求解流程:每个智能体都会输出自身的推理过程与反馈内容,使得全建模过程可被审计。我们的框架在线性规划(LP)、混合整数线性规划(MILP)与非线性规划任务的4个基准中的3个上取得了当前最优(SOTA)性能,同时在剩余数据集上也保持了极强的竞争力。

英文摘要

We propose OptiAgent, a multi-agent framework that, given a natural language description of an Operations Research problem, is able to output a solver-ready mathematical formulation as well as executable code. Our architecture prioritizes the mathematical modeling step, where dedicated agents extract structures, such as decision variables and constraints, enabling iterative self-correction. We introduce a novel multi-loop validation architecture with four specialized feedback mechanisms, each targeting a distinct failure mode such as misinterpretation, structural defects, mathematical inconsistencies, validation failures, and code errors. Alongside accuracy, our modular design improves the process of solving optimization problems by improving transparency, as each agent exposes its reasoning and feedback, making the full modeling process auditable. Our framework achieves state-of-the-art performance on 3 out of 4 benchmarks across LP, MILP, and Nonlinear Programming tasks, while remaining highly competitive on the remaining dataset.

URL PDF HTML
2607.05339 2026-07-07 cs.LG cs.AI stat.ML 新提交

TREK: Distill to Explore, Reinforce to Refine

TREK:蒸馏以探索,强化以优化

Yuanda Xu, Zhengze Zhou, Kayhan Behdin, Jelena Markovic-Voronov, Hejian Sang, Xiaomin Li, Wenhui Zhu, Xinchen Du, Aida Rahmattalabi, Ran He, Sen Na, Zhipeng Wang, Alborz Geramifard

发表机构 * LinkedIn Corporation(领英公司) Harvard University(哈佛大学) Georgia Institute of Technology(佐治亚理工学院)

AI总结 针对GRPO在学生策略覆盖外的难提示样本上失效问题,提出TREK方法,通过蒸馏扩展探索空间再结合GRPO优化,在多推理与智能体任务上大幅提升模型性能。

Comments 18 pages, 3 figures, 6 tables

详情
AI中文摘要

群组相对策略优化(GRPO)在当前策略已能采样出有效推理轨迹时表现出色,但对于正确解模式超出学生策略在线分布支撑范围的难提示样本,其性能会陷入停滞。我们提出TREK(基于前向KL的教师路由探索),这是一种简单的分阶段流程,其使用蒸馏的目的并非模仿,而是扩展探索支撑范围。TREK的核心优势是通用性:由于它仅需使用已验证的输出轨迹,因此可对接外部黑盒教师、白盒教师,或是获得额外推理时上下文的同模型,即便无法获取教师内部参数,也能高效识别出最值得巩固的难提示样本。TREK首先识别出无辅助学生模型通过率极低的提示,查询提案源生成已验证的候选解,保留按当前学生似然排序的前r个提案,执行短时间的前向KL阶段将这些已验证模式纳入学生的分布支撑范围,之后再回归标准的在线GRPO优化。在数学推理任务上,采用DeepSeek-V4作为提案源的TREK在AIME 2024和AIME 2025数据集上的所有测试规模Qwen3模型均取得性能提升;对于Qwen3-8B模型,其将AIME 2025的avg@16指标从36.9提升至40.3,将AIME 2024的avg@16指标从47.9提升至51.1,而无需外部教师的自上下文变体分别达到38.5和49.6的性能。在智能体任务上,TREK将ALFWorld的成功率从75.8提升至82.8,将ScienceWorld的成功率从12.5提升至26.7;值得注意的是,在最难的任务类别上,TREK在训练早期就能达到高成功率,而无辅助的GRPO则需要多得多的优化步数才能达到相近水平。

英文摘要

Group Relative Policy Optimization (GRPO) is effective when the current policy already samples useful reasoning trajectories, but it stalls on hard prompts whose correct solution modes lie outside the student's on-policy support. We propose TREK (Teacher-Routed Exploration via Forward KL), a simple staged procedure that uses distillation not for imitation but for exploration support expansion. A key advantage of TREK is its generality: because it only consumes verified output trajectories, it can use an external black-box teacher, a white-box teacher, or the same model given additional inference-time context, and it can efficiently identify which hard-prompt samples are most worth consolidating even when teacher internals are unavailable. TREK first identifies prompts where the unaided student has very low pass rate, queries a proposal source to produce verified candidate solutions, keeps the top-$r$ proposals ranked by current student likelihood, applies a short forward-KL phase to pull those verified modes into the student's support, and then returns to standard on-policy GRPO refinement. On mathematical reasoning, TREK with DeepSeek-V4 proposals improves Qwen3 models across all tested scales on AIME 2024 and AIME 2025; for Qwen3-8B, it improves AIME 2025 from 36.9 to 40.3 and AIME 2024 from 47.9 to 51.1 (avg@16), while the self-context variant reaches 38.5 and 49.6 without an external teacher. On agentic tasks, TREK raises ALFWorld success rate from 75.8 to 82.8 and ScienceWorld success rate from 12.5 to 26.7; notably, on the hardest task types, TREK achieves high success rates early in training while unaided GRPO requires substantially more optimization steps to reach comparable levels.

URL PDF HTML
2607.05325 2026-07-07 cs.CV 新提交

CenSynCMB: Centre Maps and Physics-Guided Synthesis for Microbleed Detection

CenSynCMB:用于脑微出血检测的中心图与物理引导合成方法

Lucas He, Hanyuan Zhang, Krinos Li, Adama Fatima Saccoh, Silvia Ingala, Rafael Rehwald, Marleen de Bruijne, Frederik Barkhof, Rhodri Davies, Carole H. Sudre

发表机构 * UCL(伦敦大学学院)

AI总结 针对脑微出血自动检测难度大的问题,提出融合3D注意力U-Net等模块的CenSynCMB框架,通过物理引导合成数据提升检测性能,在公开数据集上取得最优结果。

详情
AI中文摘要

脑微出血(CMBs)是小血管病的MRI标志物,也是淀粉样蛋白相关成像异常微出血组分(ARIA-H)的特征,但脑微出血尺寸小、分布稀疏,且与血管、类钙化病灶及伪影高度相似,导致自动检测难度极大。本文提出CenSynCMB这一中心引导、伪影感知的框架,融合3D注意力U-Net、辅助中心图监督、假阴性驱动重加权,以及按折次进行的带标注阳性脑微出血与难例负样本物理引导合成方法。合成数据可让检测器在不发生验证集或测试集数据泄露的前提下学习紧凑病灶与常见伪影特征。在VALDO任务2上,CenSynCMB取得了局部对比下最优的病灶级F1值(74.3%,p=0.020);在外部AIBL SWI数据集上,取得了局部对比下最高的召回率(88.5%,p=0.0058)与F1值(65.0%,p=0.0016)。上述结果支撑了在大规模无标注MRI队列中开展可扩展脑微出血候选提取的应用,同时指出队列专属校准是后续实现可靠负荷估算的下一步方向。

英文摘要

Cerebral microbleeds (CMBs) are MRI markers of small vessel disease and the microbleed component of amyloid related imaging abnormalities (ARIA-H), but their small size, sparsity, and similarity to vessels, calcification-like foci, and artefacts make automated detection difficult. We propose CenSynCMB, a centre-guided and mimic-aware framework combining a 3D Attention U-Net, auxiliary centre-map supervision, false-negative-driven reweighting, and fold-wise physics-guided synthesis of positive CMBs and labelled hard negatives. Synthetic data expose the detector to compact lesions and common mimics without validation or test leakage. On VALDO Task 2, CenSynCMB achieved the best local-comparison lesion-level F1 (74.3%, p = 0.020); on external AIBL SWI, it achieved the highest local-comparison recall (88.5%, p = 0.0058) and F1 (65.0%, p = 0.0016). Together, these results support scalable CMB candidate extraction in large, unlabelled MRI cohorts, while highlighting cohort-specific calibration as the next step toward reliable burden estimation.

URL PDF HTML
2607.05319 2026-07-07 cs.CV cs.AI 新提交

Steering Optimisation Trajectories in Diffusion Representation Learning

引导扩散表示学习中的优化轨迹

Rajat Rasal, Avinash Kori, Tian Xia, Ben Glocker

发表机构 * Imperial College London(伦敦帝国理工学院)

AI总结 该研究探究扩散自编码器图像质量相近但潜在结构差异大的成因,提出SteeringDRL方法,通过门控残差U-Net和噪声水平课程引导优化,提升表示质量并降低种子敏感性。

详情
AI中文摘要

我们研究了扩散自编码器为何能在学习到差异极大的潜在结构的同时,实现相近的图像质量。我们将该行为溯源至优化动力学;通过分析图像重建质量与潜在表示质量的变化曲线,发现训练早期的优化轨迹会围绕两种截然不同的状态分布。处于重建状态的模型在训练早期优先保障图像保真度,而处于解耦状态的模型则会更平缓地同步提升重建质量与解耦能力。我们假设该行为可通过靶向扩散U-Net中的捷径路径、控制早期噪声水平暴露来干预,进而在训练过程中调控重建-解耦权衡。为了将优化过程引导至更优质的表示,我们提出SteeringDRL方法,将门控残差U-Net与简单的噪声水平暴露课程训练相结合。在多个解耦基准测试中,SteeringDRL提升了表示质量并降低了种子敏感性。该方法还可扩展至以对象为中心的学习中的空间解耦任务,在合成与真实数据集上均提升了分割质量。

英文摘要

We study why diffusion autoencoders can achieve similar image quality while learning substantially different latent structures. We trace this behaviour to optimisation dynamics; we analyse curves of image reconstruction against latent representation quality, revealing trajectories that organise around two distinct regimes early in training. Models in the reconstruction regime prioritise image fidelity early, whereas those in the disentanglement regime improve reconstruction and disentanglement more gradually. We hypothesise that this behaviour can be influenced by targeting shortcut pathways in the diffusion U-Net and controlling early noise-level exposure, thereby shaping the reconstruction-disentanglement trade-off during training. To steer optimisation toward stronger representations, we introduce SteeringDRL, combining gated residual U-Nets with a simple noise-level exposure curriculum for training. Across disentanglement benchmarks, SteeringDRL improves representation quality and reduces seed sensitivity. Our method further extends to spatial disentanglement in object-centric learning, improving segmentation quality on synthetic and real-world datasets.

URL PDF HTML
2607.05317 2026-07-07 cs.CV cs.AI cs.LG 新提交

Topological Shape Representation for Aneurysm -- Bifurcation Detection

面向动脉瘤与分叉检测的拓扑形状表示方法

Akshay Gokhale, Mansi Dhamne

发表机构 * Sardar Patel Institute of Technology(萨达尔·帕特尔技术学院)

AI总结 针对颅内动脉瘤CTA检测假阳性高、小病灶灵敏度低的问题,提出即插即用拓扑感知框架,采用SECT表征血管几何,大幅提升小动脉瘤检测性能与跨设备泛化性。

Comments 36 pages, 12 figures, preprint

详情
AI中文摘要

从CT血管造影(CTA)中自动检测颅内动脉瘤(IAs)受到高假阳性率的严重制约。卷积神经网络(CNNs)依赖局部像素强度,导致囊状动脉瘤与血管分叉之间出现系统性混淆,这一问题在尺寸小于3毫米的小病灶上尤为突出,此类病灶的检测灵敏度低于60%。本文提出一种即插即用的拓扑感知假阳性降低框架,对平滑欧拉特征变换(SECT)——一种独立于强度、编码全局3D血管几何的方向性表示——开展评估,并与基于持久性的摘要(持久性图像与持久性景观)进行对比,所有实验在RSNA 2025数据集的分层子集上完成。SECT取得了0.943的AUC,大幅优于方向无关方法(AUC约为0.68),且呈现出临床性能反转特性:它在小于3毫米的群组上表现优异,在95%特异性下保持0.943的AUC与78.5%的灵敏度。该表示还具备扫描设备无关性,在覆盖四家厂商的留一扫描机(LOGO)验证下取得0.927的平均AUC。通过捕获非对称几何不变量而非强度分布,SECT可靠解决了颅内动脉瘤检测中的主要结构混淆因素,可作为混合深度学习诊断流水线的鲁棒下游过滤器。

英文摘要

Automated detection of intracranial aneurysms (IAs) from CT angiography (CTA) is severely hindered by high false-positive rates. Convolutional neural networks (CNNs) rely on local pixel intensities, causing systematic confusion between saccular aneurysms and vascular bifurcations -- a problem especially acute for small lesions (<3 mm), where detection sensitivity falls below 60%. We propose a plug-and-play, topology-aware false-positive reduction framework evaluating the Smooth Euler Characteristic Transform (SECT) -- a directional representation encoding global 3D vascular geometry independently of intensity -- against persistence-based summaries (Persistence Images and Landscapes), tested on a stratified subset of the RSNA 2025 dataset. SECT achieves an AUC of 0.943, substantially outperforming direction-agnostic methods (AUC ~0.68), and exhibits a clinical performance inversion: it excels on the sub-3 mm cohort, maintaining 0.943 AUC and 78.5% sensitivity at 95% specificity. The representation is also scanner-agnostic, achieving 0.927 mean AUC under leave-one-scanner-out (LOGO) validation across four manufacturers. By capturing asymmetric geometric invariants rather than intensity profiles, SECT reliably resolves the primary structural confounder in IA detection, positioning it as a robust downstream filter for hybrid deep-learning diagnostic pipelines.

URL PDF HTML
2607.05316 2026-07-07 cs.CL cs.LG 新提交

How Much is Left? LLMs Linearly Encode Their Remaining Output Length

还剩多少?大语言模型对其剩余输出长度进行线性编码

Mohamed Amine Merzouk, Dmitri Carpov, Mirko Bronzi, Damiano Fornasiere, Adam Oberman

发表机构 * Mila, Quebec AI Institute(米拉,魁北克人工智能研究所) McGill University(麦吉尔大学) LawZero(法律零)

AI总结 该研究探究大语言模型是否保有剩余输出长度的内部估计,通过在冻结隐藏状态上训练线性探针,证实LLMs可线性编码剩余输出长度,存在类计划的输出长度内部表征。

Comments 21 pages, 9 figures

详情
AI中文摘要

大语言模型逐token生成内容,但其响应呈现出非常一致的长度结构:分步求解过程会以可预测的token数结束,信息检索会在数句后停止,内容撤回会让响应延长可测量的长度。本文探究模型是否携带了对剩余响应长度的内部估计。我们在三个开源70-80亿参数模型的冻结隐藏状态上、跨七个补全风格数据集训练最小容量的线性探针,得到三项相互印证的发现:第一,在输出任何内容之前,仅通过提示的最后一个隐藏状态就可以线性解码出总响应长度;第二,在自然语言数据集上训练得到的探针方向具备广泛迁移性,可泛化到训练中从未出现的受控合成补全任务,性能优于统计基线,反之从合成数据训练的探针难以迁移到自然语言场景,这种不对称性本身也具备研究价值;第三,在精心筛选的高损失补全样本上,当模型撤回并重启部分求解过程时,探针的逐位置估计值会同步向上偏移,这种定向行为是仅基于位置的预测器完全无法复现的(该结论来自定性观测而非聚合统计结果)。我们将其定义为对剩余生成长度的近似估计,该结论与Transformer无法实现精确计数的不可能性结果并不冲突,这也表明大语言模型维持了一种类计划的输出长度内部表征(该表征可被解码,但不一定会以因果方式参与生成过程)。

英文摘要

Large language models generate one token at a time, yet their responses show remarkably consistent length structure: step-by-step solutions converge in predictable token counts, retrievals stop after a few sentences, retractions extend responses by measurable amounts. We ask whether the model carries an internal estimate of how much response remains. Training minimal-capacity linear probes on frozen hidden states of three open-weight 7-8B models across seven completion-style datasets, we find three converging pieces of evidence. First, total response length is linearly decodable from the prompt's last hidden state alone, before any output is emitted. Second, probe directions trained on natural-language datasets transfer broadly, including to controlled synthetic completions never seen in training, outperforming a statistical baseline; the converse direction generally fails, and this asymmetry is itself informative. Third, on curated high-loss completions, the probe's per-position estimate shifts upward at the moment the model retracts and restarts a partial solution, a directional behavior no position-only predictor can reproduce (qualitative, not aggregate). We frame this as approximate estimation of remaining generation length, distinct from exact-counting impossibility results for transformers, and interpret it as evidence that LLMs maintain a plan-like internal representation of output length (decodable, not necessarily used causally).

URL PDF HTML
2607.05315 2026-07-07 cs.RO 新提交

Socially-Aware Autonomous Doorway Traversal and Payload Delivery for Emergency Assistance

面向应急援助的具备社会感知能力的自主过门与物资递送机器人系统

Andrew Snowdy, Ananya Trivedi, Sarvesh Prajapati, Lorena Maria Genua, Taskin Padir

发表机构 * Department of Electrical and Computer Engineering, Northeastern University(美国东北大学电气与计算机工程系) Northeastern University(美国东北大学)

AI总结 针对机器人辅助应急疏散场景,以行为树为核心框架实现社会感知自主过门与救援物资递送功能,经多场景实验验证系统可靠性,为应急响应机器人提供实用基础。

详情
AI中文摘要

在本研究中,我们聚焦机器人辅助应急疏散场景,梳理该场景下两项核心相关能力:一是提前为待疏散人员开启房门以保持其通往出口的路径畅通,二是取回救援装备并递送给执行疏散任务的应急人员。从系统层面来看,该场景要求机器人同步完成多项任务:机器人需定位符合《美国残疾人法案》(ADA)标准的门控按钮以及待取回的救援装备,同时必须感知周边人员状态并据此调整自身行为,确保为疏散过程提供支持而非造成阻碍。我们采用以行为树为核心的框架满足上述需求,选择该结构的原因是其可基于环境触发信号选择高层任务,且能够在新场景出现时完成功能扩展。我们在丰田人类支持机器人平台上完成105组实验,覆盖5种硬件场景与3种仿真场景,实验覆盖该场景下机器人需做出的各类决策:是否按下门控按钮、是否避让周边人员、是否通行由他人扶住的房门、是否优先取回救援装备再通行房门。整体来看,105组实验中有97组实现了系统任务的成功完成。上述结果表明,本框架可为覆盖范围更广的应急响应类机器人援助任务提供实用基础。相关代码与演示视频可通过对应链接获取。

英文摘要

In this work, we focus on the scenario of a robot-assisted emergency evacuation. We consider two capabilities relevant to such a setting. The first is opening doors ahead of the people being evacuated, so that their path toward an exit stays clear. The second is retrieving rescue equipment and delivering it to the emergency responders carrying out the evacuation. From a systems perspective, this involves several tasks at once. The robot must locate ADA-compliant door buttons and the rescue equipment it needs to retrieve. Additionally, it must remain aware of the people around it and adapt its behavior to them, so that it supports the evacuation rather than getting in the way. We address these demands with a behavior tree at the core of our framework. This structure is chosen for its ability to select high-level tasks based on environmental triggers, and to extend to new situations as they arise. We evaluate the system in 105 trials on the Toyota Human Support Robot, across five hardware and three simulation scenarios. These trials capture the decisions the robot must make in this setting: whether to press a door button, yield to a nearby person, walk through a door someone else is holding, or first retrieve rescue equipment before traversing the door. Overall, the system completes 97 of the 105 trials successfully. These results suggest our framework provides a practical basis for robotic assistance in broader emergency response tasks. Code and video demonstrations are available at https://github.com/AndrewSnowdy/hsr_mm_control.

URL PDF HTML
2607.05311 2026-07-07 cs.CV 新提交

Deep Learning for Semen Analysis in Male Infertility: Computer Vision, Multimodal Fusion, and Clinical Translation

男性不育症精液分析深度学习技术:计算机视觉、多模态融合与临床转化

Runwei Guan, Shaofeng Liang, Jiacheng Weng, Xiaoyi Gu, Jia Weng, Daizong Liu, Duo Pan, Qingxin Zhang, Xiao Liang, Weiping Ding, Suoyu Zhu, Ming Yuan, Yanhua Fei

发表机构 * Department of Gynaecology and Obstetrics, The Affiliated Jiangyin Hospital of Nantong University(南通大学附属江阴医院妇产科) Department of Oncology, the Affiliated Jiangyin Hospital of Nantong University(南通大学附属江阴医院肿瘤科) Thrust of AI, Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)人工智能推力实验室) FertiTech AI(生殖科技人工智能公司) Department of Oncology, Suzhou Xiangcheng People’s Hospital(苏州市相城区人民医院肿瘤科) Department of Biological Sciences and Bioinformatics, School of Science, Xi’an Jiaotong-Liverpool University(西交利物浦大学理学院生物科学与生物信息学系) School of Artificial Intelligence and Computer Science, Nantong University(南通大学人工智能与计算机科学学院)

AI总结 针对传统精液分析的主观性强等缺陷,综述聚焦计算机视觉与深度学习驱动的精子分析技术,梳理方法、数据集与落地障碍,提出分阶段临床转化路线。

Comments 46 pages, 14 figures

详情
AI中文摘要

男性不育在全球不育负担中占比很高,精子分析始终是诊断、治疗规划与辅助生殖技术的核心环节。但常规精液评估劳动强度大、依赖操作人员水平,且受观察者间及观察者内的变异限制,推动了客观、可复现的计算方法发展。本综述面向发展视角,全面整合人工智能驱动的精子分析研究,重点关注计算机视觉、深度学习、多模态融合、鲁棒性与临床转化。首先梳理面向特定任务的方法,包括精子检测计数、基于跟踪的活力评估、语义与实例分割、形态及缺陷分类、功能评估、遗传完整性评估。随后汇总公开数据集、基准、评估指标,以及整合显微图像、延时视频、计算机辅助精液分析(CASA)参数、DNA完整性检测结果与临床元数据的新兴多模态策略。除算法性能外,探讨实际部署的核心障碍,包括数据稀缺、跨中心域偏移、标注不一致、可解释性、不确定性校准、隐私保护学习与工作流集成。最后勾勒分阶段临床转化路线图,涵盖技术标准化、多中心回顾性验证、静默前瞻性评估、人在回路临床测试、辅助生殖技术(ART)结局验证、监管审批与上市后监测。本综述将该领域从特定任务视觉识别到可信多模态生殖智能的发展脉络进行梳理,明确了将AI驱动的精子分析转化为临床有效决策支持所需的进展与待解决挑战。

英文摘要

Male infertility contributes substantially to the global infertility burden, and sperm analysis remains central to diagnosis, treatment planning, and assisted reproductive technology. Conventional semen evaluation, however, is labor-intensive, operator-dependent, and limited by inter- and intra-observer variability, motivating the development of objective and reproducible computational approaches. This review provides a comprehensive and perspective-oriented synthesis of artificial intelligence-driven sperm analysis, with a focus on computer vision, deep learning, multimodal fusion, robustness, and clinical translation. We first review task-specific methods for sperm detection and counting, tracking-based motility assessment, semantic and instance segmentation, morphology and defect classification, functional assessment, and genetic integrity evaluation. We then summarize public datasets, benchmarks, evaluation metrics, and emerging multimodal strategies that integrate microscopic images, time-lapse videos, CASA-derived parameters, DNA integrity assays, and clinical metadata. Beyond algorithmic performance, we discuss key barriers to real-world deployment, including data scarcity, cross-center domain shift, annotation inconsistency, interpretability, uncertainty calibration, privacy-preserving learning, and workflow integration. Finally, we outline a staged clinical translation roadmap spanning technical standardization, multicenter retrospective validation, silent prospective evaluation, human-in-the-loop clinical testing, ART outcome validation, regulatory approval, and post-market monitoring. By organizing the field from task-specific visual recognition to trustworthy multimodal reproductive intelligence, this review highlights both the progress and the unresolved challenges required to translate AI-driven sperm analysis into clinically meaningful decision support.

URL PDF HTML
2607.05310 2026-07-07 cs.AI 新提交

Evaluating and Understanding Model Editing for Medical Vision Language Models

医学视觉语言模型的模型编辑评估与理解

Guli Zhu, Chenwei Wu, Liyue Shen

发表机构 * EECS, University of Michigan(密歇根大学电子工程与计算机科学系)

AI总结 针对现有多模态编辑基准不适配临床需求的问题,提出临床基准M3Bench,测试多类编辑方法的性能短板,为医学VLM部署后安全适配提供支撑。

Comments Accepted to the European Conference on Computer Vision (ECCV) 2026. Code and benchmark are available at https://github.com/BioMed-AI-Lab-U-Michgan/M3Bench

详情
AI中文摘要

模型编辑有望以快速、定向的方式纠正医学视觉语言模型(VLM)部署后的错误,无需高成本的重新训练。但现有多模态模型编辑基准聚焦通用任务,无法反映真实临床领域的需求与变异性。为解决该问题,本文提出M3Bench,这一面向多模态模型编辑的临床基准可评估编辑在图像文本变异、模态与协议偏移、临床知识组合、时间演进等挑战下的可靠性、精确性与泛化性。M3Bench包含覆盖不同解剖结构、模态与专科的16276道问题,支持单次与序列编辑。通过在6个医学及通用VLM上评估4种代表性编辑方法,发现没有方法能在所有指标上表现优异:基于梯度的编辑迁移能力强但存在严重的局部性破坏,基于记忆的编辑可保留局部性却缺乏组合泛化性,且对主干网络相关超参数敏感度高。本文进一步将这些缺陷归因于VLM的隐空间几何特性以及不同编辑方法对其空间分布的改变。总体而言,M3Bench为多模态模型编辑搭建了严格的临床压力测试框架,为更安全的部署后适配提供了可落地的指导。该基准可通过对应公开链接获取。

英文摘要

Model editing promises a fast, targeted way to correct post-deployment mistakes in medical vision-language models (VLMs) without costly retraining. However, existing multimodal model editing benchmarks focus on general-purpose tasks and do not reflect realistic clinical domain requirements and variability. To address this, we introduce M3Bench, a clinically grounded benchmark for multimodal model editing that evaluates whether an edit remains reliable, precise, and generalizable under the challenges of image and text variation, modality and protocol shifts, clinical knowledge composition, and temporal progression. M3Bench contains 16,276 questions spanning diverse anatomy, modalities, and specialties, and supports both single and sequential edits. By evaluating 4 representative editors across 6 medical and general VLMs, we find that no method excels across all criteria. Gradient-based editors achieve strong transfer but suffer from catastrophic locality violations, whereas memory-based methods preserve locality but lack compositional generality and exhibit high backbone-dependent hyperparameter sensitivity. We further attribute these failures to the latent space geometry of VLMs and how different editing methods shift its landscape. Overall, M3Bench establishes a rigorous clinical stress test for multimodal model editing and offers actionable guidance for safer post-deployment adaptation. The benchmark is publicly available at https://github.com/BioMed-AI-Lab-U-Michgan/M3Bench .

URL PDF HTML
2607.05306 2026-07-07 cs.LG 新提交

Biologically Informed Deep Neural Networks for Multi-Omic Integration, Pathway Activity Inference and Risk Stratification in Cancer

用于癌症多组学整合、通路活性推断与风险分层的生物信息引导深度神经网络

Pedro Henrique da Costa Avelar, Le Ou-Yang, Min Wu, Sophia Tsoka

发表机构 * King’s College London(伦敦国王学院) Institute for Infocomm Research, Agency for Science, Technology and Research (A*STAR)(科技研究局信息与通信研究所) Shenzhen University(深圳大学) University of Manchester(曼彻斯特大学)

AI总结 针对多组学整合中可解释性与表征能力的权衡难题,提出通路活性自编码器,依托生物先验约束实现多组学有效整合,在乳腺癌相关任务上取得优异表现,给出实用整合指南。

详情
AI中文摘要

整合复杂的多组学数据面临显著挑战。现有方法通常需要在模型可解释性与表征能力之间做出权衡,其中多数方法要么依赖事后可解释性分析,要么采用可能忽略复杂交互作用的线性模型。本文提出适用于多组学场景的通路活性自编码器,该模型通过通路信息引导的架构约束嵌入先验知识,在保留表征能力的同时提升可解释性。将该多组学框架应用于乳腺癌场景,在生存预测与分子亚型分类任务中开展评估,结果表明多组学整合可带来正向增益。本文分析了各单一组学层对下游任务性能的影响,发现基因、蛋白质与微小RNA表达层的贡献最强。可复现性研究表明,Dropout可提升模型的鲁棒性与一致性,但过度正则化会降低预测性能。最后,对学习到的特征空间的可视化结果证明了该框架的固有透明性与临床相关性。相关结果凸显了多组学整合的价值,明确了各单一组学层的作用,为该框架下的多组学整合制定了实用指南。总体而言,本文提出的通路活性自编码器框架可生成兼具生物学意义的优质隐表征,能够直接转化为具有临床价值的洞察。

英文摘要

Integrating complex, multi-omics data presents significant challenges. Existing approaches often face a trade-off between model interpretability and representational capacity, with most either relying on post-hoc interpretation or use linear models that may overlook complex interactions. We report Pathway Activity Autoencoders for the multi-omics setting, which embed prior knowledge via pathway-informed architectural constraints, fostering interpretability, while preserving representational power. Our multi-omic framework is applied in the context of breast cancer and is evaluated in survival prediction and subtype classification with results indicating a positive effect of integration. We conduct analysis of individual omics layer impact on end-task performance, revealing that gene, protein, and microRNA expression layers provide the strongest contribution. Repeatability studies indicate that, while dropout improves model robustness and consistency, excessive regularisation can reduce predictive performance. Finally, visualizations of the learned feature space illustrate the framework's intrinsic transparency and clinical relevance. The results underscore the value of multi-omic integration and delineate the impact of individual omics layers, establishing practical guidelines for integration within our framework. Overall, our pathway activity autoencoder frameworks yield superior latent representations that are biologically meaningful and are directly translatable into clinically relevant insights.

URL PDF HTML