arXivDaily arXiv每日学术速递 周一至周五更新
全部学科分类 1901
2607.29687 2026-08-03 cs.RO 新提交

Diagnosing Compositional Generalization in Sequential Robot Tasks

诊断序列机器人任务中的组合泛化问题

Yixiao Wang, Cheng-En Wu, Lingfeng Sun, Pengcheng Wang, Xiang Ji, Boyuan Liang, Guojian Zhan, Masayoshi Tomizuka

机构 * University of California, Berkeley(加州大学伯克利分校) Tsinghua University(清华大学)

AI总结 本文针对序列机器人操作的组合泛化问题,将泛化差距分解为三类偏移,发现结构化子集覆盖动作相关依赖即可实现高分布外性能,微调单演示可大幅提升OOD成功率,提出数据收集应优先依赖覆盖。

详情
AI中文摘要

序列机器人操作要求策略能执行熟悉指令组件的新颖组合。然而,为所有可能的指令元组收集演示会产生组合成本,而覆盖稀疏的数据集在分布外重组时往往失效。本文从指令空间覆盖的角度研究组合泛化,将泛化差距分解为三个来源:边缘指令偏移、指令组合偏移和上下文-动作偏移。该分解使我们能够诊断稀疏训练覆盖何时足够,以及训练集必须保留何种结构以实现可靠的动作预测。我们的结果表明,无需穷举元组枚举:当结构化子集覆盖与动作相关的依赖关系时,其规模仅为完整任务空间的四分之一即可恢复强大的分布外性能。我们进一步发现,稀疏训练失效通常是由于指令引导而非缺少低级技能;每个任务仅微调一个演示,可将分布外成功率从0.4%提升至54.7%。对于语义依赖任务,有效覆盖必须捕捉关系结构,而非仅因子多样性。这些发现表明,高效的机器人数据收集应优先考虑指令空间中的依赖覆盖,而非穷举任务扩展。更多结果见补充材料,项目网站为this https URL。

英文摘要

Sequential robot manipulation requires policies to execute novel combinations of familiar instruction components. However, collecting demonstrations for all possible instruction tuples is combinatorially expensive, while sparsely covered datasets often fail under out-of-distribution recombination. This paper studies compositional generalization through the lens of instruction-space coverage. We decompose the generalization gap into three sources: \textit{marginal instruction shift}, \textit{instruction-compositional shift}, and \textit{context--action shift}. This decomposition allows us to diagnose when sparse training coverage is sufficient, and what structure the training set must preserve for reliable action prediction. Our results show that exhaustive tuple enumeration is unnecessary: a structured subset, as small as one quarter of the full task space, can recover strong out-of-distribution performance when it covers action-relevant dependencies. We further find that sparse training often fails due to instruction steering rather than missing low-level skills; finetuning only one demonstration per task improves OOD success from \(0.4\%\) to \(54.7\%\). For semantically dependent tasks, effective coverage must capture relational structure rather than only factor diversity. These findings suggest that efficient robot data collection should prioritize dependency coverage in instruction space over exhaustive task expansion. More results are available in the supplementary material. Project website: https://yixiaowang7.github.io/Diagnosing_Compositional_Generalization_Robot_Page/.

URL PDF HTML 收藏
2607.29684 2026-08-03 cs.CV 新提交

Toward Robust and 3D-Aware RGB-NIR Imaging in the Dark

面向黑暗环境中鲁棒且具备三维感知能力的RGB-NIR成像

Muyao Niu, Mingze Ma, Yifan Zhan, Qingtian Zhu, Zhihang Zhong, Wei Guo, Chang Wen Chen, Yinqiang Zheng

机构 * The University of Tokyo(东京大学) Adelaide University(阿德莱德大学) School of Artificial Intelligence (SAI) Shanghai Jiao Tong University(上海交通大学人工智能学院) Hong Kong Polytechnic University(香港理工大学)

AI总结 本文针对黑暗环境下低光照RGB-NIR成像鲁棒性不足的问题,提出一种无需干净RGB监督、具备三维感知能力的神经模型,可融合含噪RGB与NIR线索恢复干净RGB图像,经合成与真实数据验证效果优越。

Comments ACM Multimedia 2026, Codes and Models: https://github.com/MyNiuuu/3DarkFusion

详情
AI中文摘要

低光照成像的鲁棒性仍是该领域面临的挑战。近期研究探索将近红外(NIR)与含噪RGB图像融合以实现更优的增强效果,但多数方法依赖精心整理的训练数据对,在不同场景下的鲁棒性有限。本文为RGB-NIR低光照成像提供了新视角,引入具备三维感知能力的神经建模方法。无需使用干净的RGB监督数据,即可优化出强大模型,在三维空间中隐式融合含噪程度极高的RGB观测结果与NIR线索,有效恢复干净的RGB图像。该模型省去了收集干净RGB数据的需求,可在不同噪声水平间泛化。在合成数据与真实数据上开展的大量评估表明其具有优越性。代码可访问:this https URL

英文摘要

Robust low-light imaging remains challenging for the community. Recent studies have explored fusing Near-Infrared (NIR) with noisy RGB to achieve improved enhancement, yet most methods depend on carefully curated training data pairs, with limited robustness under different scenarios. This paper offers a new perspective for RGB-NIR low-light imaging by incorporating 3D-aware neural modeling. Without using clean RGB supervision, a powerful model can be optimized to implicitly fuse extremely noisy RGB observations with NIR cues in 3D space, effectively recovering clean RGB images. The proposed model obviates the requirement for clean RGB data collection, generalizes across different noise levels. Extensive evaluations on synthetic and real data demonstrate its superiority. Codes available: https://github.com/MyNiuuu/3DarkFusion

URL PDF HTML 收藏
2607.29678 2026-08-03 cs.CL cs.DC cs.PF 新提交

TokTier: Exact Stateful Tokenization for Agentic LLM Serving

TokTier:面向智能体大语言模型服务的精确有状态分词方案

Zhenyu Zhang, Zhichao Cao

机构 * Arizona State University(亚利桑那州立大学)

AI总结 本研究提出TokTier,一种面向智能体LLM服务的精确有状态分词方案,通过增量修复、GPU加速分词等技术,将首次令牌生成时间降低16%-34%,饱和请求速率提升至1821次/秒,性能远超现有方案。

Comments 24 pages, 18 figures, 8 tables

详情
AI中文摘要

大语言模型服务系统会缓存提示词的键值状态,但大多数前端仍会在每次调用时重新对完整请求文本进行分词。这一成本主要由编码智能体承担,这类智能体在每次获取小工具结果后会重新提交长对话文本,且难以实现复用,因为即使是短的追加内容也会改变前序序列末尾附近的分词边界。在来自两个智能体生态系统的153951次调用中,中位数调用追加约1400个字符,仅有1.0%-3.6%的调用会启动或重建包含数百万字符上下文的会话。在94.1%的 fleet 提示词缓存命中率下,分词耗时占首次生成令牌时间的比例最高达64%。TokTier是一种有状态分词服务,其核心约定是:生成的令牌ID始终与请求文本的完整参考分词结果完全一致。对于会话续传,它会对追加内容周围的小窗口进行重新分词,并在每次请求时执行稳定边界检查后仅拼接符合要求的部分;若检查失败则扩大窗口或回退至完整分词。对于无可复用前缀的调用,它会将GPT系列模型的正则预分词分解为本地运行规则,并在GPU上执行精确预分词和BPE分词。采样影子验证器会对实时流量进行重新检查。针对17种分词器系列,差分测试覆盖了1.5×10^10次拆分检查、12.4TB真实文本语料库以及93000+次重放的智能体步骤,且未出现任何分歧。增量修复在处理10万至300万字符时耗时0.5-1.1毫秒,比HF分词器快达437倍,在处理100万字符时比最强的基于缓存的基准方案Gigatoken(完全预热)快2.1倍。GPU完整分词可在0.87毫秒内对100万至1000万字符的请求进行编码,比HF分词器快达491倍,比已发表最快的CPU方法快23.4倍。结合vLLM,在记录的突发流量下,中位数首次令牌生成时间降低16%-34%,P99降低23%。在50毫秒P99目标下,4个修复核心加1个GPU可维持1821次请求/秒,而16核无状态前端的饱和速率仅为40次请求/秒。

英文摘要

LLM serving systems cache prompt KV state, yet most front ends still re-tokenize the full request text on every call. The cost lands on coding agents, which resubmit a long transcript after each small tool result, and reuse is hard because even a short append can change token boundaries near the end of the previous sequence. Across 153,951 calls from two agent ecosystems, the median call appends about 1.4K characters, and only 1.0-3.6% of calls start or rebuild a session with contexts of millions of characters. At a 94.1% fleet prompt-cache hit rate, tokenization reaches up to 64% of time to first token. TokTier is a stateful tokenization service with one contract: emitted token IDs are always identical to full reference tokenization of the request text. For a session continuation, it re-tokenizes a small window around the append and splices only after a per-request stable-boundary check, widening the window or falling back to full tokenization on failure. For a call without a reusable prefix, it decomposes GPT-family regex pre-tokenization into run-local rules and runs exact pre-tokenization and BPE on a GPU. A sampled shadow verifier re-checks live traffic. Across 17 tokenizer families, differential campaigns cover 1.5x10^10 split checks, a 12.4 TB real-text corpus, and 93,000+ replayed agent steps, with zero divergence. Incremental repair takes 0.5-1.1 ms from 100K to 3M characters, up to 437x faster than HF tokenization and 2.1x faster at 1M than the strongest cache-based baseline (Gigatoken) fully prewarmed. GPU full tokenization encodes a 1M-character request in 0.87 ms, up to 491x below HF and 23.4x below the fastest published CPU method. With vLLM, median time to first token drops 16-34% and P99 drops 23% under recorded bursts. Under a 50 ms P99 objective, four repair cores plus one GPU sustain 1,821 requests/s where a 16-core stateless front end saturates at 40.

URL PDF HTML 收藏
2607.29642 2026-08-03 cs.CL 新提交

Evolving language compositionality in a frequency-structured meaning space

在频率结构化的意义空间中演化语言的组合性

Fabio De Ponte, Eloise Gaines-White, Conor Houghton, Seth Bullock

机构 * Université de Namur(那慕尔大学) Vrije Universiteit Brussel(布鲁塞尔自由大学) University of Bristol(布里斯托尔大学)

AI总结 该研究通过迭代学习模型发现,频率分布在学习者可整体习得的形式-意义单元上时可塑造语言组合性,若分布在更小单元则会阻碍语言稳定传递。

Comments 17 pages, 4 figures (plus 2 figures in appendix), submitted to Wivace 2026 (https://sites.google.com/cam.ac.uk/wivace26)

详情
AI中文摘要

迭代学习模型被引入用于研究语言演化,即人类语言的特征属性至少部分是如何通过在语言使用者之间的反复传递而形成的。关键发现是,语言组合性能够自发产生,这是语言通过语言学习瓶颈反复传递的结果。在此,我们探究不同意义的频率发生变化(使得某些意义出现频率远高于其他意义)时,会如何影响其组合性的特征。我们发现,正如在自然语言中观察到的那样,高频意义可以摆脱符合表征低频意义的语法的压力。然而,当频率结构被施加在意义向量的部分而非整体时,尽管最频繁的元素能够被可靠地学习,语言仍无法跨代传递。这些结果表明,仅当频率分布被定义在学习者能够整体习得的形式-意义单元上时,频率才能塑造涌现的语言结构;而当频率被分布在更小的单元上时,它无法支持组合泛化所需的关系结构,从而阻碍稳定的语言传递。

英文摘要

The iterated learning model was introduced to investigate language evolution: the way in which the characteristic properties of human languages have been shaped, at least partly, by repeated transmission from one language user to another. The key finding is that language compositionality can arise spontaneously as a consequence of language being passed repeatedly through a language learning bottleneck. Here we explore how changing the frequency of different meanings, so that some meanings occur much more frequently than others, affects the character of its compositionality. We find that, as observed in natural languages, high-frequency meanings can escape the pressure to conform to the grammar that characterizes lower-frequency meanings. However, when the frequency structure is instead imposed on parts rather than on whole meaning vectors, the language fails to transmit across generations. This occurs despite the fact that the most frequent elements are reliably learned. These results suggest that frequency can shape emergent linguistic structure only when the frequency distribution is defined over form-meaning units that learners can acquire holistically. When frequency is instead distributed over smaller units, it fails to support the relational structure required for compositional generalisation, thereby preventing stable language transmission.

URL PDF HTML 收藏
2607.29640 2026-08-03 cs.RO 新提交

Bootstrapping Self-Supervised Learning of Binary Classification Using Error Bounds: A Case Study on a Robotic Insertion Task

基于误差边界引导二分类自监督学习:机器人插入任务案例研究

Zebin Duan, Norbert Krüger, Juan Heredia, Thorbjørn Mosekjær Iversen, Frederik Hagelskjær

机构 * Mærsk Mc-Kinney Møller Institute(马士基麦金尼姆勒研究所) University of Southern Denmark(南丹麦大学) Danish Institute for Advanced Study (DIAS)(丹麦高等研究院)

AI总结 本研究针对机器人插入任务,提出结合UMAP降维与Wilson Score置信边界的二分类自监督学习数据引擎,可随任务执行减少昂贵验证需求并控制误差水平。

Comments 8 pages, 7 figures, 2 tables

详情
AI中文摘要

柔性制造要求解决方案能快速部署且设置时间最短,以保持竞争力,控制误差水平是关键属性,故障可能从轻微性能下降到严重设备损坏,但传统部署常涉及大量设置、数据收集、模型训练或参数调优及系统测试,导致显著延迟,阻碍商业可行性。我们提出一种数据引擎,在执行任务时收集数据并提升性能,该引擎包含两个分类器:快速模型预测与昂贵验证。首先执行模型预测,基于预测的置信度水平决定是否使用昂贵验证,通过调整置信度水平,用户可控制可容忍误差水平。我们将该方法应用于真实机器人插入任务,使用力数据进行模型预测,系统采用UMAP降维,并使用Wilson Score计算预测的置信边界。结果表明,该方法能随时间学习并减少对昂贵验证的需求,同时保持在设定的错误率范围内,凸显了置信边界在自改进模型中提升机器人分类任务可靠性的潜力。

英文摘要

Flexible manufacturing requires rapid deployment of solutions and minimal setup time to remain competitive. An essential attribute is the ability to control error levels, as failures can range from minor performance degradation to severe equipment damage. However, conventional deployment often involves extensive setup, data collection, model training or parameter tuning, and system testing, resulting in significant delays that hinder commercial feasibility. We propose a data engine which gathers data and improves its performance while executing the task. The data engine consists of two classifiers, a fast model prediction and expensive verification. First, a model prediction is performed and based on the confidence level of the prediction, the expensive verification can be used. By adjusting the confidence level, users can control the level of tolerable error. Our method is implemented on a real-world robotic insertion task, which uses force data for the model prediction. The system applies UMAP dimensionality reduction and uses Wilson-Score to compute the confidence bounds of the prediction. Results demonstrate the ability to learn and reduce the need for expensive verifications over time, while staying within the set error-rate. The results highlight the potential of confidence bounds in self-improving models to enhance reliability in robotic classification task.

URL PDF HTML 收藏
2607.29633 2026-08-03 cs.CV 新提交

OASIS: Occlusion-aware Single-image Hand Avatar Reconstruction via 3D Gaussian Splatting

OASIS:基于3D高斯溅射的遮挡感知单图像手部化身重建

Zhisheng Han, Shiyao Wu, Jiayan Qiu, Yakun Ju, Lu Liu, Le Zhang, Pengfei Feng, Huiyu Zhou, Zheheng Jiang

机构 * University of Leicester(莱斯特大学) University of Exeter(埃克塞特大学) University of Birmingham(伯明翰大学) China University of Geoscience(中国地质大学)

AI总结 本研究提出OASIS框架,通过3D高斯溅射结合可见性条件注意力与网格上特征表示,实现单图像手部化身重建,在视觉保真度、效率及下游应用通用性上优于现有方法。

Comments Accepted to ACM Multimedia 2026. Project page: https://mova-hand.github.io/MOVA/. Code repository: https://github.com/ivyyy77/OASIS

详情
AI中文摘要

单图像3D手部化身重建本质上是不适定问题,且因高度铰接的手部存在严重自遮挡导致视觉证据有限,以及依赖姿态的复杂变形而极具挑战性。现有方法主要依赖隐式NeRF风格表示,其体积拟合计算成本高,且常难以保留手部细粒度细节。本研究提出OASIS,一种用于单图像手部化身重建的定制化3D高斯溅射框架。为在单视图重建中忠实地编码稀疏的图像特定外观线索,我们通过将输入图像观测与3D手部几何明确对齐,并对所得视觉证据进行上下文自适应分词,构建几何对齐的视觉证据令牌。由于严重自遮挡使图像证据的可靠性固有地依赖可见性,我们引入可见性条件的点-图像注意力,以可靠地将视觉证据传递给几何令牌,从而生成用于忠实且鲁棒重建的遮挡感知高斯特征。为进一步捕捉铰接手部的非刚性变形,我们引入网格上特征表示,使高斯变形能由局部表面拉伸引导。在该框架下,我们采用一次性适应方案,从多身份训练数据中学习共享手部先验,随后将其适配到目标图像以实现目标特定重建。大量实验表明,在挑战性姿态和野外场景中,OASIS在视觉保真度和效率上均优于现有基线,且在文本到化身生成、纹理编辑等下游应用中展现出强大通用性。

英文摘要

Single-image 3D hand avatar reconstruction is fundamentally ill-posed and particularly challenging due to limited visual evidence under severe self-occlusion and the complex pose-dependent deformation of highly articulated hands. Existing methods predominantly rely on implicit NeRF-style representations, whose volumetric fitting is computationally expensive and often struggles to preserve fine-grained hand details. In this work, we present OASIS, a tailored 3D Gaussian Splatting framework for single-image hand avatar reconstruction. To faithfully encode sparse image-specific appearance cues in single-view reconstruction, we construct geometry-aligned visual evidence tokens by explicitly aligning input image observations with 3D hand geometry and context-adaptively tokenizing the resulting visual evidence. Since severe self-occlusion makes the reliability of image evidence inherently visibility-dependent, we introduce a visibility-conditioned point-image attention to reliably transfer visual evidence to geometric tokens, yielding occlusion-aware Gaussian features for faithful and robust reconstruction. To further capture non-rigid deformation of articulated hands, we introduce a Feature-on-Mesh representation to enable Gaussian deformation to be guided by local surface stretching. Under this framework, we adopt a one-shot adaptation scheme that learns a shared hand prior from multi-identity training data and then fits it to a target image for target-specific reconstruction. Extensive experiments show that OASIS outperforms existing baselines in both visual fidelity and efficiency across challenging poses and in-the-wild scenarios, and further demonstrates strong versatility in downstream applications such as text-to-avatar generation and texture editing.

URL PDF HTML 收藏
2607.29627 2026-08-03 cs.CV 新提交

FlexComposer: Unified Video Compositing from Images to Dynamic Footage with Flexible Trajectory Control

FlexComposer:支持灵活轨迹控制的从图像到动态素材的统一视频合成框架

Songchun Zhang, Sitong Guo, Xianghao Kong, Pengwei Liu, Yuwei Guo, Lvmin Zhang, Anyi Rao

机构 * HKUST(香港科技大学) ZJU(浙江大学) CUHK(香港中文大学) Stanford University(斯坦福大学)

AI总结 FlexComposer是支持灵活轨迹控制的统一视频合成框架,通过三项关键设计实现静态图像与动态素材的无缝整合,在视觉质量等指标上优于现有SOTA方法。

Comments 30 pages, 10 figures

详情
AI中文摘要

生成式视频合成是将外部素材无缝插入现有视频序列的技术,对内容创作和视觉效果至关重要。但现有方法存在控制保真度的权衡问题:要么从静态图像生成幻觉运动,无法保留预动画素材的动态性;要么缺乏沿用户定义轨迹精确放置素材的细粒度空间控制。我们提出FlexComposer,这是一个将视频合成为轨迹引导条件生成任务的统一框架,可无缝整合静态图像和动态素材。该方法包含三项关键设计:(1)统一规范前景表示,将物体的内在运动与全局位移解耦,将异构输入标准化为稳定居中的潜在空间;(2)空间感知潜在注入策略,利用VAE潜在空间的平移等变性,通过无参数机制将规范特征传输到目标轨迹;(3)混合数据集与合成到真实课程,结合程序模拟、真实电影素材和生成数据,隐式学习物理上合理的光照与阴影协调。这种统一设计处理从产品照片到动态主体的多样化输入,实现高保真运动控制和环境整合,无需显式3D重建或辅助可学习适配器。大量实验表明,FlexComposer在视觉质量、时间一致性和轨迹贴合度上优于现有SOTA方法。

英文摘要

Generative video compositing, which involves inserting external assets seamlessly into existing video sequences, is essential for content creation and visual effects. However, existing approaches suffer from a control-fidelity trade-off: they either hallucinate motion from static images, failing to preserve the dynamics of pre-animated assets, or lack fine-grained spatial control for precise asset placement along user-defined trajectories. We propose FlexComposer, a unified framework that standardizes video compositing as a trajectory-guided conditional generation task, enabling the seamless integration of both static images and dynamic footage. Our approach introduces three key designs: (1) a Unified Canonical Foreground Representation that decouples an object's intrinsic motion from its global displacement, standardizing heterogeneous inputs into a stabilized, centered latent space; (2) a Spatial-Aware Latent Injection strategy that exploits the translation equivariance of VAE latent spaces to transport canonical features onto target trajectories via a parameter-free mechanism; and (3) a Hybrid Dataset and Synthetic-to-Real Curriculum that synergizes procedural simulation, real-world cinematic footage, and generative data to implicitly learn physically plausible illumination and shadow harmonization. This unified design handles diverse inputs from product photos to dynamic subjects achieving high-fidelity motion control and environmental integration without the need for explicit 3D reconstruction or auxiliary learnable adapters. Extensive experiments demonstrate that FlexComposer outperforms state-of-the-art methods in visual quality, temporal consistency, and trajectory adherence.

URL PDF HTML 收藏
2607.29622 2026-08-03 cs.RO cs.CV 新提交

RayViT: Ray-Conditioned Visual Representations for Viewpoint-Robust Imitation Learning

RayViT:用于视角鲁棒模仿学习的光线条件视觉表示

Qian Wang, Longrui Chen, Peiran Sun, Aleksandar Taranovic, Niklas Freymuth, Ge Li, Weiran Liao, C. F. Maximilian Nagy, Yucheng Tan, Tao Chen, Gerhard Neumann

机构 * Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院) University of Leeds(利兹大学)

AI总结 针对视觉模仿学习中RGB观测缺乏几何线索导致策略对相机扰动脆弱的问题,提出RayViT架构,结合辅助余弦相似度损失,在RoboCasa基准及真实机器人任务中提升了策略的鲁棒性与多任务表现。

详情
AI中文摘要

视觉模仿学习使机器人能够直接从图像中获取视觉运动技能,但RGB观测缺乏明确的几何线索,导致学习到的策略对相机扰动较为脆弱。为解决该问题,我们提出光线条件视觉Transformer编码器(Ray-conditioned Vision Transformer Encoder,RayViT),这是一种将相机几何信息注入预训练ViT骨干网络的轻量型架构。RayViT将相机几何表示为普吕克光线图(Plücker ray map),将其分块为光线特征,并使用门控交叉注意力生成光线条件类token。这些光线特征作为密集位置嵌入添加,而光线类token则替换原始ViT类token以提供几何感知的总结表示。我们将该方法与辅助余弦相似度损失相结合,以持续提升几何感知token的性能与鲁棒性。在仿真和真实机器人任务上的实验表明,RayViT在多任务RoboCasa基准测试中,相机扰动下的鲁棒性较基线提升约13个百分点,在真实世界多任务成功率中,平均完成阶段数较基线提升1.78。

英文摘要

Visual imitation learning enables robots to acquire visuomotor skills directly from images, yet RGB observations lack explicit geometric cues, making learned policies brittle to camera perturbations. To address this, we propose \textbf{Ray-conditioned Vision Transformer Encoder (RayViT)}, a lightweight architecture that injects camera geometry into pretrained ViT backbones. RayViT represents camera geometry as a Plücker ray map, patchifies it into ray features, and uses gated cross-attention to produce a ray-conditioned class token. These ray features are added as dense positional embeddings, while the ray class token replaces the original ViT class token to provide a geometry-aware summary representation. We combine this approach with an auxiliary cosine similarity loss to consistently improve the performance and robustness for geometry-aware tokens. Experiments on sim- and real-robot tasks demonstrate that RayViT improves robustness by approximately 13 percentage points under camera perturbations in multi-task RoboCasa benchmark and by 1.78 average completed stages in real-world multi-task success rate compared to baselines.

URL PDF HTML 收藏
2607.29621 2026-08-03 cs.LG cs.AI 新提交

CENDRe: Concept Extraction with Natural Domain Representations

CENDRe:基于自然域表示的概念提取

Antonia Holzapfel, Andres Felipe Posada Moreno, Sebastian Trimpe

机构 * Institute for Data Science in Mechanical Engineering (DSME)(机械工程数据科学研究所(DSME)) RWTH Aachen University(亚琛工业大学)

AI总结 针对现有时间序列概念提取方法的局限,提出CENDRe方法,可自动确定概念数量,同时在时域和频域定位概念,在合成基准和真实轴承故障数据上均表现优异。

详情
AI中文摘要

卷积神经网络(CNN)广泛用于时间序列分类,但其在关键领域的部署需要理解驱动预测的时间和频谱模式。概念提取(CE)方法通过分析模型潜空间内的表示来识别此类模式,但现有时间序列CE方法存在三个局限:仅在时域操作、忽略频率特征,需预先定义概念数量,且生成的定位与模型使用的区域不匹配。我们提出针对CNN的概念提取方法CENDRe以解决这些局限。它首先通过两个阶段对每时间步的潜表示进行聚类来发现概念,其中基于轮廓系数的聚合自动选择概念数量;接着通过存在得分的梯度定位每个概念,该得分将潜表示与其原型对比,生成聚焦于驱动概念区域的掩码。这些梯度通过输入的可微可逆映射(如傅里叶变换)传播,得到相同概念在频域的定位。最后,每个概念获得量化其对每个类贡献的相关性得分。在合成基准上,CENDRe的表示正确性与最先进的CE方法相当,且重要性正确性显著更高;在真实轴承故障数据上,CENDRe提取了驱动模型预测的频带,这些频带位于故障诊断常检查的区域,提供了时域CE方法无法提供的模型评估证据。

英文摘要

Convolutional neural networks (CNNs) are widely used for time-series classification, but their deployment in critical domains requires understanding the temporal and spectral patterns that drive their predictions. Concept extraction (CE) methods identify such patterns by analyzing representations within the models' latent space. However, existing time-series CE methods have three limitations: they operate only in the time domain and overlook frequency features, predefine the number of concepts, and produce localizations misaligned with the regions the model uses. We address these limitations by proposing CENDRe, a concept extraction method for CNNs. It first discovers concepts by clustering per-timestep latent representations in two stages, where silhouette-guided aggregation selects the number of concepts automatically. Then, it localizes each concept through gradients of a presence score that contrasts the latent representations with their prototypes, producing masks that concentrate on the regions driving the concept. These gradients, propagated through a differentiable invertible mapping of the input such as a Fourier transform, yield localizations for the same concepts in the frequency domain. Finally, each concept receives a relevance score that quantifies its contribution to each class. On synthetic benchmarks, CENDRe achieves representation correctness comparable to state-of-the-art CE methods and significantly higher importance correctness. On real bearing-fault data, CENDRe extracts the frequency bands driving the model's predictions, located in regions commonly inspected for fault diagnosis, producing evidence to assess the model that time-domain CE methods cannot.

URL PDF HTML 收藏
2607.29614 2026-08-03 cs.LG cs.AI cs.CV 新提交

A Human-Centered Validation of the Explainability-Performance Coefficient

面向可解释性-性能系数的以人为中心验证

Christian Oliva, Luis F. Lago-Fernández

机构 * Universidad Autónoma de Madrid(马德里自治大学)

AI总结 本研究提出模型无关的EPC分数,量化解释质量,经多模态实证及人类解释验证,可揭示网络激活等依赖关系,与人类判断高度一致。

详情
AI中文摘要

深度学习模型在高风险领域的快速普及,加剧了对可解释人工智能(XAI)可信赖性的需求。然而,客观评估解释保真度、使XAI指标与以人为中心的理解保持一致,仍是关键的开放挑战。本研究提出一种模型无关的指标——EPC分数,它是可解释性-性能系数(EPC)的扩展,通过明确平衡特征选择稀疏性与保留模型性能之间的权衡来量化解释质量。通过对表格、文本和图像模态的实证验证,我们发现EPC分数能有效揭示网络激活、数据维度与解释器性能之间的操作依赖关系。此外,我们针对独立的人类解释验证了EPC分数,证明更高的EPC分数与人类词汇情感判断、空间视觉标注高度一致。

英文摘要

The rapid adoption of deep learning models in high-risk domains has intensified the need for trustworthy Explainable Artificial Intelligence (XAI). However, objectively evaluating explanation fidelity and aligning XAI metrics with human-centered understanding remain critical open challenges. In this work, we propose a model-agnostic metric, the EPC score, which is an extension of the Explainability-Performance Coefficient (EPC), that quantifies explanation quality by explicitly balancing the trade-off between feature selection sparsity and preserved model performance. Through an empirical validation across tabular, text, and image modalities, we show that the EPC score effectively uncovers operational dependencies among network activations, data dimensionality, and explainer performance. Furthermore, we validate the EPC score against independent human-based explanations, proving that higher EPC scores strongly align with human lexical sentiment judgments and spatial visual annotations.

URL PDF HTML 收藏
2607.29613 2026-08-03 cs.RO cs.CL cs.CV 新提交

WCM: A World Critic Model for Vision-Language-Action Reinforcement Learning

WCM:用于视觉-语言-动作强化学习的世界评论者模型

Senyu Fei, Xiaopeng Yu, Siyin Wang, Xianzhong Zhao, Jingjing Gong, Xipeng Qiu

机构 * Tongji University(同济大学) Shanghai Innovation Institute(上海创新研究院) Fudan University(复旦大学)

AI总结 该研究针对视觉-语言-动作强化学习中评论者与机器人部分可观测性不匹配的问题,提出WCM模型,联合预测未来潜态与值估计,在149个仿真任务和7个真实任务上均实现最优性能与泛化性。

详情
AI中文摘要

视觉-语言-动作(VLA)模型的强化学习(RL)后训练在机器人操纵领域展现出强大潜力。在RL方法中,基于评论者的方法依赖于主要基于单帧观测或单帧VLM骨干潜变量运行的值估计器,这与机器人控制的部分可观测性存在根本不匹配。将观测历史纳入评论者的朴素方法会在高维视觉空间中产生指数级复杂度,且仍会失败,因为纯标量回报回归无法为跨时间动态的学习提供足够监督。我们将根本原因识别为状态近似问题:若无显式世界建模目标,评论者的表示无法捕捉准确值估计所需的时间结构。为解决此问题,我们提出基于轻量LeJEPA架构构建的世界评论者模型(WCM);WCM联合预测未来潜状态并估计值,使评论者的表示被显式训练以捕捉时间动态,而非仅回归标量回报。WCM可无缝集成到同策略和异策略训练流程,且与包括Pi0、Pi0.5和OpenVLA-OFT在内的最先进VLA骨干兼容。在四个基准的149个任务上开展的大量实验表明,WCM在分布内和分布外设置中均持续实现最先进性能,且泛化增益尤为显著。我们进一步使用OpenVLA-OFT和Pi0.5在七个真实世界操纵任务上通过异策略RL验证WCM,确认其可在多样设置中稳定部署。

英文摘要

Reinforcement learning (RL) post-training of Vision-Language-Action (VLA) models has shown strong promise for robotic manipulation. Among RL methods, critic-based approaches rely on a value estimator that predominantly operates on single-frame observations or single-frame VLM backbone latents, which is a fundamental mismatch with the partially observable nature of robot control. A naive approach to incorporate observation history into the critic incurs exponential complexity with high-dimensional visual space, and still fails because pure scalar-return regression provides insufficient supervision for learning cross-temporal dynamics. We identify the root cause as a state approximation problem: without an explicit world modeling objective, the critic's representation cannot capture the temporal structure needed for accurate value estimation. To address this, we propose the World Critic Model (WCM), built on a lightweight LeJEPA architecture; WCM jointly predicts future latent state and estimates values, such that the critic's representation is explicitly trained to capture temporal dynamics rather than merely regress scalar returns. WCM integrates seamlessly into both on-policy and off-policy training pipelines and is compatible with state-of-the-art VLA backbones including Pi0, Pi0.5, and OpenVLA-OFT. Extensive experiments on 149 tasks across four benchmarks demonstrate that WCM consistently achieves state-of-the-art performance in both in-distribution and out-of-distribution settings, with particularly strong generalization gains. We further validate WCM on seven real-world manipulation tasks using OpenVLA-OFT and Pi0.5 with off-policy RL, confirming stable deployment across diverse settings.

URL PDF HTML 收藏
2607.29602 2026-08-03 cs.CL cs.AI cs.CV cs.HC 新提交

FriendBench: Benchmarking Dyadic Familiarity Inference in Humans and Multimodal Large Language Models

FriendBench:人类与多模态大语言模型的二元熟悉度推理基准

Jeffrey M. Girard, Jason Z. Zheng, Jacqueline R. Vertino, Antony D'Avirro, Benjamin Peloquin

机构 * Fluid Concepts Research(流体概念研究机构)

AI总结 该研究推出FriendBench基准,通过20秒二元破冰对话片段推断两人熟悉度,对比7家公司26个模型与人类的表现,发现模型与人类准确率无统计差异但先验倾向不同,且仅人类能从可见行为中获益,同时发布了相关资源。

Comments 15 pages, 3 figures

详情
AI中文摘要

解读社交情境往往依赖行为而非仅言语。我们推出FriendBench,这是一个用于从20秒二元破冰对话片段中推断两人是已熟悉还是初次见面的基准。每对都回答相同类型的提示,因此仅互动方式能揭示答案。在文本、音频和视频模态下,我们将来自7家公司的26个模型与96组平衡二元对的匹配人类面板进行比较。最佳模型与人类群体在各模态的准确率上无统计差异,但达成路径不同:人类在两种答案间保持平衡,而最强模型倾向于“陌生人”——这是有效先验的差异,而非判别能力的差异。更丰富的模态对两者的帮助不均等,且仅人类能从语音之外的可见行为中获益。我们发布了刺激材料、人类评分和模型预测结果。

英文摘要

Reading a social situation often depends on behavior, not words alone. We introduce FriendBench, a benchmark for inferring whether two people are already familiar or are meeting as strangers, from a 20-second clip of a dyadic ice-breaker conversation. Every pair answers the same type of prompt, so only the manner of interaction can reveal the answer. Across text, audio, and video, we compare 26 models from seven companies against matched human panels over 96 balanced dyads. The best model and the human crowd are statistically indistinguishable on accuracy in every modality, but reach it differently: humans stay balanced across the two answers, while the strongest models lean toward "stranger"---a difference in effective prior, not discrimination. Richer channels help both unequally, and only humans gain from visible behavior on top of speech. We release the stimuli, human ratings, and model predictions.

URL PDF HTML 收藏
2607.29592 2026-08-03 cs.CV cs.LG 新提交

TOOD: Task-Aware Out-of-Distribution Score Calibration for Continual Learners

TOOD:面向持续学习智能体的任务感知分布外分数校准

Mostafa ElAraby, Samer B. Nashed, Liam Paull

机构 * Mila - Quebec AI Institute(米拉-魁北克人工智能研究所) CIFAR AI Chair(加拿大高级研究所人工智能主席项目)

AI总结 本文针对持续学习智能体的分布外检测遗忘问题,提出无需训练的TOOD事后校准方法,在多数据集上显著提升了分布外检测性能。

Comments 21 pages, 9 figures, and 4 tables. Accepted for oral presentation at the Conference on Lifelong Learning Agents (CoLLAs 2026)

详情
AI中文摘要

持续学习(CL)系统的核心挑战是在学习新任务的同时保持对已学任务的性能。持续学习系统另一个同样重要但研究较少的方面是区分输入是否来自系统已遇任务集合之外的能力,即分布外(OOD)检测。本文报告了持续学习系统中OOD检测动态、随时间性能下降原因(称为OOD遗忘,OODF)及缓解策略的多项发现。主要发现:OODF与旧任务分类性能仅呈弱负相关,说明二者机制不同,且该效应对基于能量和基于特征的OOD检测方法均存在。基于能量的检测器因学习更多任务出现logit尺度下降,称为置信间隙;基于特征的检测器则因互补效应(称为流形拥挤)性能下降。基于上述观察,提出TOOD,一种无需训练的事后方法,将logits分解为单任务能量分数,并用回放缓冲区统计数据重新校准。在CIFAR-10、CIFAR-100及100任务ImageNet-1K流上的实验显示,多数设置下TOOD的OOD检测性能优于未校准的能量方法,在10个CIFAR配置中9个排第一或第二,置信间隙最严重时增益最大。结果表明,持续学习中OOD恶化的很大一部分源于分数校准不当,而非判别结构完全丢失。

英文摘要

The primary challenge of continual learning (CL) systems is to learn new tasks while remaining performant on previously learned tasks. A similarly important though less well-studied aspect of CL systems is their ability to distinguish inputs that are unlikely to come from within the set of tasks the system has already encountered, often called out-of-distribution (OOD) detection. This paper presents several findings related to the dynamics of OOD detection in CL systems, causes of performance degradation over time which we call OOD forgetting (OODF), and proposed mitigation strategies for this degradation. Chiefly, we find the unintuitive result that OODF is only weakly anti-correlated with classification performance on previous tasks, suggesting that the underlying mechanisms producing OODF are distinct. Moreover, this effect is observed for both energy-based and feature-based OOD detection methods. Energy-based detectors suffer a drop in logit scale as additional tasks are learned, which we term the Confidence Gap, while feature-based detectors also degrade under a complementary effect we call Manifold Crowding. Motivated by these observations, we propose TOOD, a training-free post-hoc method that decomposes logits into per-task energy scores and re-calibrates them using replay-buffer statistics. Experiments on CIFAR-10, CIFAR-100, and a 100-task ImageNet-1K stream show that TOOD improves OOD detection performance over uncalibrated energy in most settings and ranks first or second in nine of ten CIFAR configurations, with the largest gains when the confidence gap is most severe. These results suggest that a substantial portion of OOD deterioration in continual learning arises from score miscalibration rather than from a complete loss of discriminative structure.

URL PDF HTML 收藏
2607.29581 2026-08-03 cs.CV 新提交

Explaining AI-Image Detection: What the Heatmap Actually Shows

AI图像检测的可解释性:热图实际显示了什么

Leonid Kuturin, Ilya Sotnikov, Mark Khusnutdinov, Mikhail Potemkin, Pavel Baranas, Aleksandra Korepanova, Alexander Kalashnikov

机构 * Sirius Educational Centre(天狼星教育中心) HSE University(高等经济大学)

AI总结 该研究针对AI图像检测的可解释性问题,构建检测器并测试归因图的可靠性,发现现有归因图无法通过检测器盲对照,未找到可靠的AI图像检测解释方法。

Comments 8 pages of main text; 27 pages including references and appendix. 9 figures, 21 tables

详情
AI中文摘要

商品评价照片是一种凭证,平台会依据它批准退款,而生成式模型将伪造这类照片的成本降至为零。我们研究该检测问题,因此构建了一个检测器并附上归因图作为其证据,随后在旨在在出错时改变我们结论的控制条件下,对186527张图像测量这一组合的效果。压缩历史而非合成驱动了朴素评估:我们最强的模型在产品不重叠的划分上达到0.9999 PR-AUC(精确率-召回率曲线下面积),但当我们将合成图像重新编码为真实类别的格式后,该模型的PR-AUC降至0.7254,而五个公开检测器的变化最多仅为0.07。对齐一个类别会转移线索而非移除它,修复后的模型将原生文件的合成概率中位数设为0.0004。对两个类别采用相同的最终编码修复了这一问题,三种子集的析因分析表明,编码变化带来了全部增益(+0.176 ± 0.009 PR-AUC)。该编码仅均衡了最后阶段:仅取证特征仍能以0.7145的性能区分两个类别,而基础率为0.254。为验证证据,我们对归因图进行因果测试,对照条件从不参考检测器。是否存在归因排序完全取决于检测器是否对图像做出反应。在我们的首个修复检测器(100张编辑帧中96张判定为真实)上,没有任何归因图优于随机水平。在我们选定的检测器上,17张编辑图像中有12张的归因图通过了该控制测试,生成图像中有8张通过;扰动在两个轴上均有效,且无任何梯度-CAM变体表现出优势。简单对照条件从未通过测试,在生成图像上中心先验的表现比随机更差。我们的集成区域归因图通过了两个轴的测试,其最高像素AP为每张图12.4秒,而遮挡法为44.9秒。通过检测器盲对照测试目前仍不算是可靠的解释,且我们未找到任何符合要求的解释。

英文摘要

A marketplace review photograph is a document: platforms approve refunds on it, and generative models drove the cost of forging one to zero. We study that detection problem, so we build a detector and attach an attribution map as its evidence, then measure what that pair delivers on 186,527 images under controls designed to change our conclusions when something is wrong. Compression history, not synthesis, drives naive evaluation: our strongest model reaches 0.9999 PR-AUC (area under the precision-recall curve) on a product-disjoint split, yet falls to 0.7254 once we re-encode synthetics into the real class's format, while five public detectors move by at most 0.07. Aligning one class relocates the cue rather than removing it, and the repaired model then assigns native files a median probability of synthesis of 0.0004. One identical final encode for both classes repairs that, and a three-seed factorial credits the encoding change with the whole gain (+0.176 +- 0.009 PR-AUC). That encode equalises the last stage only: forensic features alone still separate the classes at 0.7145 against a base rate of 0.254. For evidence we test maps causally, against controls that never consult the detector. Whether an attribution ranking exists at all depends on whether the detector reacts to the image. On our first-fix detector, which calls 96 of 100 edited frames real, no map beats a random one. On the detector we selected, twelve of seventeen maps clear that control on edited images and eight on generated ones; perturbation leads both axes and no gradient-CAM variant shows a positive advantage. The trivial controls never clear it, and on generated images the centre prior is worse than random. Our ensembled regional map clears both axes and takes the top pixel AP at 12.4 s per map against 44.9 for occlusion. Clearing a detector-blind control is not yet a faithful explanation, and we demonstrate none.

URL PDF HTML 收藏
2607.29569 2026-08-03 cs.RO cs.SY eess.SY 新提交

Safe Vision Language Action Models via Barrier Enhanced Flow Matching

基于障碍增强流匹配的安全视觉语言动作模型

Kasra Sinaei, Hung-Chieh Wu, Donald Ebeigbe

机构 * The Pennsylvania State University(宾夕法尼亚州立大学)

AI总结 该研究提出将流匹配生成模型与控制障碍函数安全保证结合的模块化推理框架,通过修改流匹配去噪过程实现本质安全,在不降低模型成功率的前提下完成安全验证。

详情
AI中文摘要

本文提出一种模块化推理框架,将流匹配(Flow Matching)生成模型与形式化控制障碍函数(Control Barrier Function, CBF)安全保证相结合。与现有对模型最终输出施加外部安全过滤器的方法不同,我们的方法在模型内部修改流匹配去噪过程,从本质上生成安全轨迹。通过采用平滑的对数求和指数聚合障碍,我们对整个动作块实施安全约束。该聚合障碍确保计算开销的最小增加,且不改变模型的语义意图。我们证明,在该框架内,生成分布与目标分布之间的2-瓦瑟斯坦距离保持有界。我们的方法无需特定安全数据集或代价高昂的模型重训练,为安全推理提供了通用解决方案。我们在两个机器人操作平台和一个2D导航基准上验证了该方法,确认我们的框架在不降低模型成功率的前提下实现了可靠的安全性。

英文摘要

This article presents a modular inference framework that integrates Flow Matching generative models with formal Control Barrier Function (CBF) safety guarantees. Unlike existing methods that apply external safety filters to a model's final output, our approach modifies the Flow Matching denoising process within the model to inherently generate safe trajectories. By employing a smooth Log-Sum-Exponential aggregate barrier, we enforce safety over entire action chunks. This aggregate barrier ensures a minimal increase in computational overhead and does not alter the semantic intent of the model. We show that, within the proposed framework, the 2-Wasserstein distance between the generated distribution and the target distribution remains bounded. Our method eliminates the need for safety-specific datasets or costly model retraining, providing a versatile solution for safe inference. We validate the approach on two robotic manipulation platforms and a 2D navigation benchmark, verifying that our framework achieves reliable safety without degrading the success rate of the model.

URL PDF HTML 收藏
2607.29567 2026-08-03 cs.RO 新提交

TransGraspNet: Physically and Geometrically Consistent Manipulation of Transparent Labware

TransGraspNet:透明实验器皿的物理与几何一致性操纵

Hailing Hu, Mingyi Zhu, Yiquan An, Yifei Tian, Tianyou Zuo, Lifeng Zhou

机构 * Peking University(北京大学) School of Advanced Manufacturing and Robotics, Peking University(北京大学先进制造与机器人学院) Shanghai Jiao Tong University(上海交通大学) Southern University of Science and Technology(南方科技大学)

AI总结 TransGraspNet是实现透明实验器皿物理与几何一致性操纵的框架,通过三个耦合原则解决跨阶段不一致问题,在真实机器人平台上实现了高抓取成功率与零液体泼洒的可靠操作。

详情
AI中文摘要

操纵装有液体的透明实验玻璃器皿本质上关乎安全:即便是微小的几何误差也会导致抓取不稳定,引发危险的液体泼洒。尽管透明物体感知与机器人抓取领域近期取得了进展,但现有多数系统独立优化检测、深度重建与抓取规划,导致跨阶段不一致:不完善的边界会引发深度渗出现象,扭曲的表面会破坏法向估计,与任务无关的抓取评分会产生倾斜或偏离中心的抓取,在动态运动下失效。本文提出TransGraspNet,这是一个几何-物理一致性框架,通过三个耦合原则明确强化从感知到执行的一致性:边界一致性以生成结构可靠的物体轮廓作为下游先验,表面一致性以在深度重建过程中保留几何保真度与表面法向精度,物理一致性则通过质心对齐与力 wrench 空间稳定性优化抓取选择,实现直立且动态鲁棒的操纵。我们在公共基准、专用透明玻璃器皿数据集及真实机器人平台上评估TransGraspNet。结果显示其边界质量与表面法向保真度均有提升,在杂乱透明场景中展现出优异的任务级性能。最重要的是,该系统实现了可靠的实际操作,包括在杂乱环境中达到高抓取成功率,且在高速液体运输过程中零泼洒,凸显了所提方法的有效性。

英文摘要

Manipulating transparent laboratory glassware that contains liquid is inherently safety-critical: even small geometric errors can cause unstable grasps and hazardous spillage. Although recent progress has been made in transparent object perception and robotic grasping, most existing systems optimize detection, depth reconstruction, and grasp planning independently, which leads to cross-stage inconsistency imperfect boundaries induce depth bleeding, distorted surfaces corrupt normal estimation, and task agnostic grasp scoring yields tilted or off-center grasps that fail under dynamic motion. In this paper, we propose TransGraspNet, a geometry physics consistent framework that explicitly enforces consistency from perception to execution through three coupled principles: boundary consistency to produce structurally reliable object contours as downstream priors, surface consistency to preserve geometric fidelity and surface normal accuracy during depth reconstruction, and physics consistency to refine grasp selection with centroid alignment and wrench-space stability for upright and dynamically robust manipulation. We evaluate TransGraspNet on public benchmarks, a dedicated transparent glassware dataset, and a real robotic platform. The results show improved boundary quality and surface normal fidelity, and demonstrate strong task-level performance in cluttered transparent scenes. Most importantly, the proposed system achieves reliable real-world operation, including high grasp success rates in clutter and zero spillage during high speed liquid transport, highlighting the effectiveness of our method.

URL PDF HTML 收藏
2607.29561 2026-08-03 cs.LG cs.AI 新提交

MOT-SR: Multi-Objective Tool-Augmented Scientific Equation Discovery with Large Language Models

MOT-SR:基于大语言模型的多目标工具增强型科学方程发现

Boxiao Wang, Runxiang Wang, Kai Li, Chongming Li, Zhiwei Chen, Yifan Zhang, Jian Cheng

机构 * Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所) University of the Chinese Academy of Sciences(中国科学院大学) School of Advanced Interdisciplinary Sciences(先进交叉科学学院) School of Astronomy and Space Science, University of the Chinese Academy of Sciences(中国科学院大学天文与空间科学学院)

AI总结 MOT-SR是整合外部分析工具、采用双协同LLM模块的多目标工具增强型符号回归框架,在40项标准任务及EMRI轨道建模中均展现出更优性能,可实现长程科学动力学的可靠建模。

Comments Code is available at https://github.com/wswbx/MOT-SR

详情
AI中文摘要

符号回归(Symbolic Regression,SR)旨在从观测数据中解析出解析方程,是科学建模的核心环节。尽管近期基于大语言模型(Large Language Model,LLM)的方法展现出潜力,但存在两大局限:其一,这类方法缺乏用于揭示变量依赖关系的数据分析机制,降低了方程发现的效率;其二,多数方法依赖仅聚焦拟合误差的单目标评估,对结构复杂度与泛化性的忽视常导致模型过早收敛至局部最优,限制了其探索更广阔方程空间的能力。本文提出多目标工具增强型符号回归(Multi-Objective Tool-augmented Symbolic Regression,MOT-SR),这一统一框架整合外部分析工具以提取结构先验并指导方程生成,同时通过维护动态帕累托最优前沿的多目标评估模块,联合优化准确性、复杂度与泛化性。MOT-SR采用两个协同的LLM模块:元策略生成器(Meta Strategy Generator)基于帕累托最优方程选择工具并合成结构优化策略,方程生成器(Equation Generator)据此生成新的候选方程。该系统以闭环方式运行,持续优化策略与方程结构。在40项标准任务中,MOT-SR在准确性、泛化性与效率上均优于现有SR方法。我们进一步在极端质量比旋进(extreme mass-ratio inspiral,EMRI)轨道建模任务中验证MOT-SR的性能,该任务是空间引力波天文学的重要问题,微小的局部误差会在长期演化中大幅累积。所发现的可解释修正项在保留配置上实现了最低的轨迹级积分误差,这些结果证明MOT-SR具备实现长程科学动力学可靠建模的潜力。

英文摘要

Symbolic Regression (SR) aims to discover analytical equations from observational data and plays a central role in scientific modeling. While recent Large Language Model (LLM) based approaches show promise, they face two limitations. First, they lack data analysis mechanisms for uncovering variable dependencies, which reduces the efficiency of equation discovery. Second, most methods rely on single-objective evaluation focused solely on fitting error. This neglect of structural complexity and generalization often causes models to converge prematurely to local optima, limiting their ability to explore the broader equation space. We propose Multi-Objective Tool-augmented Symbolic Regression (MOT-SR), a unified framework that integrates external analytical tools to extract structural priors and guide equation generation, while jointly optimizing for accuracy, complexity, and generalization via a multi-objective evaluation module that maintains a dynamic Pareto front. MOT-SR employs two collaborative LLM modules: a Meta Strategy Generator, which selects tools and synthesizes structural optimization strategies based on Pareto-optimal equations, and an Equation Generator, which produces new candidate equations accordingly. The system operates in a closed-loop manner, continuously refining both strategies and equation structures. Across 40 standard tasks, MOT-SR outperforms existing SR methods in accuracy, generalization, and efficiency. We further validate MOT-SR on extreme mass-ratio inspiral (EMRI) orbital modeling, an important problem in space-based gravitational-wave astronomy where small local errors can accumulate substantially over long-term evolution. The discovered interpretable correction achieves the lowest trajectory-level integration error on held-out configurations. These results demonstrate the potential of MOT-SR to enable reliable modeling of long-horizon scientific dynamics.

URL PDF HTML 收藏
2607.29555 2026-08-03 cs.LG 新提交

Pyramidal Width Can Increase Under Vertex Insertion

顶点插入时可增大的棱锥宽度

Jinze Zhao

机构 * University of California, San Diego(加利福尼亚大学圣迭戈分校)

AI总结 该研究针对2015年的棱锥宽度不会因顶点插入而增大的猜想,构造三维整数多面体反例,证明顶点插入可增大棱锥宽度,相关证明附带精确验证工具。

详情
AI中文摘要

Lacoste-Julien与Jaggi于2015年提出猜想:当添加顶点且所有旧点仍为顶点时,多面体的棱锥宽度不会增大。我们在三维欧氏空间R³中给出含6个整数点的精确反例:令P为v₀至v₄的凸包,Q为v₀至v₅的凸包,其中各顶点坐标为v₀=(-1,-3,-1)、v₁=(3,2,-2)、v₂=(0,2,1)、v₃=(-1,-3,3)、v₄=(-2,0,1)、v₅=(-1,0,-2);P的5个顶点均保留为Q的顶点,但P的棱锥宽度平方(PWidth(P)²)为48/353,Q的棱锥宽度平方(PWidth(Q)²)为36/133,顶点插入使棱锥宽度增大了√(1059/532)≈1.410886779倍。证明利用棱锥宽度与面距离的等价性,通过整数支撑超平面验证面格,以有限有理计算得到各面距离,论文附带无依赖的精确验证工具。

英文摘要

Lacoste-Julien and Jaggi conjectured in 2015 that the pyramidal width of a polytope cannot increase when a vertex is added, provided that every old point remains a vertex. We give an exact counterexample with six integer points in $\R^3$. For \[ P=\conv\{v_0,\ldots,v_4\},\qquad Q=\conv\{v_0,\ldots,v_5\}, \] where \[ \begin{aligned} v_0&=(-1,-3,-1), & v_1&=(3,2,-2), & v_2&=(0,2,1),\\ v_3&=(-1,-3,3), & v_4&=(-2,0,1), & v_5&=(-1,0,-2), \end{aligned} \] all five vertices of $P$ remain vertices of $Q$, but \[ \PWidth(P)^2=\frac{48}{353} \quad\text{and}\quad \PWidth(Q)^2=\frac{36}{133}. \] Thus vertex insertion increases pyramidal width by the factor $\sqrt{1059/532}\approx 1.410886779$. The proof uses the equivalence between pyramidal width and facial distance, certifies both face lattices by integer supporting hyperplanes, and evaluates every facial distance by a finite rational calculation. A dependency-free exact verifier accompanies the paper.

URL PDF HTML 收藏
2607.29553 2026-08-03 cs.AI 新提交

COntExt: Towards Context-Aware Ontology Extension from Operational Metrics

COntExt:面向基于运行指标的上下文感知本体扩展

Hussain Hussain, Stefan Schöberl, Angelika Schneider, Verena Geist

机构 * Know Center Research GmbH Software Competence Center Hagenberg GmbH(哈根堡软件能力中心有限公司) Fraunhofer AISEC(弗劳恩霍夫应用研究促进协会人工智能与安全研究所)

AI总结 针对运行指标目录与本体知识手动关联的问题,提出COntExt框架,通过父类预测等三个子任务,利用指标上下文扩展本体,实验显示其能以更低成本提升本体扩展效果。

详情
AI中文摘要

组织越来越多地以结构化、机器可读格式定义运行指标,用于监控系统、流程和合规性。这些指标定义隐含编码了领域知识,如引用的概念、属性和关系,通常超出形式本体所捕获的内容。然而,运行指标目录与本体知识之间的关联目前是手动、临时且劳动密集型的。我们提出COntExt,一个上下文感知本体扩展框架,以结构化指标定义为输入,利用这些指标的上下文,建议如何将引用的概念和属性集成到现有本体中。该框架将扩展问题定义为三个子任务:父类预测、关系类型预测和数据属性分配。我们在四个网络安全本体上评估了每个任务的不同算法。结果表明,在关系类型预测和数据属性分配中,源自指标的上下文比本体上下文基线能提供更好的建议。我们的工作证明,运行指标目录是一种实用且未被充分利用的本体扩展来源,使组织维护本体的成本显著低于手动工程。

英文摘要

Organizations increasingly define operational metrics in structured, machine-readable formats to monitor systems, processes, and compliance. These metric definitions implicitly encode domain knowledge, such as referencing concepts, properties, and relationships, that often extends what is captured in formal ontologies. Yet the connection between operational metric catalogues and ontological knowledge remains manual, ad-hoc, and labor-intensive. We present COntExt, a framework for context-aware ontology extension that takes structured metric definitions as input and suggests how referenced concepts and properties should be integrated into an existing ontology, utilizing the context of these metrics. The framework defines the extension problem as three sub-tasks: parent class prediction, relation type prediction, and data property assignment. Across four cybersecurity ontologies, we evaluate different algorithms for each task. Our results show that metric-derived context improves the suggestions over ontology-context baselines for relation type prediction and data property assignment. Our work demonstrates that operational metric catalogues are a practical and underexploited source for ontology extension. This work enables organizations to maintain their ontologies at a significantly lower cost than manual engineering.

URL PDF HTML 收藏
2607.29545 2026-08-03 cs.CV 新提交

MoRoute: Dynamic Routing for In-Context Multimodal Video Generation

MoRoute:面向上下文多模态视频生成的动态路由

Chong Gao, Jie Ma, Zhan Peng, Chongxiao Wang, Haoxue Wu, Jun Liang, Guanbin Li, Jing Li

机构 * Sun Yat-sen University(中山大学) HUJING Digital Media & Entertainment Group(沪景数字媒体娱乐集团) Huazhong University of Science and Technology(华中科技大学)

AI总结 MoRoute是采用动态层路由连接VLM与视频DiT的多模态视频生成框架,在三个基准数据集上均优于现有最优方法,提升了视频生成与编辑的性能。

Comments Project page: https://orange-3dv-team.github.io/MoRoute/

详情
AI中文摘要

多模态视频生成旨在在单个模型中生成和编辑以文本、图像、视频任意组合为条件的视频,使不同任务能够共享互补数据与生成先验。统一这些任务需要对多样条件进行多模态理解,通常由预训练视觉语言模型(VLM)提供支持。核心挑战在于如何将VLM的分层多模态表示与预训练视频扩散Transformer(DiT)相连接。现有方法要么仅注入VLM最终层或少数手动选定层的特征,要么联合训练架构匹配的理解与生成流,难以复用异构预训练骨干网络。我们提出MoRoute,一种统一多模态视频生成框架,将冻结的VLM与架构不同的预训练视频DiT视为异构专家,通过动态层路由实现连接。对于每个输入,轻量的分块路由器使每个DiT块能选择与其生成阶段最相关的VLM层,从而学习多模态理解与视频合成间的自适应对应关系。MoRoute还通过统一上下文条件直接将参考图像与源视频融入DiT token序列,在各类生成与编辑任务中保留细粒度视觉细节。在IntelligentVBench、OpenVE-Bench和RefVIE-Bench上的实验表明,MoRoute在各基准上均优于最优对比方法,在1-5分制下平均得分分别提升0.15、0.18和0.34。

英文摘要

Multimodal video generation aims to generate and edit videos conditioned on arbitrary combinations of text, images, and videos within a single model, allowing diverse tasks to share complementary data and generative priors. Unifying these tasks requires multimodal understanding of diverse conditions, which is typically provided by a pretrained vision-language model (VLM). A key challenge is how to connect the VLM's hierarchical multimodal representations with a pretrained video diffusion transformer (DiT). Existing methods either inject features from only the final or a few manually selected VLM layers, or jointly train architecture-matched understanding and generation streams, making it difficult to reuse heterogeneous pretrained backbones. We introduce MoRoute, a unified multimodal video generation framework that formulates a frozen VLM and a pretrained video DiT with different architectures as heterogeneous experts connected through dynamic layer routing. For each input, a lightweight block-wise router enables every DiT block to select the VLM layer most relevant to its generation stage, thereby learning an adaptive correspondence between multimodal understanding and video synthesis. MoRoute further incorporates reference images and source videos directly into the DiT token sequence through unified in-context conditioning, preserving fine-grained visual details across diverse generation and editing tasks. Experiments on IntelligentVBench, OpenVE-Bench, and RefVIE-Bench show that MoRoute consistently surpasses the best competing method on each benchmark, improving the average score by 0.15, 0.18, and 0.34 on a 1-5 scale, respectively.

URL PDF HTML 收藏
2607.29539 2026-08-03 cs.CL cs.AI 新提交

ARB: A Matched Authorship-Rewriting Benchmark Dataset for AI-Text Detector Evaluation

ARB:用于AI文本检测器评估的匹配作者改写基准数据集

Gaetano Perrone, Simon Pietro Romano

机构 * University of Napoli Federico II(那不勒斯费德里科二世大学)

AI总结 本文提出用于AI文本检测器评估的ARB基准数据集,对比五种检测器在传统基准与人类被LLM改写场景下的性能,发现传统基准测得的性能无法迁移至改写人类文本场景。

详情
AI中文摘要

现有的AI文本检测基准通常将人类撰写的文本与大型语言模型(LLM)直接生成的文本进行对比。虽然已有研究表明改写和 paraphrasing(意译)会降低检测器的性能,但目前仍不清楚在这种传统基准上测得的性能,能否预测当人类撰写的内容被LLM改写时检测器的表现。为解决这一差距,本文引入了作者改写基准(Authorship-Rewriting Benchmark,ARB),该数据集由1800份人类源文本构建而成,分别来自XSum、WritingPrompts和OpenWebText各600份,同时包含四个开源权重生成器:Llama-3.2-3B、Qwen2.5-7B、Mistral-7B、Gemma-2-9B。每份源文本生成四种匹配变体:人类撰写文本(HUMAN)、LLM直接生成文本(Free-LLM)、LLM改写的人类文本(H2L)、同一生成器改写的LLM文本(LLM2L)。本文在严格的1%误报率(TPR@1%FPR)操作点下评估了五种检测器:FastDetectGPT、Binoculars-falcon-7b、RADAR、BERT-Defense、RoBERTa-Defense。结果显示,FastDetectGPT和Binoculars-falcon-7b能检测出91.2%和93.5%的LLM直接生成文本,但仅能检测出30.8%和15.1%的LLM改写人类文本,降幅达60至78个百分点;当LLM文本被同一模型改写时,上述检测器的召回率仍保持78.3%和83.0%,降幅仅为10至13个百分点,RADAR也呈现相同模式(从66.8%降至12.2%),而BERT-Defense和RoBERTa-Defense在所有场景下的召回率均低于3%。这些结果表明,在传统的人类与LLM对比基准上测得的检测器性能,无法迁移到被LLM改写的人类文本场景中,不过同一检测器对仅由LLM改写的文本仍基本保持鲁棒性。

英文摘要

Standard AI-text detection benchmarks compare human-written text against text generated directly by large language models (LLMs). While prior work has shown that rewriting and paraphrasing can degrade detector performance, it remains unclear whether performance measured on this conventional benchmark predicts detector behavior when human-authored content is rewritten by an LLM. To address this gap, we introduce Authorship-Rewriting Benchmark (ARB), built from 1,800 human source texts (600 each from XSum, WritingPrompts, and OpenWebText) and four open-weight generators (Llama-3.2-3B, Qwen2.5-7B, Mistral-7B, Gemma-2-9B). Each source item yields four matched variants: human-written (HUMAN), direct LLM generation (Free-LLM), LLM-rewritten human text (H2L), and same-generator LLM-rewritten LLM text (LLM2L). We evaluated five detectors (FastDetectGPT, Binoculars-falcon-7b, RADAR, BERT-Defense, RoBERTa-Defense) at a strict 1%-false-positive operating point (TPR@1%FPR). FastDetectGPT and Binoculars-falcon-7b detected 91.2% and 93.5\% of direct LLM text, but only 30.8% and 15.1% of human text an LLM had rewritten, a drop of 60-78 percentage points. The same detectors retained 78.3% and 83.0% recall when LLM text was rewritten by the same model, a much smaller decline of 10-13 points. RADAR followed the same pattern (66.8% to 12.2%), while BERT-Defense and RoBERTa-Defense stayed below 3% recall across all regimes. These results show that detector performance measured on the conventional human-vs-LLM benchmark does not transfer to human-authored text revised by an LLM, even though the same detectors remain largely robust to LLM-only rewriting.

URL PDF HTML 收藏
2607.29531 2026-08-03 cs.CV q-bio.NC 新提交

Multi-Source Multi-View Graph Domain Adaptation with Hyperbolic Residual Encoding for Cross-Site MDD Identification from rs-fMRI

基于双曲残差编码的多源多视图图域适应用于跨站点静息态fMRI的重度抑郁症识别

Zhanpeng Zheng, Xiran Chen, Haiteng Jiang, Renjie Tian, Qinyu Cai, Jiexi Liu, Xiaofeng Chen, Weikai Li, Yansu Wang

机构 * School of Computer and Artificial Intelligence, Shandong Jianzhu University(山东建筑大学计算机与人工智能学院) Institute of Fundamental and Frontier Sciences, University of Electronic Science and Technology of China(电子科技大学基础与前沿研究院) School of Mathematics and Statistics, Chongqing Jiaotong University(重庆交通大学数学与统计学院) State Key Laboratory of Brain-machine Intelligence, Zhejiang University(浙江大学脑机智能国家重点实验室) Institute of Computer Vision and Traffic Image Understanding, School of Information Science and Engineering, Chongqing Jiaotong University(重庆交通大学信息科学与工程学院计算机视觉与交通图像理解研究所) School of Life Sciences, Westlake University(西湖大学生命科学学院) School of Computer and Artificial Intelligence, Nanjing University of Finance and Economics(南京财经大学计算机与人工智能学院)

AI总结 该研究针对跨站点rs-fMRI的MDD识别难题,提出结合双曲残差编码、双流自适应融合及类别级对齐的多源多视图图域适应框架,在七个目标域取得73.60%平均准确率,实现有效泛化。

详情
AI中文摘要

从静息态功能磁共振成像(rs-fMRI)中进行跨站点重度抑郁症(MDD)识别,面临站点间分布偏移和异质功能连接(FC)视图的阻碍。这些视图捕捉互补的神经关系,但呈现出不同的站点偏差和图拓扑结构,使得在不牺牲疾病相关信息或跨视图一致性的情况下进行对齐变得复杂。现有研究大多将多视图连接组学习与跨站点适应分开处理。据我们所知,很少有研究在多源无监督域适应框架下联合建模多个FC视图用于基于rs-fMRI的跨站点MDD分类。我们构建皮尔逊相关、稀疏表示和格兰杰因果图,每个图由特定视图的图注意力网络编码。双流自适应融合明确整合成对的跨视图交互,随后采用轻量级双曲残差编码进行曲率感知的表示优化。类别级柯西-施瓦茨对齐减少源间及源-目标差异,辅以对抗学习、信息最大化和置信度感知伪标签。在七个未标记目标域上,我们的框架达到73.60%的平均准确率和71.90%的AUC,证明在异质采集条件下的有效泛化。这些结果凸显了统一异质视图建模、曲率感知优化及多源域适应对跨站点MDD识别的有效性。源代码可在指定地址获取。

英文摘要

Cross-site identification of major depressive disorder (MDD) from resting-state functional magnetic resonance imaging (rs-fMRI) is hindered by inter-site distribution shifts and heterogeneous functional connectivity (FC) views. These views capture complementary neural relationships but exhibit distinct site biases and graph topologies, complicating alignment without sacrificing disease-relevant information or cross-view consistency. Existing studies largely treat multi-view connectome learning and cross-site adaptation separately. To the best of our knowledge, few studies have jointly modeled multiple FC views under multi-source unsupervised domain adaptation for cross-site rs-fMRI-based MDD classification. We construct Pearson correlation, sparse representation, and Granger causality graphs, each encoded by a view-specific graph attention network. Dual-stream adaptive fusion explicitly integrates pairwise cross-view interactions, followed by lightweight hyperbolic residual encoding for curvature-aware representation refinement. Class-wise Cauchy--Schwarz alignment reduces inter-source and source-target discrepancies, complemented by adversarial learning, information maximization, and confidence-aware pseudo-labeling. Across seven unlabeled target domains, our framework achieves 73.60% mean accuracy and 71.90% AUC, demonstrating effective generalization under heterogeneous acquisition conditions. These results highlight the effectiveness of unified heterogeneous-view modeling, curvature-aware refinement, and multi-source domain adaptation for cross-site MDD identification.The source code is at https://github.com/OPUS-Lightphenexx/MM-HyperGDA

URL PDF HTML 收藏
2607.29527 2026-08-03 cs.LG cs.AI cs.CY econ.EM stat.ML 新提交

TerraNova: A Foundation Model for the Anthropocene

TerraNova:人类世的基础模型

Carlos Rodriguez-Pardo, Massimo Tavoni

机构 * Politecnico di Milano(米兰理工大学) RFF-CMCC European Institute on Economics and the Environment (EIEE)(RFF-CMCC欧洲经济与环境研究所) Euro-Mediterranean Center on Climate Change (CMCC)(欧洲地中海气候变化中心)

AI总结 TerraNova是适配原生几何的基础模型,融合地球物理与社会数据,可重建密集场、适配未见变量,兼具地理空间编码能力与国家层面功能。

Comments 32 pages, 16 figures. Supplementary Information (full methodological specification, ablation programme, extended results, computational cost; 157 pages) available at the project page: https://carlosrodriguezpardo.es/projects/TerraNova/

详情
AI中文摘要

人类世的核心问题是将地球物理系统与人类社会建模为一个耦合系统,但目前没有任何学习表示能覆盖两者的观测广度。我们认为该障碍源于几何层面:地球物理系统以忽略政治边界的连续场形式被测量,而社会数据则按行政单位统计;地球系统基础模型适配前者的几何结构,将其与后者耦合需对边界进行有损平均。我们提出TerraNova,这一基础模型在1024个原生几何的物理与社会记录上训练,包括512个网格化地球系统场和512个国家指标。专用编码器表示位置、国家、时间和任务,跨模态Transformer将其融合为共享时空状态,超网络生成每个查询的解码器,其证据头返回预测分布。两个对比目标耦合该表示:一是每个国家与其领土内坐标间的人口加权对齐,二是与预训练的地理空间嵌入(承载图像衍生语义)的对齐。通过该解码器读取的表示,在与专用地理空间编码器竞争力相当的同时,覆盖了后者未表示的维度(时间、海洋和不确定性),并支持国家层面的能力;冻结的主干网络可从稀疏观测重建密集场,且能在消费级硬件上数分钟内适配未见变量。

英文摘要

A defining problem of the Anthropocene is to model the physical Earth and human societies as one coupled system, yet no learned representation spans their observational breadth. We argue the obstacle is geometric: the physical Earth is measured as continuous fields that ignore political borders, whereas societies are reported for administrative units. Earth-system foundation models serve the first geometry; coupling it to the second has required lossy averaging over borders. We introduce TerraNova, a foundation model trained on 1,024 physical and societal records in their native geometries: 512 gridded Earth-system fields and 512 national indicators. Dedicated encoders represent location, country, time and task, cross-modal transformers fuse them into a shared spatiotemporal state, and a hypernetwork generates a per-query decoder whose evidential head returns a predictive distribution. Two contrastive objectives couple the representation: a population-weighted alignment between each country and coordinates in its territory, and one to pretrained geospatial embeddings carrying image-derived semantics. Read out through that decoder, the representation is competitive with purpose-built geospatial encoders while spanning axes they do not represent (time, oceans and uncertainty) and supporting country-level capabilities. The frozen backbone reconstructs dense fields from sparse observations and adapts to unseen variables in minutes on consumer hardware.

URL PDF HTML 收藏
2607.29517 2026-08-03 cs.RO cs.HC 新提交

STAGE: STyle-controllable Action GEneration for personalized autonomous driving

STAGE:面向个性化自动驾驶的风格可控动作生成

Zihao Liu, Xing Liu, Yizhai Zhang, Panfeng Huang

机构 * Northwestern Polytechnical University(西北工业大学) School of Astronautics(航天学院) Research Center for Intelligent Robotics(智能机器人研究中心) National Key Laboratory of Aerospace Flight Dynamics(航空航天飞行动力学重点实验室)

AI总结 本文针对自动驾驶系统难以匹配用户个性化驾驶风格的问题,提出STAGE风格可控动作生成方法,通过模仿学习与偏好学习实现风格控制,实验验证其风格对齐与安全性能。

Comments Accepted for publication in IEEE Robotics and Automation Letters

Journal ref IEEE Robotics and Automation Letters, vol. 11, no. 2, pp. 2130-2137, Feb. 2026

详情
AI中文摘要

驾驶风格是驾驶员在驾驶过程中保持的行为偏好,由其不同的经历、习惯和需求塑造,通常表现为不同程度的激进性。如果人类选择使用自动驾驶系统,会期望系统的驾驶风格与自身习惯高度相似,但当前工业级自动驾驶系统难以满足这一需求。为解决该问题,本文开发了面向驾驶任务的风格可控动作生成方法STAGE。其训练过程基于模仿学习,融合风格值与潜在值动作模态编码;随后采用偏好学习将用户驾驶风格识别为连续、单调的风格值,为降低偏好训练过程中的人力成本,还开发了一套规则用于对比数据对中的驾驶风格。推理阶段,用户输入风格值即可控制生成的动作模式,动态满足自身期望。通过STAGE方法验证,在多种典型道路场景中,风格可控的动作生成结果与人类期望高度一致;此外,将STAGE方法与多种其他方法对比,揭示了STAGE的独特功能,包括风格可控性、风格连续性、驾驶风格对齐能力及驾驶安全性。本工作的代码可在指定URL获取。

英文摘要

Driving style refers to the behavioral preferences that drivers maintain during driving, shaped by their diverse experiences, habits, and needs, and is typically reflected in varying levels of aggressiveness. If humans choose to use autonomous driving systems, they would expect the driving style of the systems to closely resemble their own habit. However, this is challenging for current industrial autonomous driving systems. To address this, we developed a style controllable action generation method, STAGE, for driving tasks. Its training process is based on imitation learning, incorporating both style value and latent value action modality encoding. Preference learning is then used to identify the user's driving style as a continuous, monotonic style value. And to reduce the cost of human involvement in the preference training process, we also developed a set of rules to compare driving style in data pairs. Then, during inference, the user inputs the style value to control the generated action patterns, dynamically meeting the user's expectations. Using the STAGE method, we verified that the style-controlled action generation results in several typical road scenarios significantly align with human expectations. Furthermore, through comparisons between the STAGE method and various other approaches, we reveal the unique functionalities of STAGE, including its style controllability, style continuity, driving style alignment capability and driving safety. The code for this work is available at: https://github.com/CarlDegio/STAGE

URL PDF HTML 收藏
2607.29513 2026-08-03 cs.RO 新提交

Homotopy-Aware Corridor Generation without Predefined Reference Paths

无预定义参考路径的同伦感知走廊生成

Haoze Dong, Minghan Li, Meng Guo, Zhongkui Li

机构 * School of Advanced Manufacturing and Robotics, Peking University(北京大学先进制造与机器人学院)

AI总结 该研究提出一种无预定义参考路径的自适应多尺度凸集图框架,用于生成同伦感知安全走廊,经数值与硬件实验验证,其图构造高效、轨迹性能稳定,同伦感知轨迹更短且能应对未知障碍物。

Comments 8 pages, 8 figures. Accepted for publication in IEEE Robotics and Automation Letters (RA-L)

详情
AI中文摘要

生成安全走廊对于机器人无碰撞运动规划至关重要,但现有大多数方法依赖预定义参考路径,这会偏向走廊几何结构,并隐式限制可探索的同伦类。我们提出一种基于凸集图(GCS)的无参考路径走廊生成框架,直接将走廊构造为凸集序列,使走廊结构从自由空间表示中自然形成,而非来自引导路径。为推理走廊间的相似性,我们将基于可见性的变形从路径扩展至凸集序列,实现拓扑冗余走廊的融合,同时保留不同的可行方案。为克服现有基于静态全局分解的GCS方法适应性有限的问题,我们进一步开发自适应多尺度GCS,其中基于采样的细粒度图支持局部更新,基于可见性的粗粒度图实现紧凑的全局探索。两个尺度维持拓扑一致性,允许在环境不确定性下进行增量更新,无需完全重构图。数值实验对GCS构造、走廊生成、同伦感知探索及局部更新进行了表征,结果显示图构造高效、轨迹级性能稳定,且同伦感知轨迹的持续时间短于现有基线。地面机器人与空中机器人的硬件实验,包括利用机载定位的部署,进一步验证了该框架在平移及未知障碍物场景下的有效性。

英文摘要

Generating safe corridors is essential for collision-free robotic motion planning, yet most existing methods rely on predefined reference paths, which bias corridor geometry and implicitly limit the homotopy classes that can be explored. We propose a reference-path-free corridor generation framework on graphs of convex sets (GCS) that constructs corridors directly as sequences of convex sets, allowing corridor structure to emerge from the free-space representation rather than from a guiding path. To reason about similarity among corridors, we extend visibility-based deformation from paths to convex-set sequences, enabling the fusion of topologically redundant corridors while preserving distinct alternatives. To overcome the limited adaptability of existing GCS methods based on static global decompositions, we further develop an adaptive multi-scale GCS, in which a sampling-based fine-scale graph supports localized updates and a visibility-based coarse-scale graph enables compact global exploration. The two levels maintain topological consistency, allowing incremental updates without full graph reconstruction under environmental uncertainty. Numerical experiments characterize GCS construction, corridor generation, homotopy-aware exploration, and local updates, showing efficient graph construction, stable trajectory-level performance, and shorter-duration homotopy-aware trajectories than existing baselines. Hardware experiments on ground and aerial robots, including deployment with onboard localization, further validate the framework under translated and previously unknown obstacles.

URL PDF HTML 收藏
2607.29509 2026-08-03 cs.CV cs.LG 新提交

Leveraging Transfer Learning with Class-Specific Decoders for Laparoscopic Segmentation

结合迁移学习与类别特定解码器的腹腔镜图像分割方法

Priya Tomar, Aditya Parikh, Christian Bauckhage, Rafet Sifa

机构 * Fraunhofer IAIS(弗劳恩霍夫智能分析与信息系统研究所) University of Bonn(波恩大学)

AI总结 该研究提出结合迁移学习与类别特定解码器的腹腔镜分割方法,在直肠和胆囊切除术数据集上验证了器官特定解码器模型(CEMD)的性能,其Dice系数达62.4%且收敛更快,但未解决类别不平衡问题。

Comments Paper already Published in IEEE Big data 2025

详情
AI中文摘要

手术数据中有效的多器官分割需要学习复杂的解剖特征,并缓解类别不平衡带来的挑战,类别不平衡源于体积较小、暴露有限的结构占比相对较低。近期腹腔镜多器官分割研究聚焦于通过类别特定解码器架构学习结构特定特征,取得了良好结果。本研究将以解码器为核心的架构扩展至跨手术领域的知识迁移研究,利用代表不同手术领域(直肠手术与胆囊切除术)的两个数据集,探究在部分共同解剖表征下手术概念知识的迁移情况;同时对比不同训练阶段编码器与解码器的特征适配,分析网络中的知识适配与保留情况。实验结果证实了解码器特定架构的先前发现,表明器官特定解码器模型(CEMD)在跨域预训练后进行全微调,可达到最高的分割性能(Dice系数为62.4%),且比从头训练收敛速度快得多。但研究也发现,手术数据中的类别不平衡仍是一个持续存在的挑战,迁移学习无法完全解决代表性不足的解剖结构的类别不平衡问题。

英文摘要

Effective multi-organ segmentation in surgical data requires learning the intricate anatomical features and alleviating the challenge of class imbalance, which results from relatively lower proportions of small and limitedly exposed structures. Recent works on laparoscopic multi-organ segmentation focus on learning structure-specific features through class-specific decoder architectures and report favorable results. This work extends the decoder-focused architectures to investigate knowledge sharing in the cross-surgical domain. We utilize two datasets representing different surgical domains, rectal and cholecystectomy surgeries, to explore how surgical conceptual knowledge transfers under partially common anatomical representations. Additionally, we compare the feature adaptation for the encoder and decoder at different training stages to analyse the knowledge adaptation and retention in the network. Our results corroborate previous findings on decoder-specific architectures and demonstrate that the organ-specific decoder model (CEMD), fully fine-tuned after cross-domain pre-training, achieves the highest segmentation performance (62.4\% dice) while converging substantially faster than training from scratch. However, we also find that class imbalance in surgical data remains a persistent challenge that transfer learning does not fully resolve for underrepresented anatomical structures.

URL PDF HTML 收藏
2607.29491 2026-08-03 cs.LG cs.AI 新提交

DreamQAS: Learning a Decision-Useful World Model for VQE-Efficient Quantum Architecture Search

DreamQAS:面向VQE高效量子架构搜索的决策有用世界模型学习

Jiayang Niu, Yan Wang, Jie Li, Ke Deng, Azadeh Alavi, Muhammad Usman, Yongli Ren

机构 * School of Computing Technologies, RMIT University(RMIT大学计算技术学院) Quantum Systems, Data61, CSIRO(澳大利亚联邦科学与工业研究组织数据61分部量子系统部)

AI总结 该研究提出DreamQAS模型,以基于模型的强化学习框架实现VQE高效量子架构搜索,在多个分子任务上降低了真实VQE调用次数并提升了反事实动作排名效用。

Comments 26 pages, 4 figures, including appendices

详情
AI中文摘要

基于强化学习的量子架构搜索(RL-QAS)在每次扩展量子电路后都会反复优化变分量子本征求解器(VQE),尽管电路构建和动作合法性是确定且已知的。我们提出DreamQAS,这是一种基于模型的强化学习框架,它保留了这些精确的电路动态,仅学习成本高昂的VQE后反馈。循环随机先验集成预测了相对于经验能量前沿的无预言机分数,并支持在显式合法电路上的多步想象策略学习。基于排名的激活、感知不确定性的悲观主义与截断,以及选择性真实VQE验证构成了一个可靠性控制的学习循环。在常见的15000回合预算和RL方法的冻结评估下,DreamQAS在5个分子任务中的4个上具有最低的平均冻结策略能量误差,在1个上为第二低。在两种方法的所有种子都达到的精细误差目标下,它在4个任务上使用的真实VQE调用减少了1.6倍至2.0倍,在BeH2-8q任务上减少了10.6倍。反事实动作排名效用在所有5个任务中均有所增加,平均增加0.346,95%置信区间为[0.185, 0.507],而直接贪婪和束搜索使用同一模型无法恢复想象策略学习的增益。集成分歧还在所有3个被研究任务上改善了风险覆盖,优于随机弃权(不执行)。这些结果确立了一种用于QAS的世界模型设计,其价值在于决策有用的反馈而非精确的能量预测。

英文摘要

Reinforcement-learning-based quantum architecture search (RL-QAS) repeatedly optimizes a variational quantum eigensolver (VQE) after extending a circuit, although circuit construction and action legality are deterministic and known. We introduce DreamQAS, a model-based RL framework that preserves these exact circuit dynamics and learns only the expensive post-VQE feedback. A recurrent randomized-prior ensemble predicts an oracle-free score relative to an empirical energy frontier and supports multi-step imagined policy learning over explicit legal circuits. Ranking-based activation, uncertainty-aware pessimism and truncation, and selective real-VQE verification form a reliability-controlled learning loop. Under a common 15,000-episode budget and frozen evaluation for the RL methods, DreamQAS has the lowest mean frozen-policy energy error on four of five molecular tasks and the second-lowest on one. At fine-error targets reached by all seeds of both methods, it uses 1.6x to 2.0x fewer real VQE calls on four tasks and 10.6x fewer on BeH2-8q. Counterfactual action-ranking utility increases across all five tasks, with a mean increase of 0.346 and a 95 percent confidence interval of [0.185, 0.507], while direct greedy and beam use of the same model does not recover the gains of imagined policy learning. Ensemble disagreement also improves risk-coverage over random rejection on all three probed tasks. These results establish a world-model design for QAS whose value lies in decision-useful feedback rather than exact energy prediction.

URL PDF HTML 收藏
2607.29484 2026-08-03 cs.CL cs.LG 新提交

Evidence-Type Competition: When Can Interventional Data Teach Language Models Causal Direction?

证据类型竞争:干预数据何时能教会语言模型因果方向?

Xining Xun

机构 * Tsingjiao Information Science (Beijing) Co., Ltd(北京清教信息科技有限公司)

AI总结 该研究发现干预数据训练语言模型因果推理的金标准假设存在局限,观测上下文会抑制模型的因果方向判断能力,提出证据平均方案可降低符号错误率。

Comments 13 pages, 6 figures, 4 tables

详情
AI中文摘要

干预数据被广泛视为训练模型因果推理的金标准。我们在完全受控的合成环境中测试这一假设,对比观测相关性与因果效应,发现其失效的情况颇具启发性。在辛普森悖论场景中,当两者符号系统相反时,增加预训练中干预样本的比例并不能提升因果方向的判断能力:模型的do()-响应幅度单调增长,但其符号却复制自观测上下文。决定是否使用干预证据的并非训练混合比例,而是推理时上下文存在的证据类型。在相同训练方案下,纯观测上下文在50个场景中引发29个符号反转,混合上下文引发19个,仅对齐干预探针则实现41个正确。从上下文中移除观测证据会立即释放被抑制的因果插值能力(true率提升+0.56);四状态内容操纵显示,该切换由内容介导且呈梯度变化。这种抑制在不同训练种子间稳定存在(匹配协议的第二个种子上11/11出现强反转),在0.93B参数规模下仍具鲁棒性(匹配探针仅组的反转率为31.8% vs. 6%),尽管绝对增益缩小至四分之一。对CLadder的外部审计揭示了学习到的正效应先验具有两层结构:符号随机重训练可在分布内移除该先验,但分布外无法移除。我们总结:能力存在于权重中,切换存在于上下文中,激活补丁将切换定位到中间层的观测行。我们进一步量化了基于探针的因果评估的采样噪声底限,以及将符号错误从26%降至9%的证据平均方案。

英文摘要

Interventional data is widely regarded as the gold standard for teaching models causal reasoning. We test this assumption in a fully controlled synthetic environment pitting observational correlation against causal effect, and find it fails instructively. In Simpson's-paradox worlds, where the two have systematically opposite signs, increasing the fraction of interventional samples in pretraining does not improve causal direction: the magnitude of the model's do()-response grows monotonically, yet its sign is copied from the observational context. What governs whether interventional evidence is used is not the training mixture but the evidence type present in the context at inference time. Under an identical training recipe, a purely observational context induces systematic sign reversal in 29/50 worlds, a mixed context in 19/50, while aligned interventional probes alone yield 41/50 correct. Erasing observational evidence from the context immediately releases the suppressed causal interpolation ability (ratio_true = +0.56); a four-state content manipulation shows the switch is content-mediated and graded. The suppression is stable across training seeds (11/11 strong reversals persist on a matched-protocol second seed) and robust as a rate at 0.93B parameters (31.8% vs. 6% reversals in the matched probe-only arm), even as absolute gains shrink four-fold. An external audit on CLadder exposes a learned positive-effect prior with a two-layer structure: sign-randomized retraining removes it in-distribution but not out-of-distribution. We summarize: the capability lives in the weights; the switch lives in the context, and activation patching localizes the switch to the middle layers' observational rows. We further quantify the sampling noise floor of probe-based causal evaluation and an evidence-averaging protocol that cuts sign errors from 26% to 9%.

URL PDF HTML 收藏
2607.29482 2026-08-03 cs.RO 新提交

Temporal Policy: History-Initialized Action Generation for Robotic Learning from Demonstration

时间策略:用于机器人演示学习的历史初始化动作生成

Dylan Miller, Martin Jagersand

机构 * University of Alberta(阿尔伯塔大学)

AI总结 本文提出Temporal Policy生成框架,将动作生成为时间耦合传输问题,在降低近一个数量级传输成本的同时匹配基线成功率,实现高频闭环控制。

Comments Accepted to the 2026 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2026)

详情
AI中文摘要

标准扩散模型和流匹配模型依赖于无信息高斯先验的独立耦合,被迫学习复杂且高成本的向量场以到达物理动作空间。生成模型擅长捕捉机器人演示学习(LfD)中的多模态行为,但通常存在推理成本高的问题。本文提出Temporal Policy,一种基于随机插值的生成框架,将动作生成为时间耦合传输问题。通过在机器人近期历史上初始化生成流,我们明确地将过去状态与未来动作序列耦合。这种依赖数据的耦合降低了传输成本,产生了平滑的向量场。我们在视觉运动模拟基准和物理Barrett WAM 2×7自由度遥操作平台上验证了Temporal Policy。与噪声初始化基线相比,我们的方法将传输成本降低了近一个数量级,在单个NVIDIA RTX 4080上实现了19.1毫秒的推理延迟。重要的是,在匹配最先进基线成功率的同时,实现了这些几何和计算效率。这种简化的传输几何绕过了独立高斯先验的计算瓶颈,有助于实现高频闭环控制。代码可在此https URL获取。

英文摘要

By relying on independent couplings from uninformative Gaussian priors, standard diffusion and flow matching models are forced to learn complex, high-cost vector fields to reach the physical action space. Generative models excel at capturing multimodal behaviors for robotic Learning from Demonstration (LfD), but often suffer from high inference cost. This paper introduces Temporal Policy, a generative framework based on stochastic interpolants that formulates action generation as a temporally coupled transport problem. By initializing the generative flow at the robot's recent history, we explicitly couple past states to future action sequences. This data-dependent coupling reduces transport cost and produces straight vector fields. We validate Temporal Policy across visuomotor simulation benchmarks and on a physical Barrett WAM 2x 7DoF teleoperation platform. Our approach reduces transport costs by nearly an order of magnitude compared to noise-initialized baselines, achieving a 19.1 ms inference latency on a single NVIDIA RTX 4080. Crucially, these geometric and computational efficiencies are achieved while matching the success rates of state-of-the-art baselines. This simplified transport geometry bypasses the computational bottleneck of independent Gaussian priors, helping enable high-frequency, closed-loop control. The code is publicly available at https://github.com/dmiller12/TemporalPolicy.

URL PDF HTML 收藏
2607.29473 2026-08-03 cs.CV cs.LG cs.PF 新提交

Lightweight Neural Networks for Affordance Segmentation: Enhancement of the Decoder Module

用于Affordance分割的轻量级神经网络:解码器模块的增强

Simone Lugani, Edoardo Ragusa, Rodolfo Zunino, Paolo Gastaldo

机构 * University of Genoa(热那亚大学)

AI总结 本文针对可穿戴机器人视觉Affordance分割的算力限制问题,通过分析分割头的作用增强轻量级神经网络解码器,所得模型在真实数据集上优于基准方案且计算需求低。

Journal ref S. Lugani, E. Ragusa, R. Zunino, and P. Gastaldo, "Lightweight Neural Networks for Affordance Segmentation: Enhancement of the Decoder Module" in Applications in Electronics Pervading Industry, Environment and Society. ApplePies 2023

详情
AI中文摘要

在可穿戴机器人上部署深度神经网络进行视觉Affordance分割可能至关重要,因为该问题存在一些相互矛盾的方面:一方面,Affordance分割需要高水平的抽象能力,通常涉及大型模型;另一方面,可穿戴机器人上的计算资源无法支持大型模型实时运行。本文分析了分割头在泛化性能与计算成本之间权衡中的作用,所得模型在知名真实数据集上的表现优于现代基准解决方案,同时满足低计算需求。

英文摘要

The deployment of deep neural networks for visual affordance segmentation on wearable robots poses may prove critical, due to some conflicting aspects of the problem. On one hand, affordance segmentation requires high-level abstraction capabilities, that typically involve large-size models. On the other hand, computing resources hosted on wearable robots prevent to run large-size models in real-time. The paper presents an analysis of the role of the segmentation head in the trade-off between generalization performance and compute cost. The obtained models outperform modern baseline solutions in well-known, real-world datasets while meeting low computing requirements.

URL PDF HTML 收藏