arXivDaily arXiv每日学术速递 周一至周五更新
全部学科分类 1927
2608.06377 2026-08-07 cs.CL cs.AI cs.LG 新提交

Learning When to Trust via Selective Context Preference Optimization

通过选择性上下文偏好优化学习何时信任

Xian Sun, Wei Chow, Yingshuo Wang, Junhao Liu, Wei Gao, Qing Wu, Lingdong Kong

机构 * Duke University(杜克大学) National University of Singapore(新加坡国立大学) UC Berkeley(加州大学伯克利分校) UC Irvine(加州大学欧文分校) Northeastern University(东北大学) Nanyang Technological University(南洋理工大学)

AI总结 本研究针对语言模型易受误导性外部信号影响的问题,提出SCOPE方法,在含四种条件的MIST基准上优化DPO目标,降低SC2W的同时保持正常上下文下的准确率,主张以选择性信任评判模型。

Comments Project Page at this https URL (https://worldbench.github.io/scope) GitHub Repo at this https URL (https://github.com/worldbench/SCOPE) HF Dataset at this https URL (https://huggingface.co/datasets/worldbench/MIST-Bench)

详情
AI中文摘要

语言模型越来越多地基于外部信号生成答案,而单个误导性信号就能将正确答案变为错误答案。明显的补救措施是训练模型抵制此类信号,但这隐藏了一种失效模式:忽略所有上下文的模型看似鲁棒,却在上下文值得信任时毫无用处。我们将此问题重新定义为选择性信任,并推出MIST,这是一个人工标注的基准,为每个推理项提供四种匹配条件(干净、误导性、正确上下文、不相关上下文),同时提出SC2W,这是一种配对指标,用于统计误导性信号将干净正确答案转为错误答案的频率。在全面的基准研究中,我们发现这种易受影响性是普遍存在的。随后我们提出SCOPE,该方法挖掘干净正确/误导错误的失效案例,并在所有四种条件下均衡的匹配偏好对上优化标准直接偏好优化(DPO)目标,而非仅针对误导性项。我们的方法大幅降低了流行开源模型的SC2W,同时在添加的上下文干净、正确或不相关时保持准确率。通过这项工作,我们认为应基于选择性信任而非仅抵制来评判模型。

英文摘要

Language models increasingly condition their answers on external signals, and a single misleading one can turn a correct answer wrong. The obvious remedy, training models to resist such signals, hides a failure mode: a model that ignores all context looks robust yet is useless when the context is worth trusting. We recast the problem as selective trust and introduce MIST, a human-annotated benchmark that renders each reasoning item under four matched conditions (clean, misleading, correct-context, and irrelevant-context), together with SC2W, a paired metric counting how often a misleading signal flips a clean-correct answer to wrong. Across a comprehensive benchmark study, we observe that such a susceptibility is universal. We then propose SCOPE, which mines clean-correct/misleading-wrong failures and optimizes a standard Direct Preference Optimization (DPO) objective over matched preference pairs balanced equally across all four conditions, rather than over misleading items alone. Our approach substantially reduces SC2W on popular open-sourced models while preserving accuracy when the added context is clean, correct, or irrelevant. With this work, we argue that models should be judged on selective trust, not on resistance alone.

URL PDF HTML 收藏
2608.06375 2026-08-07 cs.RO 新提交

$ω$-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulation

ω-0:一种用于类人机器人协同移动操作的潜在预测世界动作模型

Zhe Li, Zhenzhe Zhang, Yangyang Wei, Wenjie Zhang, Xichen Yuan, Peiyuan Zhi, Gen Li, Xinying Guo, Fengjie Gao, Jianfei Yang, Shanghang Zhang

机构 * NTU(南洋理工大学) PKU(北京大学) BAAI(北京智源人工智能研究院) HKUST(GZ)(香港科技大学(广州))

AI总结 本文提出 ω-0 模型,针对类人机器人协同移动操作问题,结合潜在视觉预见与扩散动作生成,在 11 项家庭任务上优于多个基线,还构建了 ω-HOME 数据集。

详情
AI中文摘要

类人机器人的 household 任务通常需要协同移动操作,即机器人必须将移动、调整姿态、保持平衡和操作对象整合为单一协调行为。然而,现有类人机器人策略通常将移动与操作解耦,而近期的世界动作模型要么以机械臂为中心,要么以视频为中心。本文提出 ω-0,一种用于真实世界类人机器人协同移动操作的潜在预测全身世界动作模型。给定语言指令、当前视觉观测和机器人本体感受状态,ω-0 直接预测控制器兼容的全身动作潜在变量,用于真实机器人执行。ω-0 不重构未来视频,而是学习紧凑的未来观测嵌入作为轻量级预测目标,将潜在视觉预见与基于扩散的全身动作生成相结合。该模型支持以自我为中心的 RGB、以异中心的 RGB 和以异中心的深度输入,并利用基于控制器的仿真回放,将人类/公共视觉运动先验转化为机器人可执行的动作潜在变量。我们进一步收集 ω-HOME,这是一个时长超 40 小时的真实世界家庭类人机器人数据集,包含同步多视图观测、全身 SMPL 运动、机器人状态和动作潜在变量。针对 11 项家庭任务的真实世界实验表明,单一 ω-0 模型可生成流畅的移动中操作行为,且始终优于代表性的模仿学习、VLA、类人机器人和 WAM 基线。

英文摘要

Humanoid household tasks often require concurrent loco-manipulation, where the robot must move, adjust posture, maintain balance, and manipulate objects as a single coordinated behavior. Yet existing humanoid policies typically decompose locomotion and manipulation, while recent world-action models remain either arm-centric or video-centered. We present $\omega$-0, a latent predictive whole-body world-action model for real-world humanoid concurrent loco-manipulation. Given a language instruction, current visual observation, and robot proprioceptive state, $\omega$-0 directly predicts controller-compatible whole-body action latents for real-robot execution. Rather than reconstructing future videos, $\omega$-0 learns compact future observation embeddings as a lightweight predictive objective, coupling latent visual foresight with diffusion-based whole-body action generation. The model supports egocentric RGB, exocentric RGB, and exocentric depth inputs, and leverages controller-based simulation replay to ground human/public visual-motion priors into robot-executable action latents. We further collect $\omega$-HOME, a 40+ hour real-world household humanoid dataset with synchronized multi-view observations, whole-body SMPL motions, robot states, and action latents. Real-world experiments on 11 household tasks demonstrate that a single $\omega$-0 model can produce smooth manipulate-while-moving behaviors and consistently outperform representative imitation learning, VLA, humanoid, and WAM baselines.

URL PDF HTML 收藏
2608.06374 2026-08-07 cs.RO 新提交

DyPES-VLA: Learning Shared Dynamics Priors and Embodiment-Specific Control for Cross-Embodiment Manipulation

DyPES-VLA:学习共享动态先验与具身特定控制以实现跨具身操作

Junfeng Li, Junjie He, Zhide Zhong, Yangyang Zheng, Pingyue Sheng, Jiayu Dong, Ruixin Li, Haodong Yan, Jiaguan Zhu, Tianran Zhang, Runze Yu, Wen Chen, Liuqing Yang, Yuxiang Gao, Haoang Li

机构 * The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)) COCO Matrix

AI总结 该研究针对跨具身机器人操作问题,提出DyPES-VLA模型,通过学习共享动态先验与具身特定MoE动作头,在LIBERO等数据集上达到先进操作成功率。

详情
AI中文摘要

视觉-语言-动作(Vision-Language-Action,VLA)模型已成为机器人操作的强大范式,但为异构机器人具身训练单一通用策略仍是未解决的问题。现有方法存在两个主要局限:其一,它们未充分利用不同视觉与交互数据间共享的动态先验,限制了跨具身迁移能力;其二,它们需要大量手动预处理,将具身特定动作转换为通用格式。为克服这些局限,我们提出DyPES-VLA,一种学习共享动态先验与具身特定控制的跨具身VLA模型。首先,我们通过在跨具身数据上以未来预测目标训练视觉-语言模型(Vision-Language Model,VLM)来学习共享动态先验,驱动共享查询表示捕捉物体运动、接触及交互引发的场景变化。其次,一个具身特定的混合专家(Mixture-of-Experts,MoE)动作头将这些共享动态先验直接转换为每个具身原生动作空间中的可执行控制,无需手动将异构动作预对齐为通用格式。该动作头共享注意力层以捕捉通用时序动作结构,同时其具身特定的前馈专家模块解决不同具身的独特运动学约束与控制语义。作为通用策略,我们的DyPES-VLA在仿真与真实世界评估中达到了先进性能:在LIBERO上的成功率为98.0%,在RoboCasa-GR1上为59.25%,在RoboTwin~2.0上为89.02%。

英文摘要

Vision-Language-Action (VLA) models have become a powerful paradigm for robot manipulation, but training a single generalist policy for heterogeneous robot embodiments remains an open problem. Existing methods have two main limitations. First, they underuse dynamics priors shared across diverse visual and interaction data, limiting cross-embodiment transfer. Second, they require extensive manual preprocessing to convert embodiment-specific actions into a common format. To overcome these limitations, we propose DyPES-VLA, a cross-embodiment VLA that learns shared Dynamics Priors and Embodiment-Specific control. First, we learn shared dynamics priors by training the vision-language model (VLM) with a future-prediction objective on cross-embodiment data, driving the shared query representation to capture object motion, contact, and interaction-induced scene changes. Second, an embodiment-specific Mixture-of-Experts (MoE) action head translates these shared dynamics priors into executable controls directly in each embodiment's native action space, without manually pre-aligning heterogeneous actions into a common format. This head shares attention layers to capture common temporal action structures, while its embodiment-specific feed-forward experts resolve the unique kinematic constraints and control semantics of distinct embodiments. As a generalist policy, our \ourmethod achieves state-of-the-art performance across simulation and real-world evaluations, reaching 98.0% success on LIBERO, 59.25% on RoboCasa-GR1, and 89.02% on RoboTwin~2.0.

URL PDF HTML 收藏
2608.06366 2026-08-07 cs.AI cs.LG 新提交

Tracing the Heart: An Evidence-Linked Pipeline for Heart-Failure Feature Engineering

追踪核心:一种用于心力衰竭特征工程的证据关联管道

Soorya Ram Shimgekar, Michelle Hu, Dorisa Shehi, Daniel Kang, Roy Ka-Wei Lee, Koustuv Saha, Christian Poellabauer, Christopher Lee, Sajeev Singh, Piyum Zonooz, Navin Kumar, Zeeshan Ahmed, Priyadarshini Kachroo

机构 * Nimblemind(宁敏德(音译)) Singapore University of Technology and Design(新加坡科技设计大学) University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) Florida International University(佛罗里达国际大学) University of California Los Angeles(加利福尼亚大学洛杉矶分校) Rutgers University Newark(罗格斯大学纽瓦克分校) Rutgers Institute for Health Health Care Policy and Aging Research(罗格斯大学健康、医疗保健政策与老龄化研究所) Robert Wood Johnson Medical School(罗伯特·伍德·约翰逊医学院) Rutgers Health(罗格斯医疗)

AI总结 该研究针对心力衰竭EHR特征工程瓶颈,开发了nMAS管道,经500条虚拟记录验证,可提升HFrEF和HFpEF表型分析的AUROC,为自动化可审核特征工程提供了可行方案。

详情
AI中文摘要

电子健康记录(EHR)特征工程是临床研究与AI领域的主要瓶颈,占数据科学家工作量的39%-45%,在心力衰竭领域尤为突出:美国约有670万成年人受心力衰竭影响,需将碎片化的EHR数据与疾病特异性、基于指南的临床推理相结合。现有的基于规则及大语言模型(LLM)的方法仅能实现部分自动化,可维护性与证据可追溯性有限。我们开发了Nimblemind多智能体系统(nMAS)——一种用于自动化心力衰竭特征工程的、证据关联且基于评分标准的管道,并在来自9个EHR源表的500条虚拟患者记录上对其进行评估。nMAS生成了132个结构化特征及70个基于评分标准的聚合特征,这些特征经结构完整性、评分标准合规性及来源验证,并由受限LLM审核。添加聚合特征后,HFrEF表型分析的保留AUROC从0.895提升至0.963,HFpEF表型分析的保留AUROC从0.870提升至0.910;独立LLM对证据支持与方法学合理性的评分标准评估显示,这些特征获得了满分的81.5%。这些结果证明了针对复杂心血管EHR数据开展自动化、可审核的特征工程的可行性,但评估仅限于单机构队列,需进行外部验证。

英文摘要

Electronic health record (EHR) feature engineering is a major bottleneck in clinical research and AI, accounting for 39-45% of data scientists' workload. This is especially pronounced in heart failure, which affects an estimated 6.7 million U.S. adults and requires integrating fragmented EHR data with disease-specific, guideline-based clinical reasoning. Existing rule-based and large language model (LLM)-based approaches offer only partial automation with limited maintainability and evidence traceability. We developed the Nimblemind Multi-Agent System (nMAS), an evidence-linked, rubric-grounded pipeline for automated heart-failure feature engineering, and evaluated it on 500 dummy patient records from nine EHR source tables. nMAS generated 132 structured and 70 rubric-scored aggregated features, verified for structural integrity, rubric compliance, and provenance, and audited by a restricted LLM. Adding the aggregated features improved held-out AUROC from 0.895 to 0.963 for HFrEF and 0.870 to 0.910 for HFpEF phenotyping, and an independent LLM-based rubric assessment of evidence support and methodological soundness scored the features at 81.5% of maximum points. These results demonstrate the feasibility of automated, auditable feature engineering for complex cardiovascular EHR data, though evaluation was limited to a single-institution cohort and external validation is needed.

URL PDF HTML 收藏
2608.06351 2026-08-07 cs.AI 新提交

Challenges in Evaluating Explanation Methods for Static and Evolving Data

静态与演化数据的解释方法评估面临的挑战

Jerzy Stefanowski

机构 * Poznan University of Technology(波兹南工业大学)

AI总结 本文针对可解释人工智能的评估不足,以DetoxAI系统为例展开研究,探索了演化数据流的解释适配方法,最后关联了数据、模型与解释协同演化的跟踪挑战。

Comments 13 pages, 1 figure = this paper is a preprint of the workshop [Explainable AI in Space] paper for IJCAI ECAI 2026 conference

详情
AI中文摘要

本文针对可解释人工智能(XAI)在评估方面存在的不足展开研究,通过DetoxAI图像识别系统(用于偏差检测与概念遗忘)阐明了这些不足。随后,给出了图像分类解释方法的基于人类认知的评估示例,进一步探索了针对带有概念漂移的演化数据流的解释适配方法,讨论了将反事实方法适配到该问题的相关经验,最后将上述内容与数据、模型及解释协同演化的跟踪挑战关联起来。本文已被收录至IJCAI-ECAI 2026不来梅会议的EASi 2026研讨会论文集《Explainable AI in Space》,该论文集属于Springer CCIS第3107卷(2016年)。

英文摘要

This paper addresses the limitations of Explainable Artificial Intelligence (XAI) with respect to insufficient evaluation. They are illustrated through the DetoxAI image recognition system for bias detection and concept unlearning. Then, an example of a human-grounded evaluation of methods for explaining image classification is presented. The paper further explores methods for adapting explanations to evolving data streams with concept drift. Experiences with adapting counterfactuals for this problem are discussed. Finally it is related to the challenges of tracking the co-evolution of data, models, and explanations.\footnote{This paper has been accepted for a publication in this http URL (ed) Explainable AI in Space. Proceedings of EASi 2026 Workshop at IJCAI-ECAI 2026 Bremen, Springer CCIS vol 3107 (2016).}

URL PDF HTML 收藏
2608.06347 2026-08-07 cs.CL 新提交

RP-OPSD: Reasoning-Pivot-Guided On-Policy Self-Distillation for Multilingual Reasoning Transfer

RP-OPSD:基于推理枢轴引导的多语言推理迁移在线策略自蒸馏

Xinye Wang, Junxiao Liu, Shujian Huang

机构 * Nanjing University(南京大学)

AI总结 该研究针对多语言推理迁移中现有在线策略自蒸馏未优先考虑关键推理信号的问题,提出 RP-OPSD 方法,利用教师视图分布偏移引导特权蒸馏,在 17 种语言的数学推理基准上优于基线,提升了多语言推理能力。

Comments 16 pages. Under review

详情
AI中文摘要

多语言推理迁移对于将大型语言模型(LLM)的推理能力扩展到高资源语言之外至关重要。在线策略自蒸馏(OPSD)及其变体已成为一种有前景的范式,可为学生生成的 rollout 提供密集的 token 级监督,然而它们的目标并未明确优先考虑对跨语言迁移最关键的推理信号。我们指出,目标语言推理包括表层文本和推理枢轴的生成,推理枢轴是推进或重定向推理过程并塑造后续推理的决策。这促使我们将特权蒸馏集中在这类枢轴周围。因此,我们提出 RP-OPSD,即基于推理枢轴引导的在线策略自蒸馏,利用带有和不带有英语参考解的匹配教师视图之间的分布偏移作为操作代理,以引导特权蒸馏和参考锚定。在涵盖 17 种语言和多个难度级别的数学推理基准上进行的实验表明,我们的方法优于强大的多语言推理基线和 OPSD 变体。进一步分析显示,RP-OPSD 将特权蒸馏集中在推理控制和问题条件状态更新 token 上,同时降低了主要支持表层实现的 token 的权重。我们的代码可在此 https URL 获取。

英文摘要

Multilingual reasoning transfer is crucial for extending reasoning capabilities of large language models (LLMs) beyond high-resource languages. On-policy self-distillation (OPSD) and its variants have emerged as a promising paradigm, providing dense token-level supervision on student-generated rollouts, yet their objectives do not explicitly prioritize reasoning signals most critical to cross-lingual transfer. We characterize that target-language reasoning comprises the generation of both surface text and reasoning pivots, which are decisions that advance or redirect the reasoning process and shape subsequent inference. This motivates concentrating privileged distillation around such pivots. We therefore propose RP-OPSD, Reasoning-Pivot-guided On-Policy Self-Distillation, using the distributional shift between matched teacher views with and without an English reference solution as an operational proxy to guide privileged distillation and reference anchoring. Experiments on mathematical reasoning benchmarks covering 17 languages and multiple difficulty levels show that our method outperforms strong multilingual reasoning baselines and OPSD variants. Further analysis reveals that RP-OPSD concentrates privileged distillation on reasoning-control and problem-condistioned state-update tokens, while downweighting it for tokens that mainly support surface realization. Our code is available at this https URL.

URL PDF HTML 收藏
2608.06346 2026-08-07 cs.AI 新提交

TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories

TRAJDEBUG:追踪错误生命周期以识别长视野智能体轨迹中的关键失败

Yunjia Qi, Zehua Yin, Xintong Shi, Hao Peng, Songyuanyi Lu, Yixian Liu, Richeng Xuan, Yuhong Liu, Zhichao Hu, Xiaozhi Wang, Lei Hou, Bin Xu, Juanzi Li

机构 * Tsinghua University(清华大学) Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院) Tencent Hunyuan(腾讯混元)

AI总结 针对长视野智能体轨迹调试的级联错误与关键错误定位难题,提出TrajDebug框架,构建含486条轨迹的TrajErrBench基准,实验显示其性能优于现有基线,可提供改进智能体的可操作反馈。

详情
AI中文摘要

基于大语言模型(LLM)的智能体系统在复杂领域展现出卓越能力,但存在级联错误和调试困难的问题。关键错误检测旨在定位失败轨迹中导致最终失败的最早错误步骤,然而该领域进展面临两大挑战:其一,长轨迹难以识别单个错误,因为判断某一步骤的证据可能分散在遥远的指令、观测和先前上下文中;其二,失败轨迹通常包含多个具有不同下游影响的局部错误,其中仅部分错误需为最终失败负责。本研究提出TrajDebug,这是一种错误生命周期追踪框架,通过多粒度历史压缩和基于证据的错误识别解决长轨迹错误发现问题,并通过追踪每个错误的解决状态和终端影响支持关键归因。我们进一步构建TrajErrBench,这是一个包含486条手动标注的失败轨迹的基准数据集,源自Tau2Bench和SWE-Bench Pro,涵盖现实工具使用和编码场景。在不同智能体基准上的实验表明,TrajDebug相较于现有基线实现了最佳整体性能,应用研究进一步证明其诊断结果可为提升下游智能体成功率提供可操作的反馈。我们将发布代码和数据以促进进一步研究。

英文摘要

LLM-based agentic systems have shown remarkable capabilities in complex domains, while suffering from cascading errors and difficulty in debugging. Critical error detection aims to locate the earliest error step in a failed trajectory that is responsible for the final failure. However, progress faces two main challenges. First, long trajectories make it difficult to identify individual errors, since the evidence for judging a step may be scattered across distant instructions, observations, and prior context. Second, failed trajectories often contain multiple local errors with different downstream effects, only some of which remain responsible for the final failure. In this work, we propose TrajDebug, an error-lifecycle tracing framework that addresses long-trajectory error discovery with multi-granularity history compression and evidence-based error identification, and supports critical attribution by tracing each error's resolution status and terminal impact. We further construct TrajErrBench, a benchmark of 486 manually annotated failed trajectories from Tau2Bench and SWE-Bench Pro, covering realistic tool-use and coding scenarios. Experiments across diverse agent benchmarks show that TrajDebug achieves the best overall performance over existing baselines, and application studies further demonstrate that its diagnoses provide actionable feedback for improving downstream agent success. We will release the codes and data to facilitate further research.

URL PDF HTML 收藏
2608.06332 2026-08-07 cs.RO 新提交

GeniWorld: A Generalizable Interactive World Model for Robotic Manipulation via Visual Actions

GeniWorld:一种用于机器人操作的可泛化交互式世界模型

Chenghao Gu, Hanyang Yu, Jingbo Zhang, Haitao Lin, Wenyao Zhang, Jinghe Wang, Hanglei Jin, Shuzhao Xie, Jingyan Jiang, Zhi Wang

机构 * Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院) Tencent Robotics X(腾讯Robotics X实验室) The Hong Kong University of Science and Technology(香港科技大学) Shenzhen Technology University(深圳技术大学)

AI总结 针对通用机器人策略在复杂环境中鲁棒性不足的问题,提出GeniWorld交互式世界模型,通过解耦本体与环境动态、构建自回归视频预测模型实现泛化,可用于策略评估并提升下游操作性能。

详情
AI中文摘要

通用机器人策略具备较强能力,但在复杂且未见过的环境中的鲁棒性仍有限。在多样化真实世界环境中扩展机器人学习与评估的成本高且颇具挑战性。基于动作的世界模型是一种有前景的替代方案,但它们常存在动作可控性有限、对分布外(OOD)场景泛化能力差的问题。为此,我们提出GeniWorld,一种可在未见过场景中实现稳健泛化的机器人交互式世界模型。该模型基于预训练视频生成模型构建,使用基于URDF的渲染将数值动作转换为视觉动作表示,实现空间上精准的动作控制。通过明确将机器人本体运动学与环境动态解耦,我们的模型减轻了场景过拟合,便于对机器人-环境交互进行建模。为实现闭环控制,我们构建了集成高频机器人运动学控制的自回归视频预测模型,使其可与机器人策略及人类远程操作者交互。实验中,即便仅在有限的固定场景数据上训练,我们的模型仍实现了优异的域内性能,且对高度随机的未见过环境具备稳健的零样本泛化能力。对于下游应用,GeniWorld可作为可扩展的策略评估器,在环境扰动下仍保持可靠。此外,即便仅使用有限的真实世界演示,GeniWorld也能在世界模型内生成多样化的操作轨迹,提升下游策略在复杂环境中的性能与鲁棒性。

英文摘要

Generalist robot policies exhibit strong capabilities, but their robustness in complex and unseen environments remains limited. Scaling robot learning and evaluation in diverse real-world environments remains costly and challenging. Action-conditioned world models offer a promising alternative, but they often suffer from limited action controllability and poor generalization to out-of-distribution (OOD) scenarios. To this end, we present GeniWorld, an interactive world model for robots that generalizes robustly across unseen scenarios. Building on pretrained video generative models, we use URDF-based rendering to transform numerical actions into visual action representations, enabling spatially grounded action control. By explicitly decoupling embodiment kinematics from environmental dynamics, our model mitigates scene overfitting and facilitates modeling of robot-environment interactions. To achieve closed-loop control, we construct an autoregressive video prediction model integrated with high-frequency robot kinematic control, enabling interaction with both robot policies and human teleoperators. In our experiments, even when trained solely on limited fixed-scene data, our model achieves superior in-domain performance and robust zero-shot generalization to highly randomized, unseen environments. For downstream applications, GeniWorld serves as a scalable policy evaluator that remains reliable under environmental perturbations. Furthermore, even with limited real-world demonstrations, GeniWorld generates diverse manipulation trajectories within the world model, improving downstream policy performance and robustness in complex environments.

URL PDF HTML 收藏
2608.06311 2026-08-07 cs.CV cs.AI 新提交

Does FLAIR super-resolution erase or hallucinate small white-matter lesions?

FLAIR超分辨率是清除还是幻觉了小白质病变?

Zahra Khodakarami, Yue Li, Pulkit Khandelwal, John Detre, Sandhitsu Das, Christopher Brown, David Wolk, Paul Yushkevich

机构 * University of Pennsylvania(宾夕法尼亚大学)

AI总结 该研究针对FLAIR超分辨率是否影响白质病变的问题,采用ADNI数据对比多种上采样方法,发现超分辨率主要清除小病灶,ECLARE的小病灶信号恢复效果最优。

Comments 10 pages, 2 figures, 3 tables. Accepted at the 11th International Workshop on Simulation and Synthesis in Medical Imaging (SASHIMI 2026), held in conjunction with MICCAI 2026. This is the version submitted for review; the final authenticated version will appear in the Springer LNCS proceedings

详情
AI中文摘要

Flair序列扫描中的白质高信号(WMH)亮区与脑血管病理及神经退行性病变相关,临床中FLAIR通常采用厚层采集,导致层间分辨率较差。超分辨率(SR)是从各向异性扫描中恢复各向同性体积的常用方法,但在WMH分割前应用SR是否能保留病变内容仍未知:模型可能清除真实小病变或幻觉出不存在的病变。本研究使用ADNI队列29名受试者的1毫米各向同性高分辨率(HR)FLAIR扫描数据,每例均由专家手动分割WMH,随后将其降质为模拟的3毫米和5毫米层间采集数据,采用多对比度隐式神经表示(INR)、单对比度自监督模型(ECLARE)及三次插值将其上采样至HR网格。以模拟厚层切片的WMH分割结果为下限,原始HR FLAIR的分割结果为上限,开展病灶水平分析。在4种WMH分割方法(WMH-SynthSeg、segcsvd、MARS-WMH、TrUE-Net)中,选择对HR图像中小病灶最敏感的MARS-WMH,采用检测灵敏度、清除率(重建后丢失的HR检测病灶比例)、幻觉率(手动及HR分割均不存在的预测成分比例)作为评估指标。结果显示,SR的主要影响是清除真实小病灶而非幻觉,且清除率随层厚增加而升高,不过所有重建方法的病灶检测性能均优于原始厚层切片;ECLARE在两种层厚下均能最佳恢复小病灶信号,而INR的表现与三次插值无差异。

英文摘要

White matter hyperintensities (WMH), bright regions on Fluid-attenuated Inversion Recovery (FLAIR) scans are associated with cerebrovascular pathology and neurodegeneration. FLAIR is usually acquired with thick slices in clinical settings, giving it poor through-plane resolution. Super-resolution (SR) is a widely used method for recovering an isotropic volume from an anisotropic scan. Yet whether applying it prior to WMH segmentation preserves lesion content remains unknown: a model may erase small real lesions or hallucinate absent ones. We used 1-mm isotropic high-resolution (HR) FLAIR scans from 29 individuals in the ADNI cohort, each manually segmented for WMH by an expert. Then, we degraded each to simulated 3 and 5 mm through-plane acquisitions. Multi-contrast implicit neural representation (INR), a single-contrast self-supervised model (ECLARE), and cubic interpolation were used to upsample them onto the HR grid. WMH segmentation from a simulated thick slice and the original HR FLAIR set the floor and ceiling, respectively, for the per-lesion analysis. Of four WMH segmentation methods (WMH-SynthSeg, segcsvd, MARS-WMH, TrUE-Net), we ran the analysis under the most sensitive one to small lesions on HR (MARS-WMH) with the evaluation metrics of detection sensitivity, erasure rate (HR-detected lesions lost after reconstruction), and hallucination rate (predicted components absent from both the manual and HR segmentation). The dominant effect of SR was erasure of small real lesions, not hallucination, and it increased with slice thickness, though every reconstruction still improved lesion detection over the raw thick slice. ECLARE recovered small lesion signal best at both thicknesses, while the INR was no better than cubic interpolation.

URL PDF HTML 收藏
2608.06310 2026-08-07 cs.LG cs.CL 新提交

RRC: Unlocking Generative Reward Models in LLM Reinforcement Learning via Ranking-Based Reward Construction

RRC:基于排序的奖励构造解锁LLM强化学习中的生成式奖励模型

Chenglong Wang, Ziming Zhu, Yifu Huo, Bei Li, Qiaozhi He, Yan Ding, Xiaoyang Hao, Yuxin Gao, Tianhua Zhou, Xiaojia Chang, Tongran Liu, Jingbo Zhu

机构 * School of Computer Science and Engineering, Northeastern University(东北大学计算机科学与工程学院) NiuTrans Research(NiuTrans研究院) Institute of Psychology, CAS(中国科学院心理研究所) Kunming University of Science and Technology(昆明理工大学)

AI总结 本研究针对生成式奖励模型在LLM强化学习中潜力未充分发挥的问题,提出RRC方法,通过两种互补策略提升RL训练效果,在多基准上取得一致增益。

详情
AI中文摘要

奖励建模的最新进展展现出从判别式奖励模型到生成式奖励模型的范式转变。然而,尽管生成式奖励模型在响应排序方面能力强大,但其在强化学习(RL)中的潜力尚未得到充分发挥。我们的分析表明,这一局限源于生成式奖励建模的比较性质与现有RL算法采用的标量评分范式之间存在不匹配。为弥合这一差距,我们提出了基于排序的奖励构造(Ranking-based Reward Construction,RRC)方法,该方法通过从相对偏好排序中推导奖励,使生成式奖励模型能够提供更有效的RL学习信号。RRC引入了两种互补策略:利用采样响应间比较的自竞争排序,以及通过少量参考响应实现可扩展的基于排序的奖励构造的锚点引导排序。在开放式对话和推理基准上开展的实验表明,RRC显著提升了生成式奖励模型的RL训练效果,相较于现有奖励构造方法取得了一致的性能增益。我们的代码可在该https URL获取。

英文摘要

Recent advances in reward modeling show a paradigm shift from discriminative reward models to generative reward models. However, despite their strong capabilities in response ranking, generative reward models have not realized their potential in reinforcement learning (RL). Our analysis reveals that this limitation arises from a mismatch between the comparative nature of generative reward modeling and the scalar scoring paradigm adopted by existing RL algorithms. To bridge this gap, we propose a Ranking-based Reward Construction (RRC) approach, which enables generative reward models to provide more effective RL learning signals by deriving rewards from relative preference rankings. RRC introduces two complementary strategies: self-competitive ranking, which exploits comparisons among sampled responses, and anchor-guided ranking, which enables scalable ranking-based reward construction with a small set of reference responses. Experiments across open-ended chat and reasoning benchmarks demonstrate that RRC substantially improves RL training with generative reward models, achieving consistent gains over existing reward construction approaches. Our code can be found at this https URL.

URL PDF HTML 收藏
2608.06307 2026-08-07 cs.CV 新提交

UQ-Loc: Uncertainty-Aware LiDAR Scene Coordinate Regression

UQ-Loc:感知不确定性的激光雷达场景坐标回归

Jacek Komorowski

机构 * Warsaw University of Technology(华沙理工大学)

AI总结 UQ-Loc扩展LightLoc架构,添加各向同性高斯协方差头,采用NLL损失结合kNN正则化训练,改进SC2-PCR求解器推理,提升6自由度定位精度并校准不确定性。

详情
AI中文摘要

基于激光雷达的场景坐标回归(SCR)直接将点云映射到3D场景坐标,无需显式地图检索即可实现精确的6自由度定位。但现有方法输出确定性预测,丢弃了可提升鲁棒性及下游决策的偶然不确定性。本文提出UQ-Loc,它扩展了LightLoc架构,添加各向同性高斯协方差头,为每个体素预测完整的3×3正定协方差矩阵。训练采用负对数似然(NLL)损失,辅以基于k近邻(kNN)的空间平滑正则化项;推理时使用改进的SC2-PCR求解器,结合不确定性加权种子评分与马氏距离内点测试。本文采用预期校准误差(ECE)作为评估预测不确定性质量的合理指标。实验表明,UQ-Loc在6自由度定位精度上实现持续提升,同时生成校准良好的协方差矩阵。

英文摘要

LiDAR-based Scene Coordinate Regression (SCR) maps point clouds directly to 3D scene coordinates, enabling precise 6-DoF localisation without explicit map retrieval. However, existing methods produce deterministic predictions, discarding aleatoric uncertainty that could improve robustness and downstream decision-making. We present UQ-Loc, which extends the LightLoc architecture with an anisotropic Gaussian covariance head that predicts a full 3x3 positive-definite covariance matrix per voxel. Training uses a Negative Log-Likelihood (NLL) loss augmented with a kNN-based spatial smoothness regulariser, while inference employs a modified SC2-PCR solver with uncertainty-weighted seed scoring and a Mahalanobis-distance inlier test. We adopt Expected Calibration Error (ECE) as a principled metric for evaluating the quality of the predicted uncertainty. Experiments demonstrate that UQ-Loc achieves consistent improvement in 6-DoF localization accuracy while producing well-calibrated covariances.

URL PDF HTML 收藏
2608.06301 2026-08-07 cs.AI cs.CL cs.LG 新提交

HarnessOpt-Bench: Evaluating LLMs at Harness Optimization

HarnessOpt-Bench:评估大型语言模型的 harness 优化能力

Varun Ursekar, Apaar Shanker, Yash Maurya, Shehab Yasser, Vijay S. Kalmath, Veronica Chatrath, Yuan Xue

机构 * Scale AI

AI总结 本研究提出HarnessOpt-Bench基准,评估前沿LLM在高成本随机评估下的端到端harness优化能力,发现优化器模型差异大于编码harness、原生harness非始终更优,该能力具可测性与提升空间。

详情
AI中文摘要

随着大型语言模型(LLM)越来越多地部署在智能体系统中,其能力不仅取决于模型权重,还取决于harness——围绕模型的提示词、工具、控制流、内存和编排代码。这使得自动化harness优化(即AI系统通过迭代和评估引导的方式改进harness)成为提升AI系统的重要途径,也是AI系统自身需要具备的高要求能力。然而,学界缺乏通用协议来评估前沿LLM在该任务上的表现。本文提出HarnessOpt-Bench,这是一个在高成本且随机评估场景下进行端到端harness优化的基准。优化器是一个结合了编码harness的LLM,它会接收目标智能体的种子harness、分级评估反馈以及固定的目标评估预算,然后编辑harness并提名最终候选方案,该方案的得分基于其在保留的测试分区上相对于种子harness的归一化增益,而该测试分区在整个搜索过程中保持不可访问。可信执行环境会强制执行评估边界、计量目标智能体的资源使用情况,并保留候选版本以供审计。我们将5个前沿LLM作为优化器,在共享编码harness和它们的原生harness下,针对4个下游任务进行了超过111次评分运行的评估。实验结果显示,优化器模型之间的差异大于它们所作用的编码harness之间的差异,原生harness并不始终更优,且增益在不同任务和种子方案之间存在显著差异。这些结果表明,harness优化是一种可测量且具有区分度的能力,存在巨大的提升空间。

英文摘要

As LLMs are increasingly deployed within agentic systems, their capabilities depend not only on the model weights but also on the harness: the prompts, tools, control flow, memory, and orchestration code surrounding them. This makes automated harness optimization -- the iterative and evaluation-guided improvement of a harness by an AI system -- both an important route to improving AI systems and a demanding capability for AI systems themselves. Yet the community lacks a common protocol for measuring how well frontier LLMs perform at this task. We introduce HarnessOpt-Bench, a benchmark for end-to-end harness optimization under expensive and stochastic evaluation. An optimizer, an LLM paired with a coding harness, receives a target agent's seed harness, graded evaluation feedback, and a fixed target-evaluation budget. It edits the harness and nominates a final candidate, which is scored by its normalized gain over the seed on a held-out test partition that remains inaccessible throughout search. A trusted execution environment enforces the evaluation boundary, meters target-agent resource use, and preserves candidate versions for audit. We evaluate 5 frontier LLMs as optimizers both under a shared coding harness and under their native harnesses across 4 downstream tasks, over 111 scored runs. Experiment results show that optimizer models separate more than the coding harnesses they act through, native harnesses are not consistently superior, and gains vary substantially across tasks and seed regimes. These results establish harness optimization as a measurable and discriminative capability with large space for improvement.

URL PDF HTML 收藏
2608.06296 2026-08-07 cs.LG 新提交

On-Policy Self-Distillation without Any Supervision

无任何监督的在线策略自蒸馏

Yijiang Li, Bingyang Wang, Yijun Liang, Yunjie Tian, Di Fu, Nuno Vasconcelos

机构 * UC San Diego(加州大学圣迭戈分校) Georgia Institute of Technology(佐治亚理工学院) University of Maryland, College Park(马里兰大学帕克分校) ByteDance(字节跳动)

AI总结 本研究提出无监督在线策略自蒸馏(U-OPSD),仅用模型自身生成结果实现在线策略自蒸馏,在多数学基准上优于基础模型,部分场景超越OPSD、GRPO等监督方法。

详情
AI中文摘要

在线策略(自)蒸馏(OPD / OPSD)在大型语言模型(LLM)的后训练阶段展现出强大潜力。然而,现有方法仍严重依赖外部监督,包括真值信号、环境反馈或更大模型的指导,因此未能实现真正的“自”蒸馏。本研究表明,仅利用模型自身生成结果并通过内部一致性即可实现在线策略自蒸馏,我们提出了无监督在线策略自蒸馏(U-OPSD)。U-OPSD首先采样多个rollout结果,在自一致性阈值下通过多数投票构建伪解;随后将教师分布基于最短伪解进行条件设置,并将其蒸馏到模型最长错误补全的前缀中,使模型能在自身确信错误的位置进行精准修正。在不同基准、基础模型和训练设置下,U-OPSD始终优于基础模型,且与带真值(GT)的监督方法(如OPSD和GRPO)相当或超越。在AIME24、AIME25、HMMT25、MATH500和AMC23基准上,Qwen3非思考模式下,U-OPSD在4B和8B规模时较基础模型分别提升8.5%和10.7%,较OPSD平均提升3.2%和2.3%;在思考模式下,U-OPSD与OPSD表现相当,4B规模时超越OPSD 0.9%,8B规模时与OPSD持平,同时分别超越GRPO 0.7%和1.1%。

英文摘要

On-policy (Self-)Distillation (OPD / OPSD) has shown strong potential for post-training large language models (LLMs). However, existing methods still rely heavily on external supervision, including ground-truth signals, environmental feedback, or guidance from larger models, and therefore fall short of genuine "self"-distillation. In this study, we show that on-policy self-distillation can be achieved using only a model's own generations via internal consistency. We propose Unsupervised On-Policy Self-Distillation (U-OPSD). U-OPSD first samples multiple rollouts and constructs a pseudo-solution by majority vote under a self-consistency threshold. It then conditions a teacher distribution on the shortest pseudo-solution and distills it into prefixes of the model's longest incorrect completion, allowing the model to correct itself precisely where it is confidently wrong. Across diverse benchmarks, base models, and training settings, U-OPSD consistently improves over the base models and matches or surpasses supervised methods with ground truth (GT), such as OPSD and GRPO. On AIME24, AIME25, HMMT25, MATH500, and AMC23, U-OPSD improves over the base model by 8.5% and 10.7% on Qwen3 non-thinking mode at the 4B and 8B scales, respectively, and outperforms OPSD by an average of 3.2% and 2.3%. In thinking mode, U-OPSD remains on par with OPSD, outperforming it by 0.9% at 4B and matching it at 8B, while surpassing GRPO by 0.7% and 1.1%, respectively.

URL PDF HTML 收藏
2608.06294 2026-08-07 cs.AI cs.ET 新提交

QuanTiMedAI: Quantum-Enhanced Time-Series Model guided by Agentic AI for Cardiac Arrest Mortality Prediction

QuanTiMedAI:由智能体人工智能引导的量子增强时间序列模型用于心脏骤停死亡率预测

Mutasim Fuad Sarker, Adiba Rahman Namira, Wafa Binte Alam, Md Adnan Arefeen, Mahzabeen Emu, Sumaiya Tabassum Nimi

机构 * North South University(北南大学) Memorial University(纪念大学)

AI总结 该研究针对心脏骤停死亡率预测的静态数据局限,提出QuanTiMedAI量子-智能体框架,结合智能体LLM与量子循环网络,在MIMIC-IV数据集上仅用605个参数实现0.852的AUROC,优于现有最先进基线。

Comments Submitted for review

详情
AI中文摘要

心脏骤停仍是重症监护病房中最致命的病症之一。尽管电子健康记录数据的可用性不断提升,但针对该人群的现有死亡率预测研究大多依赖于入院早期得出的静态汇总信息,此类方法忽略了患者在ICU住院期间生理恶化与恢复的时间演变过程。为解决这一局限,我们提出了QuanTiMedAI,这是一款为心脏骤停死亡率预测开发的量子-智能体框架,采用由智能体人工智能引导的量子增强时间序列模型。该系统结合了用于临床知情特征发现的智能体大语言模型(LLM)与用于感知时间的死亡率预测的紧凑型量子循环网络。研究结果表明,由智能体LLM引导的特征选择始终优于传统特征选择方法,且所提出的量子架构通过非线性特征增强实现了具有竞争力的预测性能,同时保持了极低的参数数量。通过对MIMIC-IV中心脏骤停患者队列的大量实验,QuanTiMedAI的量子增强架构仅用605个参数就达到了0.852的AUROC,比该任务当前的最先进基线提升了约2.9%。一项结构化 ablation研究系统验证了每个架构设计选择的贡献。这些结果表明,量子增强序列建模在使用显著更少参数的情况下,能够超越经典循环网络。

英文摘要

Cardiac arrest remains one of the most lethal conditions encountered in intensive care units. Despite the growing availability of electronic health record data, existing mortality prediction studies in this population largely depend on static summaries derived from early admission. Such approaches ignore the temporal progression of physiological deterioration and recovery that unfolds throughout a patient's ICU stay. To address this limitation, we introduce QuanTiMedAI, a quantum-agentic framework developed for cardiac arrest mortality prediction using agentic AI guided quantum enhancement time series model. The proposed system combines an agentic large language model (LLM) for clinically informed feature discovery with a compact quantum recurrent network for temporality aware mortality prediction. Our findings demonstrate that agentic LLM-guided feature selection consistently outperforms conventional feature selection approaches, and the proposed quantum architecture achieves competitive predictive performance through nonlinear feature enhancement while keeping the number of parameters very low. Through extensive experimentation on a MIMIC-IV cohort of cardiac arrest patients, QuanTiMedAI's quantum-enhanced architecture attains an AUROC of 0.852 using only 605 parameters, an improvement of approximately 2.9\% over a current state-of-the-art baseline for this task. A structured ablation study systematically validates the contribution of each architectural design choice. These results show that quantum-enhanced sequential modeling can exceed classical recurrent networks while using substantially fewer parameters.

URL PDF HTML 收藏
2608.06292 2026-08-07 cs.CL cs.SC 新提交

NeSy-RAG: Neuro-Symbolic RAG for Explainable Question Answering

NeSy-RAG:用于可解释问答的神经符号检索增强生成框架

Jonas Gann, Michael Gertz

机构 * Heidelberg University(海德堡大学)

AI总结 NeSy-RAG是一种模块化神经符号RAG框架,可生成透明推理轨迹,在ShARC基准上以61.1%的准确率优于同模型RAG基线,实现可解释问答。

详情
AI中文摘要

检索增强生成(RAG)通过将大型语言模型(LLM)与文本语料库等外部知识绑定,改进了问答任务,但它的推理过程仍在很大程度上不透明:中间推理步骤难以验证,且无法可靠地归因于特定证据。此外,用户特定上下文的缺失很少被系统检测到,往往导致输出不完整或不正确。我们提出NeSy-RAG,一种模块化神经符号RAG框架,它从检索到的文本块中合成可归因的Prolog模块。对于每个文本块,系统生成语义上有意义的谓词,这些谓词编码布尔声明,可能依赖于用户事实。利用联合自然语言-代码嵌入,谓词被检索并组合成Prolog查询。为解决用户上下文不完整的问题,我们引入了一种符号知识缺口检测机制,该机制识别其真值会影响查询结果的缺失用户事实,并自动触发后续交互。执行生成的Prolog查询会产生确定性答案以及透明的执行轨迹,该轨迹将每个推理步骤与其原始来源关联起来。在ShARC基准上,无需针对特定领域进行训练,NeSy-RAG达到了61.1%的准确率,优于达到42.8%准确率的同模型RAG基线。

英文摘要

Retrieval-augmented generation (RAG) improves question answering by grounding large language models (LLMs) in external knowledge such as text corpora. However, its reasoning process remains largely opaque: intermediate reasoning steps are difficult to verify and cannot be reliably attributed to specific evidence. Moreover, missing user-specific context is rarely detected systematically, often leading to incomplete or incorrect output. We propose NeSy-RAG, a modular neuro-symbolic RAG framework that synthesizes attributable Prolog modules from retrieved text chunks. For each chunk, the system generates semantically meaningful predicates that encode Boolean claims, which may depend on user facts. Using joint natural language-code embeddings, predicates are retrieved and composed into Prolog queries. To address incomplete user context, we introduce a symbolic knowledge-gap detection mechanism that identifies missing user facts whose truth values affect the query outcome and automatically triggers follow-up interactions. Executing the resulting Prolog queries yields deterministic answers together with transparent execution traces that link each reasoning step to its originating source. On the ShARC benchmark, without domain-specific training, NeSy-RAG achieves 61.1% accuracy, outperforming a same-model RAG baseline that achieves 42.8% accuracy.

URL PDF HTML 收藏
2608.06291 2026-08-07 cs.LG cs.AI 新提交

BaKron: Efficient Quantization with Kronecker-Factored Hessians

BaKron:基于克罗内克因式分解海森矩阵的高效量化方法

Johann Birnick, Rayan Saab

机构 * University of California San Diego(加利福尼亚大学圣迭戈分校)

AI总结 BaKron是一种高效神经网络量化算法,通过结合反对角并行与递归分治结构,将计算量从O(m²n²)降至O(mn(m+n)),兼具GPTQ的缩放效率与更丰富的曲率信息,且对基础量化器和海森估计器模块化。

详情
AI中文摘要

我们加速一类神经网络量化算法,这类算法的几何由海森矩阵的任意克罗内克因式分解近似所决定。GPTQ风格的自适应舍入通常使用从输入激活中得到的单侧信息,而双侧克罗内克因式分解海森矩阵近似还能捕捉输出坐标间的相关性,但直接在向量化权重域应用GPTQ计算成本很高。基于BoA和YAQA所用的双侧自适应舍入公式,我们提出BaKron,一种结合反对角并行性与递归分治结构的高效求解器。对于m×n的权重矩阵,BaKron使用O(m+n)的顺序步骤,同时将总计算量从O(m²n²)降至O(mn(m+n)),因此它达到了GPTQ的立方级缩放,同时利用了更丰富的曲率信息。此外,BaKron对于基础量化器和海森估计器均具有模块化特性。我们还提供了实际基准测试,考虑了BaKron可调用的一系列海森矩阵,找到一种计算这些海森矩阵的高效技术,并对该算法进行了实验评估。

英文摘要

We accelerate a family of algorithms for neural network quantization whose geometry is informed by any Kronecker-factored approximation of the Hessian. GPTQ-style adaptive rounding typically uses one-sided information derived from input activations. Two-sided Kronecker-factored Hessian approximations can additionally capture correlations across output coordinates, but applying GPTQ directly in the vectorized weight domain is computationally expensive. Building on the two-sided adaptive-rounding formulation used by BoA and YAQA, we introduce BaKron, an efficient solver that combines anti-diagonal parallelism with a recursive divide-and-conquer construction. For an $m\times n$ weight matrix, BaKron uses $O(m+n)$ sequential steps while reducing the total work from $O(m^2n^2)$ to $O(mn(m+n))$. Thus, it matches the cubic scaling of GPTQ while exploiting richer curvature information. Moreover, BaKron is modular with respect to both the base quantizer and the Hessian estimator. We also provide practical benchmarks, consider a range of Hessians that BaKron can be called with, find an efficient technique to compute these Hessians, and evaluate the algorithm experimentally.

URL PDF HTML 收藏
2608.06288 2026-08-07 cs.LG stat.ML 新提交

Surv-IPTB: An Attention-Based Model for Estimating Individual Probability of Treatment Benefit with Survival Data

Surv-IPTB:一种基于注意力的生存数据个体治疗获益概率估计模型

Lev V. Utkin, Stanislav K. Kogan, Andrei V. Konstantinov

机构 * Higher School of Artificial Intelligence Technologies(人工智能技术高等学院) Peter the Great St.Petersburg Polytechnic University(彼得大帝圣彼得堡理工大学)

AI总结 本研究提出基于注意力的 Surv-IPTB 模型,将生存数据的 IPTB 估计转化为二分类问题,通过成对患者比较处理右删失数据,在合成非线性数据集上优于 T-learner、S-learner 等基线模型,可用于个性化治疗获益评估。

详情
AI中文摘要

本研究提出了一种新颖的基于注意力的框架,用于在生存分析场景中估计个体治疗获益概率(Individual Probability of Treatment Benefit,IPTB)。所提出的模型名为 Surv-IPTB,可直接量化特定患者在接受治疗与接受对照治疗时获得更长生存时间的概率。我们将 IPTB 估计重新表述为二分类问题,利用治疗组与对照组之间的成对患者比较。该框架通过不精确概率表示法对右删失观测值进行合理处理,其中不确定的治疗效果由区间值概率表征。具有可学习查询-键变换的注意力机制能够灵活、数据驱动地聚合成对比较,同时为删失案例学习软分类概率。我们在具有复杂非线性结构的合成数据集(包括螺旋形、钟形和圆形特征空间)上进行了大量实验,结果表明,我们的方法在不同删失率和治疗效果强度下均保持稳健性能。该模型始终优于配备随机生存森林、Cox 比例风险模型和 Beran 估计器的元学习器基线(T-learner 和 S-learner),尤其是在传统方法表现显著退化的具有挑战性的非线性场景中。这些结果确立了所提出的基于注意力的框架为生存场景中个性化治疗获益评估的可扩展且统计合理的解决方案。实现该模型的代码已公开提供。

英文摘要

This work presents a novel attention-based framework for estimating the Individual Probability of Treatment Benefit (IPTB) in survival analysis contexts. The proposed model, called Surv-IPTB, directly quantifies the probability that a specific patient will experience extended survival time under treatment versus control. We reformulate IPTB estimation as a binary classification problem, leveraging pairwise patient comparisons across treatment and control cohorts. The framework incorporates a principled handling of right-censored observations through imprecise probability representations, where uncertain treatment effects are characterized by interval-valued probabilities. An attention mechanism with learnable query-key transformations enables flexible, data-driven aggregation of pairwise comparisons, while simultaneously learning soft class probabilities for censored cases. Through extensive experiments on synthetic datasets with complex nonlinear structures, including spiral, bell-shaped, and circular feature spaces, we demonstrate that our approach maintains robust performance across varying censoring rates and treatment effect strengths. The model consistently outperforms meta-learner baselines (T-learner and S-learner) equipped with random survival forests, Cox proportional hazards, and Beran estimators, particularly in challenging nonlinear scenarios where conventional methods exhibit significant degradation. The results establish the proposed attention-based framework as a scalable and statistically principled solution for personalized treatment benefit assessment in survival settings. The code implementing the model is publicly available.

URL PDF HTML 收藏
2608.06275 2026-08-07 cs.CV eess.IV 新提交

TLNM: Externally Validated Tooth Detection, Numbering and Segmentation from Smartphone Photographs Using Mask R-CNN

TLNM:使用 Mask R-CNN 从智能手机照片进行经外部验证的牙齿检测、编号与分割

Arash Nedaei, Henna Tiensuu, Elina Väyrynen, Saujanya Karki, Jaakko Suutala

机构 * University of Oulu(奥卢大学)

AI总结 本研究提出基于 Mask R-CNN 的 TLNM 模型,经1272张智能手机图像训练,结合两种优化机制,在内外测试集上表现优异,可实现智能手机照片的牙齿检测、编号与分割,为远程牙科提供低成本方案。

Comments 16 pages, 7 figures, 6 tables

详情
AI中文摘要

口腔健康问题影响全球数十亿人,但专业牙科护理的高成本与有限可及性阻碍了预防性口腔医疗。现有研究依赖临床级X光片或口腔内相机图像,这类图像无法用于公众自我筛查。本研究提出一种适用于智能手机照片的牙齿定位与编号模型。我们开发了定制化的 Mask R-CNN(掩码区域卷积神经网络)流程,该流程在1272张带标注的智能手机图像上完成训练。为应对用户生成健康数据的变异性,该流程融入两种领域知识驱动的机制:一是掩码灰度世界白平衡算法,用于减轻人工色偏;二是解剖学约束检测层,用于强化结构有效性并抑制假阳性。评估包含四个阶段:内部保留测试、独立外部测试、描述性 ablation 研究(消融研究),以及使用同一内部测试集的折基训练稳定性分析。在内部测试集上,该模型的实例掩码 AP@50 达0.818、类别感知 PQ 达0.780、操作 F1 达0.884;训练稳定性表现为模型间差异有限:十次运行中,实例掩码 AP@50 的标准差为0.009。在外部数据集上,尽管存在人群、传感器及采集方案的差异,该模型仍取得实例掩码 AP@50 达0.901、类别感知 PQ 达0.832、操作 F1 达0.928的结果。推理流程以开源容器化 API 形式提供。这些结果表明,消费级智能手机图像可支持自动化牙齿层面的解剖映射,为资源受限环境下的远程筛查与远程牙科提供了可扩展、潜在低成本的基础。

英文摘要

Oral health issues affect billions globally, but the cost and limited access to professional dental care hinder preventive oral healthcare. Research relies on clinical-grade radiographs or intraoral camera images, unavailable for public self-screening. This study introduces a tooth localisation and numbering model for smartphone photographs. We developed a customised Mask Region-based Convolutional Neural Network (Mask R-CNN) pipeline trained on 1,272 annotated smartphone images. To address variability in patient-generated health data, the pipeline incorporates two domain-informed mechanisms: a masked gray-world white-balancing algorithm to mitigate artificial colour casts and an anatomically constrained detection layer to enforce structural validity and suppress false positives. Evaluation comprised four stages: internal held-out testing, independent external testing, a descriptive ablation study, and fold-based training stability analysis using the same internal test set. On the internal test set, the model achieved an instance-mask AP@50 of 0.818, class-aware PQ of 0.780, and operational F1 of 0.884. Training stability showed limited between-model variation: across ten runs, instance-mask AP@50 had a standard deviation of 0.009. On the external dataset, the model achieved an instance-mask AP@50 of 0.901, class-aware PQ of 0.832, and operational F1 of 0.928 despite differences in population, sensors, and acquisition protocols. The inference pipeline is available as an open-source, containerised API. These results demonstrate that consumer-grade smartphone imagery can support automated tooth-level anatomical mapping, offering a scalable, potentially low-cost foundation for remote screening and tele-dentistry in resource-constrained environments.

URL PDF HTML 收藏
2608.06270 2026-08-07 cs.AI 新提交

The Illusion of Visual Tool-Use: A Causal Audit of Thinking with Images

视觉工具使用的错觉:对图像思考的因果审查

Zhiheng Wang, Bo Peng, Lai Wei, Chaochao Lu

机构 * Shanghai Artificial Intelligence Laboratory(上海人工智能实验室) Shanghai Jiao Tong University(上海交通大学) Shanghai Innovation Institute(上海创新研究院)

AI总结 本文通过因果审查方法,发现多模态大语言模型的视觉工具使用存在“调用而不查看”“查看而不规划”等错觉,整体准确率增益下大量场景无因果效果。

详情
AI中文摘要

“图像思考”范式为多模态大语言模型(multimodal LLMs)配备了裁剪缩放等主动视觉操作,但使用这些操作的模型在 token 成本显著更高的情况下,仅能获得边际收益甚至负收益,还可能反复裁剪无关区域,在直接推理能正确回答的问题上失败。本文研究返回的视觉证据是否会对答案产生因果影响,为此将视觉工具使用构建为因果图,区分观测介导路径与动作诱导捷径,并从三个层面进行干预审查:策略层面(对比工具使用与直接推理)、轨迹层面(在展开过程中破坏所有观测)、步骤层面(在固定前缀下反事实替换单个观测)。本文提出的步骤层面估计量为视觉证据增益,用于分离每个返回观测的贡献。在六个代表性模型和五个细粒度感知基准上,研究发现策略校准存在两种失败模式:“调用而不查看”即返回观测对答案无因果影响,“查看而不规划”即观测有信息但调用顺序不连贯。轨迹层面诊断分解了策略层面的准确率增益,显示增益集中在少数校准良好的情况中,本文将这种差异称为视觉工具使用的错觉:尽管整体准确率有增益,但视觉工具使用在大量展开过程中并无因果效果。代码可在该 https URL 获取。

英文摘要

The "thinking-with-images" paradigm equips multimodal LLMs with active visual operations such as crop-and-zoom. However, models using these operations often achieve only marginal or negative gains over direct inference at substantially higher token cost. They may also repeatedly crop irrelevant regions and fail on questions that direct inference answers correctly. We ask whether the returned visual evidence causally affects the answer. To answer this question, we formulate visual tool-use as a causal graph that separates observation-mediated paths from action-induced shortcuts. We then audit it through interventions at the three levels: policy (comparing tool-use with direct inference), trajectory (corrupting all observations during rollout), and step (counterfactually replacing one individual observation under a fixed prefix). Our step-level estimand, Visual Evidence Gain, isolates the contribution of each returned observation. Across six representative models and five fine-grained perception benchmarks, we uncover policy miscalibration with two failure modes. In Calling Without Looking, returned observations have no causal effect on the answer. In Looking Without Planning, observations are informative but the call schedule is incoherent. A trajectory-level diagnostic decomposes the policy-level accuracy gain and shows that the gain is concentrated in a Calibrated minority. We term this discrepancy the illusion of visual tool-use: despite aggregate accuracy gains, visual tool-use is not causally effective across a broad range of rollouts. The code is available at this https URL.

URL PDF HTML 收藏
2608.06265 2026-08-07 cs.AI cs.DB cs.LG 新提交

Improving the Realism of Synthetic Clinical Benchmarks Under Utility Constraints

在效用约束下提升合成临床基准的真实性

Omid Bazgir, Md Nasir, Jacob Hoffman, Yang Yang, Manu Agrawal, Anusua Trivedi, Vinay Rao Dandin, Chris Gibbons, Christine Swisher

机构 * Oracle Health and Life Sciences(甲骨文健康与生命科学部门)

AI总结 本文针对合成临床基准的结构不真实问题,提出在不破坏下游效用检查的前提下提升其真实性的方法,通过确定性修正改善基准指标,明确需将效用作为约束而非真实性的充分证据。

详情
AI中文摘要

面向企业AI智能体的合成临床基准虽可通过现有效用检查,仍可能存在结构不真实的问题,尤其在隐私敏感、难以获取运营数据的医疗场景中。本文研究如何在不破坏实际使用的下游效用检查的前提下改进这类基准,将基准修正定义为效用约束下的真实性提升:数据集的修改需在保持高于运营效用下限的同时提升真实性。本文在基于Synthea生成患者、经演示电子健康记录工作流程处理并与运营数据采用相同下游流程的护理差距基准上实例化该思路,真实性通过缺失结构、简洁性、结构合理性及人群对齐度衡量。基线基准极为单薄:采样对缺失率达79.44%,仅12.75%的行可操作,38.94%的患者无任何可操作指标,前三令牌集中度达100.0%。两种确定性修正可在保持高于当前效用下限的同时改善这些指标,而朴素的 densification 对照组则保留了不真实的模板化特征。本文进一步表明,基准内部真实性与对聚合运营参考的源保真度是相关但不同的目标。这些结果表明,应明确优化合成基准质量,将效用视为约束之一而非真实性的充分证据。

英文摘要

Synthetic clinical benchmarks for enterprise AI agents can pass existing utility checks and still remain structurally unrealistic, especially in privacy-sensitive healthcare settings where operational data are hard to access. We study how to improve such benchmarks without breaking the downstream utility checks already used in practice. We formulate benchmark revision as utility-constrained realism improvement: dataset changes should increase realism while staying above an operational utility floor. We instantiate this idea on a care-gap benchmark derived from Synthea-generated patients exercised through demonstration electronic health record workflows and then processed by the same downstream pipeline as operational data. Realism is measured through missingness structure, simplicity, structural plausibility, and population alignment. The baseline benchmark is extremely thin: sampled-pair missingness is 79.44%, only 12.75% of rows are actionable, 38.94% of patients have zero actionable measures, and top-three token concentration reaches 100.0%. Two deterministic revisions improve these panels while remaining above the current utility floor, whereas a naive densification control preserves unrealistic templating. We further show that internal benchmark realism and source fidelity to an aggregate operational reference are related but distinct objectives. These results suggest that synthetic benchmark quality should be optimized explicitly, with utility treated as one constraint rather than as sufficient evidence of realism.

URL PDF HTML 收藏
2608.06264 2026-08-07 cs.CV cs.LG eess.IV 新提交

OTLesMix: Wasserstein Barycenter and Optimal Transport Map for Synthetic Lesion Generation with Diverse Shapes and Locations

OTLesMix:用于生成形状与位置多样化合成病灶的Wasserstein重心与最优传输映射

Robin Trombetta, Carole Lartizien

机构 * Univ. Lyon(里昂大学) INSA Lyon(里昂国立应用科学学院) UCBL(里昂第一大学) CNRS(法国国家科学研究中心) Inserm(法国国家健康与医学研究院) CREATIS

AI总结 本研究提出OTLesMix方法,利用Wasserstein重心与最优传输映射生成多样化合成病灶,在三项脑病灶分割任务上使Dice分数提升2.9至6.6个百分点,性能优于现有混合类方法。

详情
AI中文摘要

过去十年深度学习的发展革新了医学图像分割,可从海量数据中提取精确描述符以表征病理特征。数据增强被广泛认为是提升模型训练效果的技术,既包含空间操作、强度修改等简单变换,也包含更先进的合成技术,其目标是从现有数据集生成新的真实样本,以丰富训练所用图像。其中多项研究提出不同混合策略来结合真实样本,但这些方法的主要缺陷之一是生成病灶的形状与位置多样性有限。本研究提出一种名为OTLesMix的新型图像合成方法,利用Wasserstein重心与最优传输计划生成真实且多样化的样本。我们在三项脑病灶分割任务上评估了该方法,结果显示,与未使用合成数据训练的模型相比,该方法使Dice分数提升了2.9至6.6个百分点,且优于现有最先进的基于混合的方法。

英文摘要

The development of deep learning over the past decade has revolutionized medical imaging segmentation, allowing the extraction of precise descriptors from large volumes to characterize pathologies. Data augmentation is a technique widely regarded as a way to improve model training. It includes simple transformations like spatial operations or intensity modifications, but also more advanced synthesis techniques. Their goal is to generate new realistic samples from an existing dataset to diversify the images used during training. Among them, several propose different mixing strategies to combine real samples. However, one of their major shortcomings is to yield limited variability in terms of generated lesion shapes and locations. In this work, we introduce a novel image synthesis method, called OTLesMix, that leverages Wasserstein barycenter and optimal transport plan to generate realistic and diverse samples. We evaluated our method on three brain lesion segmentation tasks, on which it improves the Dice score compared to a model trained without synthetic data by 2.9 to 6.6 points, and outperforms state-of-the-art mix-based methods.

URL PDF HTML 收藏
2608.06259 2026-08-07 cs.LG 新提交

RxnCLF: Contrastive Transformation-Aware Reaction Foundation Model for Improved Reactivity Prediction

RxnCLF:用于改进反应性预测的感知变换的反应基础模型

Yiting Zheng, Cheng Fang, Anthony Donofrio, Haote Li

机构 * Discovery Chemistry, Merck & Co., Inc.(默克公司发现化学部门)

AI总结 本研究提出RxnCLF,一种基于凝聚反应图的自监督对比反应基础模型,经170万Pistachio反应预训练后,在多类产率预测基准上均优于基线模型,展现出良好泛化潜力。

Comments 8 pages, 6 figures

详情
AI中文摘要

反应产率预测仍面临挑战,原因在于标注数据稀缺,且反应空间兼具组合规模庞大与稀疏分布的特点,这限制了现有反应表示的泛化能力。基于字符串、指纹和图的反应编码仅能部分捕捉化学变换,致使复杂底物反应的准确预测难度较大。我们提出反应对比学习基础模型(RxnCLF),这是一种用于反应表示学习的自监督对比框架。RxnCLF构建于凝聚反应图(CRG)之上,该图将反应物与产物信息统一为单张图,使模型能够学习显式且丰富的变换结构,而非分离的图结构。在170万个Pistachio反应上进行预训练后,RxnCLF学习到一个紧凑且连续的潜在空间,该空间既包含反应中心特征,又涵盖更广泛的侧链上下文,使其具备变换感知能力和化学可解释性。在多个产率预测基准上进行微调后,包括Buchwald-Hartwig、钯催化的BH偶联,以及专有HTE C-N偶联和酰胺形成数据集,RxnCLF始终优于基于图和序列的基线模型,提升了R²值并实现了整体最佳性能。我们的结果凸显了基于CRG的RxnCLF作为可扩展反应基础模型的潜力,其有望在更广泛的反应空间中泛化,并支持多种下游反应信息学任务,包括区域选择性预测、对映选择性预测以及反应条件优化。

英文摘要

Reaction yield prediction remains challenging because labeled data are scarce and reaction space is both combinatorially large and sparsely populated, limiting the generalization of existing reaction representations. String-, fingerprint-, and graph-based reaction encodings only partially capture chemical transformations, making accurate prediction difficult for reactions with complex substrates. We propose reaction contrastive learning foundation (RxnCLF), a self-supervised contrastive framework for reaction representation learning. RxnCLF is built on a condensed reaction graph (CRG) that unifies reactant and product information into a single graph, enabling the model to learn explicit and enriched transformation structure rather than disconnected graphs. Pretrained on 1.7 million Pistachio reactions, RxnCLF learns a compact and continuous latent space that captures both reaction-center features and broader side chain contexts, making it transformation-aware and chemically interpretable. Fine-tuned on multiple yield prediction benchmarks, including Buchwald-Hartwig, Pd-catalyzed BH coupling, and proprietary HTE C-N coupling and amide formation datasets, RxnCLF consistently outperforms graph and sequence-based baselines, improving R2 and achieving the best performance overall. Our results highlight the promise of CRG-based RxnCLF as a scalable reaction foundation model, with the potential to generalize across broader reaction spaces and support diverse downstream reaction informatics tasks, including regioselectivity prediction, enantioselectivity prediction, and reaction condition optimization.

URL PDF HTML 收藏
2608.06257 2026-08-07 cs.CV cs.HC 新提交

MASS: Multiplayer World Models with Authoritative Shared State

MASS:具有权威共享状态的多人世界模型

Ziqi Cai, Siqi Yang, Yimu Wang, Zixian Gao, Yunheng Liu, Shuchen Weng, Erwin Wu, Kaipeng Zhang, Boxin Shi

机构 * Alaya Lab(Alaya实验室) Peking University(北京大学) Institute of Science Tokyo(东京科学大学)

AI总结 该研究提出MASS模型,通过将世界动态与视图渲染解耦,解决现有视频世界模型在多人环境中的缺陷,在多人Snake基准测试中实现更优状态精度,为多智能体世界模拟提供实用基础。

详情
AI中文摘要

当前视频世界模型在多人环境中表现不佳,因为它们将世界状态与依赖视图的视觉潜变量纠缠在一起,导致计算冗余、视图不一致性和可扩展性差。我们提出MASS(具有权威共享状态的多人世界模型)来解决这一局限。受多人游戏架构启发,MASS将世界动态与视图渲染解耦。一个学习得到的逻辑引擎从联合动作推进全局的、权威的类型化状态,无需任何手动编写的转移函数,充当唯一的循环记忆和同步参考。从该共享状态出发,一个学习得到的渲染引擎可按需为任意请求的相机生成独立且一致的视图。这种显式解耦使MASS在匹配的多人Snake基准测试中,相较于最先进的多视图基线,实现了更优的状态精度和更低的跨视图不一致性。它推进了包含1024个并发玩家的预测世界,共10000个循环步骤。我们的结果表明,显式的权威状态建模为可扩展且一致的多智能体世界模拟提供了实用基础。

英文摘要

Current video world models struggle in multiplayer environments because they entangle world state with view-dependent visual latents, leading to redundant compute, view inconsistencies, and poor scalability. We propose MAS (Multiplayer world models with Authoritative Shared State) to resolve this limitation. Inspired by multiplayer game architectures, MAS disentangles world dynamics and view rendering. A learned Logic Engine advances a global, authoritative typed state from joint actions without any hand-written transition function, acting as the sole recurrent memory and synchronization reference. From this shared state, a learned Rendering Engine generates independent and consistent views for any requested camera on demand. This explicit disentangling allows MAS to achieve superior state accuracy and lower cross-view inconsistency compared to state-of-the-art multi-view baselines on a matched multiplayer Snake benchmark. It advances predicted worlds with 1,024 concurrent players for 10,000 recurrent steps. Our results show that explicit, authoritative state modeling provides a practical foundation for scalable and consistent multi-agent world simulation.

URL PDF HTML 收藏
2608.06252 2026-08-07 cs.CV cs.AI 新提交

Toward Deployable Bangla Sign Language Recognition with Expert-Validated Data and a Lightweight Attention-Based Model

面向可部署的孟加拉语手语识别:基于专家验证数据与轻量型注意力模型

Saad Ahmed, Md Khalid Syfullaha

机构 * Bangladesh Army University of Science and Technology(孟加拉国陆军科技大学)

AI总结 本文构建专家验证的RSBdSL38数据集,提出轻量型注意力卷积网络,实现高准确率孟加拉语手语识别,模型可在普通智能手机部署,相关资源已公开。

详情
AI中文摘要

孟加拉国的聋人和听障人士主要通过孟加拉语手语(BdSL)进行交流,在个人设备上实现自动BdSL识别可拓宽其获取教育与服务的渠道。现有系统使用的数据集来自受控场景,且未经过专家验证,同时采用的重型预训练主干网络不适合在设备端使用。本文提出RSBdSL38数据集,包含10874张经专家验证的图像,覆盖全部38种BdSL手势,对应孟加拉语字母表的51个字母,由孟加拉国三所特殊学校的真实手语使用者录制完成。本文提出一种基于注意力的轻量型卷积网络,参数规模为298470,由分组瓶颈残差块、通道与空间注意力模块、多尺度深度手部特征块、双池化层及Swish激活函数构建而成。该模型从零开始训练,准确率达96.37%(5个随机种子的均值为95.72%±0.54%),在相同协议下,与9种基于ImageNet预训练的高效架构中表现最佳的模型相比,准确率仅低1.08个百分点,但参数数量减少8.5至68倍,MACs减少1.3至21.7倍。经重新训练后,该模型在6个公开BdSL基准上的准确率为92.95%至98.33%,在合并语料库上的准确率为97.04%,在BdSL-38上的零样本准确率为76.25%。移除任意一个架构阶段会导致准确率下降7.61至89.30个百分点,而训练配方的影响最多为3.17个百分点。结合删除-插入与权重随机化检验的Grad-CAM分析证实,模型预测依据为手语使用者的手部。在36名手语使用者中留出6名作为独立测试集的情况下,模型准确率为85.18%。将模型量化至0.48 MB后,在普通智能手机上运行时,单张图像推理耗时3.98 ms,内存占用为15.5 MB。综上,RSBdSL38数据集与本文提出的从零开始训练的模型,以远低于预训练主干网络的成本,将基准准确率转化为可部署的易用性;相关数据集、代码与模型已公开。

英文摘要

Deaf and hard-of-hearing people in Bangladesh communicate mainly through Bangla Sign Language (BdSL). Automatic BdSL recognition on personal devices could widen access to education and services. Existing systems use controlled-setting datasets without expert verification and heavyweight pretrained backbones unsuited to on-device use. We introduce RSBdSL38, 10,874 expert-validated images spanning all 38 BdSL hand signs, representing the 51 letters of the Bangla alphabet, recorded from real signers at three special-needs schools across Bangladesh. We propose a lightweight attention based convolutional network of 298,470 parameters, built from grouped bottleneck residual blocks, channel and spatial attention, a multi-scale depthwise hand-feature block, dual pooling, and Swish activations. Trained from scratch, it attains 96.37% accuracy (95.72% +- 0.54% over five seeds), within 1.08 percentage points of the best of nine ImageNet-pretrained efficient architectures under an identical protocol, using 8.5 to 68x fewer parameters and 1.3 to 21.7x fewer MACs. Retrained, it reaches 92.95 to 98.33% on six public BdSL benchmarks, 97.04% on a merged corpus, and 76.25% zero-shot on BdSL-38. Removing any architectural stage costs 7.61 to 89.30 points, against at most 3.17 for the training recipe. Grad-CAM with deletion-insertion and weight-randomization checks confirms that predictions follow the signing hand. A signer-independent split holding out 6 of 36 signers yields 85.18%. Quantized to 0.48 MB, it runs at 3.98 ms per image within a 15.5 MB footprint on a commodity smartphone. Together, RSBdSL38 and our from-scratch model turn benchmark accuracy into deployable accessibility at a fraction of pretrained-backbone cost; dataset, code, and models are released.

URL PDF HTML 收藏
2608.06240 2026-08-07 cs.CV cs.AI 新提交

PRISM: Distribution-Gated Flow Matching for Controllable Unpaired Image Translation

PRISM:用于可控非配对图像翻译的分布门控流匹配

Elad Yoshai, Natan T. Shaked

机构 * Tel Aviv University(特拉维夫大学)

AI总结 PRISM是一种无GAN的流匹配框架,通过分布门控实现可控非配对图像翻译,在5个自然与生物医学基准上,其在多数任务的Inception FID、KID及组织病理学细胞核计数比上表现优异,平衡了目标逼真度与结构保留。

详情
AI中文摘要

非配对图像到图像翻译需在无配对监督的情况下,为每张图像决定要更改和保留的内容。许多基于扩散的非配对翻译器通过应用于整张图像的单一全局噪声或引导值来控制保留内容,无法区分需保留的内容与需更改的外观。本文提出PRISM,一种无GAN的流匹配框架,用学习得到的逐特征门控替代该全局控制。该门控的空间先验源自每个源特征与目标特征分布的标准化距离,因此远离目标的特征可被释放,与目标一致的特征则被保留。该门控同时控制初始化(将真实源潜变量与任务匹配的损坏混合)和常微分方程(ODE)积分期间的传输时序。损坏与任务匹配:对于结构保留翻译采用内容锚定的AdaIN,对于结构变化翻译采用部分锚定。推理时可从文本或检测器局部覆盖该门控,无需重新训练,在保留原始图像重要结构的同时仍能生成逼真结果。我们在5个自然和生物医学基准(AFHQ猫→狗、CelebA-HQ外观翻译、白天→夜晚重照明、虚拟染色及乳腺冷冻→永久组织病理学)上评估PRISM。在相同拆分协议下,所评估方法中,PRISM在4个基准上取得最佳Inception FID和KID,在第5个基准上取得有竞争力的结果,且在组织病理学任务中,其细胞核计数比最接近理想值,支持在目标逼真度与结构保留间实现良好平衡。

英文摘要

Unpaired image-to-image translation must decide, per image, what to change and what to preserve without paired supervision. Many diffusion-based unpaired translators control preservation through a single global noise or guidance value applied across the image, which cannot separate content to keep from appearance to change. We present PRISM, a GAN-free flow-matching framework that replaces this global control with a learned per-feature gate. The gate's spatial prior is derived from each source feature's standardized distance to the target feature distribution, so features far from the target are freed while target-consistent features are preserved. The same gate controls both the initialization, which mixes the real source latent with a task-matched corruption, and the transport timing during Ordinary Differential Equation (ODE) integration. The corruption is matched to the task, content-anchored (AdaIN) for structure-preserving translation and partially anchored for structure-changing translation, and the gate can be overridden locally at inference from text or a detector without retraining, preserving important structures of the original image while still generating realistic results. We evaluate PRISM on five natural and biomedical benchmarks (AFHQ cat->dog, CelebA-HQ appearance translation, day->night relighting, virtual staining, and breast frozen->permanent histopathology). Among the evaluated methods under a shared same-split protocol, PRISM attains the best Inception FID and KID on four benchmarks and a competitive result on the fifth, and on histopathology yields the nuclei-count ratio closest to the ideal, supporting a favorable balance between target realism and structural preservation.

URL PDF HTML 收藏
2608.06223 2026-08-07 cs.AI cs.LG 新提交

TS-RAG: Retrieval Augmented Generation for Time Series Forecasting

TS-RAG:面向时间序列预测的检索增强生成

Yixiong Xiao, Congxi Xiao, Jingbo Zhou

机构 * Baidu, Inc.(百度公司)

AI总结 针对时间序列预测模型的局限,提出TS-RAG框架,引入参考token融合输入与检索序列信息,在多个真实预测基准上实现最优性能。

详情
AI中文摘要

尽管深度学习模型,尤其是基于Transformer的架构,在时间序列预测中已展现出出色性能,但检索增强生成(RAG)在该领域的应用仍十分有限。由于RAG已被证实能通过整合相关外部信息提升大语言模型的能力,检索相似时间序列序列作为参考或许也能提高时间序列预测任务的准确性。然而,大多数时间序列模型受限于有限的训练数据、较小的参数规模,以及缺乏大语言模型具备的广泛生成能力。像在语言模型中那样简单地将参考序列拼接进提示词,可能无法得到预期结果。为应对这些挑战,我们提出一种新方法TS-RAG,利用RAG提升预测性能。该框架引入专门设计的参考token,以有效融合输入序列与检索到的相似序列的信息,从而更稳健地捕捉复杂的时间动态。实验结果表明,TS-RAG在多个真实世界预测基准上均达到一致的最先进性能。

英文摘要

While deep learning models, particularly transformer-based architectures, have shown impressive performance in time series forecasting, the application of retrieval-augmented generation (RAG) in this domain remains limited. Since RAG has proven effective in enhancing the capabilities of large language models by incorporating relevant external information, retrieving similar time series sequences as references might also improve accuracy in time series forecasting tasks. However, most time series models are constrained by limited training data, smaller parameter scales, and a lack of the extensive generative capabilities found in large language models. Simply concatenating reference sequences into the prompt, as done in language models, may not yield the expected results. To address these challenges, we propose a novel approach, TS-RAG, which leverages RAG to enhance forecasting performance. The framework introduces specially designed reference tokens to effectively fuse information from the input sequence with that from retrieved similar sequences, enabling a more robust capture of complex temporal dynamics. Experimental results demonstrate that TS-RAG achieves consistent state-of-the-art performance across several real-world forecasting benchmarks.

URL PDF HTML 收藏
2608.06221 2026-08-07 cs.RO cs.HC cs.LG 新提交

Robot Learning from Human Demonstrations: Handwritten Alphabet Trajectories and Human-Likeness Evaluation

机器人从人类演示中学习:手写字母轨迹与类人性评估

Alperen Kenan, Paul Bremner, Manuel Giuliani

机构 * University of the West of England(西英格兰大学) Bristol Robotics Laboratory(布里斯托机器人实验室) Kempten University of Applied Sciences(肯普滕应用科学大学)

AI总结 该研究提出LfD框架,构建含力与归一化时间维度的GMM-GMR方法,基于3142个手写演示数据集,经21人用户研究生成类人性得分71.50的轨迹,开源数据集提供基准。

Comments 9 pages, 7 figures, 4 tables, accepted for presentation at the IEEE International Conference on Development and Learning (ICDL) 2026, Kyoto, Japan, 15-18 September 2026

详情
AI中文摘要

从演示中学习(LfD)提供了一种开发框架,机器人可通过观察和模仿人类动力学来发展运动技能,减少了向机器人教授技能时对显式编程的依赖。生成的类人机器人运动被认为是建立信任、实现人机自然协作的关键因素。本文提出了一种从演示中学习类人机器人运动的框架,包括数据收集、概率轨迹学习和感知用户评估。通过触摸屏遥操作界面,从22名参与者处收集了3142个手写演示的数据集,涵盖全部52种拉丁字母的大小写组合,采集了平面位置、接触力和时间信息。基于LfD中广泛使用的高斯混合模型(Gaussian Mixture Model)与高斯混合回归(Gaussian Mixture Regression)方法,本研究对该框架进行了扩展,纳入力和归一化时间维度以实现人类动力学的更丰富表示,并使其适应非连续多段轨迹,从而实现跨演示的泛化。一项由21名参与者参与的用户研究,使用介于机器人运动和类人运动之间的连续量表评估生成轨迹的感知类人性,量表归一化为0-100,其中50为中性中点。生成轨迹的总体类人性得分为71.50(标准差SD=22.56),表明大多数轨迹被感知为更具类人性。参与者指出几何定位和轨迹序列是最具影响力的感知因素,并对类人机器人行为持积极态度。该数据集作为开源资源发布,为开发和评估类人机器人运动方法提供了可复现的基准。

英文摘要

Learning from demonstration (LfD) provides a developmental framework through which robots can develop motor skills by observing and imitating human dynamics, reducing reliance on explicit programming to teach a skill to a robot. The resulting human-like robot motion is recognised as a key factor in building trust and enabling natural collaboration in human-robot interaction. This paper presents a framework for learning human-like robot motion from demonstration, including data collection, probabilistic trajectory learning, and perceptual user evaluation. A dataset of 3,142 handwriting demonstrations was collected from 22 participants across all 52 Latin alphabet character-case combinations via a touchscreen teleoperation interface, capturing planar position, contact force, and timing. Building on the widely used Gaussian Mixture Model and Gaussian Mixture Regression approach for learning from demonstration, the framework is extended in this work by incorporating force and normalised time dimensions to enable richer representation of human dynamics, and adapting it to handle non-continuous, multi-segment trajectories, enabling generalisation across demonstrations. A user study with 21 participants evaluated the perceived human-likeness of the generated trajectories using a continuous scale anchored between robotic and human-like motion, normalised to 0-100 where 50 represents the neutral midpoint. The generated trajectories achieved an overall human-likeness score of 71.50 (SD=22.56), indicating that the majority of trajectories were perceived as more human-like. Participants identified geometric positioning and trajectory sequence as the most influential perceptual factors, and reported positive attitudes toward human-like robot behaviour. The datasets are released as open-source, providing a reproducible benchmark for developing and evaluating human-like robot motion methods.

URL PDF HTML 收藏
2608.06219 2026-08-07 cs.RO cs.HC 新提交

Design and Evaluation of a Touchscreen-Based Teleoperation Interface for Robotic Manipulators

面向机械臂的触摸屏远程操作界面的设计与评估

Juan José García Cárdenas, Alperen Kenan, Hamidreza Raei, Paul Bremner, Manuel Giuliani, Arash Ajoudani, Adriana Tapus

机构 * Institut Polytechnique de Paris(巴黎综合理工学院) University of the West of England(西英格兰大学) IIT(意大利理工学院) Kempten University of Applied Sciences(肯普滕应用技术大学)

AI总结 本研究设计并评估了一种用于机械臂的触摸屏远程操作界面,经20名参与者对比测试,该界面可缩短任务时间、提升路径精度并降低认知负荷,优于传统操纵杆。

Comments 9 pages, 7 figures, accepted for presentation at the IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2026), Kitakyushu, Japan, 24-28 August 2026

详情
AI中文摘要

直观的远程操作界面对于在复杂环境中安全、有效地操作机械臂至关重要。在核工业中,擦拭采样等表面接触任务需要精确的路径与力跟踪、避障以及操作员持续的注意力,而传统的操纵杆界面难以有效支持这些需求。本研究设计并评估了一种新型触摸屏远程操作界面,该界面将连续的手指动作直接映射到机械臂的运动,提供更精细的速度控制,并将控制与可视化相结合,相比传统控制器,可实现更自然、精确且直观的表面交互。研究开展了包含20名参与者的对比用户研究,使用所提出的触摸屏、传统操纵杆和一键自主模式,评估任务性能与工作量。任务采用Franka Emika Panda机械臂模拟真实的表面操作,操作员从另一国家进行远程控制。研究记录了运动学、生理学和行为数据,以全面评估各控制条件下的任务性能、认知负荷和操作员信任度。结果显示,与操纵杆相比,参与者使用触摸屏界面完成远程操作任务的效率和准确性更高,完成时间中位数减少53.5%(2.50分钟对比5.38分钟),正弦路径的区域内覆盖率更高(90.7%对比84.1%),两种路径几何形状的超调量更低;通过NASA-TLX量表(0-100)量化的认知负荷,从操纵杆到触摸屏平均降低9分(52对比43,降幅17.3%),而一键自主模式下认知负荷最低(31,较操纵杆降低21分、降幅40.4%,较触摸屏降低12分、降幅27.9%)。本研究提出了一种易于实现的触摸屏界面,可提升远程操作表面任务的性能,同时降低认知负荷。

英文摘要

Intuitive teleoperation interfaces are crucial for the safe and effective operation of robotic manipulators in challenging environments. In the nuclear industry, surface contact tasks such as swab sampling require precise path and force tracking, obstacle avoidance, and sustained operator attention, which conventional joystick interfaces struggle to support effectively. This study designs and evaluates a novel touchscreen teleoperation interface that maps continuous finger movements directly to robotic manipulator motions, provides finer velocity control, and integrates control with visualization, enabling more natural, precise, and intuitive surface interaction than conventional controllers. A comparative user study with 20 participants evaluated task performance and workload using the proposed touchscreen, a conventional joystick, and a single-click autonomous mode. Tasks simulated realistic surface manipulation using a Franka Emika Panda arm, remotely controlled from another country. Kinematic, physiological, and behavioral data were recorded to comprehensively assess task performance, cognitive load, and operator trust across each control condition. Participants completed teleoperation tasks more efficiently and accurately with the touchscreen interface, achieving a 53.5% reduction in completion time (median: 2.50 vs. 5.38 min), higher in-area coverage on the sinusoidal path (90.7% vs. 84.1%), and lower overshoot on both path geometries compared with the joystick. Cognitive load, quantified via NASA-TLX (0-100), decreased from joystick to touchscreen (mean TLX 52 to 43; -9 points, -17.3%) and was lowest under the autonomous one-click mode (31; -21 points vs. joystick, -40.4%; -12 vs. touchscreen, -27.9%). This research presents an easy-to-implement touchscreen interface that improves performance in teleoperated surface tasks while reducing cognitive load.

URL PDF HTML 收藏
2608.06216 2026-08-07 cs.LG cs.AI 新提交

Continual Learning in Transition

过渡中的持续学习

Zhiyan Hou, Dan Zhang, Tao Feng, Liyuan Wang, Wei Li, Xiangzhao Hao, Hongyan An, Junfeng Fang, Haokai Ma, Zhaohui Xu, Haiyun Guo, Jinqiao Wang, Tat-Seng Chua

机构 * Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所) National University of Singapore(新加坡国立大学)

AI总结 本文系统综述持续学习从以参数为中心向系统级适配的转变,通过时机、方式、位置三轴框架分析其演化,讨论相关挑战与未来方向。

Comments 23 pages, 6 figures, 1 table. Survey on continual learning in the LLM and agentic-AI era

详情
AI中文摘要

经典持续学习(CL)主要聚焦于通过以参数为中心的机制,如训练策略、架构设计和权重适配,使模型能够更新并保留知识。然而,新兴范式正重塑CL的范围,使其超越这种传统的模型适配视角。例如,策略内学习拓宽了更新机制的空间;测试时训练将CL从训练阶段扩展到推理阶段;而外部控制组件,如记忆、技能库和交互协议,将模型能力的演化边界扩展到远超出静态参数空间的范围。总体而言,这些发展表明一种从以参数为中心的学习向系统级适配的转变。为了表征这种转变,我们从三个维度考察持续学习的演化:学习发生的时机(When)、方式(How)和位置(Where)。How维度涵盖策略外、策略内以及超越梯度的优化机制;When维度涵盖预训练、训练后和推理时阶段的演化;Where维度划分内部参数与外部结构约束内发生的更新。基于这一三轴框架,我们系统地综述了代表性方法,追踪了持续学习正在发生的转变,并讨论了这一范式转变带来的关键挑战、更广泛的影响以及未来方向。

英文摘要

Classical continual learning (CL) has primarily focused on enabling models to update and retain knowledge through parameter-centric mechanisms, e.g., training strategies, architectural designs, and weight adaptation. However, emerging paradigms are reshaping the scope of CL beyond this traditional model adaptation view. For instance, on-policy learning broadens the space of update mechanisms; test-time training extends CL from the training phase to inference; and external harness components such as memory, skill libraries, and interaction protocols extend the evolutionary boundaries of model capabilities far beyond the static parameter space. Collectively, these developments indicate a transition from parameter-centric learning toward system-level adaptation. To characterize this transition, we examine the evolution of continual learning through three dimensions: When, How, and Where learning occurs. The How dimension encompasses off-policy, on-policy, and beyond-gradient optimization mechanics. The When dimension captures evolution across pre-training, post-training, and inference-time stages. The Where dimension delineates updates occurring within internal parameters versus external structural constraints. Anchored by this tri-axial framework, we systematically survey representative methods, trace the ongoing transition of continual learning, and discuss the key challenges, broader implications, and future directions arising from this paradigm shift.

URL PDF HTML 收藏
2608.06208 2026-08-07 cs.RO 新提交

ErgoSurf: Ergodic Control for the Coverage of Unknown Surfaces

ErgoSurf:用于未知表面覆盖的遍历控制

Stefan Schneyer, Timo Bachmann, Maged Iskandar, Korbinian Nottensteiner, Alin Albu-Schäffer, Freek Stulp, João Silvério

机构 * German Aerospace Center (DLR)(德国航空航天中心) Technical University of Munich (TUM)(慕尼黑工业大学)

AI总结 提出ErgoSurf框架,结合GPIS模型与触觉传感,实现未知表面的遍历覆盖与几何在线学习,经仿真和真实机器人实验验证有效。

详情
AI中文摘要

以表面为中心的接触型任务,包括检查、清洁、打磨和抛光等,要求机器人在保持稳定接触的同时系统性地覆盖该表面。遍历控制生成的轨迹会在某一位置停留的时间与任务特定的期望空间分布成正比,从而实现高效的信息采集和覆盖。然而,传统遍历控制方法依赖表面几何的先验知识,或需要视觉传感器输入来预先扫描几何结构,限制了其在未知或动态环境等真实场景中的适用性。本文提出一种新颖的在线遍历控制框架,可实现系统性表面覆盖,同时重构未知表面几何结构。我们采用高斯过程隐式表面(GPIS)模型,在执行过程中从固有触觉传感学习全局表面几何。为实现高效在线规划,我们用观测接触点处切平面采样的点云局部近似表面,并将其迭代拟合到高斯过程中。该近似同时作为目标分布和覆盖分布的采样域。我们采用热扩散类比计算引导遍历探索的势场,将空间覆盖目标转化为平滑的机器人轨迹。我们通过仿真和真实机器人实验验证了该框架,证实其可同时实现遍历覆盖和在线表面几何学习,重构误差接近真实值。

英文摘要

Contact-centric tasks on surfaces, ranging from inspection and cleaning to sanding and polishing, require robots to systematically cover the surface while maintaining stable contact. Ergodic control generates trajectories that spend time at a location proportional to a desired, task-specific spatial distribution, enabling efficient information gathering and coverage. However, traditional ergodic control methods rely on prior knowledge of surface geometry or require a vision sensory input to scan the geometry beforehand, limiting their applicability in real-world scenarios with unknown or dynamic environments. This paper introduces a novel online ergodic control framework that achieves systematic surface coverage while simultaneously reconstructing unknown surface geometry. We employ a Gaussian Process Implicit Surface (GPIS) model that learns global surface geometry from intrinsic tactile sensing during execution. For efficient online planning, we approximate the surface locally using point clouds sampled from tangent planes at observed contact points and iteratively fit them to the Gaussian Process. This approximation simultaneously serves as the sampling domain for both the target and the coverage distributions. We employ a heat-diffusion analogy to compute potential fields that guide ergodic exploration, translating spatial coverage objectives into smooth robot trajectories. We demonstrate our framework through simulation and real-robot experiments, validating simultaneous ergodic coverage and online surface geometry learning with reconstruction errors approaching the ground truth.

URL PDF HTML 收藏