arXivDaily arXiv每日学术速递 周一至周五更新
重置
全部学科分类 2117
2506.18493 2026-06-12 cs.CV 版本更新

ShowFlow: From Robust Single Concept to Condition-Free Multi-Concept Generation

ShowFlow: 从鲁棒的单概念到无条件的多概念生成

Trong-Vu Hoang, Quang-Binh Nguyen, Thanh-Toan Do, Tam V. Nguyen, Minh-Triet Tran, Trung-Nghia Le

发表机构 * University of Science(科学大学) Vietnam National University(越南国家大学) Monash University(墨尔本大学) University of Dayton(Dayton大学)

AI总结 提出ShowFlow框架,通过KronA-WED适配器和语义感知注意力正则化增强单概念生成,并利用SAMA和布局一致性指导实现无额外条件的多概念生成。

详情
AI中文摘要

定制化图像生成仍然是可控图像合成中的核心挑战。对于单概念生成,保持身份保留和提示对齐是困难的。在多概念场景中,仅依赖提示而不使用布局框或语义掩码等额外条件,通常会导致身份丢失和概念遗漏。在本文中,我们介绍了ShowFlow,一个旨在应对这些挑战的全面框架。我们提出了用于单概念图像生成的ShowFlow-S,以及用于处理多个概念的ShowFlow-M。ShowFlow-S引入了一个KronA-WED适配器,它将Kronecker适配器与权重和嵌入分解相结合,并配合一种新颖的语义感知注意力正则化(SAR)训练目标,以增强单概念生成。在此基础上,ShowFlow-M直接重用由ShowFlow-S学习的鲁棒模型,以支持无需额外条件的多概念生成,并集成了主体自适应匹配注意力(SAMA)和布局一致性指导作为即插即用模块。大量实验和用户研究验证了ShowFlow的有效性,突显了其在广告和虚拟试穿等实际应用中的潜力。我们的源代码将在以下网址公开:this https URL。

英文摘要

Customizing image generation remains a core challenge in controllable image synthesis. For single-concept generation, maintaining both identity preservation and prompt alignment is challenging. In multi-concept scenarios, relying solely on a prompt without additional conditions like layout boxes or semantic masks, often leads to identity loss and concept omission. In this paper, we introduce ShowFlow, a comprehensive framework designed to tackle these challenges. We propose ShowFlow-S for single-concept image generation, and ShowFlow-M for handling multiple concepts. ShowFlow-S introduces a KronA-WED adapter, which integrates a Kronecker adapter with weight and embedding decomposition, and together with a novel Semantic-Aware Attention Regularization (SAR) training objective to enhance single-concept generation. Building on this foundation, ShowFlow-M directly reuses robust models learned by ShowFlow-S to support multi-concept generation without extra conditions, incorporating a Subject-Adaptive Matching Attention (SAMA) and a Layout Consistency guidance as the plug-and-play module. Extensive experiments and user studies validate ShowFlow's effectiveness, highlighting its potential in real-world applications like advertising and virtual dressing. Our source code will be publicly available at: https://htrvu.github.io/showflow.

2604.20236 2026-06-12 cs.LG 版本更新

Machine Learning-based Two-Stage Graph Sparsification for the Travelling Salesman Problem

基于机器学习的两阶段图稀疏化方法用于旅行商问题

Bo-Cheng Lin, Yi Mei, Mengjie Zhang

发表机构 * Centre for Data Science and Artificial Intelligence(数据科学与人工智能中心) School of Engineering and Computer Science(工程与计算机科学学院) Victoria University of Wellington(惠灵顿维多利亚大学)

AI总结 提出两阶段方法,先结合α-Nearest和POPMUSIC得到近完美召回率的候选图,再用轻量级分类器修剪单源边,在保持≥99.69%最优边的同时降低37%-47%密度。

详情
AI中文摘要

高性能TSP求解器(如Lin-Kernighan-Helsgaun (LKH))在\emph{候选图}(为求解器预先选定的边的小子集)中搜索,而不是在完整图上搜索。两种主要的稀疏化启发式方法,$\alpha$-Nearest和POPMUSIC,各自在密度-覆盖率平衡上存在不足:$\alpha$-Nearest密集且召回率稳定,而POPMUSIC更稀疏但其召回率随规模增大而下降。它们的并集在密度上远低于完整图的同时弥补了召回率差距,为进一步缩减留下了空间。现有的基于学习的稀疏化方法在完整图上对边评分,这种方法代价高昂且主要限于欧几里得实例。我们提出了一种两阶段方法,反转了这一逻辑。第一阶段取$\alpha$-Nearest和POPMUSIC的并集,在${\sim}6N$条边上实现近乎完美的召回率。关键在于,并集为每条边标注了其\emph{来源出处}——即它是由$\alpha$-Nearest、POPMUSIC还是两者共同支持的。第二阶段在这些标注边上训练一个轻量级分类器,并修剪得分最低的边。由于双源边几乎总是最优的,学习问题简化为过滤单源子集——这比从头开始对所有$O(N^2)$条边进行分类要容易得多。在四种距离类型、五种空间分布以及50到500的问题规模上,该流程将候选图密度降低了37%-47%,同时保留了${\geq}99.69\%$的最优旅行边,并且在TSP500上以更低的密度达到或超过了近期仅限欧几里得的神经稀疏化方法的覆盖率。

英文摘要

High-performance TSP solvers such as Lin-Kernighan-Helsgaun (LKH) search within a \emph{candidate graph} -- a small subset of edges pre-selected for the solver -- rather than over the complete graph. The two leading sparsification heuristics, $α$-Nearest and POPMUSIC, each fall short of the density-coverage balance: $α$-Nearest is dense with stable recall, while POPMUSIC is sparser but its recall degrades with scale. Their union closes the recall gap while remaining far below the complete graph in density, leaving room for further reduction. Existing learning-based sparsifiers score edges on the complete graph, an approach that is expensive and largely limited to Euclidean instances. We propose a two-stage method that inverts this logic. Stage~1 takes the union of $α$-Nearest and POPMUSIC, achieving near-perfect recall at ${\sim}6N$ edges. Crucially, the union annotates each edge with its \emph{source provenance} -- whether it was endorsed by $α$-Nearest, POPMUSIC, or both. Stage~2 trains a lightweight classifier on these annotated edges and prunes the lowest-scoring ones. Because dual-source edges are almost always optimal, the learning problem reduces to filtering the single-source subset -- a substantially easier task than classifying all $O(N^2)$ edges from scratch. Across four distance types, five spatial distributions, and problem sizes from 50 to 500, the pipeline reduces candidate-graph density by $37$-$47\%$ while retaining ${\geq}99.69\%$ of optimal-tour edges, and matches or exceeds the coverage of recent Euclidean-only neural sparsifiers at lower density at TSP500.

2604.18307 2026-06-12 cs.CL 版本更新

Reasoning Models Know What's Important, and Encode It in Their Activations

推理模型知道什么重要,并在其激活中编码

Yaniv Nikankin, Martin Tutek, Tomer Ashuach, Jonathan Rosenfeld, Yonatan Belinkov

发表机构 * Technion(技术离子大学) University of Zagreb, FER(扎格雷布大学,FER) MIT(麻省理工学院) Kempner Institute, Harvard(哈佛大学凯普纳研究所)

AI总结 通过分析模型激活而非仅依赖推理链文本,发现激活能更有效识别关键推理步骤,且模型在生成后续步骤前已内部编码步骤重要性。

详情
AI中文摘要

语言模型通常通过生成包含许多重要性不同的步骤的长推理链来解决复杂任务。虽然某些步骤对生成最终答案至关重要,但其他步骤是可移除的。确定哪些步骤最重要以及为什么,仍然是理解模型如何处理推理的核心开放问题。我们研究了这个问题是通过模型内部还是通过推理链本身的标记来最好地解决。我们发现,模型激活比标记包含更多信息,用于识别重要的推理步骤。关键的是,通过在模型激活上训练探针来预测重要性,我们表明模型在生成后续步骤之前就已经编码了步骤重要性的内部表示。不同模型中重要性的内部表示在哪些步骤重要上具有高度一致性。这种表示分布在各个层中,并且与表面特征(如步骤的相对位置或长度)不相关。我们的发现表明,分析激活可以揭示表面方法根本遗漏的推理方面,表明推理分析应该研究模型内部。

英文摘要

Language models often solve complex tasks by generating long reasoning chains, consisting of many steps with varying importance. While some steps are crucial for generating the final answer, others are removable. Determining which steps matter most, and why, remains an open question central to understanding how models process reasoning. We investigate if this question is best approached through model internals or through tokens of the reasoning chain itself. We find that model activations contain more information than tokens for identifying important reasoning steps. Crucially, by training probes on model activations to predict importance, we show that models encode an internal representation of step importance, even prior to the generation of subsequent steps. The internal representations of importance in different models yield high agreement on which steps are important. The representation is distributed across layers, and does not correlate with surface-level features, such as a step's relative position or its length. Our findings suggest that analyzing activations can reveal aspects of reasoning that surface-level approaches fundamentally miss, indicating that reasoning analyses should look into model internals.

2601.00921 2026-06-12 cs.LG cs.AI quant-ph 版本更新

Geometric and Quantum Kernel Methods for Predicting Skeletal Muscle Outcomes in chronic obstructive pulmonary disease

用于预测慢性阻塞性肺疾病骨骼肌结果的几何与量子核方法

Azadeh Alavi, Hamidreza Khalili, Stanley H. Chan, Fatemeh Kouchmeshki, Muhammad Usman, Ross Vlahos

发表机构 * School of Computing Technologies, RMIT University(计算技术学院,拉筹纳斯大学) School of Health & Biomedical Sciences, STEM College, RMIT University(健康与生物医学科学学院,STEM学院,拉筹纳斯大学) Pattern Recognition Pty Ltd, Melbourne(模式识别有限公司,墨尔本) Data61, CSIRO(Data61,澳大利亚联邦科学与工业研究组织)

AI总结 提出一种核几何量子混合方法,通过再生核希尔伯特空间映射合成SPD参考、随机投影压缩和低维量子回归电路,在COPD动物队列中预测肌肉重量、质量和力量,肌肉重量RMSE比最佳经典方法低约1.8%。

详情
Comments
24 pages, 2 figures
AI中文摘要

慢性阻塞性肺疾病(COPD)影响全球数亿人,骨骼肌功能障碍具有临床重要性。量子机器学习在生物医学预测中日益受到探索,但在小型生物标志物队列中的价值需要与强经典基线进行基准测试。我们分析了一个由213只动物组成的香烟烟雾COPD队列,利用血液和支气管肺泡灌洗生物标志物预测胫骨前肌重量、肌肉质量和力量。我们开发了一种核几何量子混合方法,其中合成对称正定(SPD)参考通过再生核希尔伯特空间映射,使用仅训练随机投影压缩,归一化,并输入低维量子回归电路。我们将该方法与经典岭/核模型、SPD关系表示和量子核回归(QKR)进行了基准测试。所有方法均使用条件分层重复交叉验证进行评估。最大的数值改进出现在肌肉重量上,所提出方法的平均均方根误差(RMSE)数值最低,比最佳经典比较器低约1.8%;配对折叠水平测试在Holm调整后未建立统计显著性优势,但该终点具有生物学意义。该方法在肌肉质量上也具有数值最低的平均RMSE。对于力量,仅使用生物标志物的岭回归表现最佳,表明更线性的终点结构。

英文摘要

Chronic obstructive pulmonary disease (COPD) affects hundreds of millions of people worldwide, and skeletal-muscle dysfunction is clinically important. Quantum machine learning is increasingly explored for biomedical prediction, but its value in small biomarker cohorts requires benchmarking against strong classical baselines. We analysed a cigarette-smoke COPD cohort of 213 animals with blood and bronchoalveolar-lavage biomarkers to predict tibialis anterior muscle weight, muscle quality, and force. We developed a kernel-geometric quantum hybrid method in which synthetic symmetric positive definite (SPD) references are mapped through a reproducing kernel Hilbert space, compressed using train-only random projection, normalised, and supplied to low-dimensional quantum regression circuits. We benchmarked this approach against classical ridge/kernel models, SPD relational representations, and quantum-kernel regression (QKR). All methods were evaluated using condition-stratified repeated cross-validation. The largest numerical improvement was observed for muscle weight, where the proposed method had the numerically lowest mean root mean squared error (RMSE), approximately 1.8% below the best classical comparator; paired fold-level testing did not establish statistically significant superiority after Holm adjustment, but the endpoint is biologically meaningful. The method also had the numerically lowest mean RMSE for muscle quality. For force, biomarker-only Ridge performed best, suggesting a more linear endpoint structure.

2604.16689 2026-06-12 cs.AI 版本更新

The Query Channel: Information-Theoretic Limits of Masking-Based Explanations

查询通道:基于掩码的解释的信息论极限

Erciyes Karakaya, Ozgur Ercetin

发表机构 * Department of Electrical and Computer Engineering, University of Maryland, College Park, USA(美国马里兰大学电气与计算机工程系) Faculty of Engineering and Natural Sciences, Sabanci University, Turkiye(土耳其萨班奇大学工程与自然科学学院)

AI总结 本文提出查询通道框架,将掩码后解释建模为通信过程,推导解释率与识别容量之间的信息论极限,并证明稀疏最大似然解码器可实现可靠恢复。

详情
AI中文摘要

基于掩码的事后解释方法,如KernelSHAP和LIME,通过随机扰动下的查询估计局部特征重要性。本文将这一过程建模为在查询通道上的通信,其中潜在解释作为消息,每次掩码评估作为一次信道使用。在此框架内,解释的复杂度由假设类的熵捕获,而查询接口以每次查询的识别容量确定的速率提供信息。我们推导了一个强逆定理,表明如果解释率超过该容量,则对于任何解释器和解码器序列,精确恢复的概率必然收敛到误差中的一。我们还证明了一个可达性结果,即当速率低于容量时,稀疏最大似然解码器可实现可靠恢复。互信息的蒙特卡洛估计器提供了一个非渐近查询基准,我们用它来比较最优解码与模拟LIME和KernelSHAP的基于Lasso和OLS的过程。实验揭示了在一定的查询预算范围内,信息论允许可靠解释,但标准凸替代方法仍然失败。最后,我们将神经语言模型的超像素分辨率和分词解释为一种源编码选择,它设定了解释的熵,并展示了高斯噪声和非线性曲率如何劣化查询通道,引发瀑布和错误平层行为,并使高分辨率解释无法实现。

英文摘要

Masking-based post-hoc explanation methods, such as KernelSHAP and LIME, estimate local feature importance by querying a black-box model under randomized perturbations. This paper formulates this procedure as communication over a query channel, where the latent explanation acts as a message and each masked evaluation is a channel use. Within this framework, the complexity of the explanation is captured by the entropy of the hypothesis class, while the query interface supplies information at a rate determined by an identification capacity per query. We derive a strong converse showing that, if the explanation rate exceeds this capacity, the probability of exact recovery necessarily converges to one in error for any sequence of explainers and decoders. We also prove an achievability result establishing that a sparse maximum-likelihood decoder attains reliable recovery when the rate lies below capacity. A Monte Carlo estimator of mutual information yields a non-asymptotic query benchmark that we use to compare optimal decoding with Lasso- and OLS-based procedures that mirror LIME and KernelSHAP. Experiments reveal a range of query budgets where information theory permits reliable explanations but standard convex surrogates still fail. Finally, we interpret super-pixel resolution and tokenization for neural language models as a source-coding choice that sets the entropy of the explanation and show how Gaussian noise and nonlinear curvature degrade the query channel, induce waterfall and error-floor behavior, and render high-resolution explanations unattainable.

2604.13924 2026-06-12 cs.LG cs.AI cs.CV 版本更新

ASTER: Latent Pseudo-Anomaly Generation for Unsupervised Time-Series Anomaly Detection

ASTER: 用于无监督时间序列异常检测的潜在伪异常生成

Romain Hermary, Samet Hicsonmez, Dan Pineau, Abd El Rahman Shabayek, Djamila Aouada

发表机构 * University of Montreal(蒙特利尔大学) Université de Montréal(蒙特利尔大学)

AI总结 提出ASTER框架,在潜在空间生成伪异常训练Transformer分类器,结合预训练LLM增强表示,在三个基准数据集上达到最优性能。

详情
Comments
Published in ICPR 2026
AI中文摘要

时间序列异常检测(TSAD)在工业监控、医疗保健和网络安全等领域至关重要,但由于罕见且异质的异常以及标记数据的稀缺性,它仍然具有挑战性。这种稀缺性使得无监督方法占主导地位,但现有方法通常依赖于重建或预测(难以处理复杂数据),或依赖于需要领域特定异常合成和固定距离度量的基于嵌入的方法。我们提出ASTER,一个直接在潜在空间中生成伪异常的框架,避免了手工制作的异常注入和对领域专业知识的需求。潜在空间解码器生成定制的伪异常,用于训练基于Transformer的异常分类器,而预训练的LLM丰富了该空间的时间和上下文表示。在三个基准数据集上的实验表明,ASTER达到了最先进的性能,并为基于LLM的TSAD设立了新标准。

英文摘要

Time-series anomaly detection (TSAD) is critical in domains such as industrial monitoring, healthcare, and cybersecurity, but it remains challenging due to rare and heterogeneous anomalies and the scarcity of labelled data. This scarcity makes unsupervised approaches predominant, yet existing methods often rely on reconstruction or forecasting, which struggle with complex data, or on embedding-based approaches that require domain-specific anomaly synthesis and fixed distance metrics. We propose ASTER, a framework that generates pseudo-anomalies directly in the latent space, avoiding handcrafted anomaly injections and the need for domain expertise. A latent-space decoder produces tailored pseudo-anomalies to train a Transformer-based anomaly classifier, while a pre-trained LLM enriches the temporal and contextual representations of this space. Experiments on three benchmark datasets show that ASTER achieves state-of-the-art performance and sets a new standard for LLM-based TSAD.

2604.08958 2026-06-12 cs.LG cs.AI cs.RO 版本更新

WOMBET: World Model-Based Experience Transfer for Robust and Sample-efficient Reinforcement Learning

WOMBET:基于世界模型的经验迁移实现鲁棒且样本高效的强化学习

Mintae Kim, Koushil Sreenath

发表机构 * Hybrid Robotics, UC Berkeley(混合机器人技术,伯克利大学)

AI总结 提出WOMBET框架,通过源任务中学习世界模型并生成不确定性惩罚的离线数据,再结合自适应采样进行在线微调,实现鲁棒且样本高效的强化学习迁移。

详情
Comments
13 pages, 6 figures, 8th Annual Learning for Dynamics & Control Conference (L4DC)
AI中文摘要

机器人领域的强化学习通常受限于数据收集的成本和风险,因此需要从源任务向目标任务进行经验迁移。离线到在线强化学习利用先验数据,但通常假设给定固定数据集,并未解决如何生成可靠数据进行迁移的问题。我们提出基于世界模型的经验迁移(WOMBET)框架,该框架联合生成和利用先验数据。WOMBET在源任务中学习世界模型,并通过不确定性惩罚规划生成离线数据,随后筛选出高回报和低认知不确定性的轨迹。然后,它通过在离线数据和在线数据之间进行自适应采样,在目标任务中进行在线微调,实现了从先验驱动的初始化到任务特定适应的稳定过渡。我们证明了不确定性惩罚目标提供了真实回报的下界,并推导了有限样本误差分解,捕捉了分布不匹配和近似误差。实验上,WOMBET在连续控制基准测试中相比强基线提高了样本效率和最终性能,展示了联合优化数据生成和迁移的益处。

英文摘要

Reinforcement learning (RL) in robotics is often limited by the cost and risk of data collection, motivating experience transfer from a source task to a target task. Offline-to-online RL leverages prior data but typically assumes a given fixed dataset and does not address how to generate reliable data for transfer. We propose World Model-Based Experience Transfer (WOMBET), a framework that jointly generates and utilizes prior data. WOMBET learns a world model in the source task and generates offline data via uncertainty-penalized planning, followed by filtering trajectories with high return and low epistemic uncertainty. It then performs online fine-tuning in the target task using adaptive sampling between offline and online data, enabling a stable transition from prior-driven initialization to task-specific adaptation. We show that the uncertainty-penalized objective provides a lower bound on the true return and derive a finite-sample error decomposition capturing distribution mismatch and approximation error. Empirically, WOMBET improves sample efficiency and final performance over strong baselines on continuous control benchmarks, demonstrating the benefit of jointly optimizing data generation and transfer.

2604.12497 2026-06-12 cs.LG stat.ML 版本更新

Allocating Human Oversight in AI-Enabled Analytics

AI赋能分析中的人类监督分配

Zikun Ye, Jiameng Lyu, Rui Tao

发表机构 * Michael G. Foster School of Business, University of Washington(华盛顿大学迈克尔·G·福斯特商学院) Department of Management Science, School of Management, Fudan University(复旦大学管理学院管理科学系) Guanghua School of Management, Peking University(北京大学光华管理学院)

AI总结 针对AI预测可靠性异质且未知的问题,提出基于上置信界的在线学习策略,动态分配有限的人类验证预算,使终端效率损失随预算增长趋于零。

详情
AI中文摘要

组织越来越多地部署AI作为面向客户的决策过程中的低成本预测层,包括需求感知、服务质量监控、产品测试和市场研究,但AI生成的信号在不同任务、产品和客户细分中的可靠性并不均匀。因此,企业仍然需要稀缺的人类验证(标签、审计、调查回复或后续测量)来将AI输出锚定到真实情况。由于人类真实情况本身存在噪声,在不同标注者之间甚至重复判断中都有所变化,企业必须为每个任务收集并平均多个人类标签,这使得人类验证成本高昂。我们研究如何在可靠性异质且在部署前未知的情况下,将有限的人类验证预算分配到多个AI辅助任务中。我们将其置于调优的预测驱动推断框架内。每个人类标签既提高了AI辅助估计的精度,也揭示了任务的修正难度,即在使用AI预测作为控制变量后剩余的方差。如果难度已知,最优分配将遵循Neyman平方根规则;由于未知,我们提出一种基于上置信界的策略,该策略在线学习难度并将验证导向AI最不可靠的任务。我们证明,随着预算增长,该策略相对于最优分配的终端效率损失趋于零。在合成实验和一个包含68个任务和超过2000名受访者的真实数字孪生调查中,当可靠性异质时,该策略缩小了与最优分配的大部分差距,优于均匀分配和epsilon-贪婪分配;在调查数据上,它还优于先探索后提交的试点设计,并将均匀分配的10-12%差距缩小到2-6%。AI的价值不仅取决于模型准确性,还取决于将人类监督定向到AI错误影响最大的操作策略。

英文摘要

Organizations increasingly deploy AI as a low-cost prediction layer in customer-facing decision processes, including demand sensing, service-quality monitoring, product testing, and market research, but AI-generated signals are unevenly reliable across tasks, products, and customer segments. Firms therefore still need scarce human validation (labels, audits, survey responses, or follow-up measurements) to anchor AI outputs to ground truth. Because human ground truth is itself noisy, varying across labelers and even across repeated judgments, the firm must collect and average several human labels per task, which makes human validation costly. We study how to allocate a limited human-validation budget across many AI-assisted tasks when reliability is heterogeneous and unknown before deployment. We cast this within tuned prediction-powered inference. Each human label both sharpens the AI-assisted estimate and reveals the task's rectification difficulty, the variance that remains after the AI prediction is optimally used as a control variate. If difficulties were known, the optimal allocation would follow a Neyman square-root rule; because they are unknown, we propose a policy based on upper confidence bounds that learns them online and steers validation toward tasks where AI is least reliable. We prove that the policy's terminal efficiency loss relative to the oracle allocation vanishes as the budget grows. In synthetic experiments and a real digital-twin survey with 68 tasks and over 2000 respondents, it closes most of the gap to the oracle when reliability is heterogeneous, outperforming uniform and epsilon-greedy allocation; on the survey data it also outperforms explore-then-commit pilot designs and cuts uniform's 10--12% gap to 2--6%. The value of AI depends not only on model accuracy but also on the operational policy that targets human oversight where AI errors matter most.

2604.12002 2026-06-12 cs.CL 版本更新

Self-Distillation Zero: Self-Revision Turns Binary Rewards into Dense Supervision

自蒸馏零:自我修订将二元奖励转化为密集监督

Yinghui He, Simran Kaur, Adithya Bhaskar, Yongjin Yang, Jiarui Liu, Narutatsu Ri, Liam Fowl, Abhishek Panigrahi, Danqi Chen, Sanjeev Arora

发表机构 * Princeton University(普林斯顿大学) University of Toronto(多伦多大学) Carnegie Mellon University(卡内基梅隆大学)

AI总结 提出SD-Zero方法,通过让模型同时扮演生成器和修订者,利用二元奖励生成密集的token级自监督信号,显著提升训练样本效率,在数学和代码推理任务上超越RFT、GRPO等基线。

详情
AI中文摘要

当前在可验证设置下的后训练方法分为两类。强化学习(RLVR)依赖二元奖励,虽然广泛适用且强大,但在训练过程中仅提供稀疏监督。蒸馏提供密集的token级监督,通常从外部教师或使用高质量示范中获得。收集此类监督成本高昂或不可用。我们提出自蒸馏零(SD-Zero),一种比RL更高效利用训练样本的方法,且不需要外部教师或高质量示范。SD-Zero训练单个模型扮演两个角色:生成器,产生初始响应;修订者,基于该响应及其二元奖励生成改进的响应。然后我们进行在线自蒸馏,将修订者蒸馏到生成器中,使用修订者以生成器的响应及其奖励为条件的token分布作为监督。实际上,SD-Zero训练模型将二元奖励转化为密集的token级自监督。在数学和代码推理基准上,使用Qwen3-4B-Instruct和Olmo-3-7B-Instruct,SD-Zero相比基础模型性能提升至少10%,并在相同问题集和训练样本预算下优于强基线,包括拒绝微调(RFT)、GRPO和自蒸馏微调(SDFT)。大量消融实验显示了所提出算法的两个新特性:(a)token级自定位,其中修订者能够基于奖励识别生成器响应中需要修订的关键token;(b)迭代自进化,其中改进答案的修订能力可以通过定期教师同步蒸馏回生成性能。代码:此https URL。

英文摘要

Current post-training methods in verifiable settings fall into two categories. Reinforcement learning (RLVR) relies on binary rewards, which are broadly applicable and powerful, but provide only sparse supervision during training. Distillation provides dense token-level supervision, typically obtained from an external teacher or using high-quality demonstrations. Collecting such supervision can be costly or unavailable. We propose Self-Distillation Zero (SD-Zero), a method that is substantially more training sample-efficient than RL and does not require an external teacher or high-quality demonstrations. SD-Zero trains a single model to play two roles: a Generator, which produces an initial response, and a Reviser, which conditions on that response and its binary reward to produce an improved response. We then perform on-policy self-distillation to distill the reviser into the generator, using the reviser's token distributions conditioned on the generator's response and its reward as supervision. In effect, SD-Zero trains the model to transform binary rewards into dense token-level self-supervision. On math and code reasoning benchmarks with Qwen3-4B-Instruct and Olmo-3-7B-Instruct, SD-Zero improves performance by at least 10% over the base models and outperforms strong baselines, including Rejection Fine-Tuning (RFT), GRPO, and Self-Distillation Fine-Tuning (SDFT), under the same question set and training sample budget. Extensive ablation studies show two novel characteristics of our proposed algorithm: (a) token-level self-localization, where the reviser can identify the key tokens that need to be revised in the generator's response based on reward, and (b) iterative self-evolution, where the improving ability to revise answers can be distilled back into generation performance with regular teacher synchronization. Code: https://github.com/princeton-pli/Self-Distillation-Zero.

2604.10389 2026-06-12 cs.CL 版本更新

BLUEmed: Retrieval-Augmented Multi-Agent Debate for Clinical Error Detection

BLUEmed: 基于检索增强的多智能体辩论用于临床错误检测

Saukun Thika You, Nguyen Anh Khoa Tran, Wesley K. Marizane, Hanshu Rao, Qiunan Zhang, Xiaolei Huang

发表机构 * arXiv.org University of California, San Diego(加州大学圣地亚哥分校)

AI总结 提出BLUEmed框架,结合混合检索增强生成与多智能体辩论,通过分解临床笔记、检索证据、专家辩论及安全层过滤,在术语替换错误检测中达到最优性能。

详情
Comments
Accepted to the IEEE International Conference on Healthcare Informatics (ICHI) 2026
AI中文摘要

临床笔记中的术语替换错误(即一个医学术语被一个语言上有效但临床不同的术语替换)对医疗保健中的自动错误检测构成了持续挑战。我们引入了BLUEmed,一个多智能体辩论框架,增强有混合检索增强生成(RAG),该框架结合了基于证据的推理和多视角验证用于临床错误检测。BLUEmed将每个临床笔记分解为聚焦的子查询,通过密集、稀疏和在线检索检索来源分区的证据,并分配两个具有不同知识库的领域专家智能体以产生独立分析;当专家意见不一致时,一轮结构化的反论证和跨来源裁决解决冲突,随后是一个级联安全层,过滤常见的假阳性模式。我们在一个临床术语替换检测基准上评估BLUEmed,在零样本和少样本提示下,使用多个骨干模型(涵盖专有和开源系列)。实验结果表明,在少样本提示下,BLUEmed达到了最佳准确率(69.13%)、ROC-AUC(74.45%)和PR-AUC(72.44%),优于单智能体RAG和仅辩论基线。跨六个骨干模型和两种提示策略的进一步分析证实,检索增强和结构化辩论是互补的,并且该框架从具有足够指令遵循和临床语言理解的模型中受益最大。

英文摘要

Terminology substitution errors in clinical notes, where one medical term is replaced by a linguistically valid but clinically different term, pose a persistent challenge for automated error detection in healthcare. We introduce BLUEmed, a multi-agent debate framework augmented with hybrid Retrieval-Augmented Generation (RAG) that combines evidence-grounded reasoning with multi-perspective verification for clinical error detection. BLUEmed decomposes each clinical note into focused sub-queries, retrieves source-partitioned evidence through dense, sparse, and online retrieval, and assigns two domain expert agents distinct knowledge bases to produce independent analyses; when the experts disagree, a structured counter-argumentation round and cross-source adjudication resolve the conflict, followed by a cascading safety layer that filters common false-positive patterns. We evaluate BLUEmed on a clinical terminology substitution detection benchmark under both zero-shot and few-shot prompting with multiple backbone models spanning proprietary and open-source families. Experimental results show that BLUEmed achieves the best accuracy (69.13%), ROC-AUC (74.45%), and PR-AUC (72.44%) under few-shot prompting, outperforming both single-agent RAG and debate-only baselines. Further analyses across six backbone models and two prompting strategies confirm that retrieval augmentation and structured debate are complementary, and that the framework benefits most from models with sufficient instruction-following and clinical language understanding.

2511.18322 2026-06-12 cs.RO cs.CV cs.LG 版本更新

Learning Visually Interpretable Oscillator Networks for Soft Continuum Robots from Video

从视频中学习软体连续体机器人的视觉可解释振荡器网络

Henrik Krauss, Johann Licher, Naoya Takeishi, Annika Raatz, Takehisa Yairi

发表机构 * Department of Advanced Interdisciplinary Studies, The University of Tokyo(东京大学先进跨学科研究系) Institute of Assembly Technology and Robotics, Leibniz University Hannover(莱比锡大学汉诺威装配技术与机器人研究所) Research Center for Advanced Science and Technology, The University of Tokyo(东京大学先进科学研究中心)

AI总结 提出注意力广播解码器(ABCD)和视觉振荡器网络(VONs),实现从视频中学习软体连续体机器人动力学的视觉和机械可解释性,多步预测误差降低5.8倍。

详情
Comments
Code available at: https://github.com/UThenrik/visual_oscillators_for_SCR Dataset available at: https://zenodo.org/records/17812071 Video available at: https://youtu.be/i80H8erVISM
AI中文摘要

从视频中学习软体连续体机器人(SCR)动力学提供了灵活性,但现有方法缺乏可解释性或依赖先验假设。基于模型的方法需要先验知识和手动设计。我们通过引入以下内容来弥补这一差距:(1)注意力广播解码器(ABCD),一种用于基于自编码器的潜在动力学学习的即插即用模块,生成像素级注意力图,定位每个潜在维度的贡献,同时过滤静态背景,通过空间接地潜在变量和图像叠加实现视觉可解释性。(2)视觉振荡器网络(VONs),一种二维潜在振荡器网络,与ABCD注意力图耦合,用于学习到的质量、耦合刚度和力的图像可视化,从而实现机械可解释性。我们在单段和双段SCR上验证了我们的方法,表明基于ABCD的模型显著提高了多步预测精度,在双段机器人上,Koopman算子的误差降低了5.8倍,振荡器网络的误差降低了3.5倍。VONs自主发现了振荡器的链式结构。这种完全数据驱动的方法产生了紧凑、机械可解释的模型,对未来的控制应用具有潜在意义。

英文摘要

Learning soft continuum robot (SCR) dynamics from video offers flexibility but existing methods lack interpretability or rely on prior assumptions. Model-based approaches require prior knowledge and manual design. We bridge this gap by introducing: (1) The Attention Broadcast Decoder (ABCD), a plug-and-play module for autoencoder-based latent dynamics learning that generates pixel-accurate attention maps localizing each latent dimension's contribution while filtering static backgrounds, enabling visual interpretability via spatially grounded latents and on-image overlays. (2) Visual Oscillator Networks (VONs), a 2D latent oscillator network coupled to ABCD attention maps for on-image visualization of learned masses, coupling stiffness, and forces, thereby enabling mechanical interpretability. We validate our approach on single- and double-segment SCRs, demonstrating that ABCD-based models significantly improve multi-step prediction accuracy with 5.8x error reduction for Koopman operators and 3.5x for oscillator networks on a two-segment robot. VONs autonomously discover a chain structure of oscillators. This fully data-driven approach yields compact, mechanically interpretable models with potential relevance for future control applications.

2512.14937 2026-06-12 cs.CV cs.AI 版本更新

Improving Pre-trained Adult Glioma Segmentation Models Using only Post-processing Techniques

仅使用后处理技术改进预训练的成人胶质瘤分割模型

Abhijeet Parida, Daniel Capellán-Martín, Zhifan Jiang, Nishad Kulkarni, Krithika Iyer, Austin Tapp, Syed Muhammad Anwar, María J. Ledesma-Carbayo, Marius George Linguraru

发表机构 * Sheikh Zayed Institute for Pediatric Surgical Innovation(Sheikh Zayed儿童手术创新研究所) Children’s National Hospital(儿童医院) University of Madrid(马德里大学) CIBER-BBN ISCIII School of Medicine and Health Sciences(医学与健康科学学院) George Washington University(乔治·华盛顿大学)

AI总结 针对预训练模型在胶质瘤分割中的系统误差,提出自适应后处理技术,在BraTS 2025挑战中使排名指标提升14.9%(撒哈拉以南非洲)和0.9%(成人胶质瘤),推动向高效、公平、可持续的后处理策略转变。

详情
AI中文摘要

胶质瘤是成人中最常见的恶性脑肿瘤,也是最致命的肿瘤之一。尽管积极治疗,中位生存率仍低于15个月。准确的多参数MRI(mpMRI)肿瘤分割对于手术规划、放疗和疾病监测至关重要。虽然深度学习模型提高了自动分割的准确性,但大规模预训练模型泛化能力差且常表现不佳,产生系统性错误,如假阳性、标签交换和切片不连续。这些问题因GPU资源获取不平等和大规模模型训练日益增长的环境成本而进一步加剧。在这项工作中,我们提出自适应后处理技术,以改进为各种肿瘤类型开发的大规模预训练模型产生的胶质瘤分割质量。我们在多个BraTS 2025分割挑战任务中展示了这些技术,使撒哈拉以南非洲挑战的排名指标提升了14.9%,成人胶质瘤挑战提升了0.9%。该方法推动脑肿瘤分割研究从日益复杂的模型架构转向精确、计算公平且可持续的高效临床后处理策略。

英文摘要

Gliomas are the most common malignant brain tumors in adults and are among the most lethal. Despite aggressive treatment, the median survival rate is less than 15 months. Accurate multiparametric MRI (mpMRI) tumor segmentation is critical for surgical planning, radiotherapy, and disease monitoring. While deep learning models have improved the accuracy of automated segmentation, large-scale pre-trained models generalize poorly and often underperform, producing systematic errors such as false positives, label swaps, and slice discontinuities in slices. These limitations are further compounded by unequal access to GPU resources and the growing environmental cost of large-scale model training. In this work, we propose adaptive post-processing techniques to refine the quality of glioma segmentations produced by large-scale pretrained models developed for various types of tumors. We demonstrated the techniques in multiple BraTS 2025 segmentation challenge tasks, with the ranking metric improving by 14.9 % for the sub-Saharan Africa challenge and 0.9% for the adult glioma challenge. This approach promotes a shift in brain tumor segmentation research from increasingly complex model architectures to efficient, clinically aligned post-processing strategies that are precise, computationally fair, and sustainable.

2512.14648 2026-06-12 cs.CV eess.IV 版本更新

Adaptable Segmentation Pipeline for Diverse Brain Tumors with Radiomic-Guided Subtyping and Lesion-Wise Model Ensemble

适用于多样化脑肿瘤的自适应分割流程:放射组学引导的亚型分类与病灶级模型集成

Daniel Capellán-Martín, Abhijeet Parida, Zhifan Jiang, Nishad Kulkarni, Krithika Iyer, Austin Tapp, Syed Muhammad Anwar, María J. Ledesma-Carbayo, Marius George Linguraru

发表机构 * Sheikh Zayed Institute for Pediatric Surgical Innovation(Sheikh Zayed儿童外科创新研究所) Children’s National Hospital(儿童医院) University of Washington(华盛顿大学) Universidad Politécnica de Madrid(马德里理工大学) CIBER-BBN ISCIII School of Medicine and Health Sciences(医学与健康科学学院)

AI总结 提出一种灵活模块化的自适应分割流程,通过放射组学特征检测肿瘤亚型并平衡训练,结合病灶级性能指标优化模型集成与后处理,在BraTS 2025挑战赛中达到顶尖性能,支持临床定量肿瘤测量。

详情
Comments
12 pages, 5 figures, 3 tables. Algorithm presented at MICCAI BraTS 2025
AI中文摘要

在多参数磁共振成像(MRI)上对脑肿瘤进行鲁棒且可泛化的分割仍然困难,因为肿瘤类型差异很大。BraTS 2025 Lighthouse挑战赛在多种高质量成人及儿童肿瘤数据集上对分割方法进行基准测试:多联盟国际儿童脑肿瘤分割(PED)、术前脑膜瘤肿瘤分割(MEN)、脑膜瘤放射治疗分割(MEN-RT)以及治疗前后脑转移瘤分割(MET)。我们提出了一种灵活、模块化且自适应的流程,通过选择和组合最先进的模型,并在训练前后应用肿瘤和病灶特定的处理,来提高分割性能。从MRI中提取的放射组学特征有助于检测肿瘤亚型,确保更平衡的训练。自定义的病灶级性能指标决定了每个模型在集成中的影响力,并优化了进一步细化预测的后处理,使工作流能够针对每个病例定制每一步。在BraTS测试集上,我们的流程在多个挑战中取得了与顶尖算法相当的性能。这些发现证实,自定义的病灶感知处理与模型选择能够产生鲁棒的分割,而无需将方法锁定在特定的网络架构上。我们的方法在临床实践中具有定量肿瘤测量的潜力,支持诊断和预后。

英文摘要

Robust and generalizable segmentation of brain tumors on multi-parametric magnetic resonance imaging (MRI) remains difficult because tumor types differ widely. The BraTS 2025 Lighthouse Challenge benchmarks segmentation methods on diverse high-quality datasets of adult and pediatric tumors: multi-consortium international pediatric brain tumor segmentation (PED), preoperative meningioma tumor segmentation (MEN), meningioma radiotherapy segmentation (MEN-RT), and segmentation of pre- and post-treatment brain metastases (MET). We present a flexible, modular, and adaptable pipeline that improves segmentation performance by selecting and combining state-of-the-art models and applying tumor- and lesion-specific processing before and after training. Radiomic features extracted from MRI help detect tumor subtype, ensuring a more balanced training. Custom lesion-level performance metrics determine the influence of each model in the ensemble and optimize post-processing that further refines the predictions, enabling the workflow to tailor every step to each case. On the BraTS testing sets, our pipeline achieved performance comparable to top-ranked algorithms across multiple challenges. These findings confirm that custom lesion-aware processing and model selection yield robust segmentations yet without locking the method to a specific network architecture. Our method has the potential for quantitative tumor measurement in clinical practice, supporting diagnosis and prognosis.

2506.18438 2026-06-12 cs.CV 版本更新

CPAM: Context-Preserving Adaptive Manipulation for Zero-Shot Real Image Editing

CPAM: 保持上下文的自适应操作用于零样本真实图像编辑

Dinh-Khoi Vo, Thanh-Toan Do, Tam V. Nguyen, Minh-Triet Tran, Trung-Nghia Le

发表机构 * Faculty of Information Technology, University of Science, Ho Chi Minh City, Vietnam(越南科学大学信息科技学院) Vietnam National University, Ho Chi Minh City, Vietnam(越南国家大学) Faculty of Information Technology, Monash University, Melbourne, Victoria, Australia(莫纳什大学信息科技学院) Department of Computer Science, University of Dayton, Dayton, Ohio, US(Dayton 大学计算机科学系)

AI总结 提出CPAM零样本框架,通过保持上下文的自适应操作和掩码引导,实现复杂非刚性真实图像的编辑,保留纹理和身份,无需微调。

详情
Comments
Accepted to IEEE Transactions on Multimedia. Project page: https://vdkhoi20.github.io/CPAM
AI中文摘要

使用文本描述在文本到图像扩散模型中编辑自然图像仍然是一个重大挑战,特别是在实现一致生成和处理复杂非刚性对象方面。现有方法通常难以保留纹理和身份,需要大量微调,并且在编辑特定空间区域或对象的同时保留背景细节方面存在局限性。本文提出了保持上下文的自适应操作(CPAM),一种用于复杂非刚性真实图像编辑的新型零样本框架。具体来说,我们提出了一个保留适应模块,该模块调整自注意力机制以有效保留并独立控制对象和背景。这确保了在编辑过程中使用掩码引导技术时,对象的形状、纹理和身份得以保持,同时背景不变形。此外,我们开发了一个局部提取模块,以减轻在交叉注意力机制的条件化过程中对非期望修改区域的干扰。我们还引入了各种掩码引导策略,以简单的方式促进多样化的图像操作任务。CPAM可以无缝集成到多个扩散骨干网络中,包括SD1.5、SD2.1和SDXL,展示了跨不同模型架构的强大泛化能力。在我们新构建的图像操作基准(IMBA)上进行的广泛实验表明,我们提出的方法是人类评估者的首选,优于现有的最先进编辑技术。源代码和数据将在项目页面公开发布:this https URL

英文摘要

Editing natural images using textual descriptions in text-to-image diffusion models remains a significant challenge, particularly in achieving consistent generation and handling complex, non-rigid objects. Existing methods often struggle to preserve textures and identity, require extensive fine-tuning, and exhibit limitations in editing specific spatial regions or objects while retaining background details. This paper proposes Context-Preserving Adaptive Manipulation (CPAM), a novel zero-shot framework for complicated, non-rigid real image editing. Specifically, we propose a preservation adaptation module that adjusts self-attention mechanisms to preserve and independently control the object and background effectively. This ensures that the objects' shapes, textures, and identities are maintained while keeping the background undistorted during the editing process using the mask guidance technique. Additionally, we develop a localized extraction module to mitigate the interference with the non-desired modified regions during conditioning in cross-attention mechanisms. We also introduce various mask-guidance strategies to facilitate diverse image manipulation tasks in a simple manner. CPAM can be seamlessly integrated with multiple diffusion backbones, including SD1.5, SD2.1, and SDXL, demonstrating strong generalization across different model architectures. Extensive experiments on our newly constructed Image Manipulation BenchmArk (IMBA), a robust benchmark dataset specifically designed for real image editing, demonstrate that our proposed method is the preferred choice among human raters, outperforming existing state-of-the-art editing techniques. The source code and data will be publicly released at the project page: https://vdkhoi20.github.io/CPAM

2604.08983 2026-06-12 cs.RO 版本更新

AssemLM: A Spatial Reasoning Multimodal Large Language Model for Robotic Assembly

AssemLM: 用于机器人装配的空间推理多模态大语言模型

Zhi Jing, Jinbin Qiao, Ouyang Lu, Jicong Ao, Shuang Qiu, Huazhe Xu, Yu-Gang Jiang, Chenjia Bai

发表机构 * Fudan University(复旦大学) Institute of Artificial Intelligence (TeleAI), China Telecom(人工智能研究所(TeleAI),中国电信) Tianjin University(天津大学) Northwestern Polytechnical University(西北工业大学) Tsinghua University(清华大学) City University of Hong Kong(香港城市大学)

AI总结 提出AssemLM,一种融合装配手册、点云和文本指令的多模态大语言模型,通过专用点云编码器提取几何与旋转特征,实现精确的6D装配位姿推理,并构建含90万样本的AssemBench基准,在真实机器人装配任务中取得最优性能。

详情
Comments
Project Page: https://assemlmhome.github.io/
AI中文摘要

空间推理是具身智能的基本能力,尤其对于机器人装配等精细操作任务。当前基于视觉语言模型(VLM)的方法主要依赖粗粒度的2D感知,难以对复杂3D几何进行精确推理。为解决这一局限,我们提出AssemLM,一种用于机器人装配的空间多模态大语言模型,它整合装配手册、点云和文本指令,通过显式几何理解预测任务关键的6D装配位姿。为桥接原始3D感知与高层语言推理,AssemLM采用专用点云编码器提取细粒度几何与旋转特征,以实现装配任务中精确的3D空间推理。此外,我们引入AssemBench,一个面向装配空间推理的大规模基准,包含超过90万多模态样本和精确的6D位姿标注,将评估从2D定位扩展到完整的3D几何推理。大量实验和真实机器人评估表明,AssemLM在6D位姿推理性能上达到最优,并有效支持真实环境中的精细多步装配任务。代码、模型和AssemBench数据集将公开提供。

英文摘要

Spatial reasoning is a fundamental capability for embodied intelligence, especially for fine-grained manipulation tasks such as robotic assembly. Recent methods based on vision-language models (VLMs) largely rely on coarse 2D perception and struggle to perform accurate reasoning over complex 3D geometry. To address this limitation, we propose AssemLM, a spatial multimodal large language model for robotic assembly that integrates assembly manuals, point clouds, and textual instructions to predict task-critical 6D assembly poses with explicit geometric understanding. To bridge raw 3D perception and high-level linguistic reasoning, AssemLM employs a specialized point cloud encoder to extract fine-grained geometric and rotational features for accurate 3D spatial reasoning in assembly tasks. In addition, we introduce AssemBench, a large-scale benchmark for assembly-oriented spatial reasoning with over 900K multimodal samples and precise 6D pose annotations, extending evaluation from 2D grounding to full 3D geometric inference. Extensive experiments and real-robot evaluations demonstrate that AssemLM achieves state-of-the-art 6D pose reasoning performance and effectively supports fine-grained, multi-step assembly tasks in real-world settings. Code, models, and the AssemBench dataset will be made publicly available.

2603.29515 2026-06-12 cs.LG 版本更新

Variational Graph Neural Networks for Uncertainty Quantification in Inverse Problems

变分图神经网络用于反问题中的不确定性量化

David Gonzalez, Alba Muixi, Beatriz Moya, Elias Cueto

发表机构 * Keysight-UZ Chair of the Spanish National Strategy on AI(西班牙人工智能国家战略主席席位) Aragon Institute of Engineering Research (I3A)(阿拉贡工程研究所(I3A)) Universidad de Zaragoza(萨拉戈塔大学) Laboratori de Càlcul Numèric (LaCàN)(数值计算实验室(LaCàN)) Universitat Politècnica de Catalunya - BarcelonaTech (UPC)(加泰罗尼亚理工大学 - 巴塞罗那科技大学(UPC)) Centre Internacional de Mètodes Numèrics en Enginyeria (CIMNE)(国际数值工程方法中心(CIMNE)) PIMM Lab. Arts et Métiers Institute of Technology(巴黎艺术与技术理工学院PIMM实验室)

AI总结 提出变分图神经网络(VGNN),通过在解码器引入变分层以较低成本量化认知和统计不确定性,在固体力学反问题中验证了高精度参数恢复与置信区间估计。

详情
AI中文摘要

深度学习技术在计算力学中的日益广泛应用显著加速了那些几年前还被认为是难以处理的问题的模拟。然而,在诸如工程或医学数字孪生等关键应用中,快速响应是不够的;还必须提供可靠的结果。在某些情况下,传统的确定性方法可能不是最优的,因为它们无法提供对其预测或结果的置信度度量,尤其是在反问题中,解可能不唯一或初始数据由于噪声等原因不完全可靠。经典的深度神经网络也缺乏明确的度量来量化其预测的不确定性。在这项工作中,我们提出了一种变分图神经网络(VGNN)架构,该架构将变分层集成到其架构中以建模权重的概率分布。与计算昂贵的全贝叶斯网络不同,我们的方法仅在解码器中策略性地引入变分层,从而能够以相对较低的成本估计认知不确定性和统计不确定性。在这项工作中,我们在两个固体力学案例中验证了所提出的方法:在二维弹性问题中识别具有非线性分布的弹性模量值,以及在三维超弹性梁中定位和量化施加的载荷,在这两种情况下仅使用每个测试的位移场作为输入数据。结果表明,该模型不仅以高精度恢复了物理参数,还提供了与问题物理特性一致的置信区间,并且能够定位施加载荷的位置并估计其值,为该实验提供了置信区间。

英文摘要

The increasingly wide use of deep machine learning techniques in computational mechanics has significantly accelerated simulations of problems that were considered unapproachable just a few years ago. However, in critical applications such as Digital Twins for engineering or medicine, fast responses are not enough; reliable results must also be provided. In certain cases, traditional deterministic methods may not be optimal as they do not provide a measure of confidence in their predictions or results, especially in inverse problems where the solution may not be unique or the initial data may not be entirely reliable due to the presence of noise, for instance. Classic deep neural networks also lack a clear measure to quantify the uncertainty of their predictions. In this work, we present a variational graph neural network (VGNN) architecture that integrates variational layers into its architecture to model the probability distribution of weights. Unlike computationally expensive full Bayesian networks, our approach strategically introduces variational layers exclusively in the decoder, allowing us to estimate cognitive uncertainty and statistical uncertainty at a relatively lower cost. In this work, we validate the proposed methodology in two cases of solid mechanics: the identification of the value of the elastic modulus with nonlinear distribution in a 2D elastic problem and the location and quantification of the loads applied to a 3D hyperelastic beam, in both cases using only the displacement field of each test as input data. The results show that the model not only recovers the physical parameters with high precision, but also provides confidence intervals consistent with the physics of the problem, as well as being able to locate the position of the applied load and estimate its value, giving a confidence interval for that experiment.

2601.06572 2026-06-12 cs.LG cs.AI 版本更新

Hellinger Multimodal Variational Autoencoders

Hellinger多模态变分自编码器

Huyen Vo, Isabel Valera

发表机构 * Department of Computer Science, Saarland University(萨尔兰大学计算机科学系) MPI-SWS, Saarland Informatics Campus(萨尔兰信息学校区Max Planck研究所)

AI总结 提出基于Hellinger距离的矩匹配近似方法HELVAE,避免子采样,在多模态变分自编码器中实现更优的生成一致性与质量权衡。

详情
Comments
Accepted at AISTATS 2026. Camera-ready version
AI中文摘要

多模态变分自编码器(VAEs)广泛用于弱监督生成学习,涉及多种模态。主流方法通过专家乘积(PoE)、专家混合(MoE)或其组合来聚合单模态推理分布,以近似联合后验。本文从概率意见池化的优化视角重新审视多模态推理。我们从$\alpha=0.5$的Hölder池化出发,这是$\alpha\text{-散度}$族中唯一的对称成员,并推导出一种矩匹配近似,称为Hellinger。我们利用这种近似提出HELVAE,一种避免子采样的多模态VAE,从而得到一个高效且有效的模型,该模型:(i)随着观察到的模态增加,学习更具表达力的潜在表示;(ii)在生成一致性和质量之间实现更好的权衡,优于最先进的多模态VAE模型。

英文摘要

Multimodal variational autoencoders (VAEs) are widely used for weakly supervised generative learning with multiple modalities. Predominant methods aggregate unimodal inference distributions using either a product of experts (PoE), a mixture of experts (MoE), or their combinations to approximate the joint posterior. In this work, we revisit multimodal inference through the lens of probabilistic opinion pooling, an optimization-based approach. We start from Hölder pooling with $α=0.5$, which corresponds to the unique symmetric member of the $α\text{-divergence}$ family, and derive a moment-matching approximation, termed Hellinger. We then leverage such an approximation to propose HELVAE, a multimodal VAE that avoids sub-sampling, yielding an efficient yet effective model that: (i) learns more expressive latent representations as additional modalities are observed; and (ii) empirically achieves better trade-offs between generative coherence and quality, outperforming state-of-the-art multimodal VAE models.

2603.25450 2026-06-12 cs.AI 版本更新

Cross-Model Disagreement as a Label-Free Correctness Signal

跨模型分歧作为无标签正确性信号

Matt Gorbett, Suman Jana

发表机构 * Independent Researcher(独立研究者) Department of Computer Science Columbia University(计算机科学系哥伦比亚大学)

AI总结 提出跨模型分歧作为无标签正确性指标,通过验证模型对生成模型答案的困惑度或熵来检测错误,无需训练或标签,在多个基准上优于模型内不确定性方法。

详情
AI中文摘要

在没有真实标签的情况下检测语言模型何时出错是安全部署的一个基本挑战。现有方法依赖于模型自身的不确定性——例如令牌熵或置信度分数——但这些信号在最危险的失败模式:自信错误(模型错误但确定)上会严重失效。在这项工作中,我们引入跨模型分歧作为正确性指标——一种简单、无需训练的信号,可以无需修改地插入现有的生产系统、路由管道和部署监控基础设施。给定模型生成的答案,跨模型分歧通过单次前向传递计算第二个验证模型在读取该答案时的惊讶或不确定性程度。不需要验证模型生成任何内容,也不需要正确性标签。我们将这一原则实例化为跨模型困惑度(CMP),它衡量验证模型对生成模型答案令牌的惊讶程度,以及跨模型熵(CME),它衡量验证模型在这些位置的不确定性。CMP和CME在涵盖推理、检索和数学问题求解(MMLU、TriviaQA和GSM8K)的基准测试中均优于模型内不确定性基线。在MMLU上,CMP的平均AUROC为0.75,而模型内熵基线为0.59。这些结果确立了跨模型分歧作为一种实用的、无需训练的无标签正确性估计方法,可直接应用于部署监控、模型路由、选择性预测、数据过滤和生产语言模型系统的可扩展监督。

英文摘要

Detecting when a language model is wrong without ground truth labels is a fundamental challenge for safe deployment. Existing approaches rely on a model's own uncertainty -- such as token entropy or confidence scores -- but these signals fail critically on the most dangerous failure mode: confident errors, where a model is wrong but certain. In this work we introduce cross-model disagreement as a correctness indicator -- a simple, training-free signal that can be dropped into existing production systems, routing pipelines, and deployment monitoring infrastructure without modification. Given a model's generated answer, cross-model disagreement computes how surprised or uncertain a second verifier model is when reading that answer via a single forward pass. No generation from the verifying model is required, and no correctness labels are needed. We instantiate this principle as Cross-Model Perplexity (CMP), which measures the verifying model's surprise at the generating model's answer tokens, and Cross-Model Entropy (CME), which measures the verifying model's uncertainty at those positions. Both CMP and CME outperform within-model uncertainty baselines across benchmarks spanning reasoning, retrieval, and mathematical problem solving (MMLU, TriviaQA, and GSM8K). On MMLU, CMP achieves a mean AUROC of 0.75 against a within-model entropy baseline of 0.59. These results establish cross-model disagreement as a practical, training-free approach to label-free correctness estimation, with direct applications in deployment monitoring, model routing, selective prediction, data filtering, and scalable oversight of production language model systems.

2603.21563 2026-06-12 cs.AI 版本更新

Counterfactual Credit Policy Optimization for Multi-Agent Collaboration

多智能体协作的反事实信用策略优化

Zhongyi Li, Wan Tian, Jinju Chen, Huiming Zhang, Yang Liu, Yikun Ban, Fuzhen Zhuang

发表机构 * Beihang University(北航) Peking University(北京大学) Beijing University of Posts and Telecommunications(北京邮电大学)

AI总结 针对多智能体大语言模型协作中信用分配难题,提出CCPO框架,通过反事实信用估计和验证器锚定的自评估两种分配器,将团队奖励转化为个体学习信号,提升数学推理任务表现。

详情
AI中文摘要

协作式多智能体大语言模型可以通过分解角色来解决复杂的推理任务,但此类系统的强化学习受到信用分配的限制:共享的终端奖励模糊了个体贡献,并可能鼓励搭便车行为。我们引入了协作信用策略优化(CCPO),这是一个与优化器无关的信用分配层,将团队层面的结果转化为智能体特定的学习信号。CCPO提供了两种互补的分配器。反事实信用通过比较实际团队结果与移除该智能体的反事实结果来估计智能体的边际贡献。验证器锚定的LLM自我评估是一种探索性分配器,它使用受限的自我评估和同伴评估来重新分配信用,同时保持外部验证器结果的主导地位。由此产生的角色特定奖励可以被GRPO风格的更新或其他策略梯度优化器(如GSPO和REINFORCE++)使用。我们在顺序的思考-求解设置中实例化CCPO,并在数学推理基准上评估它。结果表明,显式的信用分配通常能改善双智能体推理,尤其是在MATH500和几个分布外设置中,而增益因模型和数据集而异。

英文摘要

Collaborative multi-agent large language models (LLMs) can solve complex reasoning tasks by decomposing roles, but reinforcement learning for such systems is limited by credit assignment: shared terminal rewards obscure individual contributions and can encourage free-riding. We introduce two optimizer-agnostic credit assignment methods for converting joint outcomes into agent-specific learning signals. Counterfactual Credit for Policy Optimization (CCPO) estimates an agent's marginal contribution by comparing the realized joint outcome with a counterfactual outcome where that agent is removed. Self-Evaluated Credit for Policy Optimization (SEPO) uses constrained self- and peer-evaluations as a verifier-anchored credit signal while keeping the external task outcome dominant. Both operate at the reward-construction layer rather than as policy optimizers, producing role-specific rewards or advantages for GRPO, GSPO, or REINFORCE++. We instantiate these credit signals in a sequential Think--Solve setting and evaluate them on mathematical reasoning benchmarks. Results show that explicit credit assignment often improves dual-agent reasoning, especially on MATH500 and several out-of-distribution settings, while gains vary across models and datasets. Our code is available at: https://github.com/bhai114/ccpo.

2603.16013 2026-06-12 cs.RO cs.SE 版本更新

Safety Case Patterns for VLA-based driving systems: Insights from SimLingo

基于VLA的驾驶系统的安全案例模式:来自SimLingo的见解

Gerhard Yu, Fuyuki Ishikawa, Oluwafemi Odu, Alvine Boaye Belle

发表机构 * York University(约克大学) National Institute of Informatics(国家信息研究所)

AI总结 针对VLA驾驶系统提出RAISE安全案例设计方法,通过扩展HARA和定制模式,结合SimLingo案例验证其构建基于证据的安全声明的有效性。

详情
AI中文摘要

基于视觉-语言-动作(VLA)的驾驶系统代表了自动驾驶领域的重大范式转变,因为通过结合交通场景理解、语言解释和动作生成,这些系统能够实现更灵活、自适应和响应指令的驾驶行为。然而,尽管它们被越来越多地采用,并具有支持社会责任型自动驾驶以及理解高级人类指令的潜力,基于VLA的驾驶系统可能表现出新型的危险行为。例如,将开放式的自然语言输入(如用户或导航指令)集成到多模态控制回路中可能导致不可预测和不安全的行为,从而危及车辆乘员和行人。因此,确保这些系统的安全性对于建立对其运行的信任至关重要。为此,我们提出了一种名为RAISE的新型安全案例设计方法。我们的方法引入了针对基于指令的驾驶系统(如VLA驾驶系统)定制的新模式,扩展了危害分析和风险评估(HARA),详细说明了安全场景及其结果,并设计了一种创建VLA驾驶系统安全案例的技术。在SimLingo上的案例研究说明了如何使用我们的方法为这类新兴的自动驾驶系统构建严谨的、基于证据的安全声明。

英文摘要

Vision-Language-Action (VLA)-based driving systems represent a significant paradigm shift in autonomous driving since, by combining traffic scene understanding, linguistic interpretation, and action generation, these systems enable more flexible, adaptive, and instruction-responsive driving behaviors. However, despite their growing adoption and potential to support socially responsible autonomous driving as well as understanding high-level human instructions, VLA-based driving systems may exhibit new types of hazardous behaviors. For instance, the integration of open-ended natural language inputs (e.g., user or navigation instructions) into the multimodal control loop may lead to unpredictable and unsafe behaviors that could endanger vehicle occupants and pedestrians. Hence, assuring the safety of these systems is crucial to help build trust in their operations. To support this, we propose a novel safety case design approach called RAISE. Our approach introduces novel patterns tailored to instruction-based driving systems such as VLA-based driving systems, an extension of Hazard Analysis and Risk Assessment (HARA) detailing safe scenarios and their outcomes, and a design technique to create the safety cases of VLA-based driving systems. A case study on SimLingo illustrates how our approach can be used to construct rigorous, evidence-based safety claims for this emerging class of autonomous driving systems.

2603.14482 2026-06-12 cs.CV 版本更新

V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learning

V-JEPA 2.1: 解锁视频自监督学习中的密集特征

Lorenzo Mur-Labadia, Matthew Muckley, Amir Bar, Mido Assran, Koustuv Sinha, Mike Rabbat, Yann LeCun, Nicolas Ballas, Adrien Bardes

发表机构 * FAIR at Meta(Meta的FAIR) Universidad de Zaragoza(萨拉戈萨大学)

AI总结 提出V-JEPA 2.1系列自监督模型,通过密集预测损失、深度自监督、多模态分词器和有效缩放,学习图像和视频的密集高质量视觉表示,在多个基准上取得最优性能。

详情
AI中文摘要

我们提出V-JEPA 2.1,一系列自监督模型,能够学习图像和视频的密集、高质量视觉表示,同时保持强大的全局场景理解。该方法结合了四个关键组件。首先,密集预测损失使用基于掩码的目标,其中可见和掩码令牌都贡献于训练信号,鼓励显式的空间和时间接地。其次,深度自监督在多个中间编码器层上分层应用自监督目标,以提高表示质量。第三,多模态分词器实现了图像和视频的统一训练。最后,该模型受益于模型容量和训练数据的有效缩放。这些设计选择共同产生了空间结构、语义一致和时间连贯的表示。实验上,V-JEPA 2.1在几个具有挑战性的基准上取得了最先进的性能,包括在Ego4D上短期物体交互预测的7.71 mAP,在EPIC-KITCHENS上高级动作预测的40.8 Recall@5,以及在实际机器人抓取成功率上比V-JEPA-2 AC提高了20个百分点。该模型还在机器人导航(TartanDrive上5.687 ATE)、深度估计(NYUv2上线性探针0.307 RMSE)和全局识别(Something-Something-V2上77.7)方面表现出强大的性能。这些结果表明,V-JEPA 2.1显著推进了密集视觉理解和世界建模的最新技术。

英文摘要

We present V-JEPA 2.1, a family of self-supervised models that learn dense, high-quality visual representations for both images and videos while retaining strong global scene understanding. The approach combines four key components. First, a dense predictive loss uses a masking-based objective in which both visible and masked tokens contribute to the training signal, encouraging explicit spatial and temporal grounding. Second, deep self-supervision applies the self-supervised objective hierarchically across multiple intermediate encoder layers to improve representation quality. Third, multi-modal tokenizers enable unified training across images and videos. Finally, the model benefits from effective scaling in both model capacity and training data. Together, these design choices produce representations that are spatially structured, semantically coherent, and temporally consistent. Empirically, V-JEPA 2.1 achieves state-of-the-art performance on several challenging benchmarks, including 7.71 mAP on Ego4D for short-term object-interaction anticipation and 40.8 Recall@5 on EPIC-KITCHENS for high-level action anticipation, as well as a 20-point improvement in real-robot grasping success rate over V-JEPA-2 AC. The model also demonstrates strong performance in robotic navigation (5.687 ATE on TartanDrive), depth estimation (0.307 RMSE on NYUv2 with a linear probe), and global recognition (77.7 on Something-Something-V2). These results show that V-JEPA 2.1 significantly advances the state of the art in dense visual understanding and world modeling.

2603.15158 2026-06-12 cs.LG 版本更新

Point-Identification of a Robust Predictor Under Latent Shift with Imperfect Proxies

在不完美代理下潜在偏移中鲁棒预测器的点识别

Zahra Rahiminasab, Reza Soumi, Arto Klami, Samuel Kaski

发表机构 * Department of Computer Science, Aalto University(阿尔托大学计算机科学系) Department of Computer Science, University of Helsinki(赫尔辛基大学计算机科学系) ELLIS Institute Finland(芬兰埃利斯研究所) Department of Computer Science, Manchester University(曼彻斯特大学计算机科学系)

AI总结 针对潜在混淆变量导致的域适应问题,提出基于潜在等价类的点识别方法,通过跨域秩条件替代强完备性假设,并设计主动学习框架PQAL实现鲁棒预测。

详情
AI中文摘要

当跨域的分布偏移源于同时影响协变量和结果的潜在混淆变量时,域适应问题变得更加具有挑战性。现有的基于代理的方法通过强完备性假设来唯一确定(点识别)鲁棒预测器。完备性要求代理具有关于潜在混淆变量变化的足够信息。对于不完美代理,从混淆变量到代理分布空间的映射是非单射的,多个潜在混淆变量值可能生成相同的代理分布。这破坏了完备性假设,观测数据与多个潜在预测器(集识别)一致。为了解决这个问题,我们引入了潜在等价类(LECs)。LECs定义为诱导相同条件代理分布的潜在混淆变量组。我们证明,只要多个域在如何混合代理诱导的LECs以形成鲁棒预测器方面有足够差异,鲁棒预测器的点识别仍然可以实现。这种域多样性条件被形式化为混合权重的跨域秩条件,该条件比完备性假设弱得多。我们提出了近端准贝叶斯主动学习(PQAL)框架,该框架主动查询满足该秩条件的小型、有针对性的多样化域集合。PQAL可以恢复点识别的预测器,展示了对不同程度偏移的鲁棒性,并在合成数据、半合成dSprites、IHDP、ACS Folktables数据集上优于先前方法。

英文摘要

Addressing the domain adaptation problem becomes more challenging when distribution shifts across domains stem from latent confounders that affect both covariates and outcomes. Existing proxy-based approaches that address latent shift rely on a strong completeness assumption to uniquely determine (point-identify) a robust predictor. Completeness requires that proxies have sufficient information about variations in latent confounders. For imperfect proxies the mapping from confounders to the space of proxy distributions is non-injective, and multiple latent confounder values can generate the same proxy distribution. This breaks the completeness assumption and observed data are consistent with multiple potential predictors (set-identified). To address this, we introduce latent equivalent classes (LECs). LECs are defined as groups of latent confounders that induce the same conditional proxy distribution. We show that point-identification for the robust predictor remains achievable as long as multiple domains differ sufficiently in how they mix proxy-induced LECs to form the robust predictor. This domain diversity condition is formalized as a cross-domain rank condition on the mixture weights, which is substantially weaker assumption than completeness. We introduce the Proximal Quasi-Bayesian Active learning (PQAL) framework, which actively queries a small, targeted set of diverse domains that satisfy this rank condition. PQAL can recover the point-identified predictor, demonstrates robustness to varying degrees of shift and outperforms previous methods on synthetic data and semi-synthetic dSprites, IHDP, ACS Folktables datasets.

2603.11249 2026-06-12 cs.LG 版本更新

Differentiable Thermodynamic Phase-Equilibria for Machine Learning

可微热力学相平衡用于机器学习

Karim K. Ben Hicham, Moreno Ascani, Jan G. Rittig, Alexander Mitsos

发表机构 * RWTH Aachen University(亚琛工业大学) Process Systems Engineering (AVT.SVT)(过程系统工程) Forschungszentrum Jülich GmbH(吕根研究中心) Institute of Climate and Energy Systems ICE-1(气候与能源系统研究所) Energy Systems Engineering(能源系统工程) JARA-ENERGY

AI总结 提出DISCOMAX算法,通过可微相平衡计算结合离散枚举与掩码softmax,实现热力学一致性端到端学习,在二元液液平衡数据上优于现有方法。

详情
Comments
45 pages, 27 figures, 5 tables
AI中文摘要

相平衡的准确预测仍是化学工程中的核心挑战。将热力学结构融入神经网络的物理一致性机器学习方法最近在活度系数建模中表现出色。然而,将此类方法扩展到源于极值原理的平衡数据(如液液平衡)仍然困难。本文提出DISCOMAX,一种用于相平衡计算的可微算法,在训练和推理时均保证热力学一致性,仅受用户指定的离散化影响。该方法将可行相态的离散枚举与反向传播中的掩码softmax聚合相结合,在前向传播中传播真实平衡态,使用直通梯度估计器实现神经gE模型的物理一致性端到端学习。我们展示了该方法与统计热力学的类比,并在二元液液平衡数据上评估,其优于现有基于代理的方法,同时为从不同种类的平衡数据中学习提供了通用框架。

英文摘要

Accurate prediction of phase equilibria remains a central challenge in chemical engineering. Physics-consistent machine learning methods that incorporate thermodynamic structure into neural networks have recently shown strong performance for activity-coefficient modeling. However, extending such approaches to equilibrium data arising from an extremum principle, such as liquid-liquid equilibria, remains difficult. Here we present DISCOMAX, a differentiable algorithm for phase-equilibrium calculation that guarantees thermodynamic consistency at both training and inference, only subject to a user-specified discretization. The method combines discrete enumeration of feasible phase states with masked softmax aggregation in the backward pass, with the propagation of the true equilibrium state in the forward pass, using a straight-through gradient estimator to enable physics-consistent end-to-end learning of neural \gls{gE}-models. We show that this approach bears analogy to statistical thermodynamics, and we evaluate it on binary liquid-liquid equilibrium data where it outperforms existing surrogate-based methods, while offering a general framework for learning from different kinds of equilibrium data.

2603.14483 2026-06-12 cs.LG 版本更新

Disentangling Dynamical Systems: Causal Representation Learning Meets Local Sparse Attention

解耦动力系统:因果表示学习遇见局部稀疏注意力

Markus W. Baumgartner, Anson Lei, Joe Watson, Ingmar Posner

发表机构 * Applied Artificial Intelligence Lab, Oxford Robotics Institute, Oxford, UK(应用人工智能实验室,牛津机器人研究所,英国牛津)

AI总结 提出一种结合因果表示学习和局部稀疏注意力的方法,从原始轨迹数据中无结构假设地解耦系统参数,并通过图论准则保证可辨识性。

详情
Journal ref
Proceedings of Machine Learning Research 323, 2026
Comments
Presented as an Oral at the 5th Conference on Causal Learning and Reasoning
AI中文摘要

参数化系统辨识方法从数据中估计显式定义的物理系统的参数。然而,它们仍然受限于需要提供显式函数空间,通常通过基于可用领域知识预定义的候选函数库。相比之下,深度学习能够以高保真度对广泛复杂性的系统进行建模,但黑箱函数逼近通常无法产生揭示系统结构的显式描述性或解耦表示。我们开发了一种新的可辨识性定理,利用因果表示学习,在没有结构假设的情况下发现系统参数的解耦表示。我们推导了一个图论准则,指定何时系统参数可以从原始轨迹数据中唯一解耦,直至置换和微分同胚。关键的是,我们的分析表明,全局因果结构为考虑局部状态依赖因果结构时可实现的解耦保证提供了下界。我们将系统参数识别实例化为变分推断问题,利用稀疏正则化变换器来发现状态依赖的因果结构。我们在四个合成领域上实证验证了我们的方法,证明了其恢复基线方法无法恢复的高度解耦表示的能力。与我们的理论分析一致,我们的结果证实了强制局部因果结构通常对于完全可辨识性是必要的。

英文摘要

Parametric system identification methods estimate the parameters of explicitly defined physical systems from data. Yet, they remain constrained by the need to provide an explicit function space, typically through a predefined library of candidate functions chosen via available domain knowledge. In contrast, deep learning can demonstrably model systems of broad complexity with high fidelity, but black-box function approximation typically fails to yield explicit descriptive or disentangled representations revealing the structure of a system. We develop a novel identifiability theorem, leveraging causal representation learning, to uncover disentangled representations of system parameters without structural assumptions. We derive a graphical criterion specifying when system parameters can be uniquely disentangled from raw trajectory data, up to permutation and diffeomorphism. Crucially, our analysis demonstrates that global causal structures provide a lower bound on the disentanglement guarantees achievable when considering local state-dependent causal structures. We instantiate system parameter identification as a variational inference problem, leveraging a sparsity-regularised transformer to uncover state-dependent causal structures. We empirically validate our approach across four synthetic domains, demonstrating its ability to recover highly disentangled representations that baselines fail to recover. Corroborating our theoretical analysis, our results confirm that enforcing local causal structure is often necessary for full identifiability.

2603.14407 2026-06-12 cs.LG 版本更新

Towards One-for-All Anomaly Detection for Tabular Data

面向表格数据的通用异常检测

Shiyuan Li, Yixin Liu, Yu Zheng, Xiaofeng Cao, Shirui Pan, Heng Tao Shen

发表机构 * University of Science and Technology of China(中国科学技术大学)

AI总结 提出OFA-TAD框架,通过多视图邻居距离表示和混合专家评分网络,实现跨领域表格异常检测的通用化,一次训练即可泛化到未见数据集。

详情
Comments
Accepted by ICML 2026
AI中文摘要

表格异常检测(TAD)旨在识别表格数据中偏离大多数样本的样本,在许多实际应用中至关重要。然而,现有方法遵循“一个数据集一个模型(OFO)”范式,依赖于数据集特定的训练,导致计算成本高且对未见领域的泛化能力有限。为解决这些局限性,我们提出OFA-TAD,一个通用的“一劳永逸(OFA)”TAD框架,只需在多个源数据集上进行一次训练,即可即时泛化到来自不同领域的未见数据集。为实现通用表格异常检测,OFA-TAD提取邻居距离模式作为可迁移线索,并引入来自多个变换诱导度量空间的多视图邻居距离表示,以减轻距离分布对变换的敏感性。为自适应组合多视图距离证据,采用混合专家(MoE)评分网络进行视图特定异常评分和熵正则化门控融合,并采用多策略异常合成机制以支持单类约束下的训练。在来自14个领域的34个数据集上的大量实验表明,OFA-TAD在严格的OFA设置下实现了优越的异常检测性能和强大的跨领域泛化能力。源代码见:https://this URL。

英文摘要

Tabular anomaly detection (TAD) aims to identify samples that deviate from the majority in tabular data and is critical in many real-world applications. However, existing methods follow a ``one model for one dataset (OFO)'' paradigm, which relies on dataset-specific training and thus incurs high computational cost and yields limited generalization to unseen domains. To address these limitations, we propose OFA-TAD, a generalist one-for-all (OFA) TAD framework that only requires one-time training on multiple source datasets and can generalize to unseen datasets from diverse domains on-the-fly. To realize one-for-all tabular anomaly detection, OFA-TAD extracts neighbor-distance patterns as transferable cues, and introduces multi-view neighbor-distance representations from multiple transformation-induced metric spaces to mitigate the transformation sensitivity of distance profiles. To adaptively combine multi-view distance evidence, a Mixture-of-Experts (MoE) scoring network is employed for view-specific anomaly scoring and entropy-regularized gated fusion, with a multi-strategy anomaly synthesis mechanism to support training under the one-class constraint. Extensive experiments on 34 datasets from 14 domains demonstrate that OFA-TAD achieves superior anomaly detection performance and strong cross-domain generalizability under the strict OFA setting. The source code is available at https://github.com/Shiy-Li/OFA-TAD.

2603.10834 2026-06-12 cs.CV cs.AI 版本更新

On the Reliability of Cue Conflict and Beyond

论线索冲突的可靠性及其超越

Pum Jun Kim, Seung-Ah Lee, Seongho Park, Dongyoon Han, Jaejun Yoo

发表机构 * Ulsan National Institute of Science and Technology(乌山国立科学研究院) College of Medicine, Hanyang University(翰阳大学医学院) NAVER AI Lab(NAVER AI实验室)

AI总结 针对现有线索冲突基准在评估形状-纹理偏好时存在不稳定和模糊的问题,提出REFINED-BIAS数据集与评估框架,通过显式定义形状和纹理、构建平衡的线索对及基于排序的度量,实现更可靠和可解释的偏差诊断。

详情
Comments
Shape-Texture Bias, Cue Conflict Benchmark
AI中文摘要

理解神经网络如何依赖视觉线索提供了其内部决策过程的人类可解释视角。线索冲突基准在探究形状-纹理偏好以及激发更强、类人形状偏差通常与改进的域内性能相关的见解方面具有影响力。然而,我们发现当前基于风格化的实例化可能产生不稳定和模糊的偏差估计。具体来说,风格化可能无法可靠地实例化感知上有效且可分离的线索,也无法控制其相对信息量;基于比率的偏差可能掩盖绝对线索敏感性;将评估限制在预选类别可能忽略完整决策空间而扭曲模型预测。这些因素共同可能将偏好与线索有效性、线索平衡和可识别性伪影混淆。我们引入了REFINED-BIAS,一个用于可靠和可解释的形状-纹理偏差诊断的集成数据集和评估框架。REFINED-BIAS使用形状和纹理的显式定义构建平衡的、人类和模型可识别的线索对,并通过基于排序的度量测量完整标签空间上的线索特定敏感性,从而实现更公平的跨模型比较。在不同的训练范式和架构中,REFINED-BIAS实现了更公平的跨模型比较、更忠实的形状和纹理偏差诊断以及更清晰的实证结论,解决了先前线索冲突评估无法可靠区分的矛盾。

英文摘要

Understanding how neural networks rely on visual cues offers a human-interpretable view of their internal decision processes. The cue-conflict benchmark has been influential in probing shape-texture preference and in motivating the insight that stronger, human-like shape bias is often associated with improved in-domain performance. However, we find that the current stylization-based instantiation can yield unstable and ambiguous bias estimates. Specifically, stylization may not reliably instantiate perceptually valid and separable cues nor control their relative informativeness, ratio-based bias can obscure absolute cue sensitivity, and restricting evaluation to preselected classes can distort model predictions by ignoring the full decision space. Together, these factors can confound preference with cue validity, cue balance, and recognizability artifacts. We introduce REFINED-BIAS, an integrated dataset and evaluation framework for reliable and interpretable shape-texture bias diagnosis. REFINED-BIAS constructs balanced, human- and model- recognizable cue pairs using explicit definitions of shape and texture, and measures cue-specific sensitivity over the full label space via a ranking-based metric, enabling fairer cross-model comparisons. Across diverse training regimes and architectures, REFINED-BIAS enables fairer cross-model comparison, more faithful diagnosis of shape and texture biases, and clearer empirical conclusions, resolving inconsistencies that prior cue-conflict evaluations could not reliably disambiguate.

2603.11479 2026-06-12 cs.LG cs.AI cs.MA 版本更新

Grammar of the Wave: Towards Explainable Multivariate Time Series Event Detection via Neuro-Symbolic VLM Agents

波的语法:通过神经符号VLM智能体实现可解释的多变量时间序列事件检测

Sky Chenwei Wan, Yifei Y. Wang, Tianjun Hou, Xiqing Chang, Aymeric Jan

发表机构 * AI Lab, SLB(SLB人工智能实验室) Télécom Paris, Institut Polytechnique de Paris, France(巴黎电信学院,巴黎高等理工学院,法国)

AI总结 提出语言引导的时间序列事件检测(TSED)任务,通过事件逻辑树(ELT)将文本描述转化为结构化时序逻辑,并构建神经符号VLM智能体SELA,实现零/少样本事件检测与可解释推理。

详情
Comments
8 pages (main text), 28 pages total including appendix. 9 figures, 7 tables
AI中文摘要

时间序列事件检测(TSED)旨在定位时间序列数据中具有语义意义的事件,在高风险领域具有关键应用。与统计异常不同,事件通常由自然语言描述定义,且跨多个物理通道具有内部时序逻辑结构。然而,在现实场景中,密集的事件标注成本高昂,使得纯监督学习困难。我们引入了语言引导的TSED,该设置中模型被赋予文本事件描述,并必须在几乎没有标注数据的情况下将其映射到多变量信号中的区间。为了解决这个问题,我们提出了事件逻辑树(ELT),一种知识表示框架,将语言描述转化为信号基元上的结构化时序逻辑。基于ELT,我们提出了SELA,一种神经符号VLM智能体框架,它从信号可视化中迭代地接地基元,并在ELT约束下组合它们,产生事件区间和忠实的树状结构解释。我们进一步发布了跨能源和气候领域的真实世界基准,包含专家知识和标注。实验表明,SELA优于监督微调和现有的零/少样本时间序列推理基线。

英文摘要

Time Series Event Detection (TSED) aims to localize semantically meaningful events in time series data, with critical applications in high-stakes domains. Unlike statistical anomalies, events are often defined by natural-language descriptions with internal temporal-logic structures across multiple physical channels. However, in real-world settings, dense event annotations are expensive to obtain, making purely supervised learning difficult. We introduce Language-guided TSED, a setting where a model is given textual event descriptions and must ground them to intervals in multivariate signals with little or no labeled data. To address this problem, we propose Event Logic Tree (ELT), a knowledge representation framework that converts linguistic descriptions into structured temporal logic over signal primitives. Building on ELT, we present SELA, a neuro-symbolic VLM agent framework that iteratively grounds primitives from signal visualizations and composes them under ELT constraints, producing both event intervals and faithful tree-structured explanations. We further release a real-world benchmark across energy and climate domains with expert knowledge and annotations. Experiments show that SELA improves over supervised fine-tuning and existing zero/few-shot time series reasoning baselines.

2603.08505 2026-06-12 cs.LG cs.AI 版本更新

Echo2ECG: Enhancing ECG Representations with Cardiac Morphology from Multi-View Echos

Echo2ECG:利用多视角超声心动图的心脏形态增强心电图表示

Michelle Espranita Liman, Özgün Turgut, Alexander Müller, Eimo Martens, Daniel Rueckert, Philip Müller

发表机构 * Chair for AI in Healthcare and Medicine, Technical University of Munich (TUM) and TUM University Hospital(人工智能在医疗与医学中的中心,慕尼黑技术大学(TUM)和慕尼黑大学医院) Department of Cardiology, TUM University Hospital(心血管科,慕尼黑大学医院) Department of Computing, Imperial College London(计算系,伦敦帝国理工学院) Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心(MCML))

AI总结 提出Echo2ECG多模态自监督学习框架,通过多视角超声心动图丰富心电图表示,在结构表型分类和超声检索任务上优于现有方法,模型大小仅为最大基线的1/18。

详情
Comments
Accepted at MICCAI 2026
AI中文摘要

心电图(ECG)是一种低成本、广泛使用的模态,通过捕捉心脏电活动来诊断电异常(如房颤)。然而,它无法直接测量心脏形态表型,如左心室射血分数(LVEF),这通常需要超声心动图(Echo)。从ECG预测这些表型将实现早期、可及的健康筛查。现有的自监督方法通过将ECG与单视角Echo对齐而遭受表示不匹配,单视角Echo仅捕捉局部、空间受限的解剖快照。为解决此问题,我们提出Echo2ECG,一种多模态自监督学习框架,利用多视角Echo中捕捉的心脏形态结构丰富ECG表示。我们在两个根本上需要形态信息的临床相关任务上评估Echo2ECG作为ECG特征提取器:(1)跨三个数据集的结构性心脏表型分类,以及(2)使用ECG查询检索具有相似形态特征的Echo研究。我们的提取的ECG表示在两个任务上始终优于最先进的单模态和多模态基线,尽管模型大小仅为最大基线的1/18。这些结果表明Echo2ECG是一个鲁棒、强大的ECG特征提取器。我们的代码可从此https URL获取。

英文摘要

Electrocardiography (ECG) is a low-cost, widely used modality for diagnosing electrical abnormalities like atrial fibrillation by capturing the heart's electrical activity. However, it cannot directly measure cardiac morphological phenotypes, such as left ventricular ejection fraction (LVEF), which typically require echocardiography (Echo). Predicting these phenotypes from ECG would enable early, accessible health screening. Existing self-supervised methods suffer from a representational mismatch by aligning ECGs to single-view Echos, which only capture local, spatially restricted anatomical snapshots. To address this, we propose Echo2ECG, a multimodal self-supervised learning framework that enriches ECG representations with the heart's morphological structure captured in multi-view Echos. We evaluate Echo2ECG as an ECG feature extractor on two clinically relevant tasks that fundamentally require morphological information: (1) classification of structural cardiac phenotypes across three datasets, and (2) retrieval of Echo studies with similar morphological characteristics using ECG queries. Our extracted ECG representations consistently outperform those of state-of-the-art unimodal and multimodal baselines across both tasks, despite being 18x smaller than the largest baseline. These results demonstrate that Echo2ECG is a robust, powerful ECG feature extractor. Our code is accessible at https://github.com/michelleespranita/Echo2ECG.

2603.06652 2026-06-12 cs.CV cs.AI 版本更新

PaLMR: Towards Faithful Visual Reasoning via Multimodal Process Alignment

PaLMR: 通过多模态过程对齐实现忠实视觉推理

Yantao Li, Qiang Hui, Chenyang Yan, Kanzhi Cheng, Fang Zhao, Chao Tan, Huanling Gao, Jianbing Zhang, Kai Wang, Xinyu Dai, Shiguo Lian

发表机构 * National Key Laboratory for Novel Software Technology, Nanjing University(南京大学新型软件技术国家重点实验室) Data Science & Artificial Intelligence Research Institute, China Unicom(中国unicom数据科学与人工智能研究院) Unicom Data Intelligence, China Unicom(中国unicom数据智能)

AI总结 提出PaLMR框架,通过感知对齐数据层和过程对齐优化层,减少推理幻觉并提升视觉推理忠实度,在多个基准上取得最优结果。

详情
Journal ref
CVPR 2026 Findings
AI中文摘要

强化学习近期提升了大语言模型和多模态大语言模型的推理能力,但现有的奖励设计强调最终答案的正确性,因此容忍过程幻觉——即模型在得到正确答案的同时错误感知视觉证据的情况。我们通过PaLMR框架解决这种过程层面的不对齐,该框架不仅对齐结果,还对齐推理过程本身。PaLMR包含两个互补组件:一个感知对齐数据层,构建具有结构化伪真值和可验证视觉事实的过程感知推理数据;以及一个过程对齐优化层,构建具有过程感知评分函数的分层奖励融合方案,以鼓励视觉上可信的思维链并提高训练稳定性。在Qwen2.5-VL-7B上的实验表明,我们的方法显著减少了推理幻觉并提高了视觉推理忠实度,在HallusionBench上取得了最先进的结果,同时在MMMU、MathVista和MathVerse上保持了强劲性能。这些发现表明,PaLMR为过程对齐的多模态推理提供了一条原则性且实用的路径,推进了MLLM的可靠性和可解释性。

英文摘要

Reinforcement learning has recently improved the reasoning ability of Large Language Models and Multimodal LLMs, yet prevailing reward designs emphasise final-answer correctness and consequently tolerate process hallucinations--cases where models reach the right answer while misperceiving visual evidence. We address this process-level misalignment with PaLMR, a framework that aligns not only outcomes but also the reasoning process itself. PaLMR comprises two complementary components: a perception-aligned data layer that constructs process-aware reasoning data with structured pseudo-ground-truths and verifiable visual facts, and a process-aligned optimisation layer that constructs a hierarchical reward fusion scheme with a process-aware scoring function to encourage visually faithful chains-of-thought and improve training stability. Experiments on Qwen2.5-VL-7B show that our approach substantially reduces reasoning hallucinations and improves visual reasoning fidelity, achieving state-of-the-art results on HallusionBench while maintaining strong performance on MMMU, MathVista, and MathVerse. These findings indicate that PaLMR offers a principled and practical route to process-aligned multimodal reasoning, advancing the reliability and interpretability of MLLMs.

2603.05965 2026-06-12 cs.RO cs.CV 版本更新

PROBE: Probabilistic Occupancy BEV Encoding with Analytical Translation Robustness for 3D Place Recognition

PROBE: 具有解析平移鲁棒性的概率占用BEV编码用于3D地点识别

Jinseop Lee, Byoungho Lee, Gichul Yoo

发表机构 * SK Intellix

AI总结 提出无学习的LiDAR地点描述符PROBE,通过极坐标雅可比解析边缘化连续平移,实现距离自适应角度不确定性,在跨传感器泛化中取得高精度。

详情
Comments
8 pages, 8 figures. Accepted for publication in IEEE Robotics and Automation Letters (RA-L). \c{opyright} 2026 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses
AI中文摘要

我们提出PROBE(概率占用BEV编码),一种无学习的LiDAR地点识别描述符,将每个BEV单元的占用建模为伯努利随机变量。PROBE不依赖于离散点云扰动,而是通过极坐标雅可比解析边缘化连续笛卡尔平移,在O(R·S)时间内得到距离自适应角度不确定性σ_θ = σ_t / r。主要参数σ_t表示以米为单位的预期平移不确定性,这是一种与传感器无关的物理量,增强了跨传感器泛化能力,同时减少了对每个数据集大量调参的需求。成对相似性结合了伯努利-KL Jaccard与指数不确定性门控以及基于FFT的高度余弦相似性用于旋转对齐。在涵盖四种不同LiDAR类型的四个数据集上评估,PROBE在多会话评估中实现了手工描述符中最高的精度,并且在单会话性能上与手工和监督基线相比具有竞争力。源代码和补充材料可在该https URL获取。

英文摘要

We present PROBE (PRobabilistic Occupancy BEV Encoding), a learning-free LiDAR place recognition descriptor that models each BEV cell's occupancy as a Bernoulli random variable. Rather than relying on discrete point-cloud perturbations, PROBE analytically marginalizes over continuous Cartesian translations via the polar Jacobian, yielding a distance-adaptive angular uncertainty $σ_θ= σ_t / r$ in $\mathcal{O}(R{\cdot}S)$ time. The primary parameter $σ_t$ represents the expected translational uncertainty in meters, a sensor-independent physical quantity that enhances cross-sensor generalization while reducing the need for extensive per-dataset tuning. Pairwise similarity combines a Bernoulli-KL Jaccard with exponential uncertainty gating and FFT-based height cosine similarity for rotation alignment. Evaluated on four datasets spanning four diverse LiDAR types, PROBE achieves the highest accuracy among handcrafted descriptors in multi-session evaluation and competitive single-session performance relative to both handcrafted and supervised baselines. The source code and supplementary materials are available at https://sites.google.com/view/probe-pr.