arXivDaily arXiv每日学术速递 周一至周五更新
2604.04917 2026-06-19 cs.CV cs.AI cs.CL 版本更新

Vero: An Open RL Recipe for General Visual Reasoning

Vero: 通用视觉推理的开放RL配方

Gabriel Sarch, Linrong Cai, Qunzhong Wang, Haoyang Wu, Danqi Chen, Zhuang Liu

发表机构 * Princeton University(普林斯顿大学)

AI总结 提出Vero系列开放视觉语言模型,通过构建600K样本数据集Vero-600K和任务路由奖励,在30个基准测试中平均提升2.9-5.4点,Vero-Qwen3I-8B超越Qwen3-VL-8B-Thinking 3.8点。

Comments Project page: https://vero-reasoning.github.io/

详情
AI中文摘要

构建一个能在图表、科学、空间理解和开放式任务中工作的视觉推理器需要什么?最强的视觉语言模型(VLM)表明广泛的视觉推理是可以实现的,但其封闭的数据和强化学习(RL)流程使得其成果难以研究、复现或扩展。我们引入了Vero,一个完全开放的VLM系列,在各种视觉推理任务中匹配或超越现有的开放权重模型。我们跨六个广泛的任务类别扩展RL数据和奖励,构建了Vero-600K,一个来自59个数据集的600K样本数据集,并设计了处理异构答案的任务路由奖励。在我们的30个基准测试套件VeroEval中,Vero-600K在受控比较下优于现有的RL数据集。应用于五个起始模型,Vero变体在其初始模型上平均获得2.9-5.4分的提升。值得注意的是,基于Instruct模型训练的Vero-Qwen3I-8B,在没有额外蒸馏的情况下,平均超过Qwen3-VL-8B-Thinking 3.8分。系统的消融实验揭示,不同的任务类别引发不同的推理模式,而广泛的收益依赖于联合学习它们,而非孤立学习。所有数据、代码和模型均已公开。

英文摘要

What does it take to build a visual reasoner that works across charts, science, spatial understanding, and open-ended tasks? The strongest vision-language models (VLMs) suggest that broad visual reasoning is within reach, yet their closed data and reinforcement learning (RL) pipelines make their gains difficult to study, reproduce, or extend. We introduce Vero, a family of fully open VLMs that match or exceed existing open-weight models across diverse visual reasoning tasks. We scale RL data and rewards across six broad task categories, constructing Vero-600K, a 600K-sample dataset from 59 datasets, and designing task-routed rewards that handle heterogeneous answers. Across VeroEval, our 30-benchmark suite, Vero-600K outperforms existing RL datasets under controlled comparisons. Applied to five starting models, Vero variants gain 2.9-5.4 points on average over their initial models. Notably, Vero-Qwen3I-8B, trained on the Instruct model, surpasses Qwen3-VL-8B-Thinking by 3.8 points on average without additional distillation. Systematic ablations reveal that different task categories elicit distinct reasoning patterns and that broad gains depend on learning them jointly rather than in isolation. All data, code, and models are publicly available.

2604.05435 2026-06-19 cs.AI 版本更新

CareTransition-Audit: A Benchmark to Audit Discharge Summaries for Efficient Care Transitions

CareTransition-Audit:用于高效护理过渡的出院总结审计基准

Akshat Dasula, Prasanna Desikan, Jaideep Srivastava, Shivali Dalmia, Abhishek Mukherji

发表机构 * Department of Computer Science \& Engineering, University of Minnesota-Twin Cities, Minneapolis, USA Centific AI Research, Redmond, USA

AI总结 提出基于大语言模型的自动化框架,通过46项检查清单审计出院总结完整性,在MIMIC-IV数据集上基准测试11个模型,最佳模型与临床医生标签的Cohen's kappa约0.5,所有模型难以识别模糊文档。

Comments Accepted as a poster at IEEE-ICHI 2026; Accepted at SD4H@ICML

详情
AI中文摘要

不完整或不一致的出院文档会导致护理碎片化和可避免的再入院。尽管其在患者安全中至关重要,但审计出院总结依赖于人工审查且无法扩展。我们提出一个使用大语言模型(LLM)的自动化审计框架。我们的方法将DISCHARGED框架操作化为一个包含46个问题的检查清单。使用来自MIMIC-IV数据库的50份总结及临床医生真实标签,我们对11个LLM进行基准测试。模型评估的平均文档完整性范围为54.9%至74.2%,最佳模型与临床医生标签的Cohen's kappa值约为0.5,表明中等一致性。所有模型在识别模糊文档(Unclear)方面均存在困难,突显了当前自动化审计的关键差距。本工作为临床文档的系统性质量改进提供了临床医生验证的基准和零样本基线。

英文摘要

Incomplete or inconsistent discharge documentation drives care fragmentation and avoidable readmissions. Despite its critical role in patient safety, auditing discharge summaries relies on manual review and does not scale. We propose an automated framework for auditing discharge summaries using large language models (LLMs). Our approach operationalizes the DISCHARGED framework into a checklist of 46 questions. Using 50 summaries from the MIMIC-IV database, with clinician ground-truth labels, we benchmark 11 LLMs. Model-assessed mean documentation completeness ranges from 54.9% to 74.2%, and the best-performing models achieve a Cohen's kappa values around 0.5 against clinician labels, indicating moderate agreement. All models struggle to identify ambiguous documentation (Unclear), highlighting a key gap in current automated auditing. This work provides a clinician-validated benchmark and zero-shot baselines for systematic quality improvement in clinical documentation.

2604.03146 2026-06-19 stat.ML cs.LG 版本更新

Characterization of Gaussian Universality Breakdown in High-Dimensional Empirical Risk Minimization

高维经验风险最小化中高斯普适性破坏的表征

Chiheb Yaakoubi, Cosme Louart, Malik Tiomoko, Zhenyu Liao

发表机构 * School of Data Science, The Chinese University of Hong Kong, Shenzhen, China Huawei Noah's Ark Lab, Huawei Technologies, Paris, France School of Electronic Information Communications, Huazhong University of Science \& Technology, China

AI总结 通过将凸高斯极小极大定理推广到非高斯数据,刻画了高维经验风险最小化估计量的渐近分布,揭示了高斯普适性的适用范围与局限。

Comments 28 pages, 5 figures, 1 table

Journal ref ICML 2026

详情
AI中文摘要

我们研究了一般非高斯数据设计下的高维凸经验风险最小化(ERM)。通过启发式地将凸高斯极小极大定理(CGMT)扩展到非高斯设置,我们推导出关键统计量的渐近极小极大表征,从而能够近似ERM估计量 $\hat{\theta}$ 的均值 $\mu_{\hat{\theta}}$ 和协方差 $C_{\hat{\theta}}$。具体地,在数据矩阵的集中假设以及损失和正则化子的标准正则性条件下,我们证明:对于独立于训练数据的测试协变量 $x$,投影 $\hat{\theta}^\top x$ 近似遵循 $\mu_{\hat{\theta}}^\top x$ 的一般非高斯分布与一个独立中心高斯变量(方差为 $\mathrm{tr}(C_{\hat{\theta}} \mathbb{E}[xx^\top])$)的卷积。这一结果阐明了ERM高斯普适性的范围和局限。此外,我们证明任何 $\mathcal{C}^2$ 正则化子渐近等价于一个由其零点的Hessian矩阵和 $\mu_{\hat{\theta}}$ 处的梯度唯一确定的二次型。我们提供了跨不同损失和模型的数值模拟,以验证我们的理论预测和定性见解。

英文摘要

We study high-dimensional convex empirical risk minimization (ERM) under general non-Gaussian data designs. By heuristically extending the Convex Gaussian Min-Max Theorem (CGMT) to non-Gaussian settings, we derive an asymptotic min-max characterization of key statistics, enabling approximation of the mean $μ_{\hatθ}$ and covariance $C_{\hatθ}$ of the ERM estimator $\hatθ$. Specifically, under a concentration assumption on the data matrix and standard regularity conditions on the loss and regularizer, we show that for a test covariate $x$ independent of the training data, the projection $\hatθ^\top x$ approximately follows the convolution of the generally non-Gaussian distribution of $μ_{\hatθ}^\top x$ with an independent centered Gaussian variable of variance $\mathrm{tr}(C_{\hatθ} \mathbb{E}[xx^\top])$. This result clarifies the scope and limits of Gaussian universality for ERMs. Additionally, we prove that any $\mathcal{C}^2$ regularizer is asymptotically equivalent to a quadratic form determined solely by its Hessian at zero and gradient at $μ_{\hatθ}$. Numerical simulations across diverse losses and models are provided to validate our theoretical predictions and qualitative insights.

2601.22978 2026-06-19 cs.CR cs.PL 版本更新

Triosecuris: Formally Verified Protection Against Speculative Control-Flow Hijacking

Triosecuris:针对推测控制流劫持的形式化验证防御

Jonathan Baumann, Yonghyun Kim, Yan Farba, Catalin Hritcu, Julay Leatherman-Brooks

AI总结 提出Triosecuris,结合CET风格硬件辅助控制流完整性与编译器插入的推测加载硬化,通过形式化证明实现相对安全性,确保任意程序在推测执行下不泄露比源程序无推测时更多的信息。

Comments To appear at CSF'26; extended version with appendices. W.r.t. first revision: extended with concrete protection against Spectre RSB and renamed to Triosecuris

Journal ref 39th IEEE Computer Security Foundations Symposium (CSF) (2026) 544-559

详情
AI中文摘要

本文介绍了Triosecuris,一种针对Spectre BTB、RSB和PHT的形式化验证防御,它结合了CET风格的硬件辅助控制流完整性与编译器插入的推测加载硬化(SLH)。Triosecuris基于一个新颖的观察:在CET风格保护存在的情况下,我们可以精确检测间接调用的BTB误推测和返回的RSB误推测,并设置SLH误推测标志。我们在Rocq中将Triosecuris形式化为一种变换,并提供了机器检查的证明,表明它实现了相对安全性:任何经过变换的程序在推测执行下泄露的信息不超过源程序在无推测执行下泄露的信息。这一强安全保证适用于任意程序,即使那些不遵循密码学常数时间编程规范的程序。

英文摘要

This paper introduces Triosecuris, a formally verified defense against Spectre BTB, RSB, and PHT that combines CET-style hardware-assisted control-flow integrity with compiler-inserted speculative load hardening (SLH). Triosecuris is based on the novel observation that in the presence of CET-style protection, we can precisely detect BTB misspeculation for indirect calls and RSB misspeculation for returns and set the SLH misspeculation flag. We formalize Triosecuris as a transformation in Rocq and provide a machine-checked proof that it achieves relative security: any transformed program running with speculation leaks no more than what the source program leaks without speculation. This strong security guarantee applies to arbitrary programs, even those not following the cryptographic constant-time programming discipline.

2604.01955 2026-06-19 cs.CY 版本更新

Teaching Students to Question the Machine: An AI Literacy Intervention Improves Students' Regulation of LLM Use in a Science Task

教导学生质疑机器:一项AI素养干预措施提升学生在科学任务中调节LLM使用的能力

O. Clerc, R. Abdelghani, C. Desvaux, E. Poisson, P. Y. Oudeyer, H. Sauzéon

AI总结 本研究通过两小时的AI素养工作坊,训练中学生(8-9年级)在科学问题解决中更有效地使用大语言模型,减少盲目依赖并提高答案质量。

Comments Workshop paper accepted at ALIT4ALL 2026: 2nd International Workshop on AI Literacy Education For All, co-located with AIED 2026

详情
AI中文摘要

生成式人工智能(GenAI)在学校中的快速普及引发了人们对学生不加批判地依赖其输出的担忧。有效使用大语言模型(LLM)不仅需要技术知识,还需要监控、评估和调节与系统交互的能力,这些过程与元认知调节密切相关。这些技能在中学阶段仍在发展中,使得学生特别容易过度信任和过早接受AI输出。由于课堂时间和教师培训资源有限,迫切需要开发和评估可在现实学校条件下实施的AI素养干预措施。我们报告了一项受控的课堂研究,考察两小时的AI素养工作坊是否能改善学生在LLM支持的科学问题解决中的交互策略和最终答案质量。共有116名学生(8-9年级;13-15岁)使用生成式AI系统完成了六项科学调查任务。两天前,干预组参加了工作坊,该工作坊结合了关于LLM如何工作及失败的信息,以及关于提示和响应评估的实用指导;对照组未接受培训。受过训练的学生表现出更少的盲目依赖:他们更频繁地重新表述查询、提出后续问题,并更准确地判断响应正确性,从而获得更好的表现。相比之下,GenAI和元认知自我报告分数不能预测表现,这表明有效使用生成式AI较少依赖于自我报告测量,而更多依赖于交互调节的明确训练。总体而言,结果表明,简短、可扩展的AI素养教学可以显著改善中学生在校本学习活动中使用生成式AI的方式。

英文摘要

The rapid adoption of generative artificial intelligence (GenAI) in schools raises concerns about students' uncritical reliance on its outputs. Effective use of large language models (LLMs) requires not only technical knowledge but also the ability to monitor, evaluate, and regulate one's interaction with the system, processes closely tied to metacognitive regulation. These skills are still developing in middle school, making students particularly vulnerable to over-trust and premature acceptance of AI outputs. Because classroom time and teacher training resources are constrained, there is a pressing need to develop and evaluate AI literacy interventions that can be implemented under realistic school conditions. We report a controlled classroom study examining whether a two-hour AI literacy workshop improves students' interaction strategies and quality of final answers in LLM-supported science problem solving. A total of 116 students (grades 8-9; ages 13-15) completed six science investigation tasks using a generative AI system. Two days prior, the intervention group attended the workshop, which combined information about how LLMs work and fail with practical guidance on prompting and response evaluation; the control group received no training. Trained students showed less uncritical reliance on the system: they more often reformulated queries, asked follow-up questions, and more accurately judged response correctness, leading to better performance. In contrast, GenAI and metacognitive self-report scores did not predict performance, suggesting that effective use of generative AI depends less on self-reported measures and more on explicit training in interaction regulation. Overall, the results show that brief, scalable AI literacy instruction can meaningfully improve how middle-school students use generative AI in school-like learning activities.

2604.00527 2026-06-19 math.MG cs.RO math.DG 版本更新

Bistable Quad-Nets Composed of Four-Bar Linkages

由四杆机构组成的双稳态四边网

Gudrun Szewieczek, Daniel Huczala, Martin Pfurner, Hans-Peter Schröcker

发表机构 * University of Innsbruck, Department of Basic Sciences in Engineering Sciences(因斯布鲁克大学工程科学基础科学系) Seoul National University, Robotics Laboratory(首尔国立大学机器人实验室)

AI总结 研究由空间四杆机构组成的双稳态机械结构,通过Study二次曲面解释并利用Whiteley去平均化从柔性四边网构造,无需数值优化即可控制几何参数。

详情
AI中文摘要

我们研究了一种新型机械结构,由空间四杆机构组成,具有双稳态特性,即允许两种不同的构型。这些结构在Study二次曲面中具有四边网的解释,我们利用该解释证明了具有无限数量连杆和关节的组装体的存在性。我们提出了一种纯几何构造方法,从欧几里得空间中的无穷小柔性四边网出发,应用Whiteley去平均化。这一观点将问题置于离散微分几何的更广泛框架内,并能够从众所周知的四边网类别(如离散极小曲面)构造双稳态结构。与许多其他双稳态结构构造方法相比,我们的方法不依赖于数值优化,并且允许简单控制相关几何参数,如轴位置和卡扣角度。

英文摘要

We study a novel type of mechanical structures, composed of spatial four-bar linkages, that are bistable, that is, they allow for two distinct configurations. These structures have an interpretation as quad nets in the Study quadric which we use to prove existence of assemblies with an unbounded number of links and joints. We propose a purely geometric construction of such objects, starting from infinitesimally flexible quad nets in Euclidean space and applying Whiteley de-averaging. This point of view situates the problem within the broader framework of discrete differential geometry and enables the construction of bistable structures from well-known classes of quad nets, such as discrete minimal surfaces. In contrast to many other construction methods for bistable structures, our approach does not rely on numerical optimization and it allows for simple control of relevant geometric parameters such as axis positions and snap angles.

2603.29924 2026-06-19 cs.CV 版本更新

Abstraction in Style: Beyond Texture and Color

风格中的抽象:超越纹理与色彩

Min Lu, Yuanfeng He, Anthony Chen, Jianhuang He, Pu Wang, Daniel Cohen-Or, Hui Huang

发表机构 * Shenzhen University(深圳大学) Visual Computing Research Center (VCC), College of Computer Science and Software Engineering (CSSE)(视觉计算研究中心(VCC),计算机科学与软件工程学院) Peking University(北京大学)

AI总结 提出Abstraction in Style (AiS)框架,将结构抽象与视觉风格分离,通过中间抽象代理实现几何保真度放松,从而支持更广泛的非真实感风格迁移。

Comments SIGGRAPH 2026

详情
AI中文摘要

艺术风格通常嵌入超越表面外观的抽象,涉及对结构的有意重新诠释,而不仅仅是纹理或色彩的变化。传统的风格迁移方法通常保留输入几何结构,因此难以捕捉这种更深层次的抽象行为,尤其是对于插画和非真实感风格。在这项工作中,我们引入了Abstraction in Style (AiS),一个将结构抽象与视觉风格化分离的生成框架。给定目标图像和少量风格样本,AiS首先推导出一个中间抽象代理,该代理根据风格所展现的抽象逻辑重新诠释目标的结构。代理捕捉语义结构,同时放松几何保真度,使得后续的风格化能够在抽象表示而非原始图像上进行操作。在第二阶段,渲染抽象代理以产生最终风格化输出,保持与参考风格的视觉一致性。两个阶段都使用共享的图像空间类比实现,使得变换可以从视觉样本中学习,无需显式的几何监督。通过将抽象与外观解耦,并将抽象视为显式、可迁移的过程,AiS支持更广泛的风格变换,提高了可控性,并实现了更具表现力的风格化。

英文摘要

Artistic styles often embed abstraction beyond surface appearance, involving deliberate reinterpretation of structure rather than mere changes in texture or color. Conventional style transfer methods typically preserve the input geometry and therefore struggle to capture this deeper abstraction behavior, especially for illustrative and nonphotorealistic styles. In this work, we introduce Abstraction in Style (AiS), a generative framework that separates structural abstraction from visual stylization. Given a target image and a small set of style exemplars, AiS first derives an intermediate abstraction proxy that reinterprets the target's structure in accordance with the abstraction logic exhibited by the style. The proxy captures semantic structure while relaxing geometric fidelity, enabling subsequent stylization to operate on an abstracted representation rather than the original image. In a second stage, the abstraction proxy is rendered to produce the final stylized output, preserving visual coherence with the reference style. Both stages are implemented using a shared image space analogy, enabling transformations to be learned from visual exemplars without explicit geometric supervision. By decoupling abstraction from appearance and treating abstraction as an explicit, transferable process, AiS supports a wider range of stylistic transformations, improves controllability, and enables more expressive stylization.

2603.28387 2026-06-19 cs.AI cs.LG 版本更新

The Scaffold Effect: How Prompt Framing Drives Apparent Multimodal Gains in Clinical VLM Evaluation

脚手架效应:提示框架如何驱动临床VLM评估中的表面多模态增益

Doan Nam Long Vu, Simone Balloccu

发表机构 * Technical University of Darmstadt(达姆施塔特技术大学)

AI总结 研究发现,在临床VLM评估中,提示中提及MRI可用性即可解释70-80%的性能提升,与图像数据是否存在无关,这种“脚手架效应”揭示了表面评估无法反映真实多模态推理能力。

详情
AI中文摘要

可信的临床AI要求性能提升反映真实的证据整合而非表面伪影。我们在两个临床神经影像队列\textsc{FOR2107}(情感障碍)和\textsc{OASIS-3}(认知衰退)上评估了12个开源视觉语言模型(VLM)的二分类性能。两个数据集都包含结构MRI数据,但这些数据不携带可靠的个体级诊断信号。在这些条件下,较小的VLM在引入神经影像上下文后F1分数提升高达58%,蒸馏模型变得与规模大一个数量级的模型相当。对比置信度分析显示,仅仅在任务提示中\textit{提及}MRI可用性就解释了70-80%的转变,与影像数据是否存在无关,这是模态坍塌的一个领域特定实例,我们称之为\textit{脚手架效应}。专家评估揭示了在所有条件下捏造基于神经影像的正当理由,而偏好对齐虽然消除了引用MRI的行为,却使两种条件都退化为随机基线。我们的发现表明,表面评估不足以作为多模态推理的指标,这对VLM在临床环境中的部署有直接影响。

英文摘要

Trustworthy clinical AI requires that performance gains reflect genuine evidence integration rather than surface-level artifacts. We evaluate 12 open-weight vision-language models (VLMs) on binary classification across two clinical neuroimaging cohorts, \textsc{FOR2107} (affective disorders) and \textsc{OASIS-3} (cognitive decline). Both datasets come with structural MRI data that carries no reliable individual-level diagnostic signal. Under these conditions, smaller VLMs exhibit gains of up to 58\% F1 upon introduction of neuroimaging context, with distilled models becoming competitive with counterparts an order of magnitude larger. A contrastive confidence analysis reveals that merely \emph{mentioning} MRI availability in the task prompt accounts for 70-80\% of this shift, independent of whether imaging data is present, a domain-specific instance of modality collapse we term the \emph{scaffold effect}. Expert evaluation reveals fabrication of neuroimaging-grounded justifications across all conditions, and preference alignment, while eliminating MRI-referencing behavior, collapses both conditions toward random baseline. Our findings demonstrate that surface evaluations are inadequate indicators of multimodal reasoning, with direct implications for the deployment of VLMs in clinical settings.

2602.04037 2026-06-19 cs.LG cs.RO 版本更新

DADP: Domain Adaptive Diffusion Policy

DADP: 领域自适应扩散策略

Pengcheng Wang, Qinghang Liu, Haotian Lin, Yiheng Li, Guojian Zhan, Masayoshi Tomizuka, Yixiao Wang

发表机构 * University of California, Berkeley, California, USA(加州大学伯克利分校) Peking University, Beijing, China(北京大学) Tsinghua University, Beijing, China(清华大学)

AI总结 提出DADP,通过无监督解耦和领域感知扩散注入,实现跨动态环境的鲁棒零样本适应,在运动与操控任务上超越先前方法。

详情
AI中文摘要

学习能够泛化到未见过的转移动态的领域自适应策略,仍然是基于学习的控制中的一个基本挑战。通过领域表示学习来捕获领域特定信息,从而实现领域感知决策,已经取得了实质性进展。我们分析了通过动态预测学习领域表示的过程,发现选择与当前步骤相邻的上下文会导致学习到的表示将静态领域信息与变化的动态属性纠缠在一起。这种混合可能会混淆条件策略,从而限制零样本适应。为了应对这一挑战,我们提出了DADP(领域自适应扩散策略),通过无监督解耦和领域感知扩散注入实现鲁棒适应。首先,我们引入了滞后上下文动态预测,这是一种将未来状态估计条件化在历史偏移上下文上的策略;通过增加这个时间间隔,我们通过过滤掉瞬态属性来无监督地解耦静态领域表示。其次,我们通过偏置先验分布和重新制定扩散目标,将学习到的领域表示直接集成到生成过程中。在涉及运动和操控的具有挑战性的基准测试上的大量实验表明,DADP相对于先前方法具有优越的性能和泛化能力。更多可视化结果可在此https URL上获得。

英文摘要

Learning domain adaptive policies that can generalize to unseen transition dynamics, remains a fundamental challenge in learning-based control. Substantial progress has been made through domain representation learning to capture domain-specific information, thus enabling domain-aware decision making. We analyze the process of learning domain representations through dynamical prediction and find that selecting contexts adjacent to the current step causes the learned representations to entangle static domain information with varying dynamical properties. Such mixture can confuse the conditioned policy, thereby constraining zero-shot adaptation. To tackle the challenge, we propose DADP (Domain Adaptive Diffusion Policy), which achieves robust adaptation through unsupervised disentanglement and domain-aware diffusion injection. First, we introduce Lagged Context Dynamical Prediction, a strategy that conditions future state estimation on a historical offset context; by increasing this temporal gap, we unsupervisedly disentangle static domain representations by filtering out transient properties. Second, we integrate the learned domain representations directly into the generative process by biasing the prior distribution and reformulating the diffusion target. Extensive experiments on challenging benchmarks across locomotion and manipulation demonstrate the superior performance, and the generalizability of DADP over prior methods. More visualization results are available on the https://outsider86.github.io/DomainAdaptiveDiffusionPolicy/.

2512.00850 2026-06-19 cs.CV 版本更新

Smol-GS: Compact Representations for Abstract 3D Gaussian Splatting

Smol-GS: 抽象3D高斯溅射的紧凑表示

Haishan Wang, Mohammad Hassan Vali, Arno Solin

发表机构 * ELLIS Institute Finland(芬兰ELLIS研究所) Aalto University(阿alto大学)

AI总结 提出Smol-GS方法,通过八叉树位置编码和熵压缩学习高效溅射特征,实现3D高斯溅射的紧凑表示,在保持渲染质量的同时大幅降低存储。

详情
AI中文摘要

我们提出Smol-GS,一种学习3D高斯溅射(3DGS)紧凑表示的新方法。我们的方法学习高效的逐溅射特征来建模3D空间,这些特征捕获抽象线索,包括颜色、不透明度、变换和材质属性。我们提出八叉树导出的位置编码,显式建模空间局部性并增强表示效率。我们进一步应用基于熵的压缩来利用特征冗余,并使用递归体素层次压缩溅射坐标。这种设计在保持表示灵活性的同时,实现了数量级的存储减少。Smol-GS在标准基准测试上以高渲染质量实现了最先进的压缩性能。

英文摘要

We present Smol-GS, a novel method for learning compact representations for 3D Gaussian Splatting (3DGS). Our approach learns highly efficient splat-wise features to model 3D space, which capture abstracted cues, including color, opacity, transformation, and material properties. We propose octree-derived positional encoding, which explicitly models spatial locality and enhances representation efficiency. We further apply entropy-based compression to exploit feature redundancy and compress splat coordinates using a recursive voxel hierarchy. This design enables orders-of-magnitude reduction in storage while preserving representation flexibility. Smol-GS achieves state-of-the-art compression performance on standard benchmarks with high-level rendering quality.

2505.17006 2026-06-19 cs.CV cs.RO 版本更新

CoMo: Learning Continuous Latent Motion from Internet Videos for Scalable Robot Learning

CoMo: 从互联网视频中学习连续潜在运动以实现可扩展的机器人学习

Jiange Yang, Yansong Shi, Haoyi Zhu, Mingyu Liu, Kaijing Ma, Yating Wang, Gangshan Wu, Tong He, Limin Wang

发表机构 * Nanjing University(南京大学) Shanghai AI Lab(上海人工智能实验室) University of Science and Technology of China(中国科学技术大学) Zhejiang University(浙江大学) Fudan University(复旦大学) Tongji University(同济大学)

AI总结 提出CoMo方法,通过早期时间差分和时序对比学习从互联网视频中学习连续潜在运动,避免离散化信息损失,实现零样本泛化生成伪动作标签,联合训练策略在仿真和真实实验中表现优异。

Comments CVPR 2026

详情
AI中文摘要

从互联网视频中无监督学习潜在运动对于机器人学习至关重要。现有的离散方法通常通过小码本大小的向量量化来减轻提取过多静态背景导致的捷径学习,但它们存在信息损失,难以捕捉更复杂和细粒度的动态。此外,离散潜在运动与连续机器人动作之间存在固有分布差距,阻碍了统一策略的联合学习。我们提出CoMo,旨在从互联网规模视频中学习更精确的连续潜在运动。CoMo采用早期时间差分(Td)机制来增加捷径学习难度并显式增强运动线索。此外,为确保潜在运动更好地捕捉有意义的背景,我们进一步提出时序对比学习(Tcl)方案。具体地,正样本对通过小的未来帧时间偏移构建,而负样本对则通过直接反转时间方向形成。所提出的Td和Tcl协同工作,有效确保潜在运动更好地关注前景并增强运动线索。关键的是,CoMo表现出强大的零样本泛化能力,使其能够为未见过的视频生成有效的伪动作标签。大量的仿真和真实实验表明,使用CoMo伪动作标签联合训练的策略在扩散和自回归架构下均实现了优越性能。

英文摘要

Unsupervised learning of latent motion from Internet videos is crucial for robot learning. Existing discrete methods generally mitigate the shortcut learning caused by extracting excessive static backgrounds through vector quantization with a small codebook size. However, they suffer from information loss and struggle to capture more complex and fine-grained dynamics. Moreover, there is an inherent gap between the distribution of discrete latent motion and continuous robot action, which hinders the joint learning of a unified policy. We propose CoMo, which aims to learn more precise continuous latent motion from internet-scale videos. CoMo employs an early temporal difference (Td) mechanism to increase the shortcut learning difficulty and explicitly enhance motion cues. Additionally, to ensure latent motion better captures meaningful foregrounds, we further propose a temporal contrastive learning (Tcl) scheme. Specifically, positive pairs are constructed with a small future frame temporal offset, while negative pairs are formed by directly reversing the temporal direction. The proposed Td and Tcl work synergistically and effectively ensure that the latent motion focuses better on the foreground and reinforces motion cues. Critically, CoMo exhibits strong zeroshot generalization, enabling it to generate effective pseudo action labels for unseen videos. Extensive simulated and real-world experiments show that policies co-trained with CoMo pseudo action labels achieve superior performance with both diffusion and auto-regressive architectures.

2504.09642 2026-06-19 eess.SY cs.SY 版本更新

HBS -- Hardware Build System: Characterizing and comparing direct-Tcl and indirect-abstract approaches for hardware build systems

HBS——硬件构建系统:直接Tcl与间接抽象硬件构建方法的特征化与比较

Michał Kruszewski

AI总结 本文特征化并比较了两种硬件构建系统方法:直接Tcl方法(构建代码由EDA工具直接执行)和间接抽象方法(构建系统生成Tcl脚本后由EDA工具运行),并提出了新的直接Tcl构建系统HBS,以弥补现有直接Tcl系统功能不足,用于与间接抽象系统进行对比。

详情
AI中文摘要

构建系统已成为软件实现和部署过程中不可或缺的一部分。新的编程语言(如Go、Rust或Zig)在发布时都集成了构建系统。然而,在硬件描述领域,主流硬件描述语言(HDL)如VHDL或SystemVerilog并未发布官方构建系统。此外,硬件设计项目通常涉及多种语言。本文特征化并比较了两种常见的硬件构建系统实现方法。第一种是直接Tcl方法,其中构建系统代码在设计构建流程中由EDA工具直接执行。第二种是间接抽象方法,其中构建系统生成Tcl脚本,随后由合适的EDA工具运行。由于现有的直接Tcl构建系统在支持的功能方面均不及间接抽象构建系统,本文还提出了一种新的直接Tcl硬件构建系统,称为HBS。该实现的构建系统作为直接Tcl构建系统的代表,用于与间接抽象构建系统进行比较。

英文摘要

Build systems become an indispensable part of the software implementation and deployment process. New programming languages are released with the build system integrated into the language tools, for example, Go, Rust, or Zig. However, in the hardware description domain, no official build systems have been released with the predominant Hardware Description Languages (HDL) such as VHDL or SystemVerilog. Moreover, hardware design projects are often multilingual. The paper characterizes and compares two common approaches for hardware build system implementations. The first one, the direct-Tcl approach, in which the build system code is executed directly by the EDA tool during the design build flow. The second one, the indirect-abstract approach, in which the build system produces a Tcl script, which is later run by a proper EDA tool. As none of the existing direct-Tcl build systems was close to the indirect-abstract build systems in terms of supported functionalities, the paper also presents a new direct-Tcl hardware build system called HBS. The implemented build system was used as a representative of direct-Tcl build systems in comparison with indirect-abstract build systems.

2603.25702 2026-06-19 cs.CL 版本更新

S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation

S2D2:通过免训练自我推测实现扩散LLM的快速解码

Ligong Han, Hao Wang, Han Gao, Kai Xu, Akash Srivastava

发表机构 * Red Hat AI Innovation(红帽AI创新) MIT-IBM Watson AI Lab(MIT-IBM沃森人工智能实验室) Iowa State University(爱荷华州立大学) Core AI, IBM(IBM核心AI)

AI总结 提出S2D2,一种免训练的自我推测解码框架,通过将块扩散模型在块大小为1时变为自回归模型,实现草稿与验证角色复用,在不增加训练或测试计算下提升解码速度与准确性。

Comments Code is available at https://github.com/phymhan/S2D2

详情
AI中文摘要

块扩散语言模型通过结合块级自回归解码与块内并行去噪,为超越自回归生成提供了一条有前景的路径。然而,在实际加速所需的少步数场景中,标准的置信度阈值解码往往脆弱:激进的阈值损害质量,而保守的阈值则需要不必要的去噪步骤。现有解决此问题的方法要么需要额外训练,要么增加测试时计算。我们提出S2D2,一种用于块扩散语言模型的免训练自我推测解码框架。我们的关键观察是,当块大小减小到1时,块扩散模型变为自回归模型,从而允许相同的预训练模型同时充当草稿模型和验证模型。S2D2在标准块扩散解码中插入一个推测验证步骤,并使用轻量级路由策略来决定何时验证值得其成本。这产生了一种混合解码轨迹,其中扩散并行提出令牌,而自回归模式充当局部序列级评判器。在三个主流块扩散家族中,S2D2在准确性-速度权衡上持续优于强置信度阈值基线。在SDAR上,我们观察到相比自回归解码高达4.7倍加速,相比调优的动态解码基线高达1.57倍加速,同时准确性提升高达4.5个点。在LLaDA2.1-Mini上,S2D2与内置自校正保持互补,包括在保守设置下比静态基线快4.4倍且准确性略高。

英文摘要

Block-diffusion language models offer a promising path toward faster-than-autoregressive generation by combining block-wise autoregressive decoding with within-block parallel denoising. However, in the few-step regime needed for practical acceleration, standard confidence-thresholded decoding is often brittle: aggressive thresholds hurt quality, while conservative thresholds require unnecessary denoising steps. Existing approaches that address this issue either require additional training or incur extra test-time compute. We present S2D2, a training-free self-speculative decoding framework for block-diffusion language models. Our key observation is that a block-diffusion model becomes autoregressive when the block size is reduced to one, allowing the same pretrained model to act as both drafter and verifier. S2D2 inserts a speculative verification step into standard block-diffusion decoding and uses lightweight routing policies to decide when verification is worth its cost. This yields a hybrid decoding trajectory in which diffusion proposes tokens in parallel, while the autoregressive mode acts as a local sequence-level critic. Across three mainstream block-diffusion families, S2D2 consistently improves the accuracy-speed tradeoff over strong confidence-thresholding baselines. On SDAR, we observe up to $4.7\times$ speedup over autoregressive decoding, and up to $1.57\times$ over a tuned dynamic decoding baseline while improving accuracy by up to $4.5$ points. On LLaDA2.1-Mini, S2D2 remains complementary to built-in self-correction, including a conservative setting where it is $4.4\times$ faster than the static baseline with slightly higher accuracy.

2603.12252 2026-06-19 cs.CV cs.CL 版本更新

EndoCoT: Scaling Endogenous Chain-of-Thought Reasoning in Diffusion Models

EndoCoT:扩散模型中的内生思维链推理扩展

Xuanlang Dai, Yujie Zhou, Long Xing, Jiazi Bu, Xilin Wei, Yuhong Liu, Beichen Zhang, Kai Chen, Yuhang Zang

发表机构 * Shanghai AI Laboratory(上海人工智能实验室) Xi’an Jiaotong University(西安交通大学) University of Science and Technology of China(中国科学技术大学) Shanghai Jiaotong University(上海交通大学) Fudan University(复旦大学) The Chinese University of Hong Kong(香港中文大学)

AI总结 提出EndoCoT框架,通过迭代思维引导模块激活MLLM的推理潜力,并利用终端思维接地模块确保推理轨迹与文本监督对齐,使DiT逐步执行复杂任务,在多个基准上平均准确率达92.1%。

Comments 23 pages, 18 figures, The code and dataset are publicly available at https://internlm.github.io/EndoCoT/

详情
AI中文摘要

最近,多模态大语言模型(MLLMs)被广泛集成到扩散框架中,主要作为文本编码器来处理空间推理等复杂任务。然而,这种范式存在两个关键限制:(i)MLLM文本编码器表现出不足的推理深度。单步编码无法激活思维链过程,而这对MLLM为复杂任务提供准确指导至关重要。(ii)在解码过程中,指导保持不变。即使有正确的MLLM编码,解码过程中的不变指导也阻止了DiT逐步将复杂指令分解为可执行的去噪步骤。为此,我们提出了内生思维链(EndoCoT),一种新颖的框架,首先通过迭代思维引导模块迭代细化潜在思维状态来激活MLLM的推理潜力,然后将这些状态桥接到DiT的去噪过程。其次,应用终端思维接地模块,通过将最终状态与真实答案对齐,确保推理轨迹保持与文本监督的接地。通过这两个组件,MLLM文本编码器提供精心推理的指导,使DiT能够逐步执行并最终以逐步方式解决复杂任务。在多个基准(如Maze、TSP、VSP和Sudoku)上的广泛评估实现了平均准确率92.1%,比最强基线高出8.3个百分点。代码和数据集在此https URL公开。

英文摘要

Recently, Multimodal Large Language Models (MLLMs) have been widely integrated into diffusion frameworks primarily as text encoders to tackle complex tasks such as spatial reasoning. However, this paradigm suffers from two critical limitations: (i) MLLMs text encoder exhibits insufficient reasoning depth. Single-step encoding fails to activate the Chain-of-Thought process, which is essential for MLLMs to provide accurate guidance for complex tasks. (ii) The guidance remains invariant during the decoding process. Invariant guidance during decoding prevents DiT from progressively decomposing complex instructions into actionable denoising steps, even with correct MLLM encodings. To this end, we propose Endogenous Chain-of-Thought (EndoCoT), a novel framework that first activates MLLMs' reasoning potential by iteratively refining latent thought states through an iterative thought guidance module, and then bridges these states to the DiT's denoising process. Second, a terminal thought grounding module is applied to ensure the reasoning trajectory remains grounded in textual supervision by aligning the final state with ground-truth answers. With these two components, the MLLM text encoder delivers meticulously reasoned guidance, enabling the DiT to execute it progressively and ultimately solve complex tasks in a step-by-step manner. Extensive evaluations across diverse benchmarks (e.g., Maze, TSP, VSP, and Sudoku) achieve an average accuracy of 92.1%, outperforming the strongest baseline by 8.3 percentage points. The code and dataset are publicly available at https://internlm.github.io/EndoCoT/.

2603.22922 2026-06-19 cs.CL 版本更新

Quality Over Clicks: Iterative Reinforcement Learning for Early-Stage E-Commerce Query Suggestion

质量优于点击:面向早期电商查询建议的迭代强化学习

Qi Sun, Kejun Xiao, Huaipeng Zhao, Tao Luo, Xiaoyi Zeng

发表机构 * Alibaba International Digital Commercial Group(阿里巴巴国际数字商业集团)

AI总结 针对早期部署场景点击反馈稀疏的问题,提出质量优先的迭代强化学习框架QualEQS,从可回答性、事实性和信息增益三个维度优化查询建议质量,通过候选建议的组级分歧识别模糊上下文并挖掘难例进行迭代改进,在真实电商系统中ChatPV提升6.81%。

详情
AI中文摘要

现有的对话系统依赖查询建议来增强用户参与度。最近的方法主要使用点击率(CTR)模型优化生成模型,以与用户偏好对齐。然而,这些方法在早期部署场景中效果较差,因为点击反馈稀疏且不足以训练可靠的CTR模型。为弥补这一差距,我们提出了QualEQS,一个面向电商查询建议的质量优先迭代强化学习框架。我们将可操作的建议质量形式化为三个直接影响下游可用性的维度:可回答性、事实性和信息增益。为了在没有点击监督的情况下从在线流量中持续改进,我们进一步提出候选建议之间的组级分歧,以识别模糊的查询上下文并挖掘难训练案例进行迭代优化。我们还引入了EQS-Benchmark,一个包含16,949个真实电商查询的数据集,用于离线训练和评估。实验表明,我们基于质量的离线指标与在线性能强相关,为稀疏反馈部署提供了一种实用的评估方法。在离线和在线设置中,QualEQS均持续优于强基线,在真实企业级对话购物助手系统中,在线ChatPV提升了6.81%。

英文摘要

Existing dialogue systems rely on query suggestion to enhance user engagement. Recent approaches mainly optimize generative models using click-through rate (CTR) models to align with user preferences. However, these methods are less effective in early-stage deployment scenarios, where click feedback is sparse and insufficient for training a reliable CTR model. To bridge this gap, we propose QualEQS, a quality-first iterative reinforcement learning framework for e-commerce query suggestion. We formalize actionable suggestion quality along three dimensions that directly affect downstream usability: answerability, factuality, and information gain. To continuously improve from online traffic without click supervision, we further propose group-level disagreement among candidate suggestions to identify ambiguous query contexts and mine hard training cases for iterative refinement. We also introduce EQS-Benchmark, a dataset of 16,949 real-world e-commerce queries for offline training and evaluation. Experiments show that our quality-based offline metrics correlate strongly with online performance, providing a practical evaluation recipe for sparse-feedback deployment. In both offline and online settings, QualEQS consistently outperforms strong baselines, yielding a 6.81% improvement in online ChatPV in a real-world enterprise-level conversational shopping assistant system.

2603.16865 2026-06-19 math.OC cs.SY eess.SY 版本更新

Prescribed-Time Distributed Generalized Nash Equilibrium Seeking

预设时间分布式广义纳什均衡求解

Liraz Mudrik, Isaac Kaminer, Sean Kragelund, Abram H. Clark

AI总结 针对安全关键多智能体系统,提出首个全分布式算法,在用户预设时间T内求解带共享耦合约束的广义纳什均衡问题,采用多速率增益调度解耦观测器、优化与对偶一致性三层耦合。

Comments 12 pages, 5 figures

详情
AI中文摘要

从协同制导到碰撞避免等安全关键多智能体系统,通常必须在硬截止时间前达成协调决策,而非仅仅最终收敛。本文提出首个全分布式算法,用于在用户预设时间$T$内求解广义纳什均衡(GNE)问题(一种具有共享耦合约束和一般成本耦合的非合作博弈),该时间独立于初始条件。其基础是建立在优化李雅普诺夫函数框架上的集中式预设时间结果,并通过非归一化Hessian-梯度反馈实现,选择该反馈是因为与牛顿和归一化Hessian-梯度实现不同,它自然地分解为每个智能体的计算。分布式实现该反馈要求每个智能体同时运行三个耦合过程:全局状态的预设时间观测器、局部优化律以及强制变分GNE共享乘子的对偶一致性机制。它们的同步运行是核心难点,因为优化不断位移观测器跟踪的状态,而估计误差污染驱动优化的梯度。我们通过一种多速率增益调度解决该耦合,其中观测器和一致性层比优化层严格更快收缩,使得每个误差分量在$T$时刻精确消失。Fischer-Burmeister重构保持设计无投影,同时在截止时间强制执行约束。针对Cournot博弈和时间关键传感器覆盖问题的数值结果验证了该方法,并展示了其作为时间关键自主性求解器在环的应用。

英文摘要

Safety-critical multi-agent systems, from cooperative guidance to collision avoidance, must often reach a coordinated decision by a hard deadline rather than merely converge to one eventually. This paper proposes the first fully distributed algorithm that solves the generalized Nash equilibrium (GNE) problem, a non-cooperative game with shared coupling constraints and general cost coupling, at a user-prescribed time $T$ independent of initial conditions. The foundation is a centralized, prescribed-time result built on the optimization Lyapunov function framework and implemented via unnormalized Hessian-gradient feedback, chosen because, unlike the Newton and normalized Hessian-gradient realizations, it naturally splits into per-agent computations. Distributing this feedback requires each agent to run three coupled processes simultaneously: a prescribed-time observer of the global state, a local optimization law, and a dual-consensus mechanism that enforces the shared multipliers of the variational GNE. Their simultaneous operation is the core difficulty, as the optimization continually displaces the states the observers track, while estimation errors corrupt the gradients that drive the optimization. We resolve this coupling with a multi-rate gain schedule whose observer and dual-consensus layers contract strictly faster than the optimization layer, so that every error component vanishes exactly at $T$. A Fischer-Burmeister reformulation keeps the design projection-free while enforcing the constraints at the deadline. Numerical results for a Cournot game and a time-critical sensor-coverage problem validate the approach and demonstrate its use as a solver-in-the-loop for time-critical autonomy.

2603.19423 2026-06-19 cs.CR cs.AI cs.LG 版本更新

The Autonomy Tax: Defense Training Breaks LLM Agents

自主性税:防御训练破坏LLM智能体

Shawn Li, Yue Zhao

发表机构 * University of Southern California(南加州大学)

AI总结 揭示防御训练在提升LLM智能体安全性时,系统性地破坏其工具执行能力,导致任务失败率飙升,且无法有效防御复杂攻击。

详情
AI中文摘要

大型语言模型(LLM)智能体日益依赖外部工具(文件操作、API调用、数据库事务)来自主完成复杂的多步骤任务。实践者部署经过防御训练的模型,以防止通过恶意观察或检索内容操纵智能体行为的提示注入攻击。我们揭示了一个基本的\textbf{能力-对齐悖论}:旨在提高安全性的防御训练系统性地破坏了智能体的能力,同时未能阻止复杂的攻击。在97个智能体任务和1000个对抗性提示上,将防御模型与未防御基线进行比较,我们发现了多步骤智能体特有的三种系统性偏差。\textbf{智能体无能偏差}表现为立即的工具执行崩溃,模型在观察到任何外部内容之前就在良性任务上拒绝或生成无效操作。\textbf{级联放大偏差}导致早期失败通过重试循环传播,使防御模型在99%的任务中超时,而基线仅为13%。\textbf{触发偏差}导致矛盾的安全退化,防御模型的表现比未防御基线更差,而直接攻击以高概率绕过防御。根本原因分析表明,这些偏差源于捷径学习:模型过度拟合表面攻击模式而非语义威胁理解,这由防御效果在不同攻击类别上的极端方差所证明。我们的发现表明,当前的防御范式优化了单轮拒绝基准,同时使多步骤智能体从根本上不可靠,因此需要新的方法在对抗条件下保持工具执行能力。

英文摘要

Large language model (LLM) agents increasingly rely on external tools (file operations, API calls, database transactions) to autonomously complete complex multi-step tasks. Practitioners deploy defense-trained models to protect against prompt injection attacks that manipulate agent behavior through malicious observations or retrieved content. We reveal a fundamental \textbf{capability-alignment paradox}: defense training designed to improve safety systematically destroys agent competence while failing to prevent sophisticated attacks. Evaluating defended models against undefended baselines across 97 agent tasks and 1,000 adversarial prompts, we uncover three systematic biases unique to multi-step agents. \textbf{Agent incompetence bias} manifests as immediate tool execution breakdown, with models refusing or generating invalid actions on benign tasks before observing any external content. \textbf{Cascade amplification bias} causes early failures to propagate through retry loops, pushing defended models to timeout on 99\% of tasks compared to 13\% for baselines. \textbf{Trigger bias} leads to paradoxical security degradation where defended models perform worse than undefended baselines while straightforward attacks bypass defenses at high rates. Root cause analysis reveals these biases stem from shortcut learning: models overfit to surface attack patterns rather than semantic threat understanding, evidenced by extreme variance in defense effectiveness across attack categories. Our findings demonstrate that current defense paradigms optimize for single-turn refusal benchmarks while rendering multi-step agents fundamentally unreliable, necessitating new approaches that preserve tool execution competence under adversarial conditions.

2603.16606 2026-06-19 cs.CL 版本更新

Omnilingual SONAR: Cross-Lingual and Cross-Modal Sentence Embeddings Bridging Massively Multilingual Text and Speech

Omnilingual SONAR:跨语言与跨模态句子嵌入,连接大规模多语言文本与语音

Omnilingual SONAR Team, João Maria Janeiro, Pere-Lluís Huguet Cabot, Ioannis Tsiamas, Yen Meng, Vivek Iyer, Guillem Ramírez, Loic Barrault, Belen Alastruey, Xiang "Tony" Cao, Yu-An Chung, Marta R. Costa-Jussa, David Dale, Kevin Heffernan, Jaehyeong Jo, Artyom Kozhevnikov, Alexandre Mourachko, Christophe Ropers, Holger Schwenk, Paul-Ambroise Duquenne

发表机构 * FAIR at Meta(Meta的FAIR)

AI总结 提出OmniSONAR模型,通过渐进式训练和教师-学生蒸馏,在数千种语言上实现文本、语音、代码和数学表达式的统一语义嵌入,在跨语言检索和翻译任务上显著降低错误率,并支持零样本语音翻译。

详情
AI中文摘要

跨语言句子编码器通常只覆盖几百种语言,并且常常为了更强的对齐而牺牲下游质量,限制了它们的采用。我们引入了OmniSONAR,一个新的全语言、跨语言和跨模态句子嵌入模型家族,它原生地将文本、语音、代码和数学表达式嵌入到单一语义空间中,同时在数千种语言(从高资源到极低资源变体)的规模上提供最先进的下游性能。为了在不发生表示崩溃的情况下达到这一规模,我们使用了渐进式训练。我们首先使用LLM初始化的编码器-解码器,结合token级解码、新颖的分裂softmax对比损失和合成硬负样本,为200种语言学习一个强大的基础空间。在此基础上,我们通过两阶段教师-学生编码器蒸馏框架扩展到数千种语言变体。最后,我们通过将177种口语无缝映射到该空间,展示了该空间的跨模态可扩展性。OmniSONAR将200种语言的FLORES数据集上的跨语言相似性搜索错误减半,并在1560种语言的BIBLE基准上将错误减少了15倍。它还实现了强大的翻译性能,在多语言基准上优于NLLB-3B,并在1560种语言到英语的BIBLE翻译上比先前模型(包括更大的LLM)高出15个chrF++点。OmniSONAR在MTEB和XLCoST上也表现强劲。对于语音,OmniSONAR实现了43%更低的相似性搜索错误,并达到了SeamlessM4T语音到文本质量的97%,尽管对于翻译是零样本(仅在ASR数据上训练)。最后,通过训练一个编码器-解码器LM Spectrum,仅使用英语文本处理OmniSONAR嵌入序列,我们为复杂的下游任务解锁了向数千种语言和语音的高性能迁移。

英文摘要

Cross-lingual sentence encoders typically cover only a few hundred languages and often trade downstream quality for stronger alignment, limiting their adoption. We introduce OmniSONAR, a new family of omnilingual, cross-lingual and cross-modal sentence embedding models that natively embed text, speech, code, and mathematical expressions in a single semantic space, while delivering state-of-the-art downstream performance at the scale of thousands of languages, from high-resource to extremely low-resource varieties. To reach this scale without representation collapse, we use progressive training. We first learn a strong foundational space for 200 languages with an LLM-initialized encoder-decoder, combining token-level decoding with a novel split-softmax contrastive loss and synthetic hard negatives. Building on this foundation, we expand to several thousands language varieties via a two-stage teacher-student encoder distillation framework. Finally, we demonstrate the cross-modal extensibility of this space by seamlessly mapping 177 spoken languages into it. OmniSONAR halves cross-lingual similarity search error on the 200-language FLORES dataset and reduces error by a factor of 15 on the 1,560-language BIBLE benchmark. It also enables strong translation, outperforming NLLB-3B on multilingual benchmarks and exceeding prior models (including much larger LLMs) by 15 chrF++ points on 1,560 languages into English BIBLE translation. OmniSONAR also performs strongly on MTEB and XLCoST. For speech, OmniSONAR achieves a 43% lower similarity-search error and reaches 97% of SeamlessM4T speech-to-text quality, despite being zero-shot for translation (trained only on ASR data). Finally, by training an encoder-decoder LM, Spectrum, exclusively on English text processing OmniSONAR embedding sequences, we unlock high-performance transfer to thousands of languages and speech for complex downstream tasks.

2603.16941 2026-06-19 eess.AS cs.CL cs.SD 版本更新

The Voice Behind the Words: Quantifying Intersectional Bias in SpeechLLMs

言语背后的声音:量化语音大语言模型中的交叉偏见

Shree Harsha Bokkahalli Satish, Christoph Minixhofer, Maria Teleki, James Caverlee, Ondřej Klejch, Peter Bell, Gustav Eje Henter, Éva Székely

发表机构 * 1 Department of Speech, Music Hearing, KTH Royal Institute of Technology, Sweden 2 Centre for Speech Technology Research, University of Edinburgh, UK 3 Texas A\&M University, USA

AI总结 本研究通过2880次受控交互,评估三种语音大语言模型在六种英语口音和两种性别呈现中的口音与性别交叉偏见,发现东欧口音(尤其女性)获得更低有用性评分,且人类评估者比LLM评判更敏感。

Comments 5 pages, 3 figures, 1 table, Accepted to Interspeech 2026

详情
AI中文摘要

语音大语言模型直接处理语音输入,保留了之前级联管道中去除的口音和感知性别等线索,这导致了依赖于说话者身份的反应差异。我们使用2880次受控交互(涵盖六种英语口音和两种性别呈现,通过语音克隆保持语言内容不变),对三种语音大语言模型中的口音和性别偏见进行了大规模交叉评估。通过逐点LLM评判评分、成对比较以及经过人工验证的最佳-最差缩放,我们检测到反复出现的定向差异。东欧口音的语音获得较低的有用性评分,尤其是女性呈现的语音。反应保持礼貌但在有用性上存在差异。虽然LLM评判捕捉到了这些偏见的定向趋势,但人类评估者表现出显著更高的敏感性,显示出更强的口音级别对比。

英文摘要

Speech Large Language Models (SpeechLLMs) process spoken input directly, retaining cues such as accent and perceived gender that were previously removed in cascaded pipelines. This introduces speaker identity dependent variation in responses. We present a large-scale intersectional evaluation of accent and gender bias in three SpeechLLMs using 2,880 controlled interactions across six English accents and two gender presentations, keeping linguistic content constant through voice cloning. Using pointwise LLM-judge ratings, pairwise comparisons, and Best-Worst Scaling with human validation, we detect recurring directional disparities. Eastern European-accented speech receives lower helpfulness scores, particularly for female-presenting voices. Responses remain polite but differ in helpfulness. While LLM judges capture the directional trend of these biases, human evaluators exhibit significantly higher sensitivity, showing stronger accent-level contrasts.

2603.16357 2026-06-19 cs.CY cs.SE 版本更新

Beyond Grading Accuracy: Exploring Alignment of TAs and LLMs

超越评分准确性:探索助教与LLMs的一致性

Matthijs Jansen op de Haar, Nacir Bouali, Faizan Ahmed

AI总结 本文提出一个评估管道,通过定量研究92个UML类图,比较助教与六个开源LLMs在单个评分标准上的表现,发现开源LLMs在评分准确性上接近助教,为混合主动评分系统提供了可能。

Comments 7 pages, 3 figures

详情
AI中文摘要

在本文中,我们研究了开源大型语言模型(LLMs)在评分统一建模语言(UML)类图方面的潜力。与现有主要评估专有LLMs的工作不同,我们专注于非专有模型,使得我们的方法适用于对透明度和成本敏感的大学。此外,现有研究评估的是完整图表而非单个标准的性能,对自动评分与人类评估的一致性提供的见解有限。为解决这些差距,我们提出一个评分管道,其中学生生成的UML类图由助教(TAs)和LLMs独立评估,然后在单个标准级别比较评分。我们通过一项对软件设计课程中92个UML类图的定量研究来评估该管道,将助教评分与六个开源LLMs产生的评估进行比较。性能在单个标准上测量,突出LLMs与人类评分者存在差异的领域。我们的结果显示,每个标准的准确率高达88.56%,皮尔逊相关系数高达0.78,仅使用开源模型就比先前工作有显著改进。这些模型的性能接近助教,表明了一条通往混合主动评分系统的可能路径,其中助教在评分中得到辅助。我们的发现表明,开源LLMs可以通过明确识别与评分标准的一致性来有效支持UML类图评分。所提出的管道提供了一种实用方法,以应对随着学生人数增长而增加的工作量。

英文摘要

In this paper, we investigate the potential of open-source Large Language Models (LLMs) for grading Unified Modeling Language (UML) class diagrams. In contrast to existing work, which primarily evaluates proprietary LLMs, we focus on non-proprietary models, making our approach suitable for universities where transparency and cost are critical. Additionally, existing studies assess performance over complete diagrams rather than individual criteria, offering limited insight into how automated grading aligns with human evaluation. To address these gaps, we propose a grading pipeline in which student-generated UML class diagrams are independently evaluated by both teaching assistants (TAs) and LLMs. Grades are then compared at the level of individual criteria. We evaluate this pipeline through a quantitative study of 92 UML class diagrams from a software design course, comparing TA grades against assessments produced by six open-source LLMs. Performance is measured across individual criteria, highlighting areas where LLMs diverge from human graders. Our results show per-criterion accuracy of up to 88.56\% and a Pearson correlation coefficient of up to 0.78, representing a substantial improvement over previous work while using only open-source models. The models achieve performance close to that of a TA, suggesting a possible path toward a mixed-initiative grading system, where TAs are aided in their grading. Our findings demonstrate that open-source LLMs can effectively support UML class diagram grading by explicitly identifying alignment with grading criteria. The proposed pipeline provides a practical approach to managing increasing workloads with growing student counts.

2603.15106 2026-06-19 cs.AI 版本更新

PrototypeNAS: Rapid Design of Deep Neural Networks for Microcontroller Units

PrototypeNAS: 微控制器单元深度神经网络的快速设计

Mark Deutel, Simon Geis, Axel Plinge

发表机构 * Fraunhofer Institute for Integrated Circuits(弗劳恩霍夫集成电路研究所)

AI总结 提出零样本NAS方法PrototypeNAS,通过解耦设计与训练、多架构搜索空间、集成零样本代理和超体积子集选择,快速为不同MCU定制DNN,在图像分类等任务上分钟级找到小模型且精度接近大模型。

Comments Accepted at ECML-PKDD 2026. 18 pages, 7 figures, 4 tables. This work was funded by the European Commission as part of the MANOLO project under the Horizon Europe programme Grant Agreement No.101135782

详情
AI中文摘要

在具有不同硬件约束的边缘设备上实现高效的深度神经网络推理是一项具有挑战性的任务,通常需要为每个设备单独定制DNN架构。为避免大量人工努力,可以使用神经架构搜索。然而,许多现有的NAS方法资源密集且耗时,因为它们需要从头开始训练许多不同的DNN。此外,它们没有考虑目标系统的资源约束。为了解决这些缺点,我们提出了PrototypeNAS,一种零样本NAS方法,用于加速和自动化DNN的选择、压缩和针对不同目标微控制器单元的专门化。我们提出了一种新颖的三步搜索方法,将DNN设计和专门化与给定目标平台上的DNN训练解耦。首先,我们提出了一种新的搜索空间,不仅从单个大型架构中裁剪出较小的DNN,而且结合了多种架构类型的结构优化,以及它们的剪枝和量化配置的优化。其次,我们探索在优化过程中使用集成零样本代理而不是单个代理。第三,我们提出使用超体积子集选择从多目标优化的帕累托前沿中提取DNN架构,这些架构代表了准确性和FLOPs之间最有意义的权衡。我们在三个不同任务(图像分类、时间序列分类和目标检测)的12个数据集上评估了PrototypeNAS的有效性。我们的结果表明,PrototypeNAS能够在几分钟内识别出足够小、可部署在现成MCU上的DNN模型,并且仍然达到与大型DNN模型相当的精度。

英文摘要

Enabling efficient deep neural network (DNN) inference on edge devices with different hardware constraints is a challenging task that typically requires DNN architectures to be specialized for each device separately. To avoid the huge manual effort, one can use neural architecture search (NAS). However, many existing NAS methods are resource-intensive and time-consuming because they require the training of many different DNNs from scratch. Furthermore, they do not take the resource constraints of the target system into account. To address these shortcomings, we propose PrototypeNAS, a zero-shot NAS method to accelerate and automate the selection, compression, and specialization of DNNs to different target microcontroller units (MCUs). We propose a novel three-step search method that decouples DNN design and specialization from DNN training for a given target platform. First, we present a novel search space that not only cuts out smaller DNNs from a single large architecture, but instead combines the structural optimization of multiple architecture types, as well as optimization of their pruning and quantization configurations. Second, we explore the use of an ensemble of zero-shot proxies during optimization instead of a single one. Third, we propose the use of Hypervolume subset selection to distill DNN architectures from the Pareto front of the multi-objective optimization that represent the most meaningful tradeoffs between accuracy and FLOPs. We evaluate the effectiveness of PrototypeNAS on 12 different datasets in three different tasks: image classification, time series classification, and object detection. Our results demonstrate that PrototypeNAS is able to identify DNN models within minutes that are small enough to be deployed on off-the-shelf MCUs and still achieve accuracies comparable to the performance of large DNN models.

2603.09420 2026-06-19 cs.CV cs.AI cs.RO 版本更新

Class-Incremental Motion Forecasting

类别增量运动预测

Nicolas Schischka, Nikhil Gosala, B Ravi Kiran, Senthil Yogamani, Abhinav Valada

发表机构 * Department of Computer Science, University of Freiburg, Germany(弗赖堡大学计算机科学系) Qualcomm SARL France(法国.qualcomm SARL) Automated Driving, Qualcomm Technologies, Inc.(qualcomm Technologies, Inc. 自动驾驶部门)

AI总结 提出类别增量运动预测新任务,通过端到端框架结合伪标签与开放词汇分割,利用3D-2D投票机制和查询特征方差重放策略,缓解灾难性遗忘并适应新类别。

Comments V3: Change title. Add further experiments

详情
AI中文摘要

运动预测使自动驾驶车辆能够通过预测动态智能体的未来轨迹来预判场景演化。然而,现有方法通常假设一个封闭世界设定,具有固定的对象分类法并依赖高质量感知,限制了其在现实世界中的应用,因为现实世界中感知不完美,且新对象类别可能随时间出现。在这项工作中,我们引入了类别增量运动预测,这是一个新颖的设定,其中新对象类别随时间顺序引入,并且直接从相机图像预测未来对象轨迹。我们提出了首个针对该设定的端到端框架,该框架适应新引入的类别,同时减轻对先前学习类别的灾难性遗忘。我们的方法为已知类别生成运动预测伪标签,并将其与开放词汇分割模型的2D实例掩码进行匹配。这种3D到2D关键点投票机制过滤不一致和过度自信的预测,而基于查询特征方差的重放策略采样信息丰富的过去序列以保留先验知识。在nuScenes和Argoverse 2上的广泛评估表明,我们的方法成功地在已知类别上保持性能,同时有效适应新类别。我们进一步展示了向真实世界驾驶的零样本迁移,并表明该框架自然地扩展到nuScenes和NeuroNCAP上的开环和闭环端到端类别增量规划。代码和模型将在该https URL上公开。

英文摘要

Motion forecasting enables autonomous vehicles to anticipate scene evolution by predicting the future trajectories of dynamic agents. However, existing approaches typically assume a closed-world setting with a fixed object taxonomy and access to high-quality perception, limiting their applicability in the real world where perception is imperfect, and new object classes may emerge over time. In this work, we introduce class-incremental motion forecasting, a novel setting in which new object classes are sequentially introduced over time and future object trajectories are predicted directly from camera images. We propose the first end-to-end framework for this setting, which adapts to newly introduced classes while mitigating catastrophic forgetting of previously learned ones. Our method generates motion forecasting pseudo-labels for known classes and matches them with 2D instance masks from an open-vocabulary segmentation model. This 3D-to-2D keypoint voting mechanism filters inconsistent and overconfident predictions, while a query feature variance-based replay strategy samples informative past sequences to preserve prior knowledge. Extensive evaluations on nuScenes and Argoverse 2 show that our approach successfully preserves performance on known classes while effectively adapting to novel ones. We further demonstrate zero-shot transfer to real-world driving and show that the framework extends naturally to open- and closed-loop end-to-end class-incremental planning on nuScenes and NeuroNCAP. Code and models will be made publicly available at https://omen.cs.uni-freiburg.de.

2510.06846 2026-06-19 eess.SY cs.SY 版本更新

Decentralized CBF-based Safety Filters for Collision Avoidance of Cooperative Missile Systems with Input Constraints

基于CBF的去中心化安全滤波器:面向输入受限的协同导弹系统碰撞避免

Johannes Autenrieb, Mark Spiller

AI总结 针对多飞行器拦截场景,提出基于鲁棒控制屏障函数的去中心化安全滤波器,通过事件触发和松弛变量优化实现碰撞避免,兼顾计算效率与可扩展性。

Comments 7 pages, 5 figures, accepted for presentation at the 2026 American Control Conference (ACC 2026)

详情
AI中文摘要

本文提出了一种用于多智能体航空航天拦截场景中碰撞避免的去中心化安全滤波器。该方法利用鲁棒控制屏障函数(RCBF)来保证在有界输入和高相对度动力学下安全集的前向不变性。每个执行器执行其标称协同制导指令,而局部二次规划(QP)仅在必要时修改输入。基于距离和零控脱靶量(ZEM)准则的事件触发激活通过将主动约束限制在相关邻居来确保可扩展性。为了在多个同时主动约束下保证可行性,引入了一种松弛变量方案,以帕累托最优方式优先考虑关键智能体。多对多拦截场景的仿真结果表明,所提出的框架在最小偏离标称制导的情况下保持无碰撞运行,为安全关键的多智能体航空航天系统提供了一种计算高效且可扩展的解决方案。

英文摘要

This paper presents a decentralized safety filter for collision avoidance in multi-agent aerospace interception scenarios. The approach leverages robust control barrier functions (RCBFs) to guarantee forward invariance of safe sets under bounded inputs and high-relative-degree dynamics. Each effector executes its nominal cooperative guidance command, while a local quadratic program (QP) modifies the input only when necessary. Event-triggered activation based on range and zero-effort miss (ZEM) criteria ensures scalability by restricting active constraints to relevant neighbors. To ensure feasibility under multiple simultaneously active constraints, a slack-variable relaxation scheme is introduced that prioritizes critical agents in a Pareto-optimal manner. Simulation results in many-on-many interception scenarios demonstrate that the proposed framework maintains collision-free operation with minimal deviation from nominal guidance, providing a computationally efficient and scalable solution for safety-critical multi-agent aerospace systems.

2603.14403 2026-06-19 eess.SY cs.SY 版本更新

Robust Safety Filters for Lipschitz-Bounded Adaptive Closed-Loop Systems with Structured Uncertainties

具有结构不确定性的Lipschitz有界自适应闭环系统的鲁棒安全滤波器

Johannes Autenrieb, Peter A. Fisher, Anuradha Annaswamy

AI总结 针对自适应控制系统的瞬态安全问题,提出一种基于参考的自适应安全框架,利用Lipschitz有界跟踪误差推导鲁棒CBF条件并转化为凸SOCP,减少保守性并保证前向不变性和闭环稳定性。

Comments 6 pages, 4 figures, accepted for publication in the IEEE Control Systems Letters (L-CSS)

详情
AI中文摘要

自适应控制通过在线参数自适应为不确定动态系统提供闭环稳定性和参考跟踪。然而,仅凭这些特性并不能确保状态约束的前向不变性意义上的安全性,特别是在自适应的瞬态阶段。基于控制屏障函数(CBF)的安全滤波器已被提出以解决这一限制,但现有方法通常依赖于保守的约束收紧或二次规划公式中的静态安全裕度。本文针对具有结构参数不确定性的系统提出了一种基于参考的自适应安全框架,该框架明确考虑了瞬态植物-参考失配。安全性在参考层面通过基于屏障函数的滤波器强制执行,而自适应控制驱动植物跟踪安全认证的参考。通过利用闭环跟踪误差动态的Lipschitz界,推导出依赖于跟踪误差的鲁棒CBF条件,并等价地重新表述为凸二阶锥规划(SOCP)。与固定裕度CBF公式相比,所提出的安全滤波器公式通过使安全约束随着植物-参考跟踪误差的减小而逐渐减少限制性,从而减少了保守性,同时保留了前向不变性和闭环稳定性的正式保证。

英文摘要

Adaptive control provides closed-loop stability and reference tracking for uncertain dynamical systems through online parameter adaptation. These properties alone, however, do not ensure safety in the sense of forward invariance of state constraints, particularly during transient phases of adaptation. Control barrier function (CBF)-based safety filters have been proposed to address this limitation, but existing approaches often rely on conservative constraint tightening or static safety margins within quadratic program formulations. This paper proposes a reference-based adaptive safety framework for systems with structured parametric uncertainty that explicitly accounts for transient plant-reference mismatch. Safety is enforced at the reference level using a barrier-function-based filter, while adaptive control drives the plant to track the safety-certified reference. By exploiting Lipschitz bounds on the closed-loop tracking error dynamics, a tracking-error-dependent robust CBF condition is derived and equivalently reformulated as a convex second-order cone program (SOCP). The proposed safety-filter formulation reduces conservatism relative to fixed-margin CBF formulations by rendering the resulting safety constraints progressively less restrictive as the plant-reference tracking error decreases, while preserving formal guarantees of forward invariance and closed-loop stability.

2603.10184 2026-06-19 stat.ML cs.LG 版本更新

Stabilizing Bandits using Regularization: Precise Regret and A Quantitative Central Limit Theorem

使用正则化稳定赌博机:精确遗憾与定量中心极限定理

Budhaditya Halder, Ishan Sengupta, Koustav Chowdhury, Samya Praharaj, Koulik Khamaru

发表机构 * Department of Statistics, Rutgers University(罗切斯特大学统计系) Indian Statistical Institute, Kolkata(加尔各答印度统计研究所)

AI总结 本文提出一种精细的稳定性条件,证明正则化随机镜像下降算法满足该条件,并推导出自适应采样下经验奖励估计的非渐近Berry-Esseen界、匹配的遗憾上下界,以及抗腐败下的渐近正态性,同时揭示正则化是有效推断的必要代价。

Comments Updated rate of convergence and precise regret in version 2

详情
AI中文摘要

由于自适应采样违反了经典渐近理论中的独立性假设,使用赌博机数据进行统计推断面临根本性挑战。近期工作将稳定性~\citep{laiwei82} 确定为自适应下有效推断的充分条件。本文首先提出一个精细的稳定性条件,以在线算法的迭代形式表述,并证明一大类正则化随机镜像下降算法满足该条件。这一精细条件使我们能够在多个方面加强~\citet{laiwei82} 的渐近结果。首先,我们推导出自适应采样下经验奖励估计的非渐近Berry-Esseen界。其次,我们推导出所提算法遗憾的匹配非渐近上下界,从而精确刻画其遗憾。第三,我们证明这些正则化算法在给定水平的对抗性腐败下保持渐近正态性和有效推断。最后,我们表明正则化是必要的而非偶然的:Lai-Wei稳定性与最优的$O(\sqrt{T})$遗憾率(如EXP3等非正则化算法所达到的)不相容,因此受控的多对数级遗憾膨胀是有效推断的代价。

英文摘要

Statistical inference with bandit data presents fundamental challenges owing to adaptive sampling, which violates the independence assumptions underlying classical asymptotic theory. Recent work has identified stability~\citep{laiwei82} as a sufficient condition for valid inference under adaptivity. This paper first provides a refined stability condition, stated in terms of the iterates of an online algorithm, and shows that a large class of regularized stochastic-mirror-descent-style algorithms satisfy it. This refined condition allows us to strengthen the asymptotic results of~\citet{laiwei82} in several ways. First, we derive a non-asymptotic Berry--Esseen bound for the empirical reward estimates under adaptive sampling. Second, we derive matching non-asymptotic upper and lower bounds on the regret of the proposed algorithm, yielding a precise characterization of its regret. Third, we show that these regularized algorithms preserve asymptotic normality and valid inference under a prescribed level of adversarial corruption. Finally, we show that regularization is necessary rather than incidental: Lai--Wei stability is incompatible with the optimal $O(\sqrt{T})$ regret rate -- the rate attained by unregularized algorithms such as EXP3 -- so that a controlled, polylogarithmic inflation in regret is the price of valid inference.

2602.05533 2026-06-19 cs.AI 版本更新

Conditional Diffusion Guidance under Hard Constraint: A Stochastic Analysis Approach

硬约束下的条件扩散引导:一种随机分析方法

Zhengyi Guo, Wenpin Tang, Renyuan Xu

发表机构 * Department of Industrial Engineering and Operations Research, Columbia University(哥伦比亚大学工业工程与运营管理系) Department of Management Science and Engineering, Stanford University(斯坦福大学管理科学与工程系)

AI总结 提出基于Doob h-变换和鞅表示的条件扩散引导框架,通过鞅损失和鞅协方差损失学习条件函数梯度,确保硬约束满足并给出非渐近保证。

详情
AI中文摘要

我们研究了扩散模型中在硬约束下的条件生成,其中生成的样本必须以概率1满足预设事件。这类约束在安全关键应用和稀有事件模拟中自然出现,而软或基于奖励的引导方法无法保证约束满足。基于扩散模型的概率解释,我们利用Doob h-变换、鞅表示和二次变差过程,开发了一个原则性的条件扩散引导框架。具体地,得到的引导动力学通过涉及条件函数对数梯度的显式漂移校正来增强预训练扩散,而不修改预训练得分网络。利用鞅和二次变差恒等式,我们提出了两种新的离策略学习算法,基于鞅损失和鞅协方差损失,仅使用预训练模型的轨迹来估计h及其梯度。我们为得到的条件采样器在总变差和Wasserstein距离下提供了非渐近保证,明确刻画了得分近似和引导估计误差的影响。数值实验证明了所提方法在强制硬约束和生成稀有事件样本方面的有效性。数值实验的代码可在此https URL找到。

英文摘要

We study conditional generation in diffusion models under hard constraints, where generated samples must satisfy prescribed events with probability one. Such constraints arise naturally in safety-critical applications and in rare-event simulation, where soft or reward-based guidance methods offer no guarantee of constraint satisfaction. Building on a probabilistic interpretation of diffusion models, we develop a principled conditional diffusion guidance framework based on Doob's h-transform, martingale representation and quadratic variation process. Specifically, the resulting guided dynamics augment a pretrained diffusion with an explicit drift correction involving the logarithmic gradient of a conditioning function, without modifying the pretrained score network. Leveraging martingale and quadratic-variation identities, we propose two novel off-policy learning algorithms based on a martingale loss and a martingale-covariation loss to estimate h and its gradient using only trajectories from the pretrained model. We provide non-asymptotic guarantees for the resulting conditional sampler in both total variation and Wasserstein distances, explicitly characterizing the impact of score approximation and guidance estimation errors. Numerical experiments demonstrate the effectiveness of the proposed methods in enforcing hard constraints and generating rare-event samples. The code of the numerical experiments can be found at https://github.com/ZhengyiGuo2002/CDG_Finance.

2603.07236 2026-06-19 cs.CV 版本更新

HY-WU (Part I): An Extensible Functional Neural Memory Framework and An Instantiation in Text-Guided Image Editing

HY-WU (第一部分): 一种可扩展的功能性神经记忆框架及其在文本引导图像编辑中的应用

Mengxuan Wu, Xuanlei Zhao, Ziqiao Wang, Ruicheng Feng, Zhangyang Wang, Kai Wang

发表机构 * Tencent HY Team(腾讯 HY 团队)

AI总结 提出HY-WU框架,通过功能性神经记忆模块即时生成实例特定权重更新,避免共享权重覆盖导致的干扰,解决持续学习与个性化中的灾难性遗忘问题。

详情
AI中文摘要

基础模型正从离线预测器过渡到期望长时间运行的部署系统。在实际部署中,目标并非固定:领域漂移、用户偏好演变,以及模型发布后出现新任务。这将持续学习和即时个性化从可选功能提升为核心架构要求。然而,大多数适应流程仍遵循静态权重范式:训练后(或任何适应步骤后),推理执行单一参数向量,而不考虑用户意图、领域或实例特定约束。这将训练或适应后的模型视为参数空间中的单个点。在异构且持续演变的机制中,不同目标可能在参数上诱导分离的可行区域,迫使任何单一共享更新陷入妥协、干扰或过度专业化。结果,持续学习和个性化通常实现为对共享权重的重复覆盖,冒着先前学习行为退化的风险。我们提出HY-WU(权重释放),一种记忆优先的适应框架,将适应压力从覆盖单一共享参数点转移。HY-WU将功能性(算子级)记忆实现为神经模块:一个根据实例条件即时合成权重更新的生成器,产生实例特定算子而无需测试时优化。

英文摘要

Foundation models are transitioning from offline predictors to deployed systems expected to operate over long time horizons. In real deployments, objectives are not fixed: domains drift, user preferences evolve, and new tasks appear after the model has shipped. This elevates continual learning and instant personalization from optional features to core architectural requirements. Yet most adaptation pipelines still follow a static weight paradigm: after training (or after any adaptation step), inference executes a single parameter vector regardless of user intent, domain, or instance-specific constraints. This treats the trained or adapted model as a single point in parameter space. In heterogeneous and continually evolving regimes, distinct objectives can induce separated feasible regions over parameters, forcing any single shared update into compromise, interference, or overspecialization. As a result, continual learning and personalization are often implemented as repeated overwriting of shared weights, risking degradation of previously learned behaviors. We propose HY-WU (Weight Unleashing), a memory-first adaptation framework that shifts adaptation pressure away from overwriting a single shared parameter point. HY-WU implements functional (operator-level) memory as a neural module: a generator that synthesizes weight updates on-the-fly from the instance condition, yielding instance-specific operators without test-time optimization.

2602.20573 2026-06-19 cs.LG 版本更新

MolGraphBench: A Benchmark of GNN Architectures for Molecular Regression Tasks

MolGraphBench:用于分子回归任务的GNN架构基准测试

Rajan, Ishaan Gupta

发表机构 * Rajan 1 Ishaan Gupta 2

AI总结 提出MolGraphBench基准,比较四种GNN模型在分子回归任务上的性能,发现GCN和GIN为最优架构,并指出GNN层类型应作为可调超参数。

Comments 14 pages, 5 figures and 4 tables

详情
AI中文摘要

分子通常表示为SMILES字符串,可以轻松转换为手工设计的描述符或指纹(FP)用于分子性质预测。研究表明,SMILES可以转换为分子图 $G = (V, E)$,其中原子为节点 $(V)$,键为边 $(E)$。这些分子图随后可用于训练图神经网络(GNN)模型。尽管近年来GNN(现有和新架构)在分子性质预测中的应用激增,但仍缺乏严格的基准测试。我们提出了MolGraphBench,一个包含四种常用GNN模型的全面基准测试,用于分子性质预测。基准测试结果表明,基于绝对性能、训练效率、迁移学习和预测质量,图卷积网络(GCN)和图同构网络(GIN)是分子图回归任务的最优GNN架构。研究还表明,在融合(GNN-FP)框架中,分子指纹具有非互补性。此外,我们的GNN模型在三个数据集上取得了优于或与当前最先进GNN基线相当的性能(B3DB上GCN的RMSE为0.518,FreeSolv上GIN-FP的RMSE为1.022,RT数据集上GIN的MAE为63.783)。本研究的发现表明,GNN层类型应被视为可调超参数,而非固定设计选择,以实现更优性能。

英文摘要

Molecules are often represented as SMILES strings, which can be readily converted to hand-crafted descriptors or fingerprints (FP) for molecular property prediction. Research has demonstrated that SMILES can be converted to molecular graphs $G = (V, E)$, with atoms as nodes $(V)$ and bonds as edges $(E)$. These molecular graphs can subsequently be used to train graph neural networks (GNN) models. Despite the recent surge in application of GNN (existing and novel architectures) for molecular property prediction, a rigorous benchmark is still lacking. We propose MolGraphBench, a comprehensive benchmark of four commonly used GNN models for molecular property prediction. Benchmarking results demonstrate graph convolutional network (GCN) and graph isomorphism networks (GIN) as the optimal GNN architectures for molecular graph regression tasks, based on absolute performance, training efficiency, transfer learning and prediction quality. The study also indicates the non-complementary nature of molecular fingerprints in the fusion (GNN-FP) framework. Furthermore, our GNN models achieved performance superior or comparable performance to current state-of-the-art GNN baselines across three datasets (GCN with RMSE of $0.518$ on B3DB, GIN-FP with RMSE of $1.022$ on FreeSolv and GIN with MAE of $63.783$ on RT datasets). Findings from this study indicate that type of GNN-layer, should be treated as a tunable hyperparameter rather than a fixed design choice to achieve superior performance.

2509.15069 2026-06-19 eess.SP cs.DS cs.NA math.NA 版本更新

Efficient Computation of Time-Index Powered Weighted Sums Using Cascaded Accumulators

使用级联累加器高效计算时间索引加权和

Deijany Rodriguez Linares, Oksana Moryakova, Håkan Johansson

AI总结 提出一种利用级联累加器高效计算时间索引加权和的方法,将乘法次数从K×N减少到K+1次常数乘法,无需存储数据块,适用于实时逐样本处理系统。

Comments This work has been submitted to the IEEE for possible publication

Journal ref IEEE Signal Processing Letters, vol. 33, pp. 893-897, Feb. 2026

详情
AI中文摘要

本文提出了一种新颖的方法,使用级联累加器高效计算形如$\sum_{n=0}^{N-1} n^{K} v[n]$的时间索引加权和。传统的直接计算需要$K{\times}N$次通用乘法,对于大的$N$变得不可行,而基于查找表或信号反转的替代策略需要存储整个数据块。通过利用累加器特性,所提方法消除了此类存储需求,并将乘法成本降低到仅$K{+}1$次常数乘法,实现了高效的实时实现。当需要在逐样本处理系统中高效计算此类和时,该方法特别有用。

英文摘要

This letter presents a novel approach for \mbox{efficiently} computing time-index powered weighted sums of the form $\sum_{n=0}^{N-1} n^{K} v[n]$ using cascaded accumulators. Traditional direct computation requires $K{\times}N$ general multiplications, which become prohibitive for large $N$, while alternative strategies based on lookup tables or signal reversal require storing entire data blocks. By exploiting accumulator properties, the proposed method eliminates the need for such storage and reduces the multiplicative cost to only $K{+}1$ constant multiplications, enabling efficient real-time implementation. The approach is particularly useful when such sums need to be efficiently computed in sample-by-sample processing systems.

2601.22300 2026-06-19 physics.optics cond-mat.dis-nn cs.ET cs.LG 版本更新

Toward all-optical unsupervised Hebbian learning in deep photonic neuromorphic networks

面向全光学无监督Hebbian学习的深度光子神经形态网络

Xi Li, Disha Biswas, Peng Zhou, Wesley H. Brigner, Anna Capuano, Joseph S. Friedman, Qing Gu

发表机构 * Department of Electrical and Computer Engineering, North Carolina State University(北卡罗来纳州立大学电气与计算机工程系) Department of Electrical and Computer Engineering, The University of Texas at Dallas(德克萨斯大学达拉斯分校电气与计算机工程系) Department of Materials Science and Engineering, North Carolina State University(北卡罗来纳州立大学材料科学与工程系) Department of Physics, North Carolina State University(北卡罗来纳州立大学物理系)

AI总结 提出一种基于相变材料突触和局部光反馈的深度光子神经形态网络架构,实现在线无监督Hebbian学习,实验验证了自适应突触演化和光学推理。

Comments 16 pages, 4 figures

详情
AI中文摘要

我们提出了一种基于相变材料(PCM)突触和局部光反馈的深度光子神经形态网络(PNN)架构,用于在线、无监督的Hebbian学习。该架构将光学矢量-矩阵乘法、非易失性PCM突触加权以及局部符合驱动的突触自适应结合在一个与光子集成电路兼容的多层光子交叉开关框架中。与依赖外部计算梯度、重复光电转换或全局反向传播的传统PNN不同,所提出的框架采用由突触前和突触后光学活动直接控制的局部Hebbian学习。为了研究所提出的学习机制的可行性,我们使用光纤组件、可编程可变光衰减器和包含PCM热动力学的实时软件控制实现了PNN设计。在离线和在线学习条件下,使用代表性图像识别任务实验评估了监督和无监督学习行为。实验结果表明,在现实光纤硬件条件下,通过局部Hebbian学习实现了自适应突触演化、成功的光学推理和自主模式编码。这些结果为未来能够实现可扩展和节能的在线Hebbian学习的集成光子神经形态系统铺平了道路。

英文摘要

We propose a deep photonic neuromorphic network (PNN) architecture based on phase-change material (PCM) synapses and local optical feedback for online, unsupervised Hebbian learning. The proposed architecture combines optical vector-matrix multiplication, non-volatile PCM synaptic weighting, and local coincidence-driven synaptic adaptation within a multilayer photonic crossbar framework compatible with photonic integrated circuits. Unlike conventional PNNs that rely on externally computed gradients, repeated optical-electrical-optical conversions, or global backpropagation, the proposed framework employs local Hebbian learning governed directly by correlated pre- and post-synaptic optical activity. To investigate the feasibility of the proposed learning mechanism, we implemented the PNN design using fiber-optic components, programmable variable optical attenuators, and real-time software control that incorporates PCM thermal dynamics. Supervised and unsupervised learning behaviors were experimentally evaluated under both offline and online learning conditions using representative image-recognition tasks. The experimental results demonstrate adaptive synaptic evolution, successful optical inference, and autonomous pattern encoding through local Hebbian learning under realistic fiber-optic hardware conditions. These results establish a pathway toward future integrated photonic neuromorphic systems capable of scalable and energy-efficient online Hebbian learning.