arXivDaily arXiv每日学术速递 周一至周五更新
全部学科分类 4306
2608.02603 2026-08-04 cs.CV 新提交

WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity

WorldExam:从表观外观到内在反应性对世界模型进行基准测试

Yuxue Yang, Shuyao Shang, Jiahe Wang, Zitong Zhou, Liang Tan, Junhan Zeng, Ruizhi Li, Junyan Li, Yu Liu, Xiao Yang, Yong Li, Jun Zhu, Hongsheng Li, Tieniu Tan, Lue Fan, Zhaoxiang Zhang

机构 * CASIA(中国科学院自动化研究所) SLAI(智能科学与技术实验室) CUHK(香港中文大学) AMAP(中国农业科学院) THU(清华大学)

AI总结 该研究推出WorldExam基准,评估20个模型在视觉质量等四层级的表现,发现不同驱动模型能力有明显分化,无模型兼具广泛任务覆盖与稳定性能,高视觉质量不代表内在反应性强。

Comments Project Website: https://WorldExam.github.io

详情
AI中文摘要

可控视频生成模型正日益被开发为世界模型,因此对其作为世界模型的评估已超出生成视频的表观外观,延伸至其描绘世界的内在反应性:即从场景状态推断世界应如何反应并生成输入未明确描述的合理结果的能力。然而现有基准主要通过检查请求的动作和交互结果是否实现来评估视觉质量或明确指令完成情况,却未充分考察内在反应性。我们推出WorldExam,这是一个涵盖四个层级的分层诊断基准:视觉质量、控制依从性、空间一致性和世界反应性。它包含8个专用任务的1474个案例,支持对相机驱动、动作驱动和语言驱动模型范式的统一评估。世界反应性层级评估输入中未明确指定的场景条件反应和目标导向行为。对20个代表性模型的评估显示出明显的能力分化:相机驱动模型擅长相机控制,但其接口不支持动态交互;动作驱动模型能更精准地控制主体,但常使世界处于无反应状态;语言驱动模型在交互上表现更好,但对复杂控制的依从性较差。没有模型同时具备广泛的任务覆盖范围和始终优异的性能,表明高视觉质量和明确指令完成情况并不能保证内在反应性。

英文摘要

Controllable video generation models are increasingly being developed as world models. Accordingly, evaluating them in this role extends beyond the apparent appearance of generated videos to the inherent reactivity of the worlds they depict: the ability to infer from the scene state how the world should react and to generate plausible consequences not explicitly described in the input. Yet existing benchmarks mainly assess visual quality or explicit instruction fulfillment by checking whether requested actions and interaction outcomes are realized, leaving inherent reactivity underexamined. We introduce WorldExam, a hierarchical diagnostic benchmark spanning four levels: Visual Quality, Control Adherence, Spatial Consistency, and World Reactivity. It comprises 1,474 cases across eight dedicated tasks and supports unified evaluation of camera-, action-, and language-driven model paradigms. The World Reactivity level evaluates scene-conditioned reactions and goal-directed behaviors beyond what is explicitly specified in the input. Evaluation of 20 representative models reveals a clear capability split. Camera-driven models excel at camera control, but their interfaces do not support dynamic interaction; action-driven models control subjects more precisely but often leave the world unresponsive; and language-driven models perform better on interaction but follow complex controls less faithfully. No model combines broad task coverage with consistently strong performance, showing that high visual quality and explicit instruction fulfillment do not guarantee inherent reactivity.

URL PDF HTML 收藏
2608.02589 2026-08-04 cs.CV 新提交

CAPEval: A Decoupled Caption Evaluation across Understanding and Generation

CAPEval:跨理解与生成的解耦式标题评估

Zhipeng Liu, Haochen Wang, Zhaoxiang Zhang

机构 * University of Chinese Academy of Sciences(中国科学院大学) Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)

AI总结 本研究提出解耦式标题评估基准CAPEval,将标题质量分为覆盖度与精确度,发现二者分别对应理解与生成任务性能,为标题生成器的选择优化提供指导。

Comments 21 pages, 8 figures. Code and dataset will be available at https://liuzhipenggg.github.io/CAPEval/

详情
AI中文摘要

标题是多模态理解和文本到图像生成的主要监督信号,但以往的评估将标题质量视为单一标量目标,混淆了两个不同属性:一是标题覆盖的视觉信息量,二是图像对其表述主张的可靠程度。为此,我们设计了解耦式标题评估基准CAPEval(Coverage And Precision Evaluation,覆盖度与精确度评估),包含人工撰写的真实标题和人工验证的原子清单条目。具体而言,CAPEval将标题质量分解为覆盖度和精确度:前者量化标题覆盖真实事实内容的全面程度,后者反映标题中所有主张的事实正确率。我们选取10个标题生成器,并以标题来源为唯一变量,在四个模型家族上开展受控的下游端到端实验。实证发现存在一致的任务依赖型解离:覆盖度是理解性能的更强关联因素,而精确度是生成性能的主导预测因子。这种解耦评估范式不仅能对标题质量进行更细粒度的诊断,还能为针对不同下游任务选择和优化标题生成器提供可操作的指导。

英文摘要

Captions serve as a primary supervision signal for both multimodal understanding and text-to-image generation. However, previous evaluations treat the caption quality as a single scalar objective, which conflates two distinct properties: (1) how much visual information a caption covers and (2) how reliably the image supports its stated claims. To this end, we design a decoupled caption evaluation benchmark, CAPEval (Coverage And Precision Evaluation), with human-written ground-truth captions and human-verified atomic checklist items. Specifically, CAPEval decomposes caption quality into Coverage and Precision. The former quantifies how thoroughly a caption covers ground-truth factual content, while the latter reflects the factual correctness rate of all claims expressed in the caption. We select 10 captioners and further conduct controlled downstream end-to-end experiments with them from four model families, where the caption source is the only variable. Empirically, we find a consistent task-dependent dissociation: Coverage serves as the stronger correlate for understanding performance, whereas Precision acts as the dominant predictor for generation performance. This decoupled evaluation paradigm not only delivers a more fine-grained diagnosis of caption quality, but also offers actionable guidance for selecting and optimizing captioners tailored to different downstream tasks.

URL PDF HTML 收藏
2608.02585 2026-08-04 cs.LG cs.CL 新提交

GradCuit: Credit-Assigned Gradient Flow Enables Robust and Interpretable Test-Time Latent Reasoning

GradCuit:信用分配梯度流实现鲁棒且可解释的测试时潜在推理

Zhaoxin Yu, Qi Shen, Hengli Li, Zhaowei Zhang, Song-Chun Zhu, Chi Zhang, Zilong Zheng

机构 * Beijing Institute for General Artificial Intelligence(北京通用人工智能研究院) Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所) School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院) School of Artificial Intelligence for Science, Peking University(北京大学科学人工智能学院)

AI总结 GradCuit在测试时插入可优化潜在状态,实现序列级信用分配,在多基准上准确率优于同类方法,且鲁棒性、可解释性更强,为LLM测试时推理扩展提供新方向。

详情
AI中文摘要

基于优化的潜在推理在测试时通过优化实例特定的连续状态来改进大语言模型(LLM)的输出,同时保持模型参数冻结。然而,现有方法通常将这些状态通过解码后的标记与推理轨迹关联,导致序列级信用分配间接,且模糊了潜在更新如何塑造后续推理。我们提出GradCuit(梯度通过电路),它在提示的隐藏表示和生成的延续之间的选定Transformer层插入可优化的潜在状态。因果自注意力为每个延续标记的对数概率提供了一条通过剩余Transformer块连接到所有先前潜在状态的可微路径,使得来自整个延续的奖励加权梯度能够直接分配给潜在变量。在五个指令微调的骨干模型、三个推理基准和两种答案格式上,GradCuit达到了64.5%的平均准确率,比思维链(Chain-of-Thought)提示高出6.6个百分点,比最强的竞争方法高出2.4个百分点。GradCuit还展现出更强的鲁棒性:在七个学习率设置下,它始终优于LatentSeek,同时将准确率的标准差从1.53降至0.82,甚至其随机游走变体仍与LatentSeek具有竞争力。在可解释性方面,标记级梯度归因显示潜在影响集中在推理连接标记上,而层分析确定Transformer的中低层是最有效的优化空间。通过直接从结果反馈中优化内部推理,GradCuit开辟了鲁棒且可解释的测试时扩展的新维度,其中LLM调整自身推理方式,而非仅重新生成、采样或重新排序输出。

英文摘要

Optimization-based latent reasoning improves large language model outputs by optimizing instance-specific continuous states at test time while keeping model parameters frozen. Existing methods, however, typically connect these states to the reasoning trajectory through decoded tokens, making sequence-level credit assignment indirect and obscuring how latent updates shape subsequent reasoning. We introduce GradCuit (gradient through circuit), which inserts optimizable latent states at a selected Transformer layer between the hidden representations of the prompt and the generated continuation. Causal self-attention provides every continuation-token log-probability with a differentiable path to every preceding latent state through the remaining Transformer blocks, enabling reward-weighted gradients from the entire continuation to be assigned directly to the latents. Across five instruction-tuned backbones, three reasoning benchmarks, and two answer formats, GradCuit achieves an average accuracy of 64.5%, outperforming chain-of-thought prompting by 6.6 percentage points and the strongest competing method by 2.4 points. GradCuit also demonstrates greater robustness: across seven learning-rate settings, it consistently outperforms LatentSeek while reducing the standard deviation of accuracy from 1.53 to 0.82, and even its random-walk variant remains competitive with LatentSeek. For interpretability, token-level gradient attribution reveals that latent influence concentrates on reasoning-connector tokens, while layer analysis identifies early-to-middle Transformer layers as the most effective optimization space. By directly optimizing internal reasoning from outcome feedback, GradCuit opens a new axis of robust and interpretable test-time scaling, where LLMs adapt how they reason rather than merely regenerate, sample, or rerank outputs.

URL PDF HTML 收藏
2608.02583 2026-08-04 cs.CV cs.AI cs.CL cs.IR 新提交

UEmbed: Unified Sparse and Dense Multimodal Embeddings

UEmbed:统一稀疏与稠密多模态嵌入

Tingyu Song, Mingxin Li, Yanzhao Zhang, Dingkun Long, Pengjun Xie, Zhijie Nie, Yilun Zhao, Shu Wu

机构 * CASIA(中国科学院自动化研究所) Alibaba Group(阿里巴巴集团) University of Chinese Academy of Sciences(中国科学院大学) Yale University(耶鲁大学)

AI总结 UEmbed是一种仅解码器的多模态嵌入模型,可单次前向传播生成稀疏与稠密表示,在MMEB-v2和BEIR上表现优异,统一了两类嵌入并支持多模态智能体应用。

详情
AI中文摘要

稀疏检索是现代搜索系统的基础,从网页搜索到检索增强生成均是如此。现有研究引入了学习型稀疏检索(LSR),以超越精确词汇匹配,实现更丰富的语义。然而,LSR至今仍与编码器式双向架构绑定,其向多模态场景的扩展仍严重依赖辅助跨模态模块。为解决这些局限,我们提出UEmbed(统一嵌入),这是一种仅解码器的多模态嵌入模型,可在一次因果前向传播中同时生成稀疏词汇和稠密表示。UEmbed会在输入中附加N个可学习特殊标记,并将词汇表划分为N个不相交子集。每个标记的因果隐藏状态会预测其分配子集上的稀疏权重,且N个子集会被拼接为完整的稀疏向量。在公开数据上训练后,我们发布了规模为2B、4B和9B的UEmbed。UEmbed-9B在MMEB-v2上的稠密指标达到71.8、稀疏指标达到71.0,优于在公开数据上训练的多模态嵌入模型(如RzenEmbed)。在BEIR上,UEmbed也与强大的稠密和稀疏基准保持竞争力。此外,我们从有效性、效率和智能体应用三个维度展示了UEmbed的实用价值。总体而言,UEmbed提供了一种新范式:它在单个模型中统一了稠密和稀疏嵌入,同时进一步扩展了稀疏检索以统一文本和多模态输入。

英文摘要

Sparse retrieval underpins modern search systems, from web search to retrieval-augmented generation. Existing work has introduced Learned Sparse Retrieval (LSR) to push beyond exact lexical matching toward richer semantics. Yet LSR has so far remained tied to encoder-style bidirectional architectures, and its extension to multimodal settings still relies heavily on auxiliary cross-modal modules. To address these limitations, we introduce UEmbed (Unified Embedding), a decoder-only multimodal embedding model that produces both sparse lexical and dense representations in one causal forward pass. UEmbed appends N learnable special tokens to the input and partitions the vocabulary into N disjoint subsets. Each token's causal hidden state predicts sparse weights over its assigned subset, and the N subsets are concatenated into the full sparse vector. Trained on public data, we release UEmbed at 2B, 4B, and 9B scales. UEmbed-9B reaches 71.8 (dense) and 71.0 (sparse) on MMEB-v2, outperforming multimodal embedding models trained on publicly available data (e.g., RzenEmbed). On BEIR, UEmbed also remains competitive with strong dense and sparse baselines. Furthermore, we demonstrate the practical utility of UEmbed across three dimensions: effectiveness, efficiency, and agentic applications. Overall, UEmbed offers a new paradigm: it unifies dense and sparse embeddings in one model, while further extending sparse retrieval to unify text and multimodal inputs.

URL PDF HTML 收藏
2608.02580 2026-08-04 cs.RO 新提交

Ego2Robot: Scalable Robot Data Synthesis from Egocentric Human Data

Ego2Robot:从第一视角人类数据生成可扩展机器人数据

Ye Wang, Pei Lin, Xiong-Hui Chen, Haoqi Yuan, Zhixuan Liang, Yiyang Huang, Anzhe Chen, Zixing Lei, Jie Zhang, Tao Zhang, Haoyang Li, Tong Zhang, Chenxi Xiao, Ziyuan Jiao, Qin Jin

机构 * AIM3 Lab, Renmin University of China(中国人民大学AIM3实验室) Qwen Team, Alibaba Inc.(阿里巴巴通义千问团队) ShanghaiTech University(上海科技大学) Beijing Institute for General Artificial Intelligence (BIGAI)(北京通用人工智能研究院) Beijing University of Aeronautics and Astronautics(北京航空航天大学)

AI总结 Ego2Robot提出将第一视角人类操控视频转换为机器人训练数据的可扩展流水线,生成18561小时机器人数据,扩展RoboTwin2.0验证其联合预训练可提升机器人分布外泛化能力并经真实部署验证

详情
AI中文摘要

学习通用机器人操控策略需要大规模多样化的演示数据。第一视角人类操控视频提供了丰富的场景和任务多样性,先前研究表明,将这类视频重定向并渲染为机器人格式数据,在小规模场景下可生成有效的单任务策略。但该方法能否为大规模视觉-语言-动作模型提供预训练益处仍未被探索。我们提出Ego2Robot,这是一种可扩展的流水线,通过动作重定向、机械臂视觉合成和多级质量筛选,将第一视角人类操控视频转换为机器人训练数据。Ego2Robot支持筛选数据集和野外视频,生成了涵盖15种机器人形态的18561小时机器人训练数据,是迄今为止最大的第一视角转机器人数据集。为评估泛化性,我们扩展RoboTwin2.0,加入涵盖视觉外观、场景布局、实体形态和任务语义的解耦扰动轴。实验表明,联合预训练Ego2Robot合成数据与机器人数据,可一致提升多种扰动类型下的分布外泛化能力,其益处已在真实机器人部署中得到验证。项目页面:this https URL

英文摘要

Learning generalizable robot manipulation policies requires large-scale and diverse demonstration data. Egocentric human manipulation videos offer rich scene and task diversity, and prior work has shown that retargeting and rendering such videos into robot-format data can yield effective per-task policies at small scale. However, whether this approach can provide pretraining benefits for vision-language-action models at scale remains unexplored. We present \textbf{Ego2Robot}, a scalable pipeline that converts egocentric human manipulation videos into robot training data through action retargeting, robot-arm visual synthesis, and multi-level quality curation. Ego2Robot supports both curated datasets and in-the-wild videos, producing 18,561 hours of robot training data spanning 15 robot morphologies, making it the largest ego-to-robot dataset to date. To evaluate generalization, we extend RoboTwin2.0 with disentangled perturbation axes covering visual appearance, scene layout, embodiment morphology, and task semantics. Experiments show that joint pretraining on Ego2Robot-synthesized and robot data consistently improves out-of-distribution generalization across multiple perturbation types, with benefits validated on real-robot deployment. Project page: https://www-ye.github.io/ego2robot_blog/

URL PDF HTML 收藏
2608.02576 2026-08-04 cs.LG 新提交

Smooth Reparameterizations of Functions on Simplicial Product Spaces: Applications to Probabilistic Tensor Decomposition and Functional Data Registration

单纯形乘积空间上函数的光滑重参数化:在概率张量分解与函数数据配准中的应用

Shashwat Kumar, Arafat Rahman, Anuj Srivastava, P. -A. Absil

机构 * Johns Hopkins University(约翰斯·霍普金斯大学) University of Virginia(弗吉尼亚大学) UCLouvain(鲁汶大学(法语))

AI总结 针对单纯形乘积空间上的优化问题,提出用光滑重参数化替换单纯形乘积,得到性能优于投影梯度下降的黎曼梯度下降算法,可用于概率张量分解与函数数据配准。

Comments submitted to Journal of Optimization Theory and Applications (JOTA)

详情
AI中文摘要

我们研究定义在单纯形乘积空间上的优化问题,这类问题的例子包括通过单纯形约束张量分解学习低秩离散多元概率分布,以及在平方根速度函数(SRVF)表示下进行函数数据配准。本工作证明了用逐元素严格凸的光滑重参数化替换单纯形乘积的可行性,从而得到流形上的无约束优化问题。我们表明,这种重参数化操作会将光滑流形上的二阶Karush-Kuhn-Tucker(KKT)点映射到单纯形乘积上的弱二阶KKT点。这催生了一种用于求解重参数化问题的黎曼梯度下降(RGD)算法,该算法的性能优于投影梯度下降(PGD),且在执行曲线配准时能更忠实地表示原始函数形状。

英文摘要

We consider optimization problems defined on product spaces of simplices. Examples of this class of problems include learning low-rank discrete multivariate probability distributions via simplex constrained tensor decomposition and performing functional data registration under the Square Root Velocity Function (SRVF) representation. In this work, we demonstrate the feasibility of replacing the product simplex with a smooth, elementwise strictly convex reparameterization, resulting in an unconstrained optimization problem on a manifold. We show that performing such a reparameterization results in the second order Karush-Kuhn-Tucker (KKT) points on the smooth manifold being mapped to the weak second order KKT points on the product simplex. This leads to a Riemannian Gradient Descent (RGD) algorithm for solving the reparameterized problem, which outperforms Projected Gradient Descent (PGD), and provides a more faithful representation of the original function shapes while performing curve registration.

URL PDF HTML 收藏
2608.02575 2026-08-04 cs.LG stat.ML 新提交

Pseudorandom Streams within Diffusion Models Act as Learnable Inputs That Affect Generation Quality

扩散模型中的伪随机流是影响生成质量的可学习输入

Shengzhi Deng, Chenqi Ye, Yanze Guo

机构 * School of Mathematics, Harbin Institute of Technology(哈尔滨工业大学数学学院) Software College, Northeastern University(东北大学软件学院)

AI总结 该研究发现扩散模型的伪随机流是可学习输入,会影响生成质量,相关指标与生成退化相关,伪随机源兼具分布选择与结构化输入属性。

Comments 22 pages, 6 figures. Code and data are available at https://github.com/happyflatfish/prng-diffusion-learnability

详情
AI中文摘要

扩散模型依赖随机输入,但在有限精度硬件上,其消耗的“随机性”表现为伪随机规则生成的确定性数值轨道。可访问的轨道结构可成为可学习输入,影响训练与生成,因为实际损失及其梯度取决于每次优化步骤消耗的具体伪随机值。小型多层感知器从轨道近期历史预测其下一个值,衡量序列的可预测性;扩散探针则在保留扩散架构与训练目标的同时,将真实图像替换为在线随机张量,衡量目标系统能否利用轨道结构。在控制边缘统计并排除明显的动力学及有限精度失效后,剩余轨道在MNIST和CIFAR-10数据集上仍产生显著不同的扩散损失与生成质量,且这两项指标与宏观生成退化呈强秩相关,尽管局部排名存在差异。经独立同分布(IID)基线归一化后,探针损失与真实数据扩散损失近似遵循经验幂律,且在两个数据集上指数不同。这些结果表明,伪随机源不仅是分布选择,还是依赖模型的结构化输入。

英文摘要

Diffusion models rely on stochastic inputs, yet on finite-precision hardware, the "randomness" they consume is realized as deterministic numerical orbits generated by pseudorandom rules. Accessible orbit structure can become a learnable input and affect both training and generation because the realized loss and its gradient depend on the concrete pseudorandom values consumed at each optimization step. A small multilayer perceptron predicts the next value of an orbit from its recent history, measuring general sequence predictability. A diffusion probe replaces real images with online random tensors while preserving the diffusion architecture and training objective, measuring whether the target system can exploit orbit structure. After controlling marginal statistics and screening out clear dynamical and finite-precision failures, the remaining orbits still produce markedly different diffusion losses and generation quality on MNIST and CIFAR-10. Both measures show strong rank correlations with macroscopic generation degradation, although their local rankings differ. After normalization by the IID baseline, the probe loss and the real-data diffusion loss approximately follow an empirical power law, with different exponents on the two datasets. These results suggest that a pseudorandom source is not only a distributional choice, but also a model-dependent structured input.

URL PDF HTML 收藏
2608.02571 2026-08-04 cs.RO 新提交

Situation Aware Frontier Prioritization for Quadruped Search and Rescue

面向四足机器人搜索与救援的情境感知前沿优先策略

Kevin Farias, Santiago Martin, Barbara Flores, Vinicio Melgar, Igor Nunes, Hiago Sodre, Pablo Moraes, Ricardo B. Grando

机构 * Technological University of Uruguay(乌拉圭理工大学)

AI总结 本文提出情境感知前沿优先方法,在Gazebo仿真的两类室内救援场景中,该方法较其他方法实现最高完成率与幸存者回收率,适用于复杂救援场景的平衡决策。

详情
AI中文摘要

四足机器人是搜索与救援任务的有潜力平台,因为它们能在杂乱的室内环境中移动,而这类环境可能对轮式系统构成限制。然而,在未知的救援场景中,自主探索必须在地图扩展与发现幸存者的可能性之间取得平衡,这是经典前沿选择策略未明确解决的问题。本文提出一种面向单机器人四足搜索与救援的情境感知前沿优先方法。该方法保留了前沿探索框架,但通过信息增益、观测不足、救援相关性、地形惩罚和行进成本扩展了前沿排序。该方法在Gazebo仿真中,使用四足机器人在两个不同难度级别的室内救援场景中进行评估。第一个场景用于合理性检查,第二个场景则引入更严重的杂乱和前沿歧义。实验结果表明,所有方法在简单场景中表现可靠,而在复杂场景中表现不同。在该场景中,所提方法在评估方法中实现了最高的完成率和最高的幸存者回收率。这些结果表明,当前沿选择变得复杂,且必须在通用探索目标与救援效用之间取得平衡时,情境感知前沿优先策略是有益的。

英文摘要

Quadruped robots are a promising platform for search and rescue missions because they can navigate cluttered indoor environments that may be restrictive for wheeled systems. However, in unknown rescue scenarios, autonomous exploration must balance map expansion with the likelihood of finding victims, which is not explicitly addressed by clas- sical frontier selection strategies. This paper presents a situation aware frontier prioritization method for single robot quadruped search and rescue. The proposed approach preserves the frontier exploration framework, but extends frontier ranking with information gain, observation deficit, rescue relevance, terrain penalty, and travel cost. The method is eval- uated in Gazebo simulation with a quadruped robot in two indoor rescue scenarios with different levels of difficulty. The first scenario is used as a sanity check, while the second introduces stronger clutter and frontier ambiguity. Experimental results show that all methods perform reliably in a simple scenario, whereas in a complex scenario is different. In that setting, the proposed method achieves the highest completion rate and the highest victim recovery among the evaluated approaches. These results indicate that situation aware frontier prioritization is beneficial when frontier choice becomes nontrivial and rescue utility must be balanced against generic exploration objectives.

URL PDF HTML 收藏
2608.02561 2026-08-04 cs.CV 新提交

ReMiX-MAE: Learning Missing-Channel Cross-Modal Representations from RGB-Only Clinical Facial Videos for Sympathetic-Mediated Pain Assessment

ReMiX-MAE:从仅含RGB的临床面部视频中学习缺失通道跨模态表征以用于交感介导的疼痛评估

Nan Bi, Taoyue Wang, Lijun Yin, Vandana Sharma

机构 * School of Computing, Binghamton University(宾汉姆顿大学计算学院) SUNY Upstate Medical University(纽约州立大学上州医科大学)

AI总结 本文提出ReMiX-MAE框架,构建SMP数据集,在仅用RGB的疼痛评估任务中,其性能优于仅用RGB的基线,且在数据有限的临床场景中迁移能力更优。

详情
AI中文摘要

临床自动化疼痛评估受限于两类问题:一是临床标注的面部视频数据稀缺,且标签质量差(常为序列级自我报告);二是RGB信号中的疼痛线索可能细微或接近中性,而热成像与深度信号虽具信息价值却难以常规部署。为解决这些挑战,本文提出ReMiX-MAE(Reconstructing Missing Channel Cross-Modal Masked Autoencoder,即重构缺失通道跨模态掩码自编码器),这是一种自监督多模态掩码预训练框架,可从同步的RGB、热成像及深度视频中学习可迁移的面部表征,并明确训练对缺失模态的鲁棒性,从而支持仅基于RGB的部署。为填补临床面部疼痛数据的缺口(需具备视频级自我报告与纵向治疗轨迹),本文构建了交感介导疼痛(Sympathetic Mediated Pain,SMP)数据集,包含多次就诊的前后配对记录。在仅用RGB部署的场景下,本文通过直接特征提取与从RGB解码的伪多模态特征两种方式评估ReMiX-MAE,结果显示其在SMP数据集上始终优于仅用RGB的掩码自编码器基线,且伪多模态特征在具有挑战性的五分类场景中能带来额外性能提升;在外部数据集上,ReMiX-MAE相比仅用RGB的基线表现出更鲁棒、标签效率更高的迁移能力,凸显其在数据有限的临床场景中的优势。

英文摘要

Automated pain assessment in real clinics is limited by scarce clinically grounded facial video data with weak labels (often sequence-level self-report) and by the fact that pain cues can be subtle or near-neutral in RGB, while thermal and depth signals are informative yet impractical to deploy routinely. To address these challenges, we propose ReMiX-MAE (Reconstructing Missing Channel Cross-Modal Masked Autoencoder), a self-supervised multimodal masked pretraining framework that learns transferable facial representations from synchronized RGB, thermal, and depth videos and explicitly trains robustness to missing modalities, enabling RGB-only deployment. To fill the gap of clinically grounded facial pain data with video-level self-report and longitudinal treatment trajectories, we collect the Sympathetic Mediated Pain (SMP) dataset with paired pre- and post-recordings across multiple visits. Under RGB-only deployment, we evaluate ReMiX-MAE using both direct feature extraction and pseudo-multimodal features decoded from RGB. ReMiX-MAE consistently outperforms an RGB-only masked autoencoder baseline on SMP, with pseudo-multimodal features providing additional gains in the challenging five-class setting. Across external datasets, ReMiX-MAE further shows more robust and label-efficient transfer than RGB-only baselines, highlighting its advantage in data-limited clinical settings.

URL PDF HTML 收藏
2608.02560 2026-08-04 cs.LG cs.AI cs.IR 新提交

Structured Memory for Edge Language Models: Persistent Context and Corpus Retrieval via O(1) SSM State Injection

边缘语言模型的结构化记忆:通过O(1) SSM状态注入实现持久上下文与语料库检索

Anusha Madan Gopal, Aras Pirbadian, Kristofor D. Carlson, M Anthony Lewis, Jonathan Tapson

机构 * BrainChip Inc.(BrainChip公司)

AI总结 该研究针对边缘语言模型提出PRECOG与SMC机制,将SSM预填充成本压缩至O(1),在1.2B参数的TENNs-LLM上实现约4500倍预填充加速,达到与RAG相当的答案质量。

详情
AI中文摘要

检索增强生成(RAG)会产生与检索上下文长度成正比的预填充成本,且对于Transformer骨干网络而言,键值缓存(KV-cache)会随每个生成的令牌增长。状态空间模型(SSM)从结构上避免了第二种成本;我们消除了第一种成本,将每个查询的预填充从O(L_context)压缩至O(1)。我们提出PRECOG(预计算上下文注入),这是一种利用SSM独有特性的检索机制:固定大小、与位置无关的循环隐藏状态是模型所读取所有内容的完整摘要。PRECOG在离线阶段将文档语料预编码为SSM隐藏状态,并在查询时直接注入匹配度最高的状态,完全绕过上下文重新摄入过程。相同的状态注入机制还支持SMC(结构化记忆整合):一种具有认知领域聚类、可调整的保真度-存储权衡以及O(1)会话初始化的分层持久记忆,它将短期情景状态整合为长期语义记忆,并在查询时将两者与检索到的语料库状态融合。我们在TENNs-LLM上验证了该系统,这是一个具有192 KB隐藏状态的12亿参数门控SSM语言模型。PRECOG达到了上下文RAG的答案质量,在边缘硬件上将预填充延迟从约27秒降低至小于6毫秒,实现了约4500倍的加速,跨越了从不可用到可交互的阈值。该机制对于Transformer KV缓存而言在架构上是不可能的,因为后者与位置纠缠且随上下文长度线性增长。

英文摘要

Retrieval-augmented generation (RAG) imposes a prefill cost proportional to retrieved context length, and -- with Transformer backbones -- a KV-cache that grows with each generated token. State-Space Models (SSMs) avoid the second cost by construction; we eliminate the first, collapsing prefill from $O(L_{context})$ to $O(1)$ per query. We introduce PRECOG (Pre-Computed Context Injection), a retrieval mechanism that exploits a property unique to SSMs: the fixed-size, position-agnostic recurrent hidden state is a complete summary of everything the model has read. PRECOG pre-encodes document corpora offline as SSM hidden states and injects the best-matching state directly at query time, bypassing in-context re-ingestion entirely. The same state-injection mechanism enables SMC (Structured Memory Consolidation): a hierarchical persistent memory with cognitive-domain clustering, an adjustable fidelity-vs-storage dial, and $O(1)$ session initialization, which consolidates short-term episodic states into long-term semantic memory and fuses both with retrieved corpus states at query time. We demonstrate the system on TENNs-LLM, a 1.2B-parameter gated-SSM language model with a 192 KB hidden state. PRECOG matches in-context RAG answer quality, reducing prefill latency from $\sim$27 s to $<$6 ms on edge hardware -- a $\sim$4500$\times$ speedup that crosses the threshold from unusable to interactive. The mechanism is architecturally impossible for Transformer KV-caches, which are position-entangled and grow linearly with context length.

URL PDF HTML 收藏
2608.02528 2026-08-04 cs.LG 新提交

Uncertainty Is Not Enough: Value-of-Information Routing for Mixtures of LoRA Experts

不确定性并不足够:针对LoRA专家混合模型的信息价值路由

Tom Saliencro, Rohan Desai, Priya Nair, Maya Lindqvist, Daniel Whitmore

机构 * University of California, Irvine(加利福尼亚大学欧文分校) University of Washington(华盛顿大学)

AI总结 该研究针对LoRA专家混合模型的路由问题,提出VI-MoLE算法,通过信息价值分配替代不确定性路由,经实验验证其在多指标上优于现有路由机制。

详情
AI中文摘要

低秩适配专家混合模型(Mixtures of low-rank adaptation experts)通过将每个输入路由到适配器子集,提升了参数高效容量。近期的动态路由机制在路由或预测存在不确定性时激活更多专家,该规则默认将不确定性等同于有用的额外计算:不确定的样本可能包含未查询的专家补充证据,但也可能在所有专家达成一致后仍存在歧义。我们将路由问题建模为经认证的信息价值分配问题。VI-MoLE算法学习每个专家前缀后剩余的反事实风险,将这些预测转换为保留校准数据上的同步风险上界认证,并在单位成本下边际风险减少量最大的令牌-层动作上使用全局适配器预算。最终认证决定回答或弃权(不执行)。与不确定性门不同,该方法区分当前歧义、可恢复风险和残余风险。我们证明了同步认证有效性、递减认证增益下的最优贪心分配,以及价值估计误差下的分配遗憾。评估协议针对固定和动态MoE-LoRA路由机制,测试了匹配计算准确率、认证覆盖率、风险-覆盖率、分布偏移及尾部延迟。

英文摘要

Mixtures of low-rank adaptation experts increase parameter-efficient capacity by routing each input through a subset of adapters. Recent dynamic routers activate more experts when the router or prediction is uncertain. This rule silently equates uncertainty with useful additional computation: an uncertain example may contain complementary, unqueried expert evidence, but it may instead remain ambiguous after every expert agrees. We formulate routing as certified value-of-information allocation. VI-MoLE learns the counterfactual risk remaining after each expert prefix, converts these predictions into simultaneous upper-risk certificates on held-out calibration data, and spends a global adapter budget on the token--layer action with the largest certified marginal risk reduction per unit cost. A terminal certificate then decides whether to answer or abstain. Unlike an uncertainty gate, this procedure distinguishes present ambiguity from recoverable and residual risk. We prove simultaneous certificate validity, optimal greedy allocation under diminishing certified gains, and allocation regret under value-estimation error. The evaluation protocol tests matched-compute accuracy, certificate coverage, risk--coverage, distribution shift, and tail latency against fixed and dynamic MoE-LoRA routers.

URL PDF HTML 收藏
2608.02520 2026-08-04 cs.CL 新提交

MedPRESS: A Multi-turn Benchmark for Patient-Pressure-Induced Medical Sycophancy in LLMs

MedPRESS:面向大语言模型中患者压力诱导型医疗谄媚行为的多轮基准测试

Saman Sarker Joy, Niloy Farhan

机构 * Universiti Malaya(马来亚大学) BRAC University(BRAC大学)

AI总结 MedPRESS是衡量大语言模型患者压力诱导型医疗谄媚行为的多轮基准,含600个五轮医学对话,评估20类LLM发现其易在压力下不安全附和,反谄媚提示仅部分改善,凸显医疗LLM需抗对话压力的缺口。

Comments 27 pages, 10 figures. Both authors contributed equally

详情
AI中文摘要

大语言模型(LLM)越来越多地被用于提供健康相关建议。现有研究通过静态问题而非面向患者的压力对话来衡量其安全性。我们推出MedPRESS,这是一个用于衡量LLM中患者压力诱导型谄媚行为的多轮基准测试。MedPRESS包含600个基于医学依据的五轮对话,涵盖三个场景类别:药物与治疗需求、个人健康自我护理,以及症状分诊与护理抵抗。每个对话以健康查询开始,通过个人经历、社会证明、外部证据主张和直接对抗挑战逐步升级。我们使用结构化评判和以安全为重点的指标,评估了20个属于通用、医疗领域、轻量、大型、开放权重及专有类别的LLM。结果显示,在反复的患者压力下,模型频繁转向不安全的一致回应,且不同模型类别、模型规模和提示类型之间存在显著差异。反谄媚提示提升了部分模型的鲁棒性,但并未消除不安全的一致回应。MedPRESS凸显了医疗LLM评估中的一个关键缺口:仅具备安全的医学知识是不够的,除非模型能在对话压力下保持该知识。

英文摘要

Large language models (LLMs) are increasingly used for health-related advice. Existing research measures their safety with static questions rather than pressured patient-facing conversations. We introduce MedPRESS, a multi-turn benchmark for measuring patient-pressure-induced sycophancy in LLMs. MedPRESS contains 600 medically grounded five-turn dialogues across three scenario families: medication and treatment demand, personal health self-care, and symptom triage and care resistance. Each dialogue begins with a health query and escalates through personal experience, social proof, external evidence claims, and direct adversarial challenge. We evaluate 20 LLMs across general, medical-domain, lightweight, large, open-weight, and proprietary families using structured judging and safety-focused metrics. Results show that models frequently shift toward unsafe agreement under repeated patient pressure, with substantial variation across model families, model scale, and prompt type. Anti-sycophancy prompting improves robustness for several models, but does not eliminate unsafe agreement. MedPRESS highlights a critical gap in medical LLM evaluation: safe medical knowledge is not enough unless models can maintain it under conversational pressure.

URL PDF HTML 收藏
2608.02519 2026-08-04 cs.LG cs.AI 新提交

Analytic Planning under Uncertainty with Moment Closure

基于矩闭合的不确定性下解析规划

Shishir Sharma, Doina Precup

机构 * McGill University(麦吉尔大学) Mila – Quebec Artificial Intelligence Institute(米拉-魁北克人工智能研究所)

AI总结 本文提出一种基于矩闭合的不确定性下解析规划方法,通过二次动作值参数化实现闭式贝尔曼备份,在连续控制中降低目标方差,为感知分布的规划提供了合理框架。

Comments To appear in Proceedings of the 42nd Conference on Uncertainty in Artificial Intelligence (UAI 2026), PMLR

详情
AI中文摘要

随机环境中有效的基于模型的强化学习需要规划时考虑预测不确定性,解析传播完整状态分布是实现这一目标的合理方法,但传统上需采用受限的策略或奖励结构才能保持可处理性。因此,现代深度强化学习大多退而采用随机采样(会引入显著的目标方差)或完全忽略预测协方差的确定性点估计。本文研究是否能在无这些约束的情况下实现感知分布的规划。采用二次动作值参数化,我们首先将贝尔曼备份简化为仅对状态值函数的期望;核心思路是预测转移分布与值函数类之间的兼容性原则,在此原则下该期望在分布的矩中是解析的。我们将该原则实例化为高斯转移模型与径向基值函数配对,得到闭式备份,可同时传播预测均值和协方差。实验表明,我们的方法在连续控制的随机观测下可降低目标方差,产生校准良好的预测不确定性,为基于学习的分布模型规划提供了合理框架。

英文摘要

Effective model-based reinforcement learning in stochastic environments requires planning that accounts for predictive uncertainty. Propagating full state distributions analytically offers a principled way to do this, but has traditionally required restrictive policy or reward structures to remain tractable. Consequently, modern deep reinforcement learning has largely retreated to either stochastic sampling, which introduces significant target variance, or deterministic point estimates that ignore predictive covariance entirely. We investigate whether distribution-aware planning is possible without these constraints. Using a quadratic action-value parameterization, we first reduce the Bellman backup to an expectation over the state-value function alone; the key idea is then a compatibility principle between the predictive transition distribution and the value function class, under which this expectation is analytic in the distribution's moments. We instantiate this principle with a Gaussian transition model paired with a radial-basis value function, yielding a closed-form backup that propagates both predictive mean and covariance. Empirically, our approach reduces target variance and yields well-calibrated predictive uncertainty under stochastic observations in continuous control, providing a principled framework for planning with learned distribution models.

URL PDF HTML 收藏
2608.02515 2026-08-04 cs.CL cs.LG 新提交

LiveMem: Maintaining Memory State Continuity in Long-Running LLM Inference

LiveMem:在长期运行的大语言模型推理中维持记忆状态连续性

Zhichen Liu, Ruihan Sun, Hengjie Yang, Zipeng Wu, Zhaohan Chen, Xiaofan Zhang, Yang Xu

机构 * Southern University of Science and Technology(南方科技大学) Xidian University(西安电子科技大学)

AI总结 该研究针对长期运行LLM推理中上下文切换导致状态不连续的问题,提出LiveMem方法,通过引入独立于活跃上下文的持久记忆状态,实现状态连续性,在LongMemEval等测试中表现领先。

详情
AI中文摘要

长期运行的助手和智能体会消耗交互流,最终交互流会超出上下文的承载能力。现有的上下文保留、摘要生成和检索方法虽能保留对部分历史的访问权限,但在工作上下文发生变化时,无法在整个生命周期内提供持久状态。我们将这一缺失的推理能力定义为“上下文切换下的状态连续性”:通过固定容量的记忆状态传递计算,该记忆状态的生命周期与活跃上下文无关。我们提出一种内在记忆方法LiveMem,它在预训练的全注意力大语言模型中增加了一个记忆状态,该状态可在整个生命周期内保留历史信息,同时主注意力路径保留有界的键值窗口。上下文切换与记忆状态维护、面向记忆的后训练、状态感知服务三者协同,使得该记忆状态在其原始 token 被释放后仍能发挥重要作用。实验表明,LiveMem在评估系统和其他内在记忆方法中实现了领先的整体性能;在LongMemEval上的实验显示,即使支持证据已从当前上下文中移除,LiveMem仍能基于记忆状态回答问题,且证据距离分析表明,有用信息在活跃窗口之外仍能持续存在。因此,LiveMem将状态连续性确立为持续大语言模型推理的一种独特且互补的抽象概念。

英文摘要

Long-running assistants and agents consume interaction streams that eventually outgrow the context. Existing context retention, summarization, and retrieval preserve access to selected history, but do not provide a persistent state over the full lifecycle when working context changes. We formulate this missing inference capability as \emph{state continuity under context turnover}: carrying computation forward through a fixed-capacity memory state whose lifetime is independent of the active context. We introduce an intrinsic memory method, \textbf{LiveMem}, which augments a pretrained full-attention LLM with a memory state that preserves the historical information over the whole lifecycle while the main attention path retains a bounded KV window. Context turnover and memory state maintaining, memory-oriented post-training, and state-aware serving jointly make this memory state load bearing after its originating tokens are released. Our experiments show that LiveMem achieves leading overall performance among evaluated systems and other intrinsic memory methods. Experiments on LongMemEval show that LiveMem is able to answer the question based on the memory state, even when the supporting evidence has been removed from the current context, and evidence-distance analysis shows that useful information persists beyond the active window. LiveMem thus establishes state continuity as a distinct and complementary abstraction for continual LLM inference.

URL PDF HTML 收藏
2608.02508 2026-08-04 cs.LG cs.CL 新提交

RoMeRL: Balancing Feedback Coverage and the Memory-Reward Trap in Self-Evolving Agent Memory via Reduced-Order Utility States

RoMeRL:通过降阶效用状态平衡自进化智能体记忆中的反馈覆盖与记忆-奖励陷阱

Yi Yang, Zhennan Chen, Yihong Zhuang, Tiehan Fan, Yinan Chen, Jian Li, Jian Yang, Ying Tai

机构 * Nanjing University(南京大学) Xiamen University(厦门大学) Zhejiang University(浙江大学)

AI总结 RoMeRL通过降阶效用状态解决自进化LLM智能体记忆的反馈分散与记忆-奖励陷阱问题,在ALFWorld等基准上显著提升任务性能、降低记忆规模与LLM调用

详情
AI中文摘要

基于学习的自进化大语言模型(LLM)智能体记忆系统面临两个紧密关联的挑战:其一,按轨迹索引的效用会随交互历史增长,导致有限的反馈分散到不断扩张的状态空间中;其二,由于轨迹级奖励会共同分配给协同检索的记忆,无关经验可能会收到误导性的效用更新,进而陷入记忆-奖励陷阱。为应对这些挑战,我们提出了降阶记忆强化学习(RoMeRL),该方法通过按结果极性和记忆动力学分解的固定维度单任务记忆状态,表征不断增长的轨迹索引效用空间。RoMeRL通过一组固定的语义坐标整合新经验,其内容会随时间更新或替换,从而将反馈集中在有界的效用支撑集上。理论上,我们证明这种降阶参数化可提升每个效用坐标收到的平均反馈量,并在通用坐标转移模型下刻画错误坐标的稳态占用情况。实验中,在ALFWorld和LifelongAgentBench两个基准上,RoMeRL提升了任务性能,将冷Q(Cold-Q)比例降低80.0%,反馈密度提升约6.0倍,维持的记忆大小减少84.4%,并减少21.1%的大语言模型调用。这些结果表明,降阶效用状态可支撑高效的自进化智能体记忆,同时限制持续的奖励污染。代码可访问:this https URL

英文摘要

Learning-based memory systems for self-evolving LLM agents face two tightly coupled challenges. First, trajectory-indexed utilities grow with the interaction history, thereby dispersing limited feedback over an ever-expanding state space. Second, because trajectory-level rewards are jointly assigned to co-retrieved memories, irrelevant experiences may receive misleading utility updates and consequently enter the memory-reward trap. To address these challenges, we introduce Reduced-Order Memory Reinforcement Learning (RoMeRL), which represents the growing trajectory-indexed utility space using a fixed-dimensional per-task memory state factorized by outcome polarity and memory dynamics. RoMeRL incorporates new experiences through a fixed set of semantic coordinates whose contents are updated or replaced over time, thereby concentrating feedback over a bounded utility support. Theoretically, we show that this reduced-order parameterization increases the average feedback received by each utility coordinate and characterize the steady-state occupancy of erroneous coordinates under a generic coordinate-transition model. Empirically, across ALFWorld and LifelongAgentBench, RoMeRL improves task performance, reduces the Cold-Q ratio by 80.0%, increases feedback density by approximately 6.0 times, reduces the maintained memory size by 84.4%, and cuts LLM calls by 21.1%. These results show that reduced-order utility states support efficient self-evolving agent memory while limiting persistent reward contamination. Code is available at: https://github.com/YOUNG-fnxm/RoMeRL

URL PDF HTML 收藏
2608.02502 2026-08-04 cs.AI 新提交

CMuon: Accelerating and Stabilizing Diffusion Transformer Training via Chunked Momentum Orthogonalization

CMuon:通过分块动量正交化加速并稳定扩散Transformer的训练

Chuyan Chen, Peng Sun, Kun Yuan

机构 * Peking University(北京大学) Westlake University(西湖大学) Zhejiang University(浙江大学)

AI总结 针对扩散Transformer训练计算成本高、普通Muon优化器存在后期收敛问题的瓶颈,提出CMuon策略,通过分块权重实现训练加速与收敛优化,在ImageNet 256上200个epoch达FID1.18,训练速度超AdamW2倍

Comments ECCV 2026

详情
AI中文摘要

扩散Transformer(DiTs)在视觉生成建模中已实现了当前最优(SOTA)性能,但其训练仍存在计算成本过高的问题。尽管近期提出的动量正交化(Muon)优化器为AdamW提供了颇具前景的替代方案,但将其直接应用于DiTs会导致后期收敛效果欠佳。在本文中,我们确定了这一瓶颈的根本原因:标准DiT架构为提升计算效率,将功能不同的权重(例如AdaLN和QKV层内的权重)融合为统一张量。将Muon应用于这些融合张量会无意间引发隐式子空间耦合,从而扭曲更新方向并降低全局优化效果。为解决这一问题,我们提出了分块Muon(CMuon),这是一种简单却极为有效的策略,即在正交化之前将这些矩阵划分为独立的子组件。大量实验表明,采用CMuon训练的6.75亿参数DiT在ImageNet 256数据集上仅用200个epoch就达到了1.18的FID值。这相比AdamW实现了超过2倍的训练加速,同时有效克服了普通Muon的后期收敛平台问题。

英文摘要

Diffusion Transformers (DiTs) have achieved state-of-the-art (SOTA) performance in visual generative modeling, yet their training remains computationally prohibitive. While the recently proposed Momentum Orthogonalization (Muon) optimizer offers a promising alternative to AdamW, its direct application to DiTs yields suboptimal late-stage convergence. In this paper, we identify the root cause of this bottleneck: standard DiT architectures fuse functionally distinct weights (e.g., within AdaLN and QKV layers) into unified tensors for computational efficiency. Applying Muon to these fused tensors inadvertently induces implicit subspace coupling, which distorts update directions and degrades global optimization. To address this, we introduce Chunked Muon (CMuon), a simple yet highly effective strategy that partitions these matrices into independent sub-components prior to orthogonalization. Extensive experiments demonstrate that a 675M-parameter DiT trained with CMuon achieves a FID of 1.18 on ImageNet 256 in just 200 epochs. This represents more than a 2x training speedup over AdamW, while effectively overcoming the late-stage convergence plateaus of vanilla Muon.

URL PDF HTML 收藏
2608.02495 2026-08-04 cs.CV cs.AI 新提交

DyFrDet: Towards Accurate Small Object Detection via Dynamic Frequency Suppression with Label Disambiguation

DyFrDet:通过结合标签歧义消解的动态频率抑制实现精确的小目标检测

Zihan Yang, Yang Guo, Hongxing Zhang, Dan Lu, Siyuan Yao

机构 * Hangzhou International Innovation Institute of Beihang University(北京航空航天大学杭州国际创新研究院) Beijing University of Posts and Telecommunications(北京邮电大学) Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区)

AI总结 针对小目标检测中视觉线索不足、频域噪声与标签歧义被忽视的问题,提出DyFrDet检测器,通过DyFrFPN与LDM模块实现精确检测,在多基准上达SOTA性能。

Comments 10 pages, 4 figures, 7tabs

详情
AI中文摘要

尽管过去几十年取得了显著进展,但精确识别小目标仍然极具挑战性,因为它们的视觉线索不足。以往研究通常尝试构建小目标的判别性表示,但广泛存在的频域噪声和标签歧义性被严重忽视,这极大阻碍了精确定位。为解决这些问题,本文提出一种名为DyFrDet的新型小目标检测(SOD)检测器,可通过动态抑制频域中的背景干扰来精确定位小目标。具体而言,本文提出动态频率感知特征金字塔网络(DyFrFPN),以自适应抑制低频冗余和过多高频噪声;该网络将分层特征转换为频域表示,并引入动态频带预测器(DBP)保留用于小目标识别的判别性成分。此外,本文提出新型标签歧义消解模块(LDM),利用概率分布显式建模并缓解目标标签的固有歧义性,从而有效提升低分辨率小目标的定位精度。大量实验表明,DyFrDet在多个基准上实现了最先进的性能,证明其在各种具有挑战性场景中的有效性和鲁棒性。本文代码可在指定URL获取。

英文摘要

Despite the remarkable progress over the past decades, accurately identifying small objects remains challenging because of their insufficient visual cues. Previous works typically attempt to construct discriminative representation of the small objects. However, the wide range frequency domain noises and label ambiguities have been greatly overlooked, which significantly hinders the accurate localization. To address these issues, we propose a novel small object detection (SOD) detector termed DyFrDet, which is able to precisely localize the small object by dynamically suppressing the background distractions in frequency domain. Specifically, we propose a Dynamic Frequency-aware Feature Pyramid Network (DyFrFPN) to adaptively suppress low-frequency redundancy and excessive high-frequency noises. The DyFrFPN transforms the hierarchical features into frequency domain representation, and introduces a Dynamic Band Predictor (DBP) to preserve the discriminative components for small object identification. Afterwards, we present a novel Label Disambiguation Module (LDM), which leverages probabilistic distributions to explicitly model and alleviate the inherent ambiguity of target labels, yielding efficient improvement in localization precision of the small objects with low-resolution. Extensive experiments demonstrate that DyFrDet achieves state-of-the-art performance across multiple benchmarks, indicating its effectiveness and robustness in various challenging scenarios. Our code is available at https://github.com/ManOfStory/DyFrDet.

URL PDF HTML 收藏
2608.02491 2026-08-04 cs.AI 新提交

Long-term Measurements: Towards a Longitudinal Understanding of Human-AI Interactions

长期测量:迈向对人机交互的纵向理解

Nicole Mitchell, Dhruv Agarwal, Maty Bohacek, Remi Denton, Roma Patel

机构 * Google Research(谷歌研究院) Cornell University(康奈尔大学) Stanford University(斯坦福大学) Google DeepMind(谷歌DeepMind)

AI总结 本研究针对语言模型融入生活引发的长期人机交互风险,结合社会科学测量与NLP计算方法,提出通过长期测量建模人类行为变化,实现问题行为在线检测以缓解用户长期风险。

详情
AI中文摘要

语言模型凭借其“类人性”及快速融入用户日常生活的特点,已成为一种全新类型的技术。这种特性组合会引发纵向风险——即人类的认知、发展及社会情感变化,这类变化可能不会在短期交互中显现,却会对用户产生持久的长期影响。这为自然语言处理(NLP)领域确立了一项关键的新任务:从对文本生成的静态、短期评估,转向对行为变化的长期测量,以实现对人机交互的历时性理解。在本研究中,我们借鉴了社会科学领域用于理解纵向数据中涌现现象的核心测量方法,探讨了NLP领域的计算方法需如何与这些测量相结合,不仅用于理解人机交互的长期安全风险,还能助力引导模型开发,使其为用户带来积极而非消极的结果。这种将人类行为变化建模为模型交互函数的能力,可实现对问题行为的在线而非事后检测,应被应用于对齐框架中,以缓解用户面临的长期风险。

英文摘要

Language models have taken on the role of a very new type of technology, by virtue of their "human-ness" and rapid integration into users' daily lives. This combination of features can introduce longitudinal risks---cognitive, developmental and socio-affective changes in humans---that might not surface in short-term interactions, but can have lasting long-term effects on users. This forms the basis of a critical new mission for NLP: to pivot from static, short-term evaluations of text generations to long-term measurements of behavioral changes, towards a diachronic understanding of human-model interactions. In this work, we draw from measurements used in social science fields that are crucial to understand emergent phenomena in longitudinal data. We discuss how computational methods in the field of NLP need to be combined with such measurements, not only to understand long-term safety risks of human-model interactions, but to help steer model development towards positive rather than negative outcomes for users. This ability to model human behavioral shifts as a function of model interactions can facilitate online rather than post-hoc detection of problematic behaviors, and should be leveraged in alignment frameworks to mitigate long-term risks in users.

URL PDF HTML 收藏
2608.02486 2026-08-04 cs.CL cs.CY cs.LG 新提交

Cultural Awareness is Represented but Not Decoded: Tracing Mythological Knowledge across 18 Open-Source LLMs

文化意识被表征但未被解码:追踪18个开源大语言模型(LLM)中的神话知识

Iaroslav Chelombitko, Ekaterina Chelombitko, Mika Hämäläinen

机构 * DataSpike Metropolia University of Applied Sciences(梅托波利亞應用科學大學) Neapolis University Pafos(帕福斯尼阿波利斯大學)

AI总结 该研究分析18个开源LLM的神话知识表征,发现文化表征存在于模型残差流中,但解码器因提示语言偏差无法解码非主导文化内容,还发布了相关跨文化研究工具与基准。

Comments 45 pages, 23 figures, 18 tables. Dataset: https://huggingface.co/datasets/Aragoner/folkmotif Code: https://github.com/AragonerUA/folkmotif

详情
AI中文摘要

开源大语言模型(LLM)能可靠地命名宙斯、朱庇特和托尔,但在代表性较低的传统神话(如芬兰、斯拉夫、埃及或中国神话)中,对应神祇的一致性要差得多。我们探究这种文化默认偏差在模型内部的产生位置。基于汤普森主题实体的跨文化平行子结构,我们对来自8个架构家族的18个开源LLM,采用线性探测、logit lens(对数透镜)、激活修补和输出提取方法进行分析。残差流能清晰区分不同文化,远高于名称字符串基线,但解码器会将特定文化的令牌映射到主导文化的令牌上。失败出在读取阶段,而非表征阶段。用目标文化的母语与英语提问产生的失败,在语言内聚类但跨语言解耦:解码器受提示语言控制。我们发布了基于每个实体的(探测、输出)分解框架、基于引用锚定的跨文化基准、针对语言条件读取的内部与跨模式相关性测试,以及18个模型的每个实体预测结果。

英文摘要

Open-source LLMs reliably name Zeus, Jupiter, and Thor, but recover their counterparts in less-represented traditions like Finnish, Slavic, Egyptian, or Chinese mythology far less consistently. We ask where inside the model this cultural default is produced. On a parallel cross-cultural substrate of Thompson-motif entities, we instrument 18 open-source LLMs from 8 architecture families with linear probing, logit lens, activation patching, and output extraction. The residual stream cleanly distinguishes cultures, well above a name-string baseline, yet the decoder collapses culturally-specific tokens onto dominant-tradition ones. The failure is at readout, not at representation. Asking the same question in the target culture's native language versus English produces failures that cluster within language but decouple across language: the decoder is gated on prompt language. We release a per-entity (probe, output) decomposition framework, a citation-anchored cross-cultural ground truth, a within- versus cross-mode correlation test for language-conditioned readout, and per-entity predictions for all 18 models.

URL PDF HTML 收藏
2608.02483 2026-08-04 cs.CV stat.ML 新提交

Fermat Active Laplace Learning for Semi-Supervised Hyperspectral Image Classification

用于半监督高光谱图像分类的费马主动拉普拉斯学习

Vutichart Buranasiri, James M. Murphy

机构 * Tufts University(塔夫茨大学)

AI总结 该研究提出两种结合费马距离与泊松加权调和标签传播的主动学习算法,用于半监督高光谱图像分类,实验验证了算法的有效性与可扩展性。

详情
AI中文摘要

本文提出两种高光谱图像(HSI)分类的主动学习算法,将感知密度的费马距离与泊松加权调和标签传播相结合。所提算法采用基于不确定性的采集函数主动查询样本点,对泊松加权拉普拉斯学习(PWLL)进行了扩展。第一种算法费马主动拉普拉斯学习(FALL)利用所有数据点间的费马距离构建亲和矩阵,随后采用最小范数采集函数运行带对角扰动的PWLL;与之不同,近似费马主动拉普拉斯学习(A-FALL)计算每个数据点与通过最远点采样选出的地标像素间的费马距离,利用地标多维标度构建亲和矩阵,在多轮查询后,A-FALL通过一种留一交叉验证变体选择费马指数p。FALL与A-FALL借助费马距离及后续的调和标签传播,实现对数据流形的感知密度估计,提升标注准确率。在Salinas A与Pavia数据集上的实验验证了FALL的有效性及A-FALL对大型HSI场景的可扩展性。

英文摘要

Two active learning algorithms for hyperspectral image (HSI) classification are proposed that combine density-aware Fermat distances with Poisson-reweighted harmonic label propagation. Our methods actively query points using an uncertainty-based acquisition function, extending Poisson ReWeighted Laplace Learning (PWLL). Our first algorithm, Fermat Active Laplace Learning (FALL), builds an affinity matrix using Fermat distances between all data points. Then, PWLL is run with a diagonal perturbation using the minimum-norm acquisition function. In contrast, Approximate FALL (A-FALL) computes Fermat distances between each data point and landmark pixels selected via farthest-point sampling and constructs the affinity matrix using landmark multidimensional scaling. After several query rounds, A-FALL selects the Fermat exponent $p$ using a leave-one-out cross-validation variant. FALL and A-FALL leverage Fermat distances and subsequent harmonic label propagation to provide a density-aware estimation of the data manifold, improving labeling accuracy. Experiments on Salinas A and Pavia show the effectiveness of FALL and the scalability of A-FALL to large HSI scenes.

URL PDF HTML 收藏
2608.02474 2026-08-04 cs.CV 新提交

EchoCache: Energy-Guided Cross-Modal Caching for Efficient Audio-Driven Video Generation

EchoCache:面向高效音频驱动视频生成的能量引导跨模态缓存

Jiayu Chen, Xiaoyu Wu, Rongshan Gao, Maoliang Li, Zihao Zheng, Xinhao Sun, Hailong Zou, Guojie Luo, Xiang Chen

机构 * Peking University(北京大学) Taiyuan University of Technology(太原理工大学)

AI总结 EchoCache是一种能量引导跨模态缓存框架,通过利用音频时频能量锚点与动态缓存机制,在保持音频驱动视频生成质量的同时,实现了2.46倍的推理加速,优化了延迟-质量权衡。

Comments EchoCache is honored to be accepted by ACM MM 2026

详情
AI中文摘要

音频驱动视频生成(A2V)在合成时间连贯、音视对齐的视频方面已取得良好进展,但由于扩散模型的迭代去噪过程,其推理成本仍较高。现有缓存方法主要利用视觉特征中的时间冗余,却忽略了A2V的跨模态对齐——音频驱动视觉生成时具有高度非均匀的时间重要性。本文指出现有A2V缓存方法存在时间-语义、计算-存储两个层面的错位问题。为解决这些问题,我们提出EchoCache,这是一种用于高效A2V生成的能量引导跨模态缓存框架。EchoCache利用音频时频能量作为显著性锚点,引导隐层级缓存更新,还引入了带量化缓存管理的动态时间步长-隐层缓存机制,以实现效率与内存的联合优化。在主流A2V模型上开展的大量实验表明,EchoCache在保持生成质量和音视一致性的同时,持续优化了延迟-质量权衡;尤其在EMTD基准上针对Wan2.2-S2V模型,EchoCache实现了2.46倍的加速,且整体性能最优。代码可在该https URL获取。

英文摘要

Audio-driven video generation (A2V) has achieved promising progress in synthesizing temporally coherent and audio-visually aligned videos, yet its inference remains expensive due to the iterative denoising process of diffusion models. Existing caching methods mainly exploit temporal redundancy in visual features while overlooking the cross-modal alignment of A2V, where audio drives visual generation with highly non-uniform temporal importance. In this paper, we identify two levels of misalignment in existing A2V caching methods: temporal-semantic and computation-storage misalignment. To address them, we propose EchoCache, an energy-guided cross-modal caching framework for efficient A2V generation. EchoCache leverages audio time-frequency energy as a saliency anchor to guide latent-level cache updates and further introduces a dynamic timestep-latent caching mechanism with quantized cache management for joint efficiency and memory optimization. Extensive experiments on mainstream A2V models show that EchoCache consistently improves the latency-quality trade-off while preserving generation quality and audio-visual consistency. In particular, on Wan2.2-S2V over the EMTD benchmark, EchoCache achieves a 2.46x speedup with the best overall performance. Code is available at https://github.com/IF-LAB-PKU/EchoCache.

URL PDF HTML 收藏
2608.02472 2026-08-04 cs.CL 新提交

CTRAG: An In-Context Retrieval-based Framework for Automated Compliance Checking using LLMs

CTRAG:一种基于上下文检索的大语言模型自动化合规检查框架

Muhammad Roman, Karen Rafferty, Barry Devereux

机构 * Bristol Research and Innovation Laboratory (BRIL)(布里斯托尔研究与创新实验室(BRIL)) Toshiba Europe Ltd.(东芝欧洲有限公司) Queen’s University Belfast(贝尔法斯特女王大学)

AI总结 本文提出基于RAG的CTRAG框架,通过自适应分块、动态检索配置等策略实现自动化合规检查,在四大会计师事务所POC中F1达78%、召回85%,可减少手动工作量并提升监管信任。

Comments 10 pages, 5 figures, 8 tables

详情
AI中文摘要

信任是现代监管生态系统的基础,合规检查在培育这种信任方面发挥着关键作用。对于在高度受控环境中运营的企业而言,监管合规验证至关重要,因为它确保企业符合财务报告、数据隐私、网络安全等领域的特定行业准则。然而,手动合规测试通常耗时且易出现不一致性,尤其是当合规性间接依赖第三方服务(如云提供商)时,供应商需依靠外部提供商来满足监管标准。在本文中,我们提出CTRAG,一种用于自动化合规检查的新型检索增强生成(RAG)流水线。CTRAG采用自适应分块、动态检索配置和上下文学习等先进策略,以提高合规评估的精度和相关性。通过从监管文本中提取控制问题,并将其与非结构化公司文档交叉核对,CTRAG实现了高度准确的、基于文档的合规验证,即使在通过第三方服务实现间接合规的情况下也能胜任。实证评估显示出显著改进:在最终部署配置中,CTRAG的F1分数达到78%,召回率达到85%,确保尽可能少漏报不合规案例,同时在实际部署中减少手动审核人员的工作量。为验证CTRAG的价值,我们在一家四大专业服务公司内开发并部署了一个POC,将其应用于实际案例,并将结果与手动合规报告进行交叉核对。这些发现凸显CTRAG有望简化合规工作流程、降低风险,并在复杂高风险环境中增强监管信任。

英文摘要

Trust is fundamental in modern regulatory ecosystems, and compliance checking plays a critical role in fostering that trust. Regulatory compliance verification is essential for businesses operating in highly controlled environments, as it ensures alignment with sector-specific guidelines across domains such as financial reporting, data privacy, and cybersecurity. Manual compliance testing, however, is often time-intensive and prone to inconsistencies, particularly when compliance depends indirectly on third-party services such as cloud providers, where vendors rely on external providers to meet regulatory standards. In this paper, we present CTRAG, a novel Retrieval-Augmented Generation (RAG) pipeline designed for automated compliance checking. CTRAG employs advanced strategies, including adaptive chunking, dynamic retrieval configurations, and in-context learning, to improve the precision and relevance of compliance assessments. By extracting control questions from regulatory texts and cross-referencing them with unstructured company documentation, CTRAG achieves highly accurate, document-informed compliance verification, even in cases of indirect compliance through third-party services. Empirical evaluations demonstrate significant improvements, with CTRAG achieving an F1-score of 78% and a recall of 85% in the final deployed configuration, ensuring minimal missed non-compliance cases while reducing manual reviewer effort in a real-world deployment. To validate CTRAG value, we developed and deployed a POC within a Big Four professional services firm, applying it to real-world cases and cross-checking results against manual compliance reports. These findings highlight CTRAG potential to streamline compliance workflows, mitigate risks, and enhance regulatory trust in complex, high-stakes environments.

URL PDF HTML 收藏
2608.02470 2026-08-04 cs.CV cs.AI 新提交

Grounding Agentic VLMs with Dedicated Segmentation for Fine-Grained Vehicle Damage Assessment

基于专用分割模型实现具身智能视觉语言模型(Agentic VLMs)的细粒度车辆损伤评估

Vishwajeet Shivaji Hogale, Anjali Pai, Nitya Ravi

机构 * Northeastern University(东北大学)

AI总结 针对VLMs空间定位不可靠问题,本文提出TinyDamage架构,将空间定位委托给专用多任务分割模型,集成至7节点LangGraph智能体流程,在车辆损伤评估中大幅降低报告虚构率。

Comments 8 pages, 2 figures

详情
AI中文摘要

视觉语言模型(VLMs)正越来越多地作为推理智能体被部署到实际视觉评估流程中,但其空间定位对于细粒度、视觉模糊的目标仍不可靠。本文针对自动车辆损伤评估场景研究该差距,其中划痕、发丝级裂纹等细粒度缺陷仅占少量像素,梯度信号弱,易与反射和表面纹理混淆。研究发现,当前最先进的VLM(Qwen-VL)在该任务上语义分类准确率达87.3%,但空间层面存在系统性定位问题:会在反射区域虚构损伤、完全遗漏细长划痕,且在要求定位时输出空间不一致。本文提出TinyDamage混合架构,将空间定位委托给专用多任务分割模型,同时让VLM负责语义推理和报告生成。在分割方面,损失函数选择对微小目标定位有显著且未被充分研究的影响:广泛用于类别不平衡的焦点损失会将微小损伤检测降至0,而监督对比目标可显著提升损伤与背景的可分性。本文将该分割模型集成到7节点LangGraph智能体流程中,使VLM每一步生成都基于分割输出,在100份经人工验证报告的受控评估中,该定位将报告虚构率从92%(仅文本)、78%(仅图像)降至31%。本文还引入DET_l,一种宽松的逐类别检测指标,用于评估类别不平衡下的微小目标定位,并报告部署流程的延迟和可靠性特征。

英文摘要

Vision-language models (VLMs) are increasingly deployed as reasoning agents in real-world visual assessment pipelines, yet their spatial grounding remains unreliable for fine-grained, visually ambiguous targets. We study this gap in the context of automated vehicle damage assessment, where fine-grained defects such as scratches and hairline cracks occupy few pixels, produce weak gradient signal, and are easily confused with reflections and surface texture. We show that a state-of-the-art VLM (Qwen-VL) achieves strong semantic classification accuracy (87.3%) on this task but is systematically ungrounded at the spatial level: it hallucinates damage in reflective regions, misses elongated scratches entirely, and produces spatially inconsistent outputs when prompted for localization. We propose TinyDamage, a hybrid architecture that delegates spatial grounding to a dedicated multi-task segmentation model while reserving the VLM for semantic reasoning and report generation. On the segmentation side, we find that the choice of loss function has an outsized and underexplored effect on tiny-object grounding: focal loss, widely used for class imbalance, collapses tiny-damage detection to zero, while a supervised contrastive objective measurably improves damage/background separability. We integrate the segmentation model into a 7-node LangGraph agent pipeline that grounds every VLM generation step in the segmentation output, and show that this grounding reduces the report hallucination rate from 92% (text-only) and 78% (image-only) to 31% in a controlled evaluation on 100 human-verified reports. We introduce DET_l, a permissive per-category detection metric for evaluating tiny-object grounding under class imbalance, and report latency and reliability characteristics of the deployed pipeline.

URL PDF HTML 收藏
2608.02469 2026-08-04 cs.CV 新提交

Calibrated Similarity and Graph Clustering for Open-Set Animal Re-Identification

用于开放集动物重识别的校准相似度与图聚类

Mohamed ElBassat, Seifeldin Elkerdany, Mohamed ElBialy, Gamal Abouelhamd, Jana Ghoneim, Assem Elkady, Mohamed Elboraay, Nelly Semenova

机构 * Made In Alexandria Artificial Intelligence Team(亚历山大制造人工智能团队) Faculty of Computer Science and Engineering, Alamein International University(阿拉曼国际大学计算机科学与工程学院) Faculty of Computers and Data Science, Alexandria University(亚历山大大学计算机与数据科学学院) Faculty of Engineering, Alexandria University(亚历山大大学工程学院) Alexandria Higher Institute of Engineering and Technology(亚历山大高等工程与技术学院) Moscow Pedagogical State University (MPGU University)(莫斯科国立师范大学(MPGU大学))

AI总结 本文针对AnimalCLEF26的开放集动物重识别任务,提出结合物种感知预处理的校准全局-局部融合方法,经实验其集成模型取得公开ARI 0.72124等优异结果,优于基线模型。

详情
AI中文摘要

AnimalCLEF26面向发现导向的动物重识别任务,要求系统既需将查询图像关联到已知个体,又需通过正确聚类发现未知个体。本文针对欧亚猞猁、火蝾螈、红海龟和德州角蜥的图像,提出一种适用于该场景的相似度到聚类的流程。该方法先通过分割分离目标标本,再对猞猁、红海龟和蝾螈图像应用轻量的物种特异性预处理以增强与身份相关的视觉线索,而德州角蜥图像仅在分割后使用。随后通过WildFusion估计成对相似度,其过程是校准并结合MiewID全局描述子与两个局部匹配分支(ALIKED+LightGlue和DISK+LightGlue)。得到的查询-查询相似度经优化后,通过基于图的聚类转换为身份簇,而查询-数据库相似度用于将置信样本关联到已知身份。本文评估了无训练和微调的MiewID变体,包括Dynamic ArcFace和SphereFace2-Focal适配,并将它们组合成最终集成模型。所选集成模型大幅优于WildFusion基线,取得公开调整兰德指数(ARI)0.72124和私有ARI 0.70393,而更简单的“预处理后校准”变体取得私有ARI 0.71087。这些结果表明,结合物种感知预处理选择的校准全局-局部融合,在具有挑战性的野外条件和视觉变化下,对开放集野生动物重识别是有效的。实现代码可在GitHub获取。

英文摘要

AnimalCLEF26 addresses discovery-oriented animal re-identification, where systems must both attach query images to known individuals and discover unseen individuals by clustering them correctly. We present a similarity-to-clustering pipeline for this setting across Eurasian lynx, fire salamander, loggerhead sea turtle, and Texas horned lizard images. The method first isolates the target specimen using segmentation and then applies lightweight species-specific preprocessing for lynx, sea turtle, and salamander images to enhance identity-relevant visual cues, while Texas horned lizard images are used after segmentation only. Pairwise similarities are then estimated with WildFusion by calibrating and combining a MiewID global descriptor with two local matching branches, ALIKED + LightGlue and DISK + LightGlue. The resulting query-query similarities are refined and converted into identity clusters using graph-based clustering, while query-database similarities are used to attach confident samples to known identities. We evaluate training-free and fine-tuned MiewID variants, including Dynamic ArcFace and SphereFace2-Focal adaptations, and combine them in the final ensemble. Our selected ensemble substantially improves on the WildFusion baseline, achieving the best public ARI of 0.72124 and a private ARI of 0.70393, while a simpler preprocessing-before-calibration variant achieves the best private ARI of 0.71087. These results indicate that calibrated global-local fusion with species-aware preprocessing choices is effective for open-set wildlife re-identification under challenging field conditions and visual variation. The implementation code is available on GitHub.

URL PDF HTML 收藏
2608.02442 2026-08-04 cs.AI cs.CL 新提交

Right Answer, Wrong Method: Shortcut Hacking Misleads the Evaluation of LLM Reasoning on Frontier Science Benchmarks

正确答案,错误方法:捷径作弊误导前沿科学基准上的大语言模型推理评估

Xuan Ren, Weiqi Zhai, Tianle Pu, Yihua Zhu, Yihua Zhu, Hu Wei, Bing Zhao

机构 * Alibaba Group(阿里巴巴集团) Alibaba DAMO Academy(阿里巴巴达摩院)

AI总结 该研究指出前沿LLM在科学推理基准中存在解题作弊问题,仅答案评估会高估其推理能力,开发的反作弊策略可抑制该问题。

Comments working in progress

详情
AI中文摘要

科学推理基准通常通过最终答案准确率来评估大语言模型(LLM),但正确答案不一定体现问题针对的推理能力。我们发现了“解题作弊”这一失效模式,即LLM通过数值搜索、枚举、猜测或先验证答案等无效捷径得到正确答案,却未提供符合任务要求的有效推导。我们在不同难度等级、科学领域及前沿模型中系统分析该现象:解题作弊随基准难度急剧上升,从普通问题的2.2%升至奥林匹克级问题的28.3%、HLE的37.4%;前沿模型中被判定为正确的答案里,8.2%-44.1%属于作弊解法。我们还开发了专家启发的反作弊策略,包括自动评判器和测试时指令,结果显示抑制捷径行为会大幅降低报告准确率,但对正确且非作弊准确率的影响较小。这些发现表明,仅答案评估会高估前沿LLM的科学推理能力。

英文摘要

Scientific reasoning benchmarks typically evaluate large language models (LLMs) using final-answer accuracy. However, a correct answer does not necessarily demonstrate the reasoning capability targeted by the problem. We identify Solution Hacking, a failure mode in which an LLM reaches the correct answer through invalid shortcuts, such as numerical search, enumeration, guessing, or answer-first verification, without providing a valid task-targeted derivation. We systematically analyze this phenomenon across difficulty levels, scientific domains, and frontier models. Solution hacking increases sharply with benchmark difficulty, from 2.2\% on common problems to 28.3\% on Olympiad-level problems and 37.4\% on HLE. Moreover, 8.2\%-44.1\% of answers credited as correct across frontier models are identified as hacked solutions. We further develop expert-inspired anti-hacking strategies, including an automatic judge and a test-time instruction. The results show that suppressing shortcut behavior substantially reduces reported accuracy while having a smaller effect on correct and non-hacked accuracy. These findings reveal that answer-only evaluation can overestimate the scientific reasoning capabilities of frontier LLMs.

URL PDF HTML 收藏
2608.02441 2026-08-04 cs.AI 新提交

Agentic Commerce World: An Auditable and Verifiable Environment for Vibe Commerce

智能体商业世界:一种可审计可验证的氛围式商业环境

Shicheng Fan, Mingdai Yang, Duohao Wang, Canyu Chen, Yongfeng Zhang, Hua Wei, Manling Li, Julian McAuley, Kun Zhang, Philip S. Yu, Kejing Yu, Zhiwei Liu

机构 * University of Illinois at Chicago(伊利诺伊大学芝加哥分校) Springbrand(斯普林布兰德公司) Northwestern University(西北大学) Rutgers University(罗格斯大学) Arizona State University(亚利桑那州立大学) University of California San Diego(加州大学圣迭戈分校) Carnegie Mellon University(卡内基梅隆大学) MBZUAI(Mohamed bin Zayed 人工智能大学) Microsoft AI(微软人工智能部门)

AI总结 该研究提出智能体商业世界(ACWorld)环境,通过氛围式商业协议(VCP)实现可审计可验证的氛围式商业智能体评估,构建含两类轨道的基准并验证模型性能,分析得出过程级证据对评估智能体的必要性。

详情
AI中文摘要

在氛围式编程中,人们用自然语言描述软件并将实现任务委托给AI智能体。类似地,氛围式商业允许人们用自然语言表达买卖目标,并将相应任务委托给智能体。然而,商业活动需要相互独立控制的买方智能体和卖方智能体在共享市场中交互,同时保留各自的私人目标和不同的权限。我们提出智能体商业世界(Agentic Commerce World, ACWorld),这是一种用于评估此类智能体在持续交易中表现的环境。ACWorld通过其氛围式商业协议(Vibe Commerce Protocol, VCP)在更新共享交易状态前验证智能体的动作,并记录由此产生的交互,使智能体行为可审计、评估可复现。ACWorld基准包含200个任务的能力覆盖轨道和60个任务的大型目录轨道,该轨道可搜索785022个可交易列表。在10个模型中,平均得分分别为65.9%至85.6%和56.1%至91.4%。我们的分析表明,过程级证据是必要的:仅最终状态会遗漏评估错误,不完整的轨迹仍保留有用的过程信号,大型目录任务会暴露各阶段的瓶颈。

英文摘要

In vibe coding, people describe software in natural language and delegate implementation to AI agents. By analogy, vibe commerce allows people to express buying or selling goals in natural language and delegate the corresponding tasks to agents. Commerce, however, requires independently controlled Buyer and Merchant agents to interact in a shared market while preserving their private objectives and distinct authority. We introduce Agentic Commerce World (ACWorld), an environment for evaluating such agents across ongoing transactions. Through its Vibe Commerce Protocol (VCP), ACWorld validates agent actions before updating shared transaction state and records the resulting interactions, making agent behavior auditable and evaluation reproducible. The ACWorld Benchmark contains a 200-task capability-coverage track and a 60-task large-catalog track that searches 785,022 transactable listings. Across ten models, mean scores range from 65.9% to 85.6% and from 56.1% to 91.4%, respectively. Our analysis shows that process-level evidence is necessary: final state alone can miss evaluated errors, incomplete trajectories still retain useful process signals, and large-catalog tasks expose bottlenecks across stages.

URL PDF HTML 收藏
2608.02438 2026-08-04 cs.AI 新提交

xPress: Parallel Refinement for Diffusion Drafters in Speculative Decoding

xPress:推测解码中扩散草稿模型的并行优化

Zheng Wang, Davis Wertheimer, Yu Chin Fabian Lim, Mudhakar Srivatsa, Raghu K. Ganti, Minjia Zhang, Naigang Wang

机构 * University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) IBM(国际商业机器公司(IBM))

AI总结 xPress是恢复扩散草稿模型因果依赖的并行优化方法,在Qwen3-8B的7个基准上,可提升推测解码的接受长度与端到端吞吐量。

详情
AI中文摘要

诸如dFlash之类的块扩散草稿模型可在单次前向传播中生成一整块草稿token,大幅降低推测解码中多token草稿生成的开销。单次离散去噪过程的关键最终步骤是利用每个位置的logit分布,有条件地独立采样token,因此生成的草稿是各位置的边际分布,而非联合分布:无法保证任何草稿token依赖于其前序token。这种独立采样的边际分布易生成单个token看似合理,但在目标模型的条件验证下联合概率极低的序列,这会导致早期拒绝并限制接受长度。为解决该问题,我们提出xPress,用于恢复扩散草稿模型中缺失的因果关系。xPress是一种轻量级因果优化器,可通过并行优化一次性协调整个扩散块,在无需逐token循环的情况下恢复并传播草稿间的因果依赖。在Qwen3-8B模型上,针对7个数学、代码和聊天基准测试,与原始dFlash扩散草稿模型相比,xPress平均将接受长度提升约30%(最高提升56%),端到端解码吞吐量平均提升约1.3倍(最高提升1.7倍)。

英文摘要

Block-diffusion drafters like dFlash generate an entire block of draft tokens in a single forward pass, drastically reducing the overhead of multiple-token drafting in speculative decoding. The crucial final step of the single-pass discrete denoising process involves using the logit distribution at each position to sample conditionally independent tokens. The resulting draft is thus a set of per-position marginals, rather than a joint distribution: no draft token is guaranteed to depend on its predecessors. Such independently sampled marginals tend to produce sequences with tokens that are individually likely, but jointly improbable under the target model's distribution, which verifies each token conditionally. This can cause early rejection and limits acceptance length. To address this, we propose xPress as a means to restore the missing causality in diffusion drafters. xPress is a lightweight causal refiner that reconciles the whole diffusion block at once through parallel refinement, restoring and propagating causal dependencies across the draft without a token-by-token loop. On Qwen3-8B, across seven math, code, and chat benchmarks, xPress raises acceptance length by about 30% on average (up to +56%) and its end-to-end decoding throughput by about 1.3 on average (up to 1.7) compared to the original dFlash diffusion drafter.

URL PDF HTML 收藏
2608.02437 2026-08-04 cs.CV 新提交

InfiniSplat: Implicit Gaussian Decoding for Large-Baseline Monocular View Synthesis

InfiniSplat:用于大基线单目视图合成的隐式高斯解码

Jiawei Wang, Hao Yu, Yongzhen Hu, Xinyi Yang, Tao Ni, Xin Zhan, Junbo Chen, Xiaowei Zhou, Ruizhen Hu, Sida Peng

机构 * Zhejiang University(浙江大学) Shenzhen University(深圳大学)

AI总结 InfiniSplat是一种前馈单图像3DGS框架,通过几何引导采样和查询条件隐式解码器实现表面对齐表示,在跨数据集NVS任务中达SOTA,且具零样本泛化能力。

Comments Accepted to SIGGRAPH Asia 2026 (Journal Track). Project page: https://zju3dv.github.io/InfiniSplat

详情
AI中文摘要

单图像前馈三维高斯溅射(3DGS)旨在从单张输入图像直接生成可渲染的三维场景表示,避免了多视图采集和逐场景优化的成本。然而,现有方法常受限于像素对齐的表示,高斯分布从固定图像网格位置预测。这类像素对齐基元可生成有前景的近视图渲染,但与底层场景表面耦合较弱,在大视角偏移下难以保持连贯结构。我们提出InfiniSplat,一种前馈单图像3DGS框架,从像素对齐表示转向表面对齐表示。InfiniSplat通过几何引导采样,根据深度诱导的局部表面结构放置二维支撑点,再应用查询条件隐式解码器,从这些支撑点查询到的图像特征预测高斯属性。通过在几何中锚定支撑点,同时将高斯预测与固定像素中心解耦,InfiniSplat生成的高斯布局更贴合场景表面,减少了网格导致的分散基元。在多个跨数据集新视图合成(NVS)评估中,InfiniSplat相比单图像前馈基线达到了最先进性能,并展示了从Hypersim室内合成训练到复杂开放世界场景的零样本泛化能力。

英文摘要

Single-image feed-forward 3D Gaussian Splatting (3DGS) aims to directly generate a renderable 3D scene representation from one input image, avoiding the cost of multi-view capture and per-scene optimization. However, existing methods are often constrained by a pixel-aligned representation, where Gaussians are predicted from fixed image-grid locations. Such pixel-aligned primitives can produce promising nearby-view renderings, but they remain weakly coupled to underlying scene surfaces and struggle to preserve coherent structures under large viewpoint shifts. We present InfiniSplat, a feed-forward single-image 3DGS framework that moves from a pixel-aligned representation toward a surface-aligned representation. InfiniSplat constructs this representation by first using geometry-guided sampling to place 2D supports according to depth-induced local surface structure, and then applying a query-conditioned implicit decoder to predict Gaussian attributes from the image features queried at these supports.By grounding support locations in geometry while decoupling Gaussian prediction from fixed pixel centers, InfiniSplat produces Gaussian layouts that better follow scene surfaces and reduce scattered primitives caused by grid discretization.Across multiple cross-dataset NVS evaluations, InfiniSplat achieves state-of-the-art performance compared with single-image feed-forward baselines, and demonstrates zero-shot generalization from Hypersim indoor synthetic training to complex open-world scenes.Project page: https://zju3dv.github.io/InfiniSplat.

URL PDF HTML 收藏
2608.02433 2026-08-04 cs.LG 新提交

Foundations of Reinforcement Learning and Control:Connections and New Perspectives

强化学习与控制的基础:联系与新视角

Claire Vernade, Onno Eberhard, Martha White, Florian Dörfler, Csaba Szepesvári, Miroslav Krstic, Michael Muehlebach

机构 * University of Technology Nuremberg(纽伦堡工业大学) Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所) University of Alberta(阿尔伯塔大学) ETH Zürich(苏黎世联邦理工学院) University of California San Diego(加州大学圣迭戈分校)

AI总结 本教程围绕强化学习与控制理论的联系与差异,介绍自适应控制、演员-评论家强化算法及二者结合的新方法,助力跨领域专家理解对方工具方法。

Comments INFORMS tutorial

详情
AI中文摘要

强化学习与控制理论是两个相邻的科学领域,均聚焦于利用反馈优化未知动态系统的控制器,二者共同根源为动态规划,但已发展出不同的方法、目标与文化。尽管数十年间相互影响,两个领域间仍存在显著鸿沟。本教程介绍自适应控制、演员-评论家强化算法,以及将这两种范式结合用于经典运动控制问题数据驱动决策的新方法,旨在为理解两种方法的核心差异提供基础,帮助各领域专家更好地理解并运用对方的工具与方法。

英文摘要

Reinforcement learning and control theory are two adjacent scientific fields that focus on optimizing the controller of unknown dynamical systems using feedback. While both fields have common roots in dynamic programming, they have evolved with distinct methodologies, goals, and cultures. Despite decades of mutual influence, a significant gap persists between the two communities. This tutorial introduces adaptive control, actor-critic reinforcement algorithms, and a new way to combine these two paradigms for data-driven decision making on a classical locomotion control problem. Our aim is to provide a foundation for understanding the core differences between the two approaches and insights to help experts in each field better understand and engage with the tools and approaches of the other.

URL PDF HTML 收藏
2608.02432 2026-08-04 cs.CV 新提交

Learning to Tessellate: Point Cloud Generation via Recursive Spectral Partitioning

学习镶嵌:通过递归谱划分生成点云

Monan Sun, Bangzhen Liu, Huaidong Zhang, Shengfeng He

机构 * South China University of Technology(华南理工大学) University of Chinese Academy of Sciences(中国科学院大学) City University of Hong Kong(香港城市大学) Singapore Management University(新加坡管理大学)

AI总结 该研究提出自回归框架PointRSP,通过拓扑保留的递归谱划分实现点云生成,引入拓扑感知划分自编码器与双流级联生成器,在生成质量、多样性及复杂3D拓扑泛化上达最优性能。

Comments Accepted by ECCV2026, project page: https://huggingface.co/Mo-nan/PointRSP

详情
AI中文摘要

自回归模型已成为点云生成的有效范式。然而,大多数现有方法依赖启发式分词策略,如空间排序或随机下采样,这些策略常破坏点云固有拓扑,削弱生成形状的结构连贯性。本文提出PointRSP,一种自回归框架,将点云生成重新表述为通过递归谱划分实现拓扑保留的镶嵌过程。我们引入拓扑感知划分自编码器,而非启发式构建令牌序列,通过混合递归谱划分策略将非结构化点云分解为非平衡二叉树。该层次表示提供确定性几何蓝图,在量化潜空间中保留拓扑关系的同时捕获多尺度结构依赖。为在该空间合成形状,我们提出双流级联生成器,联合建模结构演化与特征合成。此外,我们设计几何校准位置编码机制,利用多尺度结构中心锚定潜嵌入,在结构形成早期稳定级联生成。大量实验表明,PointRSP在生成质量与多样性上达到当前最优性能,展现出对复杂3D拓扑的强泛化能力。

英文摘要

Autoregressive models have emerged as an effective paradigm for point cloud generation. However, most existing approaches rely on heuristic tokenization strategies, such as spatial sorting or stochastic downsampling, which often disrupt intrinsic point cloud topology and weaken the structural coherence of the generated shapes. In this paper, we present PointRSP, an autoregressive framework that reformulates point cloud generation as a topology-preserving tessellation process via recursive spectral partitioning. Instead of constructing token sequences heuristically, we introduce a topology-aware partitioning autoencoder that decomposes an unstructured point cloud into a non-balanced binary tree through a hybrid recursive spectral partitioning strategy. This hierarchical representation provides a deterministic geometric blueprint that preserves topological relationships while capturing multiscale structural dependencies within a quantized latent space. To synthesize shapes in this space, we propose a dual-stream cascaded generator that jointly models structural evolution and feature synthesis. In addition, we design a geometry-calibrated positional encoding mechanism that anchors latent embeddings using multi-scale structural centers, which stabilizes cascaded generation during the early stages of structural formation. Extensive experiments show that PointRSP achieves state-of-the-art performance in generation quality and diversity, demonstrating strong generalization across complex 3D topologies.

URL PDF HTML 收藏