arXivDaily arXiv每日学术速递 周一至周五更新
全部学科分类 1713
2608.07468 2026-08-10 cs.CV 新提交

SimWAM: A Simple World Action Model for End-to-End Autonomous Driving

SimWAM:一种用于端到端自动驾驶的简单世界动作模型

Zongchuang Zhao, Xin Zhou, Tianyang Xu, Zhengyang Sun, Kaixuan Zhou, Honglin Li, Dingkang Liang, Xiang Bai

机构 * Huazhong University of Science & Technology(华中科技大学) Dongfeng Research & Development Institute(东风研发院)

AI总结 SimWAM是一种仅将视频生成用作训练信号的简单WAM,通过联合流匹配协同训练视频与动作专家,在NAVSIM上达91.5 PDMS且延迟更低,可零样本迁移至nuScenes,为高效自动驾驶提供可靠基线。

Comments The code and model weights are available at this https URL (https://github.com/H-EmbodVis/SimWAM/)

详情
AI中文摘要

世界动作模型(WAM)通过将视频动态先验迁移至动作预测来改进端到端自动驾驶,但现有方法在推理时需要代价高昂的未来帧生成。我们提出SimWAM,一种简单且有效的WAM,仅将视频生成用作训练信号。它通过联合流匹配协同训练预训练视频专家和轻量动作专家,采用独立注意力掩码使动作预测与未来帧无关,训练后可丢弃视频分支,仅保留能直接预测轨迹的独立规划器。由于两个专家无共享参数,仅通过统一注意力接口交互,视频骨干可替换,动作专家可独立扩展,无需修改学习目标或推理流程。我们进一步应用强化学习优化超越轨迹模仿的组合驾驶奖励。我们的SimWAM在NAVSIM上达到91.5 PDMS,以显著更低的延迟超越了基于WAM的最先进规划器,并零样本迁移至nuScenes。这些结果表明SimWAM是一个简单且可靠的基线,可轻易受益于视频生成的进展以实现高效自动驾驶。代码和模型权重可在此httpsURL获取。

英文摘要

World-Action Models (WAMs) improve end-to-end autonomous driving by transferring video dynamics priors to action prediction, but existing methods require costly future generation at inference. We present SimWAM, a simple yet effective WAM that uses video generation purely as a training signal. It co-trains a pretrained video expert and a lightweight action expert with joint flow matching. An isolated attention mask keeps action prediction independent of future frames, allowing the video branch to be discarded after training and leaving a self-contained planner that directly predicts trajectories. Since the two experts share no parameters and interact only through a unified attention interface, the video backbone could be replaced and the action expert scaled independently without modifying the learning objective or inference pipeline. We further apply reinforcement learning to optimize a compositional driving reward beyond trajectory imitation. Our SimWAM achieves $91.5$ PDMS on NAVSIM, surpasses state-of-the-art WAM-based planners with substantially lower latency, and transfers zero-shot to nuScenes. These results position SimWAM as a simple yet solid baseline that could readily benefit from advances in video generation for efficient autonomous driving. The code and model weights are available at this https URL

URL PDF HTML 收藏
2608.07460 2026-08-10 cs.CL cs.AI 新提交

CreativeInstruct: Scalably Teaching LLMs to Balance Quality, Creativity, and Diversity

CreativeInstruct:规模化教导大型语言模型(LLM)平衡质量、创造性与多样性

Ananya Sahu, Mohit Bansal, Elias Stengel-Eskin

机构 * Columbia(哥伦比亚大学) UNC Chapel Hill(北卡罗来纳大学教堂山分校) University of Texas at Austin(德克萨斯大学奥斯汀分校)

AI总结 该研究提出CreativeInstruct指令调优方法,通过注入[StartCreativity]跨度平衡LLM的质量、创造性与多样性,其在叙事生成中表现更优,还能提升强化学习任务性能。

Comments Code: this https URL (https://github.com/ananya-sahu/CreativeInstruct)

详情
AI中文摘要

尽管后训练可提升大型语言模型(LLM)的能力,但通常会降低其输出的多样性和创造性,对明确需要创造性的任务(如故事生成)以及隐含需要创造性的任务(如强化学习(RL))产生负面影响。我们提出CreativeInstruct,这是一种可规模化的指令调优方法,通过学习注入特殊的[StartCreativity]跨度来引导生成偏向创造性,从而教导LLM平衡类似基础模型的创造性生成与后训练模型的质量。此外,我们引入了一种基于图编辑距离的结构多样性度量,该度量可捕捉纯词汇和语义度量遗漏的叙事层面变化。在叙事生成任务中,CreativeInstruct的多样性与多模型基线及其输出的蒸馏变体相当或更优,且未牺牲质量,推理时也无需多个模型。我们的人工评估结果与此一致,标注者认为CreativeInstruct的生成内容比后训练LLM的生成内容更具创造性的比例达70.3%。我们还表明,创造性模型可作为强化学习的基础:将GRPO应用于CreativeInstruct检查点,与应用于后训练检查点的相同训练相比,在AMC上提升约4%,在MATH上提升约5个百分点。

英文摘要

While post-training improves the capabilities of large language models (LLMs), it generally lowers their output diversity and creativity, negatively impacting tasks that explicitly require creativity (e.g., story generation) as well as those that require it implicitly, e.g., reinforcement learning (RL). We instead propose CreativeInstruct, a scalable instruction-tuning method that teaches LLMs to balance creative, base-model-like generations with the quality of post-trained models, by learning to inject special [StartCreativity] spans that bias generation toward creativity. Furthermore, we introduce a structural diversity metric based on graph edit distance, which captures narrative level variation missed by purely lexical and semantic metrics. On narrative generation, CreativeInstruct matches or exceeds the diversity of both multi-model baselines and distilled variants of their outputs, without sacrificing quality or requiring multiple models at inference time. These results are mirrored in our human evaluation, where we find that annotators rate CreativeInstruct generations as more creative than the post-trained LLMs' generations in 70.3% of cases. We also show the benefits of creative models as a substrate for RL: GRPO applied to a CreativeInstruct checkpoint improves by ~4% on AMC and ~5% points on MATH over the same training applied to the post-trained checkpoint.

URL PDF HTML 收藏
2608.07458 2026-08-10 cs.CL cs.AI cs.IR cs.LG 新提交

CoinRAG: Contextualized Information Nugget KV Cache Reuse for Long-Context RAG

CoinRAG:面向长上下文RAG的上下文信息 nugget KV缓存复用

Gyuwan Kim, Cheoneum Park, Tao Yang

机构 * University of California, Santa Barbara(加州大学圣巴巴拉分校) Hanbat National University(韩bat国立大学)

AI总结 CoinRAG通过两阶段检索识别检索块内与查询相关的细粒度语义单元,复用其KV缓存优化长上下文RAG,在低延迟约束下降低运算成本并提升问答F1值。

详情
AI中文摘要

检索增强生成(RAG)领域近期的优化研究已利用块级KV缓存复用,避免处理长检索上下文以提升效率,但粗粒度块中仍存在大量信息冗余与噪声。本文在低预填充延迟约束下优化帕累托前沿,同时通过提出CoinRAG(面向长上下文RAG的上下文信息 nugget KV缓存复用)最大化准确率。该名称隐喻反映核心机制:如同组装小标记(或“硬币”)积累更大价值,CoinRAG以更具语义相关性且紧凑的方式,组合复用离线计算的细粒度 nugget 缓存,高效形成学习到的上下文表示。具体而言,CoinRAG不进行完整块编码,而是通过两阶段检索在检索块内识别与查询相关的语义单元,并将其切片后的KV表示与块级上下文无缝组装。在LongBench多跳问答任务上的广泛评估表明,CoinRAG显著降低了运算成本,在标准快速预填充延迟预算下,相较于其他基线实现了新的帕累托前沿,且答案质量(F1值)平均相对提升5.3%。

英文摘要

Recent optimization studies on Retrieval-Augmented Generation (RAG) have exploited chunk-level KV cache reuse to avoid processing long retrieved contexts for higher efficiency, while significant information redundancy and noise still remain in the coarse-grained chunks. This paper optimizes the Pareto frontier under low prefill latency constraints while maximizing accuracy by proposing CoinRAG (Contextualized Information Nugget KV Cache Reuse for Long-Context RAG). The name metaphorically reflects our core mechanism: much like assembling small tokens (or "coins") to accumulate a larger value, CoinRAG compositionally reuses offline-computed, fine-grained nugget caches to form a learned contextual representation efficiently in a more semantically relevant but compact manner. Specifically, instead of full-chunk encoding, CoinRAG identifies query-relevant semantic units within retrieved chunks through two-stage retrieval and seamlessly assembles their sliced KV representations with a chunk-level context. Extensive evaluations on LongBench multi-hop question answering tasks demonstrate that CoinRAG significantly reduces operational costs and outperforms the other baselines with a new Pareto frontier and an average 5.3% relative improvement in answer quality (F1) under a standard fast prefill latency budget.

URL PDF HTML 收藏
2608.07440 2026-08-10 cs.AI 新提交

Blast Radius

爆炸半径

MY Pitsane, Hope Mogale

机构 * Algorithm Reconnaissance Division(算法侦察部) Mankind Research Labs(人类研究实验室) North-West University(西北大学) University of Pretoria(比勒陀利亚大学)

AI总结 针对智能体编码的令牌浪费问题,提出Blast Radius内存管理层,结合NECROPHORESIS与RDM实现可逆上下文驱逐,在7个OpenAI模型上降低令牌消耗17%-26%,提升编码可持续性。

详情
AI中文摘要

智能体编码面临可负担性下降与令牌浪费日益严重的问题。我们提出Blast Radius,一种预测性内存管理层,用于估计输入提示通过耦合上下文与代码通道的覆盖范围。NECROPHORESIS通过逐字归档失效上下文实现可驱逐,而重复失效实体(Recurring Dead Matter,RDM)可识别并归档重复出现的文本。我们在Polish上下文空间上构建可逆转上下文驱逐机制,为保留、重复与驱逐提供可测量基础,同时将上下文熵与复活概率关联。在7个OpenAI模型上,Blast Radius将令牌消耗降低17%-26%,在所有测试策略中实现最低溢出率,且保持字节级可逆。在450个归档实体中,378个为重复失效实体,无被召回实体。Blast Radius在HCRC下方运行,确定需归档的记录及输入提示在代码库中的覆盖范围。本研究为Algosophy的更广泛目标作出贡献:使大语言模型与智能体编码更具可复用性与可持续性。

英文摘要

Agentic coding faces growing problems of affordability and wasted tokens. We introduce Blast Radius, a predictive memory management layer that estimates an incoming prompt's reach through coupled context and code channels. NECROPHORESIS enables reversible eviction by archiving dead context verbatim, while Recurring Dead Matter (RDM) identifies and buries repeatedly occurring transcripts. We formulate reversible context eviction over a Polish context space, providing a measurable foundation for retention, recurrence, and eviction while connecting context entropy to resurrection probability. Across seven OpenAI models, Blast Radius reduced token consumption by 17-26%, achieved the lowest overflow rate among tested policies, and remained byte exact reversible. Of 450 buried bodies, 378 were recurring dead matter and zero were recalled. Blast Radius operates beneath HCRC, determining which records to bury and how far an incoming prompt may reach into the codebase. This work contributes to the broader goal of Algosophy: making large language models and agentic coding more reusable and sustainable.

URL PDF HTML 收藏
2608.07438 2026-08-10 cs.AI cs.CL cs.HC 新提交

PsychoAgent: An Affect-Sensitive Cognitive Architecture for Conflict-Aware Memory in LLM Agents

PsychoAgent:面向大语言模型智能体的、具备冲突感知记忆的情感敏感认知架构

Mohammad Amanlou, Parham Abed Azad, Farbod Davoodi, Mostafa Masumi, Behnam Bahrak, Abdol-Hossein Vahabie

机构 * School of Electrical and Computer Engineering, College of Engineering, University of Tehran(德黑兰大学工程学院电气与计算机工程学院) Sharif University of Technology(谢里夫理工大学) Missouri University of Science and Technology(密苏里科技大学) Tehran Institute for Advanced Studies, Khatam University(哈塔姆大学德黑兰高等研究院)

AI总结 该研究提出PsychoAgent架构,分离事实与情感记忆并通过冲突感知控制器整合,在三类冲突场景中其冲突关键记忆检索率优于相关基线,为LLM智能体建模类人冲突效应提供了可检查机制。

Comments 12 pages main paper + 10 pages supplementary material; supplementary material included

详情
AI中文摘要

类人认知并非仅通过主题相似性选择过往经验:情感重要性与未解决的冲突同样会影响可提取的内容。我们提出PsychoAgent,一种面向大语言模型(LLM)智能体的认知架构,它将事实记忆与情感记忆分离,并通过冲突感知执行控制器整合两者。情感记忆首先通过语义相关性过滤,再通过显著性重新排序,在保持主题适配性的同时,允许情感重要的痕迹进入提示词。在三个受控冲突场景中,完整架构检索到的冲突关键记忆多于语义-情感RAG基线和单一记忆RAG基线(0.933对0.500和0.667),仅存在微小的语义相似性成本。五名盲评者评估了27个输出,经评者内标准化后,完整架构的总体均值最高(+0.22标准差),但校正后的成对差异不显著。一段为期三天的示例轨迹进一步显示了持续的情感、离线记忆重组和选择性记忆加权。这些发现支持情感敏感检索作为一种可检查的机制,用于在LLM智能体中建模类人冲突效应。

英文摘要

Human-like cognition does not select past experience by topical similarity alone: affective significance and unresolved conflict also shape what becomes accessible. We present PsychoAgent, a cognitive architecture for LLM agents that separates factual and affective memory and integrates both through a conflict-aware executive controller. Affective memories are first filtered by semantic relevance and then re-ranked by salience, preserving topical fit while allowing emotionally important traces to enter the prompt. Across three controlled conflict scenarios, the full architecture retrieved more conflict-critical memories than semantic-affective and single-memory RAG baselines (0.933 vs. 0.500 and 0.667), with a small semantic-similarity cost. Five blinded raters evaluated 27 outputs. After within-rater standardization, the full architecture had the highest overall mean (+0.22 SD), but corrected pairwise differences were not significant. A three-day illustrative trace further shows persistent affect, offline memory recombination, and selective memory reweighting. The findings support affect-sensitive retrieval as an inspectable mechanism for modeling human-like conflict effects in LLM agents.

URL PDF HTML 收藏
2608.07437 2026-08-10 cs.AI 新提交

Fisher-R1: Training LLM Agents for Reliable Hypothesis Testing

Fisher-R1:训练用于可靠假设检验的大语言模型智能体

Jiacheng Miao, Jin Mu, Guanhua Chen, James Zou

机构 * Stanford University(斯坦福大学) University of Wisconsin–Madison(威斯康星大学麦迪逊分校)

AI总结 该研究构建了含425项多领域假设检验任务的P-Bench基准,训练出Fisher-R1智能体,其在P-Bench上较DeepSeek-V4-Pro单试验成功率平均提升21%,证明强化学习可提升LLM的统计推理可靠性。

详情
AI中文摘要

可靠的假设检验是许多实证科学结论的基础。大语言模型(LLM)智能体越来越多地被用于自动化这一过程,因为它们可以检查数据集、生成代码并端到端地生成分析结果。然而,我们发现尽管这些智能体的分析执行正确,却经常出现细微的推理错误,导致结论错误。现有的基准测试未能捕捉到这种失败模式,因为它们很少评估报告的p值在给定数据潜在假设下是否具有统计有效性。我们通过构建P-Bench来解决这一缺口,该基准包含425个开放式、现实的假设检验任务,涵盖经济学、生物学和医学领域。每个任务要求智能体仅根据科学假设和数据集,选择统计方法、计算p值并得出结论。我们进一步引入Fisher-R1,这是一种使用合成任务和强化学习训练的、用于严格假设检验的开放权重LLM智能体。在P-Bench上,Fisher-R1-14B显著优于其骨干模型,也优于包括GPT-5.4和DeepSeekV4-Pro在内的强大专有和开源基准模型,与DeepSeek-V4-Pro相比,单试验成功率平均相对提升21%,在最具挑战性的任务上提升高达26%。我们的结果表明,当前LLM智能体缺乏用于假设检验的可靠统计推理能力,而在经过验证的统计奖励任务上进行强化学习可大幅提升其可靠性。

英文摘要

Reliable hypothesis testing is the foundation of many empirical scientific claims. Large language model (LLM) agents are increasingly used to automate this process, as they can inspect datasets, generate code, and produce analyses end-to-end. However, we show that they frequently make subtle inferential errors that lead to incorrect conclusions despite correctly executed analyses. Existing benchmarks fail to capture this failure mode, as they rarely assess whether a reported p-value is statistically valid given the assumptions underlying the data. We address this gap by building P-Bench, a benchmark comprising 425 open-ended, realistic hypothesis-testing tasks spanning economics, biology, and medicine. Each task requires an agent to select a statistical method, compute a p-value, and draw a conclusion given only a scientific hypothesis and a dataset. We further introduce Fisher-R1, an open-weight LLM agent trained for rigorous hypothesis testing using synthetic tasks and reinforcement learning. On P-Bench, Fisher-R1-14B substantially improves over its backbone and outperforms strong proprietary and open-source baselines, including GPT-5.4 and DeepSeekV4-Pro, achieving a 21% average relative improvement in single-trial success over DeepSeek-V4-Pro, with gains up to 26% on the most challenging tasks. Our results demonstrate that current LLM agents lack reliable statistical reasoning for hypothesis testing and that reinforcement learning on tasks with verified statistical reward substantially improves reliability.

URL PDF HTML 收藏
2608.07436 2026-08-10 cs.AI cs.LG 新提交

Post-Grokking Collapse at the Representation-Readout Interface in Muon-Trained Transformers

Muon训练的Transformer中表示-读出接口的后顿悟崩溃

Ali Janati, Kaoutar El Maghraoui, Andrei Kanavalau, Anass Belfatmi

机构 * Data Science Institute, Columbia University(哥伦比亚大学数据科学研究所) Columbia University(哥伦比亚大学) Stanford University(斯坦福大学) CentraleSupélec(中央高等电力学院)

AI总结 该研究发现Muon训练的Transformer在模块化加法等任务中,顿悟后会因表示-读出接口故障丧失泛化性,冻结嵌入/读出可避免,傅里叶滤波能分离故障与掩码,任务对齐族可恢复性能。

Comments 34 pages, 6 figures, 20 tables. Full technical version; a condensed 9-page version is currently under review. Code: this https URL (https://github.com/Na00s/muon-grokking)

详情
AI中文摘要

在标准划分下,Muon获取隐藏矩阵,AdamW获取嵌入/输出头。Muon对模113的模块化加法的顿悟速度更快,但其解决方案不具泛化性。在$(a+b) \bmod 113$的9种配置均发生顿悟后丧失泛化能力,5个随机种子中,选定的AdamW参考值有4个低于阈值,达27.59%。这种不稳定性在两种模数、两种宽度、两种训练比例、减法任务及不同深度下均存在。失败源于表示-读出接口,该接口仅能通过损失未选定的可逆映射联合识别。训练集解决后,梯度降至$10^{-6}$量级,优化器响应不同:Muon的步长弹性为-0.03,AdamW为+1.5,Muon组每个参数的移动速度快8倍。在比特相同状态下,冻结任意一组均可防止失败。冻结嵌入/读出可在5次运行(451400步后)及5个配对种子中消除失败:未冻结分支记录137-321次亚阈值评估,冻结分支无。移除Muon的归一化和正交化无法替代:其表示从326个有效共轭对崩溃至4个,无循环崩溃,最终完全失败。傅里叶滤波可分离电路故障与掩码。5个种子3种 regime 的43个检查点中,任务对齐族仅达到100%;电路故障时不再解决任务;掩码时保持完美,而完整模型达45.85%,每个样本(含错误)均有正边际,但被近乎相等的对抗性余数否决。重新缩放可恢复99.9%;顿悟是向上解决的相同条件。任务选择该族,减法下将$(k,k)$替换为$(k,-k)$。在突发崩溃中,标准傅里叶支持不变,功率分布余弦仍为0.9899。

英文摘要

Under the standard split, Muon gets hidden matrices and AdamW embeddings/output head. Muon groks modular addition faster, but its solutions do not hold. All nine configurations on $(a+b) \bmod 113$ grok and later lose generalization. Across five seeds the selected AdamW reference falls below threshold on four, reaching 27.59%. Instability persists across two moduli, two widths, two training fractions, subtraction, and depth. The failure arises at the representation-readout interface, identified only jointly up to an invertible map unselected by the loss. After solving the training set, the gradient falls to order $10^{-6}$ and the optimizers respond differently: step-size elasticity is -0.03 for Muon versus +1.5 for AdamW, and the Muon group moves 8.0 times faster per parameter. From bit-identical states, freezing either group prevents failure. Freezing embeddings/readout removes it in five runs over 451,400 post-grokking steps and five paired seeds: unfrozen arms record 137-321 sub-threshold evaluations, frozen arms none. Removing Muon's normalization and orthogonalization is no substitute: it collapses representation from 326 effective conjugate pairs to 4, shows no recurrent collapse, and fails terminally. Fourier filtering separates circuit failure from masking. Across 43 checkpoints over five seeds and three regimes, the task-aligned family reaches exactly 100% alone. In circuit failure it no longer solves the task; in masking it remains perfect while the full model reaches 45.85%, giving a positive margin on every example, including errors, but being outvoted by a near-equal adversarial remainder. Rescaling it restores 99.9%; grokking is the same condition resolving upward. The task selects the family, swapping $(k,k)$ for $(k,-k)$ under subtraction. Across an abrupt collapse, standard Fourier support is unchanged and the power-distribution cosine remains 0.9899.

URL PDF HTML 收藏
2608.07435 2026-08-10 cs.CV cs.AI cs.CL 新提交

SABRE: Scalable and Automated Benchmarking of VLMs under Stress

SABRE:压力场景下视觉语言模型(VLM)的可扩展自动化基准测试

Zixuan Lan, Luzhe Sun, Matthew R. Walter, Jiawei Zhou

机构 * University of Chicago(芝加哥大学) Toyota Technological Institute at Chicago(芝加哥丰田技术学院) Stony Brook University(石溪大学)

AI总结 SABRE是可扩展自动化VLM压力测试框架,可生成多维度测试样本,经实验验证其能有效评估VLMs对视觉证据与世界先验的依赖程度,支持多种压力测试场景。

Comments 22 pages, 10 figures. Code and resources will be available at this https URL (https://zesearch.github.io/vlm-SABRE/)

详情
AI中文摘要

视觉语言模型(VLMs)发展迅速,但基准测试开发滞后,导致其弱点难以识别。构建压力测试成本高昂:样本需满足可控条件、保持可解答性并挑战当前模型。我们提出SABRE,一种可扩展的自动化流水线,可将测试 Primer(带有数据模式的Markdown任务设计)转换为结构化规范、生成或编辑后的图像以及问答对。自动过滤会移除被过滤VLM解决的候选样本,人工审核则验证候选样本有效性,支持标注修正和局部图像修复。我们实例化SABRE-Prior以测试VLMs是否遵循视觉证据而非依赖世界先验(对熟悉物体和场景的习得预期)。其600张图像和1000个问题涵盖上下文(熟悉场景中的意外实体)、纹理(反事实材料)、属性(非规范组件数量)及语言诱导(语言暗示但图像不支持的答案)。在6个VLMs上,宏平均准确率为17.8%至31.3%(均值22.6%)。真实图像属性控制对过滤VLM难度相当。SABRE-Counting和SABRE-Spatial试点显示该工作流支持其他压力测试设置。这些结果确立SABRE为构建和更新VLM压力测试的可复用框架,而非单一固定基准。

英文摘要

Vision-language models (VLMs) are improving rapidly, but benchmark development lags behind, making weaknesses hard to identify. Building stress tests is costly: samples must satisfy controlled conditions, remain answerable, and challenge current models. We present SABRE, a scalable, automated pipeline that converts a Test Primer (a Markdown Task Design with Data Schema) into structured specifications, generated or edited images, and question-answer pairs. Automated filtering removes candidates solved by a Filtering VLM, while human review verifies candidate validity and supports annotation correction and localized image repair. We instantiate SABRE-Prior to test whether VLMs follow visual evidence instead of relying on world priors -- learned expectations about familiar objects and scenes. Its 600 images and 1,000 questions span Context (unexpected entities in familiar scenes), Texture (counterfactual materials), Attribute (noncanonical component counts), and Language Elicitation (answers suggested by language but unsupported by the image). Across six VLMs, macro-average accuracy ranges from 17.8% to 31.3% (22.6% mean). A real-image Attribute control is comparably difficult for the Filtering VLM. SABRE-Counting and SABRE-Spatial pilots show that the workflow supports other stress-test settings. These results establish SABRE as a reusable framework for constructing and refreshing VLM stress tests rather than a single fixed benchmark.

URL PDF HTML 收藏
2608.07423 2026-08-10 cs.SD cs.LG 新提交

Cloud-Boosted Low-Compute Multi-Channel Speech Enhancement

云端增强型低计算量多通道语音增强

Xulin Fan, Juan Azcarreta, Ashutosh Pandey, Jesus Alvarez, Ke Tan, Jacob Donley, Ritwik Giri, Buye Xu

机构 * University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) Meta Reality Labs Research(Meta现实实验室)

AI总结 针对可穿戴设备语音增强的计算约束瓶颈,提出融合延迟服务器输出、分层特征增强及协作多通道维纳滤波的云端协作框架,以低额外开销显著提升边缘模型性能。

Comments Accepted to Interspeech 2026

详情
AI中文摘要

低延迟、低计算量的语音增强对具备实时通信需求的可穿戴设备至关重要,但严格的计算约束极大限制了设备端性能。知识增强作为利用更强大的服务器端模型提升边缘模型性能的有效方法已被提出,但其在语音增强领域的性能提升有限。我们提出一种融合三项技术的协作框架:(1)将延迟的服务器输出作为额外输入;(2)分层特征增强,即传递服务器中间表示以指导边缘推理;(3)协作多通道维纳滤波,融合服务器与边缘模型估计的加权协方差矩阵以优化波束成形。实验结果表明,该协作框架在仅增加极少计算开销的情况下,显著优于仅使用边缘模型的基线系统。

英文摘要

Low-latency, low-compute speech enhancement is essential for wearable devices with real-time communication requirements, but strict computational constraints significantly limit on-device performance. Knowledge Boosting has been proposed as an effective approach to improve edge model performance by leveraging a more capable server-side model, but performance gains for speech enhancement have been limited. We propose a collaborative framework incorporating three techniques: (1) delayed server output as additional input, (2) layerwise feature boosting that transfers intermediate server representations to guide edge inference, and (3) collaborative multichannel Wiener filtering, which fuses weighted covariance matrices estimated from both server and edge models for improved beamforming. Experimental results demonstrate that the proposed collaborative framework significantly outperforms the edge-only baseline with minimal additional computational overhead.

URL PDF HTML 收藏
2608.07420 2026-08-10 cs.LG 新提交

Beyond Myopic World Models: Long-Horizon End-to-End Training for Direct Future Prediction

超越近视世界模型:面向直接未来预测的长视端到端训练

Xinyi Li, Zaishuo Xia, Chenjie Hao, Yubei Chen

机构 * University of California, Davis(加州大学戴维斯分校)

AI总结 该研究针对世界模型训练中局部与长视目标不匹配的问题,提出DPWM非递归架构,采用端到端长视终点目标训练,显著提升了连续控制等基准的长时预测性能。

详情
AI中文摘要

世界模型应支持在扩展时间范围内进行想象,但大多数世界模型仍通过局部少步预测目标进行训练,并通过递归展开自身预测来部署。这造成了根本性不匹配:少步损失优化局部转移保真度,而长时预测依赖于误差和梯度如何在整个轨迹中传播。结果,训练过程中对终点具有不同下游影响的转移被同等对待,且小的局部误差会通过递归推理被放大。我们认为,通过端到端终点预测目标直接优化能更好地实现长时精度。为实例化这一范式,我们引入直接预测世界模型(Direct Prediction World Model,DPWM),这是一种非递归架构,可将任意长度的动作序列压缩为单个嵌入,并在单次前向传播中预测终点观测。该设计在预测和梯度传播中均避免了递归展开,使得在递归自回归训练变得不稳定的视域下,长时端到端训练成为可能。实验表明,在连续控制和基于像素的基准测试中,DPWM较递归世界模型基线显著提升了长时终点预测性能,且随着预测视域增大,提升幅度更大。我们进一步表明,当用相同的长时终点目标重新训练时,递归基线也会获得类似收益,支持了我们的核心主张:训练目标而非特定骨干选择是长时预测精度的主要驱动因素。我们的结果表明,世界模型可受益于在其最终使用的时间尺度上进行训练和评估,将重点从局部转移建模转向长时预测精度。

英文摘要

World models are expected to support imagination over extended temporal horizons, yet most are still trained through local few-step prediction objectives and deployed by recursively rolling out their own predictions. This creates a fundamental mismatch: few-step losses optimize local transition fidelity, while long-horizon prediction depends on how errors and gradients propagate through the entire trajectory. As a result, transitions with different downstream influence on the endpoint are treated uniformly during training, and small local errors are amplified through recursive inference. We argue that long-horizon accuracy is better achieved by optimizing directly, through an end-to-end endpoint prediction objective. To instantiate this paradigm, we introduce the Direct Prediction World Model (DPWM), a non-recursive architecture that compresses an action sequence of arbitrary length into a single embedding and predicts the endpoint observation in a single forward pass. This design avoids recurrent rollout in both prediction and gradient propagation, making long-horizon end-to-end training practical at horizons where unrolled autoregressive training becomes unstable. Empirically, DPWM substantially improves long-horizon endpoint prediction over recursive world-model baselines on continuous-control and pixel-based benchmarks, with larger gains as the prediction horizon increases. We further show that recurrent baselines benefit similarly when retrained with the same long-horizon endpoint objective, supporting our central claim that the training objective, rather than the particular backbone choice, is the main driver of long-horizon prediction accuracy. Our results suggest that world models can benefit from being trained and evaluated at the temporal scales where they are ultimately used, shifting the focus from local transition modeling toward long-horizon predictive accuracy.

URL PDF HTML 收藏
2608.07419 2026-08-10 cs.LG 新提交

Beyond Post-Hoc Temperature Scaling: Bilevel Optimization for LLM Calibration

超越事后温度缩放:用于大语言模型校准的双层优化方法

Ruochen Jin, Zhanliang Wang, Zongyu Dai, Jiancong Xiao, Bojian Hou

机构 * Dartmouth College(达特茅斯学院) University of Pennsylvania(宾夕法尼亚大学) National University of Singapore(新加坡国立大学)

AI总结 针对LLM偏好对齐导致的过度自信与校准问题,提出基于双层优化的校准方法,通过最大化预测分布熵实现,在多项选择与开放式问答任务中提升了校准效果与域外泛化能力。

Comments Third Conference on Language Modeling (COLM 2026)

详情
AI中文摘要

偏好对齐常使大语言模型(LLM)产生过度自信且校准效果差的问题。传统的事后温度缩放具有固有领域依赖性:在某一领域拟合的温度无法跨领域泛化。为此,我们提出在训练期间修改模型参数以提升校准效果。我们将预测分布的熵最大化作为校准目标,通过抑制过于集中的预测直接针对过度自信问题。受温度缩放启发,我们通过双层优化公式实现该目标:下层在参数化损失下训练模型,上层选择损失超参数以最大化熵。为使该框架适用于LLM规模,我们采用高效的一阶近似,避免显式二阶计算。在多项选择及开放式生成问答任务中,实验表明我们的方法可生成校准良好的LLM,且在域外泛化方面具有显著优势。

英文摘要

Preference alignment often makes large language models (LLMs) overconfident and poorly calibrated. Traditional post-hoc temperature scaling is inherently domain-dependent: a temperature fitted on one domain does not generalize across domains. This motivates us to modify model parameters during training to improve calibration. We propose maximizing the entropy of predictive distributions as the calibration objective, which directly targets overconfidence by discouraging overly concentrated predictions. Inspired by temperature scaling, we realize this through a bilevel optimization formulation, where the lower level trains the model under a parametric loss and the upper level selects loss hyperparameters to maximize entropy. To make the framework practical at LLM scale, we adopt an efficient first-order approximation that avoids explicit second-order computation. Across both multiple-choice and open-ended generative question answering, experiments demonstrate that our method yields well-calibrated LLMs with particular advantages in out-of-domain generalization.

URL PDF HTML 收藏
2608.07418 2026-08-10 cs.AI cs.CL 新提交

ResidencyRL: Reinforcement Learning in Simulated Clinical Environments

ResidencyRL:在模拟临床环境中开展的强化学习

Valentin Liévin, Samuel Schmidgall, Tim Strother, Alex Bijamov, Akshay Goel, Anil Palepu, Chunjong Park, Vahid Balazadeh, Min Woo Sun, Marius Guerard, Justin Chen, Dave Steiner, Vikram Dhillon, Ibrahim Azar, Akhil Mehta, Nicholas Spetsieris, Shilpan Shah, Maen Abdelrahim, Amit Dahiya, Yun Liu, Katherine Chou, Yossi Matias, Avinatan Hassidim, Dale R. Webster, Quoc V. Le, Raia Hadsell, Joelle Barral, Carey Radebaugh, Aleksandra Faust, Shekoofeh Azizi, Mike Schaekermann, Po-Hsuan Cameron Chen, Tao Tu, David Racz, Lin Yang

机构 * Google DeepMind(谷歌DeepMind) Google Research(谷歌研究院) Houston Methodist Hospital(休斯顿卫理公会医院) Trinity Health Group(三一健康集团) Stanford Oncology Partners(斯坦福肿瘤学伙伴) St. Luke Hospital(圣卢克医院)

AI总结 本研究提出 ResidencyRL,通过多轮强化学习训练临床 AI 智能体,在模拟临床环境中提升诊断准确性、降低漏报率,且能力可迁移至多个医学基准测试,为临床 AI 发展提供了新路径。

详情
AI中文摘要

在医学教育中,医师通过住院医师培训将学术知识转化为临床专长,该过程包含数千次诊疗 encounter,涵盖各类反馈来源及逐步提升的自主性。临床推理很大程度依赖于医患对话 encounter,临床医师需从中采集病史、完善诊断假设,并在不确定性下制定诊疗方案。尽管大语言模型(LLM)在静态医学基准测试中表现出色,但优化完整临床决策序列的方法仍未充分发展。我们提出 ResidencyRL,这是一种强化学习(RL)方法,用于通过模拟多轮临床 encounter 训练临床人工智能(AI)智能体,每个轨迹最多包含 60 轮对话和 8 次工具调用。ResidencyRL 将策略智能体与能够产生复杂对抗性行为的 LLM 模拟器配对,依据与诊断准确性、诊疗质量、沟通、文档记录及安全性对齐的结构化奖励进行训练。在保留的评估中,ResidencyRL 智能体在对抗条件下将诊断准确性提高了 7.0%(88.0% 对比 81.0%),并将漏报危险信号的比率降低了 31%,证明其能严格缓解过早闭合问题。盲法专家临床医师验证了这些改进,在 87.6% 的并排比较中更倾向于该训练后的智能体。操作能力可迁移至未见的基准测试:该智能体在 AMIE 多访视基准测试的全部六个临床维度上均优于基础模型,并在 AgentClinic 和 CRAFT-MD 上表现出一致的方向性改进。我们的研究结果表明,通过模拟中的多轮 RL 可有效学习序列临床决策,从而产生稳健、可泛化的能力,为实现临床精通铺平道路。仍需对真实世界工作流程进行前瞻性验证以确立临床实用性。

英文摘要

In medical education, physicians convert academic knowledge into clinical expertise through residency: years of training across thousands of encounters, with diverse sources of feedback and progressively greater autonomy. Much of clinical reasoning relies on the patient encounter, a dialogue in which a clinician elicits history, refines diagnostic hypotheses, and decides management under uncertainty. While large language models (LLMs) excel on static medical benchmarks, methods to optimize the full sequence of clinical decisions remain underdeveloped. We present ResidencyRL, a reinforcement learning (RL) method for training clinical artificial intelligence (AI) agents through simulated multi-turn clinical encounters (up to 60 dialogue turns and 8 tool calls per trajectory). ResidencyRL pairs the policy agent with LLM simulators capable of complex, adversarial behaviors, training against a structured reward aligned to diagnostic accuracy, management quality, communication, documentation, and safety. On held-out evaluations, the ResidencyRL agent improves diagnostic accuracy by 7.0% under adversarial conditions (88.0% vs. 81.0%) and reduces missed red flag rates by 31%, demonstrating rigorous mitigation of premature closure. Blinded expert clinicians validated these gains, preferring the trained agent in 87.6% of side-by-side comparisons. The procedural competencies transfer to unseen benchmarks: the agent outperforms the base model across all six clinical axes of the AMIE multi-visit benchmark, and shows consistent directional improvements on AgentClinic and CRAFT-MD. Our findings demonstrate that sequential clinical decision-making can be effectively learned through multi-turn RL in simulation, yielding robust, generalizable capabilities, paving the way towards clinical mastery. Prospective validation with real-world workflows remains necessary to establish clinical utility.

URL PDF HTML 收藏
2608.07417 2026-08-10 cs.CV cs.AI 新提交

I Seek You in Videos: Identity-Conditioned Queries for Person-Centric Video Reasoning

我在视频中寻找你:面向以人为中心的视频推理的身份条件查询

Shibo Gao, Chongxiao Wang, Chenglong Huang, Jie Ma, Haolin Shi, Fei Ding, Jing Li, Qiang Lyu, Yangyang Liu, Yang Liu, Jun Liu, Linlin Huang, Peipei Yang

机构 * Beijing Jiaotong University(北京交通大学) HUJING Digital Media & Entertainment Group(汇晶数字媒体与娱乐集团) MAIS Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所MAIS)

AI总结 该研究提出了身份条件查询(ICQ)任务,构建了ISYV基准、训练集与框架,实验显示主流多模态大语言模型在该任务上表现不佳,ISYV模型性能优于强基线且接近闭源模型。

Comments Accepted to ACM Multimedia 2026 (MM '26). 6 figures, 5 tables

详情
AI中文摘要

现实世界的视频推理通常涉及多模态、多源输入,而现有的视频推理任务通常采用简化的视频-文本设置,限制了身份匹配和以人为中心的推理。为了弥合这一差距,我们提出了身份条件查询(Identity-conditioned Queries,ICQ)任务,要求模型联合关联并解释输入视频和某个人的参考图像,利用该条件解决身份 grounding、行为理解、时间推理等挑战。基于ICQ,我们提出了ISYV(I Seek You in Videos),这是一个包含三个组件的系统性解决方案:(1)ISYV-Bench,一个具有挑战性的评估基准,包含1377个真实世界复杂视频和1377个问答对,分为六个难度级别,涵盖从身份识别到因果推理的能力;(2)ISYV-75K,一个大规模训练集,包含75K高质量样本,通过自动标注、多阶段验证和人工审核构建;(3)ISYV-Framework,包含面向ICQ的模型和训练策略,用于学习利用有信息的视频片段,无需额外的片段级标注。大量实验表明,主流的闭源和开源多模态大语言模型(MLLM)在ISYV-Bench上表现不佳,尤其是在跨域身份匹配和长时跟踪方面。ISYV-Model的性能优于强基线,在某些方面接近闭源模型的性能。总体而言,ISYV为以人为中心的视频推理提供了统一的任务定义、可扩展的数据集/基准以及建模见解。

英文摘要

Real-world video reasoning often involves multimodal, multi-source inputs, whereas existing video reasoning tasks typically assume a simplified video-text setting, limiting identity matching and person-centric reasoning. To bridge this gap, we introduce the Identity-conditioned Queries (ICQ) task, in which models are required to jointly associate and interpret an input video and a reference image of a person, and leverage this conditioning to address identity grounding, behavior understanding, and temporal reasoning, among other challenges. Building on ICQ, we present ISYV (I Seek You in Videos), a systematic solution comprising three components: (1) ISYV-Bench, a challenging evaluation benchmark with 1,377 real-world complex videos and 1,377 question-answer pairs, organized into six difficulty levels spanning capabilities from identity recognition to causal reasoning; (2) ISYV-75K, a large-scale training set of 75K high-quality samples constructed via automated annotation, multi-stage verification, and manual review; and (3) ISYV-Framework, containing an ICQ-oriented model and training strategy for learning to exploit informative video shots without additional shot-level annotations. Extensive experiments show that both mainstream closed-source and open-source MLLMs struggle on ISYV-Bench, especially in cross-domain identity matching and long-horizon tracking. ISYV-Model outperforms strong baselines and in some aspects approaches closed-source performance. Overall, ISYV provides a unified task definition, scalable datasets/benchmarks, and modeling insights for person-centric video reasoning.

URL PDF HTML 收藏
2608.07411 2026-08-10 cs.AI cs.CL cs.IR cs.LG 新提交

GeoBenchLLM: A Comprehensive Benchmark for Evaluating LLMs on Geo-Related Tasks

GeoBenchLLM:评估大语言模型地理相关任务的综合基准

Rodrigo Ferreira Rodrigues, Karim Radouane, Jose G Moreno, Lynda Tamine

机构 * University of Toulouse(图卢兹大学) IRIT(信息与电信科学研究所)

AI总结 该研究提出GeoBenchLLM综合基准,选取12个地理相关公开数据集评估LLMs的地理空间与时间理解能力,发现推理能力与模型规模对性能影响显著,基准可公开获取。

Comments Accepted at CIKM2026

详情
AI中文摘要

在地理数据语境下,现有大语言模型(LLMs)常被置于同质化场景中研究,这极大限制了对其泛化能力的认知。本文提出GeoBenchLLM,一个用于探测大语言模型地理相关任务能力的综合基准。我们精心选取了12个来自不同地理相关任务与领域的公开数据集,利用该基准对一组大语言模型的地理空间与时间理解能力进行评估。结果显示,推理能力与模型规模对整体性能有显著影响。GeoBenchLLM可在该网址公开获取。

英文摘要

In the context of geodata, existing Large Language Models have often been studied in a homogeneous setting, which has considerably limited insights into their generalization capabilities. In this paper, we present \benchName, a comprehensive benchmark for probing LLMs on geo-related tasks. We leverage a careful selection of twelve publicly available datasets from diverse geo-related tasks and domains, and evaluate a set of LLMs on geo-spatial and temporal understanding using our benchmark. Our results show that reasoning and size have a strong impact on overall performance. GeoBenchLLM is publicly available at this https URL.

URL PDF HTML 收藏
2608.07408 2026-08-10 cs.CV cs.LG 新提交

Addressable Memory for Video World Models

视频世界模型的可寻址内存

Xindi Wu, Sven Elflein, James Lucas, Olga Russakovsky, Laura Leal-Taixé, Despoina Paschalidou, Jonathan Lorraine, Aljoša Ošep

机构 * NVIDIA(英伟达) Princeton University(普林斯顿大学) University of Toronto(多伦多大学) Vector Institute(矢量研究院)

AI总结 针对交互式视频世界模型超出训练时序后内存寻址失效及压缩缓存破坏内存的问题,提出无训练框架 WorldTrace,含两种压缩方法,在新基准 LoopBench 上分别提升时序一致性 15.5%、情景回忆 19.5%。

Comments Project page: this https URL (https://research.nvidia.com/labs/sil/projects/WorldTrace/)

详情
AI中文摘要

我们研究交互式视频世界模型中的视觉持续性。这些模型依赖键值(KV)缓存作为不断增长的视觉内存来承载之前生成的帧。然而,我们发现当 rollout(展开)超出训练 horizon(时序范围)时,模型无法可靠地寻址存储的内容,因为时序旋转位置嵌入(RoPE)偏移会超出训练期间见过的范围,模型难以通过注意力机制检索相关视觉信息。此外,在 RoPE 旋转空间中朴素地压缩缓存会通过平均不兼容的位置相位破坏内存。为解决该问题,我们提出 WorldTrace,一种用于长时序视觉持续性的无训练内存框架。WorldTrace 通过为每个摘要槽分配一个不同的、符合分布的虚拟位置来保持压缩内存的可寻址性。在该可寻址缓存内,我们研究两种内存压缩方法:WorldTrace-Field 压缩历史以实现时序一致性,WorldTrace-Landmark 在检测到的转换处存储逐字场景轨迹以实现 episodic recall(情景回忆)。我们进一步引入 LoopBench,一个评估压缩缓存能否在长绕行后重建先前访问场景的基准。在 LoopBench 上,WorldTrace-Field 将时序一致性提升了 +15.5%,WorldTrace-Landmark 将情景回忆提升了 +19.5%,无需重新训练即可扩展视觉持续性生成。

英文摘要

We study visual persistence in interactive video world models. These models rely on a Key-Value (KV) cache as a growing visual memory to carry forward previously generated frames. However, we find that models can no longer reliably address stored content once rollouts extend beyond the training horizon, because temporal Rotary Positional Embeddings (RoPE) offsets then fall outside the range seen during training and the model struggles to retrieve the relevant visual information through attention. Moreover, naively compressing the cache in the RoPE-rotated space corrupts memory by averaging together incompatible positional phases. To address this, we propose WorldTrace, a training-free memory framework for long-horizon visual persistence. WorldTrace keeps compressed memory addressable by assigning each summary slot a distinct, in-distribution virtual position. Within this addressable cache, we study two memory compression approaches: WorldTrace-Field compresses history for temporal coherence, while WorldTrace-Landmark stores verbatim scene traces at detected transitions for episodic recall. We further introduce LoopBench, a benchmark evaluating whether a compressed cache can reconstruct a previously visited scene after a long detour. WorldTrace-Field improves temporal consistency by +15.5%, and WorldTrace-Landmark improves episodic recall by +19.5% on LoopBench, extending visually persistent generation without retraining.

URL PDF HTML 收藏
2608.07405 2026-08-10 cs.CV cs.AI 新提交

GeoDistill-Refine: Silhouette-First Geometry Distillation for Annotation-Free Spacecraft Segmentation

GeoDistill-Refine:面向无标注航天器分割的基于轮廓优先的几何蒸馏方法

Yonglong Zhang, Zongwu Xie, Yang Liu

机构 * School of Mechatronics Engineering, Harbin Institute of Technology(哈尔滨工业大学机电工程学院)

AI总结 本文提出GeoDistill-Refine两阶段框架,将SAM 3伪掩码迁移至紧凑分割网络,通过多提示投票、样本级门控及多几何目标优化,提升航天器图像分割精度,模型高效且适配多域评估。

详情
AI中文摘要

基础分割模型可为航天器图像提供无需人工训练掩码的监督,但其预测会随文本提示变化,且可能存在几何误差,这类误差在蒸馏过程中会被放大。本文提出GeoDistill-Refine,这是一个两阶段框架,用于将离线SAM 3伪掩码迁移至紧凑的分割网络。6个固定提示通过无加权50%投票融合,以稳定教师模型输出。学生模型首先学习前景轮廓,随后通过从伪掩码衍生的有符号距离场、骨架和面积目标进行优化。由提示一致性、有效提示比例和伪掩码面积合理性计算得到的样本级门控,可降低不可靠伪几何的影响。在SpaceSense-Bench HJM锁箱集上,GeoDistill-Refine相比普通伪标签学生模型,将图像交并比(Image IoU)和边界F1值分别提升0.0456和0.1380。在SPEED+ Lightbox、Sunlamp域及TANGO上的外部评估显示,该方法在实现具有竞争力的区域重叠的同时,还提升了边界质量或前景精度。部署的TinyUNet包含0.263M参数,在RTX 4090上每张图像推理耗时约1.1ms;SAM 3伪掩码构建及辅助几何分支仅在训练阶段使用。

英文摘要

Foundation segmentation models can provide supervision for spacecraft imagery without manual training masks, but their predictions vary with textual prompts and may contain geometric errors that are amplified during distillation. This paper presents GeoDistill-Refine, a two-stage framework that transfers offline SAM 3 pseudo-masks to a compact segmentation network. Six fixed prompts are fused by an unweighted 50% vote to stabilize the teacher output. The student first learns the foreground silhouette and is then refined with signed-distance-field, skeleton, and area objectives derived from the pseudo-mask. A sample-level gate, computed from prompt agreement, the valid-prompt ratio, and pseudo-mask area plausibility, reduces the influence of unreliable pseudo-geometry. On the SpaceSense-Bench HJM lockbox set, GeoDistill-Refine improves Image IoU and Boundary F1 by 0.0456 and 0.1380, respectively, over a plain pseudo-label student. External evaluations on the SPEED+ Lightbox and Sunlamp domains and on TANGO show competitive regional overlap together with gains in boundary quality or foreground precision. The deployed TinyUNet contains 0.263 M parameters and requires approximately 1.1 ms per image on an RTX 4090; SAM 3 pseudo-mask construction and the auxiliary geometry branches are used only during training.

URL PDF HTML 收藏
2608.07400 2026-08-10 cs.AI cs.DB econ.GN q-fin.GN 新提交

FinRank: An Evidence-Grounded Benchmark for Financial Question Answering and Retrieval over SEC Filings

FinRank:面向SEC文件的金融问答与检索的证据基准

Sasan Mansouri, Daniel Saad, Mark Wahrenburg, Manu Weissel, Fabian Woebbeking

机构 * University of Groningen(格罗宁根大学) Goethe University Frankfurt(法兰克福大学) DataNXT GmbH(DataNXT有限公司) Halle Institute for Economic Research (IWH)(哈雷经济研究所) Martin Luther University Halle-Wittenberg(马丁路德大学哈雷-维滕贝格分校)

AI总结 FinRank是针对SEC文件金融问答与检索的基准,含1185条人工问答记录,评估段落检索等任务,实验显示现有模型性能有限,为开发可靠金融问答系统提供支撑。

Comments 24 pages, 3 figures. Dataset and evaluation code: this https URL (https://github.com/datanxt/FinRank)

详情
AI中文摘要

金融问答通常以答案正确性进行评估,但在SEC文件中,看似合理甚至数值正确的答案可能基于错误的证据。类似事实和披露会在同一文件的不同章节、同一公司的不同报告期以及可比公司之间重复出现。FinRank针对这种对证据来源敏感的检索问题,要求系统识别出针对目标实体、报告期和披露背景的证据。该基准包含22家公司的10-K和10-Q文件上的1185个人工撰写的问答记录,每条记录包含参考答案、黄金支持段落,以及从文件内易混淆段落、不同报告期和可比公司中精心筛选的难负例。FinRank将段落检索、重排序和难负例判别作为单独任务进行评估。基线结果表明该设置的难度:在评估的系统中,即使是7B指令调优嵌入器在合并证据语料库上的Recall@10仅达44.8%;亚十亿参数编码器较BM25最多提升3.5个百分点,金融适配嵌入器较BM25落后9.7个百分点,当用精心筛选的难负例替换随机负例时,成对准确率下降13.0-20.5个百分点。FinRank为开发不仅准确且基于正确披露的金融问答系统提供了以证据为先的基准。

英文摘要

Financial question answering is typically evaluated by answer correctness, yet in SEC filings a plausible and even numerically correct answer can be grounded in the wrong evidence. Similar facts and disclosures recur across sections of a filing, across reporting periods of the same firm, and across comparable firms. FinRank targets this provenance-sensitive retrieval problem by requiring systems to identify evidence for the intended entity, reporting period, and disclosure context. The benchmark contains 1185 manually authored question-answer records over the 10-K and 10-Q filings of 22 companies. Each record includes a reference answer, gold supporting passages, and hand-curated hard negatives drawn from confusable passages within filings, across reporting periods, and across comparable firms. FinRank evaluates passage retrieval, reranking, and hard-negative discrimination as separately measured tasks. Baseline results demonstrate the difficulty of this setting: among the evaluated systems, even a 7B instruction-tuned embedder reaches only 44.8% Recall@10 on the pooled evidence corpus; sub-billion-parameter encoders gain at most 3.5 points over BM25, a finance-adapted embedder trails BM25 by 9.7 points, and pairwise accuracy falls by 13.0-20.5 percentage points when random negatives are replaced with the curated hard negatives. FinRank provides an evidence-first benchmark for developing financial question answering systems that are not only accurate but also grounded in the correct disclosure.

URL PDF HTML 收藏
2608.07393 2026-08-10 cs.LG eess.SP q-bio.NC 新提交

FedDOSE: Federated Learning Framework Decomposing Site Effects for Modeling Brain Dynamic Functional Connectivity

FedDOSE:分解站点效应以建模脑动态功能连接的联邦学习框架

Deepank Girish, Yi Hao Chan, Yubin Zheng, Sukrit Gupta, Jagath C. Rajapakse

机构 * Nanyang Technological University(南洋理工大学) Shanghai Jiao Tong University(上海交通大学) Indian Institute of Technology Ropar(罗帕尔印度理工学院)

AI总结 FedDOSE是分解站点效应的联邦学习框架,通过模块化引导Tucker分解等技术处理多站点fMRI的动态功能连接,在ASD和ADHD检测中性能优于现有方法。

详情
AI中文摘要

功能磁共振成像(fMRI)数据常被汇集为多站点协作联盟,因为用于分析的深度学习模型需要大量数据集才能良好泛化。联邦学习(FL)提供了一种隐私保护的协作训练范式,但标准方法仍难以应对统计异质性,站点差异是多站点数据场景中的关键挑战。此外,现有的针对fMRI的联邦学习方法依赖静态功能连接(FC),忽略了脑网络中的动态信息。为解决这一问题,我们提出FedDOSE,这是一种显式分解站点差异以分析动态功能连接(dFC)的新框架。FedDOSE引入了模块化引导的Tucker分解模块,用于编码高维dFC张量并高效捕捉模块级时空模式。在所有站点生成类别特定原型,随后通过最优传输(OT)重心公式与Procrustes分析的组合在全局层面对齐。在三个多站点静息态fMRI数据集(ABIDE-I、ABIDE-II和ADHD-200)上进行的自闭症谱系障碍(ASD)和注意缺陷多动障碍(ADHD)诊断的大量实验表明,FedDOSE在ASD和ADHD检测中优于现有最先进方法,其结果凸显了该方法从多站点数据集中学习鲁棒表征以进行可靠分析的有效性。

英文摘要

Functional Magnetic Resonance Imaging ( fMRI ) data are often pooled into collaborative multi-site consortia, as deep learning models for analyses require large datasets to generalize well. While Federated Learning (FL) offers a privacy-preserving paradigm for collaborative training, standard approaches continue to struggle with statistical heterogeneity. In particular, site differences pose a key challenge in multi-site data settings. Additionally, existing FL approaches for fMRI rely on static Functional Connectivity ( FC), omitting dynamic information in brain networks. To address this, we propose FedDOSE, a novel framework that explicitly decomposes site differences for analysis of dynamic FC (dFC). FedDOSE introduces a Modularity-Guided Tucker Decomposition block to encode high-dimensional dFC tensors and capture modular-level spatio-temporal patterns efficiently. Class-specific prototypes are generated across all sites and subsequently aligned at the global level by using a combination of Optimal Transport (OT) barycenter formulation and Procrustes analysis. Extensive experiments for diagnosing Autism Spectrum Disorder (ASD) and Attention-Deficit Hyperactivity Disorder (ADHD) on three multi-site resting-state fMRI datasets: ABIDE-I, ABIDE-II, and ADHD-200, demonstrate that FedDOSE outperforms state-of-the-art methods in ASD and ADHD detection. Our results highlight its effectiveness in learning robust representations from multi-site datasets for reliable analysis.

URL PDF HTML 收藏
2608.07385 2026-08-10 cs.LG cs.AI eess.AS eess.SP stat.ML 新提交

Omni-modal decomposition autoencoders learn full-stack wearable disentangled representations

全模态分解自编码器学习全栈可穿戴解耦表示

Ioannis Ziogas, Ensieh Khazaei, Bilal Taha, Aamna Al Shehhi, Ahsan H. Khandoker, Leontios J. Hadjileontiadis, Dimitrios Hatzinakos

机构 * Khalifa University(哈利法大学) University of Toronto(多伦多大学) MIT Media Lab(麻省理工学院媒体实验室) Aristotle University of Thessaloniki(亚里士多德大学)

AI总结 该研究针对现有多模态可穿戴模型的不足,提出OmniDecVAEs框架,在30模态的HAR任务中,提升了识别准确率与数据合成质量,可用于边缘可穿戴与医疗领域。

Comments 15 pages, 7 figures, 7 tables

详情
AI中文摘要

学习解耦表示是开发多模态可穿戴计算中通用、多功能且可持续模型的关键要求。然而,现有方法无法作为全栈可穿戴处理器运行,即它们无法同时解决特定任务的分类性能、解耦且可解释的表示学习、融合以及高度异构多模态时间序列的生成建模问题。为解决这一差距,我们引入全模态变分分解自编码器(OmniDecVAEs),这是一个可从任意数量的模态中以统一且可扩展的方式高效学习多用途表示的框架。OmniDecVAEs 通过多视图自监督分解损失和共享非对称自编码器(AE)架构学习模态条件时频潜在子空间,从而扩展了 DecVAEs。在具有多达三十种模态的挑战性全模态人类活动识别(HAR)设置上的结果表明,OmniDecVAEs 具备学习全栈可穿戴表示的能力。与基于 Transformer 和 VAE 的方法相比,OmniDecVAEs 的全栈解耦表示属性在活动和身份识别中分别带来 1.01% 和 6.75% 的准确率提升。此外,OmniDecVAEs 合成逼真的全模态时频数据,表现出增强的重构效果(平均绝对误差提升 76.84%)以及真实数据与合成数据间的分布相似性(最大均值差异提升 13.85%)。我们的结果凸显了 OmniDecVAEs 作为适用于智能边缘可穿戴设备和临床医疗的轻量型模型的潜力,它通过增强的表示能力、模态不变空间复杂度(410 万参数)和实时延迟,在单个模型中统一了处理需求和能力。

英文摘要

Learning disentangled representations is a key requirement for developing versatile, general-purpose, and sustainable models in multi-modal wearable computing. However, existing approaches do not operate as full-stack wearable processors, i.e., they do not simultaneously address task-specific classification performance, disentangled and interpretable representation learning, fusion, and generative modeling of highly heterogeneous multi-modal time series. To address this gap, we introduce Omni-modal Variational Decomposition Autoencoders (OmniDecVAEs), a framework that efficiently learns multi-purpose representations in a unified and scalable manner from arbitrarily many modalities. OmniDecVAEs extend DecVAEs by learning modality-conditioned time-frequency latent subspaces through a multi-view self-supervised decomposition loss and a shared asymmetric autoencoder (AE) architecture. Results on a challenging omni-modal human activity recognition (HAR) setting with up to thirty modalities, demonstrate the ability of OmniDecVAEs to learn full-stack wearable representations. When compared to transformer-based and VAE-based methods, OmniDecVAEs full-stack disentangled representation properties lead to accuracy improvements of 1.01% and 6.75% in activity and identity recognition, respectively. Furthermore, OmniDecVAEs synthesize realistic omni-modal time-frequency data that manifest with enhanced reconstructions (mean absolute error improves by 76.84%) and distributional similarity between real and synthetic data (maximum mean discrepancy improves by 13.85%). Our results highlight OmniDecVAEs potential as a lightweight model suitable for intelligent edge wearables and clinical healthcare, unifying processing requirements and abilities in a single model, through its enhanced representational capacity, modality-invariant spatial complexity (4.1M parameters), and real-time latency.

URL PDF HTML 收藏
2608.07371 2026-08-10 cs.LG cs.CL 新提交

Trajectory-Relative Hindsight Distillation for Agentic Reinforcement Learning

面向智能体强化学习的轨迹相对事后蒸馏

Haoyu Zheng, Yun Zhu, Qing Wang, Wenqiao Zhang

机构 * Zhejiang University(浙江大学) Shanghai AI Laboratory(上海人工智能实验室) Tencent(腾讯)

AI总结 针对智能体强化学习中事后信号分配不清的问题,提出TRIAL框架,通过轨迹相对步分配优化监督信号,在WebShop、ALFWorld等任务上优于GRPO及多数基线方法,提升了任务性能。

详情
AI中文摘要

近期的智能体强化学习方法利用事后(hindsight)机制来补充稀疏的结果奖励。然而,一个完整的回合(rollout)可以产生大量此类信号,导致如何在各个决策步(turn)间合理分配这些信号尚不明确。我们提出了TRIAL,这是一个带有统一步对齐评分协议的轨迹相对事后蒸馏框架。对于每个决策步,TRIAL提取该决策所实现结果的结果视图,并在普通上下文和事后条件上下文下评估相同的响应。带符号的对数概率差值决定了 token 级监督的方向和局部强度,而步级幅度则在整个实现轨迹上进行联合归一化。所得的分配乘数的合格 token 加权平均值为1,在保持平均乘数不变的同时,将密集监督重新分配到各个决策步。在WebShop和ALFWorld上使用不同主干(backbone)的实验表明,TRIAL在主干、环境和评估指标的全部8种组合中均优于GRPO,且在6种组合中的6种上达到了6种方法中的最佳或并列最佳性能。在使用Qwen3-1.7B的WebShop上,TRIAL将成功率从56.4%提升至75.2%,任务得分从78.7%提升至85.7%。受控消融实验进一步表明,轨迹相对步分配相比单纯的密集事后蒸馏能带来显著增益。

英文摘要

Recent agentic reinforcement learning methods use hindsight to complement sparse outcome rewards. However, a completed rollout can yield many such signals, leaving their appropriate allocation across turns unclear. We introduce TRIAL, a trajectory-relative hindsight distillation framework with a unified turn-aligned scoring protocol. For each decision turn, TRIAL extracts an outcome view of that decision's realized consequence and evaluates the same response under ordinary and hindsight-conditioned contexts. The signed log-probability gap determines the direction and local strength of token-level supervision, while turn-level magnitudes are normalized jointly over the realized trajectory. The resulting allocation multipliers have an eligible-token-weighted mean of one, redistributing dense supervision across turns while fixing its average multiplier. Experiments on WebShop and ALFWorld with different backbones show that TRIAL outperforms GRPO across all eight combinations of backbone, environment, and evaluation metric, while achieving the best or tied-best performance among six methods on six of them. On WebShop with Qwen3-1.7B, TRIAL improves the success rate from 56.4% to 75.2% and the task score from 78.7% to 85.7%. Controlled ablations further show that trajectory-relative turn allocation provides substantial gains beyond those of dense hindsight distillation alone.

URL PDF HTML 收藏
2608.07370 2026-08-10 cs.CL 新提交

LitTraceQA: A Benchmark for Multi-Stage Grounding and Verification in Scientific Question Answering

LitTraceQA:面向科学问答的多阶段溯源与验证基准

Xuye Liu, Yimu Wang, Peng Shi, Bo Xue, Xiangrui Ke, Songcheng Cai, Kath Choi, Di Wu, Freda Shi, Krzysztof Czarnecki

机构 * University of Waterloo(滑铁卢大学) Amazon(亚马逊公司) City University of Hong Kong(香港城市大学) University of Amsterdam(阿姆斯特丹大学)

AI总结 该研究提出LitTraceQA基准,用于科学问答的多阶段溯源与验证,提供含多类型证据的问答数据,可评估系统的论文检索、证据溯源及答案准确性,助力生成可验证的科学问答结果。

Comments Work in Progress

详情
AI中文摘要

科学文献正日益成为语言模型、检索增强生成系统及研究助手的知识来源,但回答来自论文的研究问题仅靠流畅生成是不够的。可靠的系统必须识别相关论文、定位支持答案的具体证据,并生成忠实于该证据的响应。我们提出LitTraceQA,一个面向科学论文的文献溯源问答基准。给定一个研究问题和论文元数据集,系统必须返回三个关联输出:规范论文标识符、支持证据位置,以及一种或多种请求格式的答案,包括自由文本、多项选择答案和结构化表格。LitTraceQA针对科学阅读中常见的证据类型:表格、图表、文本片段、方程或算法,以及引用上下文。公开开发集包含55个示例,其中包括26个隐式来源的单篇论文问题和29个多篇论文问题,并提供用于本地验证的黄金论文、证据注释和答案。我们还分析了更大规模的最终注释集合,该集合包含4978条独特问题记录,涉及4859篇独特黄金论文。通过分别评估论文检索、证据溯源和答案准确性,LitTraceQA为科学问答系统提供了一个测试平台,该平台可生成可验证的答案,而非无依据的摘要。

英文摘要

Scientific literature is increasingly used as a knowledge source for language models, retrieval-augmented generation systems, and research assistants, but answering research questions from papers requires more than fluent generation. A reliable system must identify the relevant papers, locate the concrete evidence that supports the answer, and produce a response that is faithful to that evidence. We present LitTraceQA, a benchmark for literature-grounded question answering over scientific papers. Given a research question and a metadata pool of papers, a system must return three connected outputs: canonical paper identifiers, supporting evidence locations, and answers in one or more requested formats, including free-form text, multiple-choice answers, and structured tables. LitTraceQA targets evidence types common in scientific reading: tables, figures, text spans, equations or algorithms, and citation contexts. The public development split contains 55 examples, including 26 hidden-source single-paper questions and 29 multi-paper questions, and provides gold papers, evidence annotations, and answers for local validation. We also analyze a larger final annotation collection with 4,978 unique-question records over 4,859 unique gold papers. By evaluating paper retrieval, evidence grounding, and answer accuracy separately, LitTraceQA provides a testbed for scientific QA systems that produce verifiable answers rather than unsupported summaries.

URL PDF HTML 收藏
2608.07364 2026-08-10 cs.AI cs.CY 新提交

Curriculum as Code: An AI-Assisted Architecture for Instructional Design in STEM Education

课程即代码:STEM教育中教学设计的AI辅助架构

Henrique Mohallem Paiva

机构 * Universidade Federal de Sao Paulo (Unifesp)(圣保罗联邦大学) Institute of Technology and Leadership (Inteli)(技术与领导力学院)

AI总结 该研究提出基于课程即代码的六阶段AI辅助教学设计架构,结合生成式AI与LaTeX、Python,经验证可降低教师STEM教学材料创作工作量,提升材料质量与可扩展性。

Comments This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

详情
AI中文摘要

贡献:本文提出一种基于“课程即代码”范式的六阶段AI辅助教学设计架构,将生成式AI与LaTeX、Python集成,用于自动化创建可复现、视觉一致且技术精准的STEM教育材料。背景:为主动学习定制教学材料给教师带来繁重工作,标准演示工具对技术内容支持不足,现有AI应用常产生幻觉且无法形式化学科教学创作过程,限制其在严谨学术设计中的效用。预期成果:该框架旨在减少备课时间,同时确保数学准确性、符合机构视觉标识,并通过明确规则保留教师隐性教学知识。应用设计:解决方案包含六阶段流程,以系统工作流替代临时提示工程,利用基于文本的界面和代码驱动生成(幻灯片采用LaTeX/Beamer,图形采用Python),受教学约束、情境校准及自动审核周期管控。发现:在基于项目的学习环境中,经一年时间8个模块、28个项目场景验证,该架构显著降低教师工作量。生成的资源经独立同行评审并由6位不同教师部署,确认其可扩展性超出单个创作者。基于600余份自愿学生评价,材料获得8.5至9.9/10的高质量评分。结果表明该架构具有高可复现性、最小化幻觉,且保持教学与视觉保真度,显示其适用于广泛STEM教育应用。

英文摘要

Contribution: This paper presents a six-phase AI-assisted instructional design architecture based on the Curriculum as Code paradigm, integrating Generative AI with LaTeX and Python to automate the creation of reproducible, visually consistent, and technically precise materials for STEM education. Background: Creating customized instructional materials for active learning imposes a heavy workload on faculty. Standard presentation tools lack robust support for technical content, while current AI applications often hallucinate and fail to formalize the instructional authoring process, limiting their utility for rigorous academic design. Intended Outcomes: The framework aims to reduce preparation time while ensuring mathematical accuracy, adherence to institutional visual identity, and preservation of the instructor's tacit pedagogical knowledge through explicit rules. Application Design: The solution comprises a six-phase pipeline that replaces ad-hoc prompt engineering with a systematic workflow, utilizing text-based interfaces and code-driven generation (LaTeX/Beamer for slides, Python for figures), governed by pedagogical constraints, contextual calibrations, and automated review cycles. Findings: Validated over one year across 8 modules and 28 project contexts in a Project-Based Learning environment, the architecture significantly reduced instructor workload. Generated assets underwent independent peer review and were deployed by six different faculty members, confirming scalability beyond a single author. Based on over 600 voluntary student evaluations, materials achieved high quality ratings from 8.5 to 9.9/10. Results indicate high reproducibility, minimized hallucinations, and sustained pedagogical and visual fidelity, suggesting viability for broad STEM educational applications.

URL PDF HTML 收藏
2608.07361 2026-08-10 cs.RO cs.CV 新提交

Depth-Wise Probing and Pruning of the Planning Token in a Driving Vision-Language-Action Model

驾驶视觉-语言-动作模型中规划 token 的深度探测与剪枝

Harisankar Babu, Benjamin Coors, Christopher Lang, Hendrik Berkemeyer, Tamim Asfour, Simon Foell

机构 * Robert Bosch GmbH(罗伯特·博世有限公司) Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院)

AI总结 本文针对驾驶 VLA 模型的规划 token,通过探测其 32 个解码器层的信号并剪枝部分层,在误差小幅增加下实现 1.33 倍解码器加速,验证了规划信息早期存在但格式适配问题。

Comments Accepted at the 6th DriveX Workshop (Foundation Models for Autonomous Driving), ECCV 2026. 14 pages, 8 figures, 4 tables

详情
AI中文摘要

视觉-语言-动作(VLA)模型将驾驶决策通过深度语言模型传递,但动作本身需要多少层深度尚不明确。本文研究了一个代表性驾驶 VLA,其全部规划由单个规划 token 承载,生成式规划器会将该 token 解码为轨迹。借用该规划器作为轨迹空间 logit 透镜,我们从 32 个解码器层中的每一层解码规划 token,并测量两个信号:导航指令的线性可解码性,以及与冻结原生规划器的轨迹兼容性。诊断结果显示,语义意图可在早期线性解码:指令探测准确率在第一个解码器层后达到 97.7%,而随机概率为 16.7%;相比之下,与冻结原生规划器的兼容性随深度逐渐提升,开环平均 L2 距离仅在最终层达到最小值 2.11 米。从第一层学习的读出模块可弥补大部分差距,表明规划信息已在早期存在,但尚未以部署规划器所需的格式表示。按规划 token 引发的角度偏差对解码器层排序,可在相对开环误差增加约 5% 的情况下移除 32 个层中的 8 个,实现了测得的 1.33 倍解码器加速。在评估的样本量下,未统计到特定类别性能下降。这些发现仅适用于评估的 ORION 检查点和 Bench2Drive 设置。

英文摘要

Vision-language-action (VLA) models route driving decisions through a deep language model, but it is unclear how much of that depth the action itself requires. We study a representative driving VLA whose entire plan is carried by a single planning token that a generative planner decodes into a trajectory. Borrowing the planner as a trajectory-space logit lens, we decode the planning token from every one of the 32 decoder layers and measure two signals: the linear decodability of the navigation command and trajectory compatibility with the frozen native planner. Our diagnostic shows that semantic intent is linearly decodable early: command-probe accuracy reaches 97.7\% after the first decoder layer, compared with 16.7\% chance. In contrast, compatibility with the frozen native planner improves gradually across depth, with open-loop Avg-L2 reaching its minimum of 2.11\,m only at the final layer. Learned readouts from the first layer recover much of this gap, indicating that planning information is already present early but is not yet represented in the format expected by the deployed planner. Ranking decoder layers by the angular deviation they induce in the planning token permits removal of 8 of 32 layers within an approximately 5\% relative open-loop error increase and yields a measured 1.33$\times$ decoder speedup. At the evaluated sample size, no family-specific degradation is statistically resolved. These findings are limited to the evaluated ORION checkpoint and Bench2Drive setup.

URL PDF HTML 收藏
2608.07353 2026-08-10 cs.CL cs.AI cs.IR cs.LG 新提交

Geo-Spatial Concept Probing of Large Language Models: Abstraction, Compositionality, and Grounding

大语言模型的地理空间概念探测:抽象性、组合性与接地性

Karim Radouane, Jose G Moreno, Lynda Tamine

机构 * University of Toulouse(图卢兹大学) IRIT(信息科学与技术研究院(IRIT))

AI总结 该研究针对LLMs的抽象性、组合性与接地性设计测试,构建空间概念基准并开展多模型实验,揭示当前LLMs的概念理解局限,为相关模型的优化提供洞见。

Comments Preprint

详情
AI中文摘要

理解概念是泛化能力的基础。尽管大语言模型(LLMs)在广泛任务上表现出色,但它们仍难以实现真正的概念理解。过往研究采用自然语言基准或范围狭窄的合成任务评估LLMs的概念理解,但这些设置常混淆多种技能,或缺乏对底层概念及其属性的精确控制。为支持对LLMs中概念的可控探测,我们设计了针对其核心属性——抽象性、组合性与接地性的测试。我们构建了一个以概念为中心的基准,针对方向、距离、拓扑等空间概念及其组合,并采用问答任务作为代理。我们在多种LLMs架构和训练 regime 上开展大量实验,分析模型规模与设计如何影响概念理解。结果揭示了当前LLMs的明显局限,并为理解决定其获取与组合结构化概念能力的因素提供了洞见。我们的发现为如何重新设计基于概念的LLMs以改进信息访问与知识管理提供了思路。代码将在此https URL公开。

英文摘要

Understanding concepts is fundamental to generalization. Despite their impressive performance on a wide range of tasks, Large Language Models (LLMs) still struggle with genuine concept understanding. Prior work has evaluated conceptual understanding in LLMs using natural-language benchmarks or narrowly scoped synthetic tasks, but these settings often conflate multiple skills or lack precise control over the underlying concepts and their properties. To support controlled probing of concepts in LLMs, we design tests on their core properties: abstraction, compositionality, and groundness. We set up a concept-centric benchmark, targeting spatial concepts such as direction, distance, topology, and their compositions, and use question answering tasks serving as a proxy. We conduct extensive experiments across multiple LLM architectures and training regimes to analyze how model scale and design impact conceptual understanding. The results reveal clear limitations in current LLMs and provide insights into the factors shaping their ability to acquire and compose structured concepts. Our findings shed light on how concept-based LLMs can be redesigned for improved information access and knowledge management. The code will be available at this https URL.

URL PDF HTML 收藏
2608.07346 2026-08-10 cs.AI 新提交

An End-to-End Agent Auditing Engine

端到端智能体审计引擎

Haoning Wang, Mingxun Zhang, Chenyue Yu, Yingjun Shang, Xia Hu, Guanchu Wang, Na Zou

机构 * Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)

AI总结 针对智能体适配框架的系统化评估难题,本文提出A²E引擎,借助ATP协议实现任务快速集成,通过多维指标评估适配框架能力,实验表明模型-适配框架组合性能差异显著,为模型与适配框架协同演进提供指导。

详情
AI中文摘要

随着大语言模型(LLMs)的快速发展,适配框架(harness)已成为在广泛领域部署智能体的关键基础设施。快速演变的适配框架生态系统也使得严格的能力评估愈发重要。然而,高效构建端到端、系统化且全面的评估流水线仍是一项重大挑战。为应对这一挑战,我们提出了A²E(Agent Auditing Engine,智能体审计引擎),这是一款专为智能体适配框架设计的端到端评估引擎。A²E利用我们新提出的智能体任务协议(Agent Task Protocol,ATP),实现了评估任务与不同适配框架的快速集成。通过自动插桩的监控器,它在实验过程中捕获并生成标准化的执行轨迹。在评估阶段,A²E使用一套多维指标系统地评估适配框架的能力。相较于仅评估正确性,这些指标能更细致地刻画适配框架在执行效率、工具使用、任务规划和错误恢复方面的差异。利用A²E开展的实验进一步表明,模型-适配框架组合在不同类型任务中表现出显著的性能差异,且没有任何一种组合能在所有任务中始终优于其他组合。这些发现不仅证明了系统化评估的必要性,还为模型与适配框架的协同演进提供了有用指导。我们的代码可在该https链接获取。

英文摘要

With the rapid advancement of large language models (LLMs), harnesses have become essential infrastructure for deploying agents across a wide range of domains. The fast-evolving harness ecosystem has also made rigorous capability evaluation increasingly important. However, efficiently building an end-to-end, systematic, and comprehensive evaluation pipeline remains a significant challenge. To address this challenge, we introduce $A^2E$ (Agent Auditing Engine), an end-to-end evaluation engine designed for agent harnesses. $A^2E$ leverages our newly proposed Agent Task Protocol (ATP) to enable the rapid integration of evaluation tasks with different harnesses. Through an automatically instrumented Monitor, it captures and generates standardized execution traces during experiments. In the Evaluation stage, $A^2E$ systematically assesses harness capabilities using a suite of multidimensional metrics. Compared with correctness alone, these metrics provide a more fine-grained characterization of differences among harnesses in execution efficiency, tool use, task planning, and error recovery. Experiments conducted with $A^2E$ further reveal that model-harness combinations exhibit substantial performance variation across different types of tasks, and that no single combination consistently outperforms all others across every task. These findings not only demonstrate the necessity of systematic evaluation but also provide useful guidance for the co-evolving of models and harnesses. Our code is available at this https URL.

URL PDF HTML 收藏
2608.07341 2026-08-10 cs.CL cs.AI 新提交

Zero Gap Is Not Restoration: Stratified Per-Question Probability Evaluation and Step-wise Mitigation of Benchmark Contamination

零差距并非恢复:分层逐题概率评估与基准污染的逐步缓解

Ruijie Hou, Yueyang Jiao, Zhao Wang, Yingming Li

机构 * Zhejiang University(浙江大学)

AI总结 该研究针对基准测试数据泄露导致的模型评估偏差问题,提出SA-PPG指标与RailCap方法,揭示现有缓解策略的恢复效果被高估,RailCap可实现更低的污染程度。

详情
AI中文摘要

公共基准的测试数据不可避免地会泄露到预训练语料库中,一旦被模型 memorize(记忆),就会夸大其评估分数。污染缓解评估会干预解码过程以抑制记忆并恢复受污染模型的真实能力,但目前流行的指标G-AP(Aggregate Performance的差距)存在缺陷:离散的正确/错误读数无法表征逐题性能,先平均再求差会导致过度抑制与抑制不足相互抵消,而统一的逐题权重会促使策略将求解概率推向干净模型的高频值。我们提出SA-PPG(Stratified Aggregate of Per-question Probability Gaps):通过采样估计每个问题的求解概率,将其与干净模型的逐题求解概率作差,并在干净模型求解概率定义的组内进行聚合。现有缓解策略首先估计污染所在位置,然后针对该估计进行操作,因此其准确性仅取决于估计的正确性。RailCap则在生成过程中判断污染:每当样本回退到贪心轨迹时,下一个轨迹 token(令牌)会被限制为亚军选项,累积抑制直到响应分布足够分散。在多个受污染模型和基准上的实验显示,SA-PPG表明先前策略的恢复效果被大幅高估,而RailCap实现了最低的SA-PPG值。

英文摘要

Test data from public benchmarks inevitably leaks into pretraining corpora, inflating evaluation scores once memorized. \textbf{Contamination mitigation evaluation} intervenes in the decoding process to suppress memorization and restore a contaminated model's genuine capability, but its prevailing metric, the \textbf{G-AP} (\textbf{G}ap of \textbf{A}ggregate \textbf{P}erformance), is flawed. Discrete correct/incorrect readouts cannot characterize per-question performance, averaging before differencing lets over- and under-suppression cancel out, and uniform per-question weighting invites strategies to push solve probabilities onto the clean model's high-frequency values. We propose \textbf{SA-PPG} (\textbf{S}tratified \textbf{A}ggregate of \textbf{P}er-question \textbf{P}robability \textbf{G}aps): estimate each question's solve probability by sampling, difference it against the clean model per question, and aggregate within groups defined by the clean model's solve probability. Existing mitigation strategies first estimate where contamination lies and then operate on the estimate, so they are only as correct as the estimate. \textbf{RailCap} instead judges contamination during generation: whenever a sample falls back onto the greedy trajectory, the next trajectory token is capped to the runner-up, accumulating suppression until the response distribution becomes sufficiently dispersed. Across multiple contaminated models and benchmarks, SA-PPG reveals that prior strategies' restoration is substantially overestimated, while RailCap attains the lowest SA-PPG.

URL PDF HTML 收藏
2608.07340 2026-08-10 cs.CV cs.AI 新提交

H2AL: Hyperbolic Hierarchy-aware Aggregative Learning for Registration-based Few-shot Medical Image Segmentation

H2AL:用于基于配准的小样本医学图像分割的双曲层次感知聚合学习

Jia Wang, Jiaming Cai, Zunying Hu, Zhanjie Wu, Jinyuan Liu, Hua Cheng, Yun Peng

机构 * Dalian University of Technology(大连理工大学) Chongqing University of Posts and Telecommunications(重庆邮电大学)

AI总结 针对基于配准的小样本医学图像分割忽视解剖结构层次的问题,提出H2AL框架,通过H2I模块与梯度聚合算法提升配准和分割性能,实验验证其有效性。

Comments 10 pages, 9 figures. Accepted at ACM Multimedia 2026 (MM '26)

详情
AI中文摘要

基于配准的小样本医学图像分割(RFMIS)旨在通过配准将已标记图像进行变形,从而为未标记图像生成伪标签。然而,现有方法主要在欧氏空间中执行像素级优化与推理,将解剖结构视为平坦且不相交的,这种对固有层次结构的忽视会降低伪标签质量,削弱模糊区域的区分度,进而限制分割性能。为应对该挑战,我们提出用于RFMIS的双曲层次感知聚合学习框架H2AL,可增强双任务学习的变形合理性与解剖区分度。具体而言,我们引入双曲层次感知注入(H2I)模块,利用双曲空间的层次建模能力,通过变换引导的监督双曲对比学习学习精确的层次感知表示,并通过门控注入块将此类层次先验注入欧氏空间,同时保留语义丰富性。此外,我们提出一种基于梯度聚合的端到端联合优化算法,其中将配准解码器与分割解码器的梯度(包含语义和层次线索)进行聚合,以更新共享编码器,促进跨任务的协作学习。在两个解剖区域的五种实验设置下开展的大量实验,证明了我们的方法在配准和分割任务上的有效性与效率,代码公开于该网址。

英文摘要

Registration-based Few-shot medical image segmentation (RFMIS) aims to generate pseudo-labels for unlabeled images by warping a labeled image through registration. However, existing methods primarily perform pixel-level optimization and inference in Euclidean space, treating anatomical structures as flat and disjoint. This neglect of inherent hierarchies degrades pseudo-label quality and weakens the discrimination of ambiguous regions, limiting the segmentation performance. To overcome this challenge, we propose a Hyperbolic Hierarchy-aware Aggregative Learning framework for RFMIS, termed H2AL, that enhances both deformation plausibility and anatomical discrimination for dual-task learning. Specifically, we introduce a Hyperbolic Hierarchy-aware Infusion (H2I) module, which leverages the hierarchical modeling capability of hyperbolic space to learn precise hierarchy-aware representations via transformation-guided supervised hyperbolic contrastive learning, and injects such hierarchical priors into Euclidean space through a gated infusion block while preserving semantic richness. Furthermore, we propose an end-to-end joint optimization algorithm by gradient aggregation, where the gradients from the registration and segmentation decoders, embedding semantic and hierarchical cues, are aggregated to update the shared encoder to promote collaborative learning across tasks. Extensive experiments on two anatomical regions, with five experimental settings, demonstrate the effectiveness and efficiency of our method in both registration and segmentation. The code is publicly available at this https URL.

URL PDF HTML 收藏
2608.07335 2026-08-10 cs.LG cs.AI 新提交

Aftab: A Comprehensive Benchmark of CNN Encoders and Advanced Value Functions in Parallelized Q-Networks

Aftab:并行Q网络中CNN编码器与高级价值函数的综合基准

Taha Shieenavaz, Shabnam Zareshahraki, Loris Nanni

机构 * University of Padua(帕多瓦大学)

AI总结 本研究针对并行Q网络,设计评估8种CNN拓扑并集成多种Q学习扩展,提出复合架构Aftab,在Atari-57与Procgen Hard基准上均优于基线,已开源。

详情
AI中文摘要

深度强化学习的近期进展愈发倾向于简化、高度并行化的范式,值得注意的是,并行Q网络(Parallelized Q-Network, PQN)算法可实现稳定的离策略学习,且无需依赖计算成本高昂的经验回放缓冲区或目标网络。然而,在这些无缓冲区设置下运行的视觉编码器的表征能力与参数效率仍未得到充分探索。本研究系统探究了适用于PQN的卷积神经网络(Convolutional Neural Networks, CNN)的架构设计空间,设计并严格评估了8种不同的CNN拓扑结构,在严格的参数约束下优化样本效率;此外,通过集成哈达玛编码范式(Hadamax encoding paradigm)及分布式、集成式、对决式(dueling heads)等高级Q学习扩展方法,研究了表征与价值估计增强的影响。在Atari-57基准上开展的大量实验表明,本研究提出的复合架构Aftab实现了6.479的四分位均值(Interquartile Mean, IQM)人类归一化得分,较标准PQN基线建立了0.86的改进概率;此外,在高度非平稳的Procgen Hard基准上进行的结构鲁棒性评估证实了分布外泛化能力,Aftab的IQM Procgen归一化得分为0.418,而基线为0.382。最终,本研究为无模型强化学习建立了高效、概率上更优的结构参考,同时保留了无缓冲区、并行化优化的简洁性与内存效率。完整的Aftab框架,包括所有模型定义、训练配置及原始实验日志,已开源并可在GitHub仓库获取:this https URL

英文摘要

Recent advancements in deep reinforcement learning have increasingly favored simplified, highly parallelized paradigms. Notably, the Parallelized Q-Network (PQN) algorithm achieves stable off-policy learning without relying on computationally expensive replay buffers or target networks. However, the representational capacity and parameter efficiency of visual encoders operating in these buffer-free settings remain underexplored. In this work, we systematically investigate the architectural design space of Convolutional Neural Networks for PQN. We design and rigorously evaluate eight distinct CNN topologies, optimizing for sample efficiency under strict parameter constraints. Furthermore, we study the impact of representation and value estimation enhancements by integrating the Hadamax encoding paradigm and advanced Q-learning extensions, including distributional, ensemble, and dueling heads. Extensive experiments on the Atari-57 benchmark demonstrate that our proposed composite architecture, Aftab, achieves an Interquartile Mean (IQM) Human-Normalized Score of 6.479, establishing a 0.86 Probability of Improvement over the standard PQN baseline. Additionally, structural resilience evaluations on the highly non-stationary Procgen Hard benchmark confirm out-of-distribution generalization, with Aftab yielding an IQM Procgen Normalized Score of 0.418 compared to the baseline's 0.382. Ultimately, this work establishes an efficient, probabilistically superior structural reference for model-free reinforcement learning, all while preserving the simplicity and memory efficiency of unbuffered, parallelized optimization. The complete Aftab framework, including all model definitions, training configurations, and raw experimental logs, is open-sourced and available on our GitHub repository: this https URL

URL PDF HTML 收藏
2608.07333 2026-08-10 cs.LG 新提交

When GNNs Fail: Quantifying and Overcoming Temporal Correlation Volatility in Time Series

当GNN失效:量化与克服时间序列中的时间相关性波动性

Chen Shao, Yue Wang, Zhenyi Zhu, Zhanbo Huang, Tobias Käfer, Zonghan Wu, Danai Koutra

机构 * Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院) The Hong Kong University of Science and Technology(香港科技大学) East China Normal University(华东师范大学) University of Michigan(密歇根大学)

AI总结 本研究提出时间相关性波动性(TCV)指标,发现高TCV下GNN等模型泛化差,进而提出GLIDE层,在合成与真实基准上使平均性能最高提升45.6%。

Comments 6 figures, 3 tables, 16 pages

详情
AI中文摘要

将多元时间序列表示为图(其中单个序列作为节点,成对时间相关性作为边)来建模的方法已获得广泛关注。图神经网络(GNN)的近期进展通过假设图拓扑为静态并聚合相邻序列的信息,展现出了出色的性能。在本研究中,我们调查了GNN在静态和动态设置(即成对相关性随时间发生剧烈演变)下用于预测的表示能力,并确定了当前架构的关键局限。为将此形式化,我们首先提出时间相关性波动性(TCV),这是一种与模型无关的指标,旨在量化这些潜在结构的分布演变。我们建立了TCV与性能下降之间的明确关联,证明包括Transformer在内的许多流行模型在高TCV设置下泛化能力差,且常常被简单的与结构无关的基线模型超越。为解决这些局限,我们提出动态环境推理图层(GLIDE),这是一种新型GNN层,由两种基于理论的设计机制增强:(D1)基于路径的消息传递,用于捕获基于路径的邻域;(D2)静态与动态传播分离,通过局部静态近似识别最优动态性。这些组件在动态拓扑下显著提升了学习效果,同时在静态场景中保持了鲁棒性。在合成数据集和真实世界基准上的大量实验表明,GLIDE在静态和动态设置下的平均性能提升最高达45.6%,最大增益达到85.7%。源代码可在此URL获取。

英文摘要

Modeling multivariate time series by representing them as graphs, where individual series act as nodes and pairwise temporal corre- lations serve as edges, has gained significant traction. Recent advances in Graph Neural Networks (GNNs) have demonstrated strong perfor- mance by assuming a static graph topology and aggregating information from neighboring series. In this work, we investigate the representa- tional power of GNNs for forecasting under both static and dynamic settings (i.e., when pairwise correlations evolve drastically over time) and identify critical limitations in current architectures. To formalize this, we first propose Temporal Correlation Volatility (TCV), a model- agnostic metric designed to quantify the distributional evolution of these latent structures. We establish a clear connection between TCV and performance degradation, demonstrating that many popular models, including Transformers, generalize poorly in high-TCV settings and are often outperformed by simple structure-agnostic baselines. To address these limitations, we propose Graph Layer for Inference in Dynamic En- vironments (GLIDE), a novel GNN layer enhanced by two theoretically grounded design mechanisms: (D1) Path-based Message Passing, which captures path-based neighborhoods and (D2) Static and Dynamic Propagation Separation, which identifies optimal dynamics via local static approximation. These components significantly improve learning under dynamic topology while preserving robustness in static scenarios. Ex- tensive experiments on synthetic and real-world benchmarks show that GLIDE improves average performance by up to 45.6% across static and dynamic settings, with the largest gain reaching 85.7%. The source code is available at this https URL.

URL PDF HTML 收藏
2608.07328 2026-08-10 cs.RO cs.LG 新提交

Learning Fault-Tolerant Locomotion with Adaptive Gait Timing

通过自适应步态时序学习容错运动

Giovanbattista Gravina, Luca Rossini, Carlo Rizzardo, Arturo Laurenzi, Nikos Tsagarakis

机构 * Italian Institute of Technology(意大利技术研究院)

AI总结 针对大型四足机器人执行器动力损失的容错运动问题,提出带潜在对齐损失的非对称Actor-Critic深度强化学习方法,通过自适应步态频率实现容错,经仿真与真实实验验证有效。

Comments Accepted at the 2026 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

详情
AI中文摘要

硬件故障要求四足机器人快速调整协调机制与步态时序以维持稳定性和移动能力,这对大型四足机器人尤为具有挑战性——其更大的质量和更严格的驱动限制,使得小型平台常用的激进高频补偿策略可行性降低。本研究提出一种用于执行器动力损失下容错运动的深度强化学习方法,该方法采用非对称Actor-Critic架构:Critic在训练期间可获取特权信息,Actor则需从本体感受观测中学习重构对应的潜在表示。我们引入潜在对齐损失以促使Actor与Critic表示保持一致;此外,我们在动作空间中增加可学习的步态频率参数,使机器人能响应地形变化与执行器退化实现自适应步态时序,无需预定义故障腿策略。该方法在不平地形的高保真仿真及68kg四足机器人的平地真实实验中得到验证。

英文摘要

Hardware failures require legged robots to rapidly reorganize coordination and gait timing to maintain stability and mobility. This is particularly challenging for larger quadrupeds, where increased mass and tighter actuation limits reduce the feasibility of aggressive, high-frequency compensation strategies often observed on smaller platforms. In this work, we propose a deep reinforcement learning approach for fault-tolerant locomotion under actuator power loss. The method employs an asymmetric actor-critic architecture in which the critic has access to privileged information during training, while the actor learns to reconstruct a corresponding latent representation from proprioceptive observations. We introduce a latent-alignment loss that encourages consistency between actor and critic representations. Additionally, we augment the action space with a learnable gait frequency parameter, enabling adaptive gait timing in response to terrain variations and actuator degradation without predefined faulty-leg strategies. The approach is validated in high-fidelity simulation on uneven terrain and real-world experiments on flat ground using a 68 kg quadruped robot.

URL PDF HTML 收藏