arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
全部学科分类 1711
2607.08772 2026-07-10 cs.CV 新提交

Wat3R: Underwater 3D Geometry Learning without Annotations

Wat3R:无需标注的水下3D几何学习

Jiangwei Ren, Xingyu Jiang, Zijie Song, Wei Xu, Hongkai Lin, Dingkang Liang, Xiang Bai

发表机构 * Huazhong University of Science and Technology(华中科技大学)

AI总结 针对水下3D几何估计难题,提出跨域半监督学习框架Wat3R,基于师生架构,无需标注水下数据,利用未标注视频学习,设计跨视图一致性损失,构建Water3D数据集,实验证明其在水下多视图深度估计和点云重建上性能优于现有方法。

Comments Accepted to ECCV 2026. The dataset and code are available at this https URL (https://github.com/LSXI7/Wat3R)

详情
AI中文摘要

由于光衰减、散射以及缺乏大规模高质量3D标注,水下环境中的3D几何估计面临独特挑战。开创性方法依赖大量密集标注,在水下环境不实用。本文提出Wat3R,一种跨域半监督学习框架,能将前馈3D重建模型从空中场景适配到水下。该方法基于师生架构,无需任何标注水下数据,仅通过大量未标注真实水下视频片段学习稳健几何表示。还设计了跨视图一致性损失,利用其他视图几何线索补偿当前视图因水衰减和散射造成的信息退化。鉴于缺乏综合评估基准,构建了Water3D数据集用于几何任务评估。实验结果表明Wat3R在水下多视图深度估计和点云重建方面优于当前最先进方法。

英文摘要

Estimating 3D geometry in underwater environments presents unique challenges due to light attenuation, scattering, and the absence of large-scale, high-quality 3D annotations. Pioneering methods rely on massive dense annotations that are impractical in underwater settings. In this paper, we propose Wat3R, a cross-domain semi-supervised learning framework designed to adapt feed-forward 3D reconstruction models from air to underwater scenes. Uniquely, our method eliminates the need for any annotated underwater data following a teacher-student architecture, that learns robust geometry representations merely on abundant unlabeled real underwater video footage. We also design a cross-view consistency loss that leverages geometric cues from other views to compensate for the information degradation in the current view caused by water attenuation and scattering. Furthermore, considering the lack of comprehensive evaluation benchmarks, we construct Water3D, a diverse dataset covering various water bodies and underwater scenarios, designed for geometric task evaluation. Experimental results demonstrate that Wat3R outperforms current state-of-the-art methods in underwater multi-view depth estimation and point cloud reconstruction. The dataset and code are available at this https URL.

URL PDF HTML
2607.08771 2026-07-10 cs.CV 新提交

ZipDepth: Bringing Lightweight Zero-Shot Monocular Depth Anywhere, on Any Device

ZipDepth:在任何设备上随时随地实现轻量级零样本单目深度估计

Fabio Tosi, Luca Bartolomei, Matteo Poggi, Stefano Mattoccia

发表机构 * University of Bologna(博洛尼亚大学)

AI总结 研究单目深度估计难题,提出ZipDepth轻量级网络,结合可重新参数化编码器-解码器与知识蒸馏,在多域训练集训练,参数仅610万,能在多设备实时运行,在五个基准测试中平衡零样本精度与部署效率,向高精度基础模型迈进。

Comments ECCV 2026. Code: this https URL (https://github.com/fabiotosi92/ZipDepth) - Project page: this https URL (https://zipdepth.github.io/)

详情
AI中文摘要

单目深度估计通过基础模型取得了显著进展,实现了强大的零样本泛化,但计算需求使其难以应用于嵌入式和移动平台。现有的轻量级替代方案几乎都是在单域、自监督范式下开发的,在域转移时表现不佳。我们提出了ZipDepth,这是一个紧凑的单目深度网络,通过将高效的可重新参数化编码器-解码器与来自基础模型在大型多域训练集上的大规模知识蒸馏相结合来弥合这一差距。ZipDepth仅包含610万个参数,从服务器GPU到功率受限设备都能实时运行,在五个基准测试中,在轻量级模型中实现了零样本精度和部署效率之间的最佳权衡,朝着参数多50倍的基础模型的精度迈出了重要一步。

英文摘要

Monocular depth estimation has seen remarkable progress through foundation models achieving robust zero-shot generalization, yet their computational demands place them far beyond the reach of embedded and mobile platforms. Lightweight alternatives exist, but have been developed almost exclusively within single-domain, self-supervised paradigms, failing silently under domain shift. We present ZipDepth, a compact monocular depth network that bridges this gap by combining an efficient reparameterizable encoder-decoder with large-scale knowledge distillation from a foundation model over a large multi-domain training set. Comprising just 6.1M parameters, ZipDepth runs at real-time rates from server GPUs to power-constrained devices, achieving the best trade-off between zero-shot accuracy and deployment efficiency among lightweight models across five benchmarks, taking a significant step towards the accuracy of foundation models with 50x more parameters.

URL PDF HTML
2607.08770 2026-07-10 cs.CV 新提交

LongE2V: Long-Horizon Event-based Video Reconstruction, Prediction, and Frame Interpolation with Video Diffusion Models

LongE2V:基于视频扩散模型的长时程基于事件的视频重建、预测和帧插值

Cheng-De Fan, Chun-Wei Tuan Mu, Chen-Wei Chang, Chin-Yang Lin, Kun-Ru Wu, Yu-Chee Tseng, Yu-Lun Liu

发表机构 * National Yang Ming Chiao Tung University(国立阳明交通大学)

AI总结 研究从稀疏事件流恢复高质量视频的难题,提出LongE2V方法,利用预训练视频扩散先验,通过微调基础模型实现联合处理视频重建、预测和帧插值,在多任务上优于现有方法,有高数据效率、时间连贯性和零样本泛化能力。

Comments SIGGRAPH 2026. Project page: this https URL (https://cdfan0627.github.io/LongE2V-page/)

详情
AI中文摘要

从稀疏事件流中恢复高质量视频是一项具有挑战性的任务。回归方法常常使纹理模糊,而现有的生成模型在长期稳定性方面存在困难。我们提出了LongE2V,一种利用预训练视频扩散先验来联合处理基于事件的视频重建、预测和帧插值的新方法。通过微调基础视频模型,该方法实现了高数据效率和卓越的感知质量。我们引入自回归展开和自适应上下文切换来减轻极长序列中的时间漂移。还提出了具有交叉残差校正的重新编码对齐,以确保帧插值期间的精确双向一致性。此外,事件体素密度增强确保了跨不同传感器分辨率的鲁棒性。在真实世界基准上的大量实验表明,LongE2V在所有三项任务上均优于现有方法,展现出卓越的时间连贯性和零样本泛化能力。

英文摘要

Recovering high-quality video from sparse event streams is a challenging task. Regression methods often blur textures, while existing generative models struggle with long-term stability. We propose LongE2V, a novel approach that leverages pre-trained video diffusion priors to jointly handle event-based video reconstruction, prediction, and frame interpolation. By fine-tuning a foundational video model, our approach achieves high data efficiency and superior perceptual quality. We introduce Autoregressive Unrolling and Adaptive Context Switching to mitigate temporal drift in extremely long sequences. We also propose Reencoding Alignment with Cross Residual Correction to ensure precise bidirectional consistency during frame interpolation. Furthermore, Event Voxel Density Augmentation ensures robustness across varying sensor resolutions. Extensive experiments on real-world benchmarks demonstrate that LongE2V outperforms state-of-the-art methods across all three tasks, exhibiting exceptional temporal coherence and zero-shot generalization. Project page: this https URL

URL PDF HTML
2607.08769 2026-07-10 cs.CV 新提交

Geometry and Gradient-based Partitioning for Panoramic Outdoor Reconstruction

基于几何和梯度的全景户外重建分区方法

Weijian Chen, Weibo Yao, Yuhang Zhang, Xiaolin Tang, Guo Wang, Weijun Zhang, Xitong Gao, Yihao Chen, Hongde Qin, Lu Qi

发表机构 * Insta360 Research(Insta360研究机构) Sun Yat-sen University(中山大学) South China University of Technology(华南理工大学) University of Chinese Academy of Sciences(中国科学院大学) Harbin Engineering University(哈尔滨工程大学) Wuhan University(武汉大学)

AI总结 针对大规模全景3D高斯点云重建成本高问题,提出PanoLOG两阶段框架,利用几何和梯度进行分区,粗阶段用天球建模等,细化阶段构建自适应边界体积等,还构建数据集,实现了高质量渲染和可扩展训练。

Comments Project Webpage: this https URL (https://insta360-research-team.github.io/GGPS-Website)

详情
AI中文摘要

将3D高斯点云扩展到大型户外场景在数据采集和计算方面成本高昂。采用等距投影全景图像可减少采集工作量,但现有基于局部相机视锥的分区策略会失效。为此提出PanoLOG,这是一个两阶段的粗到细框架,在全局粗阶段利用天球建模和全景单目深度监督,细化阶段通过视差驱动的不确定性构建自适应边界体积并基于梯度重要性评分分配相机。还构建了Pano360基准数据集。实验表明该方法在保持可扩展块并行训练的同时实现了一流的渲染质量。

英文摘要

Scaling 3D Gaussian Splatting (3DGS) to large outdoor scenes is costly in both data acquisition and computation. Adopting panoramic images with equirectangular projection (ERP) can reduce capture effort via their full $360^{\circ}$ field of view, yet the resulting omnipresent visibility invalidates existing partitioning strategies that rely on local camera frustums, causing block-wise optimization to degenerate into global training. Thus, we propose PanoLOG, a two-stage coarse-to-fine framework equipped with a Geometry and Gradient-based Partitioning Strategy tailored for large-scale panoramic 3DGS reconstruction. In the global coarse stage, PanoLOG leverages sky-sphere modeling and panoramic monocular depth supervision for reliable geometry, while in the refinement stage, G$^2$PS builds adaptive bounding volumes via parallax-driven uncertainty and assigns cameras via gradient-based importance scoring. Furthermore, we construct Pano360, the first benchmark on large-scale panoramic dataset for outdoor scene reconstruction. Extensive experiments demonstrate that G$^2$PS achieves state-of-the-art rendering quality while maintaining scalable, block-parallel training. Our models, training code, and dataset are publicly available.

URL PDF HTML
2607.08768 2026-07-10 cs.CL 新提交

UniClawBench: A Universal Benchmark for Proactive Agents on Real-World Tasks

UniClawBench:面向实际任务中主动智能体的通用基准测试

Zhekai Chen, Chengqi Duan, Kaiyue Sun, Bohao Li, Yuqing Wang, Manyuan Zhang, Xihui Liu

发表机构 * HKU MMLab(香港大学多媒体实验室) Meituan(美团)

AI总结 针对现有基准测试难以评估主动智能体的问题,提出UniClawBench,基于五项基础模型能力设计400个双语现实任务,采用实时评估和闭环评估策略,通过多模型框架对比展示基础模型能力和框架设计对性能的影响,还公开了基准测试和代码。

Comments Project Page: this https URL (https://uniclawbench.github.io) | GitHub Repo: this https URL (https://github.com/HKU-MMLab/UniClawBench)

详情
AI中文摘要

大语言模型和多模态大语言模型的快速发展加速了能操作日常工具并在现实环境中协助用户的主动智能体的出现。然而,现有基准测试难以有效评估此类智能体,存在依赖沙盒环境和单轮评估范式等问题。为此引入UniClawBench,首个能力驱动的基准测试,围绕五项基础模型能力构建,设计400个双语现实任务,采用实时评估和闭环评估策略,通过多模型框架对比展示了基础模型能力和智能体框架设计对性能的共同影响,并公开基准测试和代码。

英文摘要

The rapid development of large language models and multimodal large language models has accelerated the emergence of proactive agents capable of operating everyday tools and assisting users in real-world environments. However, existing benchmarks struggle to evaluate such agents effectively, as they often rely on sandboxed environments and single-turn evaluation paradigms. Moreover, their scenario-based task taxonomies mix multiple model capabilities within the same task category, making it difficult to identify the root causes of agent failures. To address these limitations, we introduce UniClawBench, the first capability-driven benchmark designed to evaluate proactive agents in dynamic, real-world settings. UniClawBench is built around five foundational model capabilities: Skill Usage, Exploration, Long-Context Reasoning, Multimodal Understanding, and Cross-Platform Coordination. Based on these capabilities, we design 400 bilingual real-world tasks. Unlike previous benchmarks that rely on static, pre-recorded answers, our benchmark evaluates agents in live Docker containers using fine-grained, step-by-step completion checkpoints. Furthermore, we design a closed-loop evaluation strategy comprising an executor agent, a hidden supervisor agent, and a user agent to simulate realistic multi-turn human feedback without leaking grading criteria. To disentangle base model capabilities from framework-level design choices, we evaluate state-of-the-art models under multiple agent frameworks. Through comprehensive comparisons across both models and frameworks, we show how base model capabilities and agent framework designs jointly shape performance in real-world environments. To facilitate future research, we make our benchmark and code publicly available at this https URL.

URL PDF HTML
2607.08766 2026-07-10 cs.CV 新提交

OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generators

OPSD-V:用于训练后少步自回归视频生成器的策略内自蒸馏

Hongyu Liu, Chun Wang, Feng Gao, Xuanhua He, Yue Ma, Ziyu Wan, Yong Zhang, Xiaoming Wei, Qifeng Chen

发表机构 * Meituan(美团) HKUST(香港科技大学) City University of Hong Kong(香港城市大学)

AI总结 研究针对训练后少步自回归视频生成器存在的问题,提出OPSD-V策略内自蒸馏范式。通过引入真实长视频数据提供监督,学生和教师模型按特定方式运行,应用该范式于相关模型后,实验及用户研究表明其在多方面有改进且更受青睐。

Comments Project page: this https URL (https://meigen-ai.github.io/OPSD-V); Code: this https URL (https://github.com/MeiGen-AI/OPSD-V)

详情
AI中文摘要

我们提出了OPSD-V,一种用于训练后少步自回归(AR)视频扩散模型的策略内自蒸馏范式。现有的少步AR视频生成器能以低延迟生成长视频,但在长时间自回归展开过程中仍存在误差累积和运动动力学减弱的问题。OPSD-V减少了长时退化,同时保留了原始的少步推理路径。关键在于在训练期间引入真实长视频数据作为时间上下文,并利用它提供密集的轨迹级监督。具体而言,学生模型遵循推理时的展开方式,根据自身先前生成的KV缓存生成每个块。同时,教师模型在相同的去噪状态下进行评估,但使用更干净的与AR一致的时间缓存,其中旧历史可以被真实视频上下文替换。这在策略内AR缓存动态下提供了密集的去噪级校正目标,而不改变采样器、去噪步数或推理时的缓存机制。我们将OPSD-V应用于代表性的少步AR视频模型,包括Self-Forcing和LongLive。实验表明在视觉质量、运动动力学和VBenchLong分数方面有持续改进。一项有10名参与者比较20对视频的用户研究表明,在66.0%的总体偏好判断中(排除平局后为82.5%),OPSD-V比基础模型更受青睐。

英文摘要

We propose OPSD-V, an on-policy self-distillation paradigm for post-training few-step autoregressive (AR) video diffusion models. Existing few-step AR video generators can produce long videos with low latency, but still suffer from error accumulation and weakened motion dynamics during long autoregressive rollout. OPSD-V reduces long-horizon degradation while preserving the original few-step inference path. The key idea is to introduce real long-video data as temporal context during training and use it to provide dense trajectory-level supervision. Specifically, the student follows the exact inference-time rollout, generating each chunk conditioned on its own previously generated KV cache. In parallel, the teacher is evaluated at the same student-visited denoising states, but uses a cleaner AR-consistent temporal cache in which older history can be replaced by real-video context. This provides dense denoising-level corrective targets under on-policy AR cache dynamics, without changing the sampler, number of denoising steps, or inference-time cache mechanism. We apply OPSD-V to representative few-step AR video models, including Self-Forcing and LongLive. Experiments show consistent improvements in visual quality, motion dynamics, and VBenchLong scores. A user study with 10 participants comparing 20 video pairs shows that OPSD-V is preferred over the base models in 66.0% of overall-preference judgments (82.5% excluding ties).

URL PDF HTML
2607.08765 2026-07-10 cs.CV 新提交

Enhancing In-context Panoramic Generation via Geometric-aware Pretraining

通过几何感知预训练增强上下文全景生成

Haoran Feng, Ruiyang Zhang, Longyi Zhang, Dizhe Zhang, Lu Qi

发表机构 * Insta360 Research(影石创新研究院) Tsinghua University(清华大学) Beihang University(北京航空航天大学) Wuhan University(武汉大学)

AI总结 该研究提出两阶段框架Canvas360用于上下文全景生成,结合几何感知预训练与微调。通过构建数据集及特定建模方法,增强文本到全景生成,经实验验证其能提高全景图像保真度,在相关指标上表现优异。

详情
AI中文摘要

在这项工作中,我们提出了Canvas360,这是一个用于上下文全景生成的两阶段框架,它将几何感知预训练与下游任务特定的微调相结合。为解决缺乏针对上下文全景任务的大规模、高质量训练数据的问题,我们提出了Canvas360Dataset,它包含100万个用于风格迁移、图像修复、图像扩展和编辑的高质量配对全景样本。在建模方面,Canvas360通过并行深度生成、速度循环填充和相似性损失正则化来增强文本到全景的生成。实验表明,Canvas360提高了全景图像保真度,在全景特定的FAED指标上表现出色,并在定量评估中取得了有竞争力或领先的结果。

英文摘要

In this work, we present Canvas360, a two-stage framework for in-context panoramic generation that combines geometry-aware pretraining with downstream task-specific fine-tuning. To address the lack of large-scale, high-quality training data tailored to in-context panoramic tasks, we propose Canvas360Dataset, a collection of 1M high-quality paired panoramic samples for style transfer, inpainting, outpainting, and editing, enabling effective supervision across diverse in-context generation scenarios. On the modeling side, Canvas360 enhances text-to-panorama generation through parallel depth generation, velocity circular padding, and similarity loss regularization, enabling the model to learn geometry-aware representations, capture object distortion details, and improve geometric consistency and global coherence. Furthermore, empowered by strong panoramic priors, Canvas360 enables a unified in-context panoramic generation framework that supports diverse downstream tasks via token-level concatenation, surpassing prior methods in both task coverage and modeling flexibility. Extensive experiments show that Canvas360 improves panoramic image fidelity, achieving particularly strong performance on the panorama-specific FAED metric and competitive or leading results across the reported quantitative evaluations. More information can be found on our project page: this https URL

URL PDF HTML
2607.08763 2026-07-10 cs.CV cs.AI 新提交

OpenCoF: Learning to Reason Through Video Generation

OpenCoF:通过视频生成学习推理

Xinyan Chen, Ziyu Guo, Renrui Zhang, Dongzhi Jiang, Hongsheng Li

发表机构 * CUHK MMLab(香港中文大学多媒体实验室) CUHK IMIXR(香港中文大学IMIXR)

AI总结 研究针对视频生成中帧链推理缺乏多样监督和专门设计的问题,引入OpenCoF框架,含OpenCoF - 17K数据集和Wan - CoF模型。通过实验探索先进设计,发现视频推理需广泛时间监督和明确机制,还开源相关资源促进研究。

Comments Project Page: this https URL (https://opencof.github.io/)

详情
AI中文摘要

推理已成为大型模型的核心能力,尤其是在可靠决策需要理解逻辑后果时。近期视频生成模型提供了与先前思维链(CoT)不同的推理路径:通过时间上相连的帧进行推理,即帧链(CoF)推理。然而,现有视频生成器主要在通用视频语料库上训练,缺乏针对CoF推理的多样监督和专门设计。为填补这一空白,我们引入OpenCoF框架,包括OpenCoF - 17K数据集(跨越11个任务族的推理视频数据集)和Wan - CoF(用于研究多样时间监督是否改善CoF行为的微调视频模型)。在四个视频推理基准测试中,Wan - CoF相对于Wan2.2 - I2V - A14B基线取得了显著提升。在此基础上,我们通过实验探索了更先进的CoF能力设计,即给模型配备视觉和文本推理令牌。该机制分别捕获用于空间和时间推理的低级视觉线索和高级语义先验。通过性能比较和注意力分析,我们研究了这些令牌在模型深度、去噪步骤、空间和时间上的贡献。我们的结果表明,更强的视频推理需要广泛的时间监督和组织中间推理状态的明确机制。我们开源了数据集、模型和代码以促进未来面向推理的视频生成研究。

英文摘要

Reasoning has become a core capability for large models, especially when reliable decisions require understanding logical consequences. Recent video generation models offer a reasoning path distinct from previous Chain-of-Thought (CoT): reasoning can unfold through temporally connected frames, known as Chain-of-Frame (CoF) reasoning. However, existing video generators are primarily trained on general video corpora, still lacking diverse supervision and dedicated designs for CoF reasoning. To address this gap, we introduce OpenCoF, a framework comprising the OpenCoF-17K dataset, a reasoning video dataset spanning 11 task families, and Wan-CoF, a fine-tuned video model for studying whether diverse temporal supervision improves CoF behavior. Across four video reasoning benchmarks, Wan-CoF achieves considerable gains over the Wan2.2-I2V-A14B baseline. Building on this, we empirically explore more advanced designs for CoF capabilities, i.e., equipping the model with visual and textual reasoning tokens. This mechanism respectively captures low-level visual cues and high-level semantic priors for spatial and temporal reasoning. Through performance comparisons and attention analysis, we examine how these tokens contribute across model depth, denoising steps, space, and time. Our results suggest that stronger video reasoning requires both broad temporal supervision and explicit mechanisms for organizing intermediate reasoning state. We open-source the dataset, model, and code to facilitate future research on reasoning-oriented video generation.

URL PDF HTML
2607.08756 2026-07-10 cs.SD cs.LG 新提交

MulTTiPop: A Multitrack Transcription Dataset for Pop Music

MulTTiPop:一个用于流行音乐的多轨转录数据集

Nathan Pruyne, Benjamin Stoler, William Chen, Chien-yu Huang, Shinji Watanabe, Chris Donahue

发表机构 * Carnegie Mellon University(卡内基梅隆大学)

AI总结 介绍用于评估自动音乐转录模型的MulTTiPop数据集,通过对Lakh MIDI和TheoryTab数据集歌曲片段基于元数据匹配等方式收集,评估模型发现有改进空间,最佳模型起始F1得分为38%。

Comments 8 pages, 4 figures. Associated web preview available at this https URL (https://gclef-cmu.org/multtipop)

详情
AI中文摘要

我们展示了MulTTiPop,这是一个用于评估自动音乐转录模型的流行音乐片段及其相关多轨MIDI录音的数据集。MulTTiPop包含572个流行音乐片段,总计3.5小时音频,涵盖了从20世纪30年代到21世纪不同流派和年代的歌曲。为收集该数据集,我们对Lakh MIDI和TheoryTab数据集中的歌曲片段进行基于元数据的匹配,手动识别音频和MIDI之间的锚点节拍,然后对音频进行节拍跟踪并使MIDI变形以匹配其节奏和时间。我们在MulTTiPop上评估了最先进的自动音乐转录模型,发现仍有很大改进空间,最佳模型的起始F1得分为38%。更多MulTTiPop的详细信息和声音示例可在该https网址获取。

英文摘要

We present MulTTiPop, a dataset of pop music segments and their associated multitrack MIDI recordings for the evaluation of automatic music transcription models. MulTTiPop contains 572 segments of popular music totaling 3.5 hours of audio, and contains songs from diverse genres and decades from the 1930s to 2000s. To collect this dataset, we perform metadata-based matching on song segments from the Lakh MIDI and TheoryTab datasets, manually identify an anchor beat between the audio and MIDI, then use beat tracking on the audio and warp the MIDI to match its tempo and timing. We evaluate state-of-the-art automatic music transcription models on MulTTiPop and find substantial room for improvement, with the best model achieving 38% Onset F1. More details and sound examples of MulTTiPop are available at this https URL.

URL PDF HTML
2607.08754 2026-07-10 cs.LG cs.AI 新提交

SLORR: Simple and Efficient In-Training Low-Rank Regularization

SLORR:简单高效的训练中低秩正则化

David González-Martínez, Shiwei Liu

发表机构 * Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所) University of Tübingen(图宾根大学) ELLIS Institute Tübingen(图宾根ELLIS研究所) Tübingen AI Center(图宾根人工智能中心)

AI总结 研究针对神经网络低秩正则化难题,提出简单无状态的SLORR框架,基于霍耶尔稀疏性度量和核范数有两个变体,通过GPU友好近似正则化权重矩阵,在ImageNet-1K及LLM预训练中验证其能在低开销下诱导可压缩性并保持性能。

详情
AI中文摘要

低秩分解广泛用于压缩神经网络,但现代模型往往难以在不显著损失精度的情况下进行激进分解。现有训练时低秩正则化方法存在局限。为此引入SLORR,一种简单、无状态且保持架构的训练中低秩正则化框架,有基于霍耶尔稀疏性度量和核范数的两个主要变体。通过GPU友好近似直接对原始权重矩阵正则化,给出近似保证。在ImageNet-1K和LLM预训练中评估,结果显示其在引入较少训练开销时能诱导可压缩性并保持性能。

英文摘要

Low-rank factorization is widely used to compress neural networks, but modern models are often not naturally amenable to aggressive factorization without significant accuracy loss. Existing training-time low-rank regularizers can improve compressibility, but they often require SVDs of large weight matrices, modify the model architecture (introducing additional trainable parameters), or rely on stateful cached quantities. To address these limitations, we introduce SLORR, a simple, stateless, and architecture-preserving framework for in-training low-rank regularization, instantiated with two main variants based on the Hoyer sparsity metric and the nuclear norm. SLORR directly regularizes the original weight matrices using GPU-friendly approximations for the forward and backward passes of the regularizers, for which we provide approximation guarantees. We first evaluate SLORR on ImageNet-1K across short-horizon continued training of ResNet-50, ViT-B/16, and ViT-L/16, and pretraining of ResNet-18, where SLORR induces compressibility while introducing less than 8% training overhead. We further evaluate SLORR-Hoyer in LLM pretraining at 135M and 560M scales: SLORR-trained compressed models preserve performance substantially better than unregularized models while adding less than 1% average training overhead.

URL PDF HTML
2607.08751 2026-07-10 cs.RO 新提交

DexVerse: A Modular Benchmark for Multi-Task, Multi-Embodiment Dexterous Manipulation

DexVerse:用于多任务、多实体灵巧操作的模块化基准测试

Yunchao Yao, Zhuxiu Xu, Tianqi Zhang, Zixian Liu, Sikai Li, Zhenyu Wei, Feng Chen, Dihong Huang, Kechang Wan, Chenyang Ma, Shuqi Zhao, Shenghua Gao, Masayoshi Tomizuka, Yi Ma, Mingyu Ding

发表机构 * UNC-Chapel Hill(北卡罗来纳大学教堂山分校) The University of Hong Kong(香港大学) UC Berkeley(加州大学伯克利分校)

AI总结 DexVerse是用于多任务、多实体灵巧操作的模块化基准测试,含100个任务,支持多种机器人手臂和手,可扩展且提供视觉变化等。通过对多种方法的基准测试,揭示任务泛化和视觉运动鲁棒性挑战,为通用灵巧操作提供测试平台。

详情
AI中文摘要

构建通用灵巧操作策略需要超越孤立任务的基准测试,以系统评估跨多种交互模式、感官条件和机器人实体的策略。现有基准测试在任务和数据多样性、实体覆盖范围或可控视觉变化方面存在局限。我们提出了DexVerse,一个用于灵巧操作的大规模模块化基准测试。它包含100个任务,支持3种机器人手臂和6种灵巧手,可扩展新任务等。提供可配置视觉变化、VR远程操作界面和3180个演示。通过对代表性方法的基准测试,揭示了任务泛化和视觉运动鲁棒性的重大挑战,使其成为通用灵巧操作的有前景的测试平台。

英文摘要

Building general-purpose dexterous manipulation policies requires benchmarks that go beyond isolated tasks to systematically evaluate policies across diverse interaction modes, sensory conditions, and robot embodiments. However, existing benchmarks remain limited in task and data diversity, embodiment coverage, or controllable visual variation, hindering studies of cross-task and cross-embodiment generalization. We present DexVerse, a large-scale and modular benchmark for dexterous manipulation. DexVerse includes 100 tasks spanning a broad range of manipulation skills, including object grasping and relocation, articulated-object interaction, functional tool use, bimanual coordination, non-prehensile control, contact-rich behaviors, multi-goal execution, and long-horizon multi-stage task completion. It supports 3 robot arms and 6 dexterous hands, and is extensible to new tasks, assets, and embodiments. To evaluate visuomotor generalization, DexVerse provides configurable visual variations in textures, background, lighting, and camera viewpoints. We further provide a VR-based teleoperation interface and 3,180 demonstrations with synchronized proprioceptive, RGB, depth, point-cloud, and state observations. We benchmark representative methods, including Diffusion Policy, DP3, OpenVLA, and $\pi_{0.5}$, across 19 tasks. Results reveal substantial challenges in task generalization and visuomotor robustness, establishing DexVerse as a promising testbed for general-purpose dexterous manipulation. Project page: this https URL

URL PDF HTML
2607.08748 2026-07-10 cs.AI cs.HC 新提交

Using AI-based Learning Assistants in Higher Education: A Large-Scale Descriptive Analysis

在高等教育中使用基于人工智能的学习助手:大规模描述性分析

Kristina Schaaff, Quintus Stierstorfer, Valerie Heckel

发表机构 * IU International University of Applied Sciences(IU国际应用科学大学)

AI总结 该研究基于77543名远程学习学生的日志数据,对基于人工智能的学习助手Syntea在高等教育中的使用进行大规模描述性分析,识别其在不同群体中的使用模式,为相关学习支持发展提供实证基础及大规模分析。

详情
AI中文摘要

在本研究中,我们对高等教育中基于人工智能的学习助手(Syntea)的使用进行了大规模描述性分析。基于77543名远程学习学生的客观日志数据,我们研究了不同性别、年龄组、学习集群、学位和学习模式的使用模式。目前,关于教育聊天机器人的现有研究很大程度上依赖于相对较小的样本和自我报告的调查数据,而关于实际使用行为的大规模证据仍然有限。我们的研究结果表明,Syntea已经融入了许多学习者的学习日常,但使用情况因人口统计学和结构背景而异。通过识别这些模式,我们的研究为基于人工智能的学习支持的进一步发展提供了实证基础,并为高等教育中教育聊天机器人的使用提供了大规模分析。

英文摘要

In this study, we present a large-scale descriptive analysis of the use of an AI-based learning assistant (Syntea) in higher education. Based on objective log data from 77,543 students enrolled in distance studies, we examine usage patterns across gender, age group, study cluster, degree, and study mode. To date, existing research on educational chatbots has largely relied on comparatively small samples and self-reported survey data, while large-scale evidence on actual usage behavior remains limited. Our findings show that Syntea is already embedded in the study routines of many learners, but that usage differs across demographic and structural contexts. By identifying these patterns, our study provides an empirical basis for the further development of AI-based learning support and contributes a large-scale analysis of educational chatbot usage in higher education.

URL PDF HTML
2607.08746 2026-07-10 cs.LG cs.AI cs.DS cs.HC 新提交

Dimensionality Reduction Meets Network Science: Sensemaking on UMAP's kNN Graph

降维与网络科学相遇:UMAP的kNN图上的意义建构

Duen Horng Chau, Donghao Ren, Fred Hohman, Dominik Moritz

发表机构 * Apple(苹果公司)

AI总结 研究探索UMAP内部kNN图的潜力,应用PageRank、k核分解和聚类系数等标准图算法增强数据意义建构,经对MNIST和Fashion MNIST评估,证明这些基于图的分析实用且与专门方法有竞争力或互补。

Comments Code and demo: this https URL (https://apple.github.io/embedding-atlas/)

详情
AI中文摘要

虽然UMAP广泛用于探索高维数据,但典型工作流程侧重于其低维嵌入,很大程度上忽略了UMAP内部构建的丰富k近邻(kNN)图。该图在UMAP的二维投影引入失真之前,在其原始高维空间中对数据流形进行编码。我们展示了这种内部表示的未开发潜力,表明应用于该图的标准图算法如何增强数据意义建构:(1)PageRank识别代表性数据点,(2)k核分解揭示密集核心区域与稀疏外围,(3)聚类系数检测具有高度相似数据点的紧密邻域。通过对MNIST和Fashion MNIST的定量和定性评估,我们表明这些基于图的分析不仅实用,而且与专门方法(如用于样本选择的k-medoids、用于基于密度聚类的HDBSCAN)具有竞争力或互补性。

英文摘要

While UMAP is widely used for exploring high-dimensional data, typical workflows focus on its lower-dimensional embedding, largely overlooking the rich k-nearest-neighbor (kNN) graph that UMAP constructs internally. This graph encodes the data manifold in its original high-dimensional space, before the distortion that UMAP's 2D projection introduces. We demonstrate the untapped potential of this internal representation, showing how standard graph algorithms applied to this graph enhance data sensemaking: (1) PageRank identifies representative data points, (2) k-core decomposition reveals dense core regions versus sparse periphery, and (3) clustering coefficient detects tight-knit neighborhoods with highly-similar data points. Through quantitative and qualitative evaluation on MNIST and Fashion MNIST, we show that these graph-based analyses are not only practical but also competitive with or complementary to purpose-built methods (e.g., k-medoids for exemplar selection, HDBSCAN for density-based clustering).

URL PDF HTML
2607.08745 2026-07-10 cs.AI cs.CV 新提交

AUTOPILOT VQA: Benchmarking Vision-Language Models for Incident-Centric Dashcam Understanding

自动驾驶视觉问答:以事件为中心的行车记录仪理解视觉语言模型基准测试

Siddharth Damodharan, Radhika Gupta, Ali Alshami, Ryan Rabinowitz, Jugal Kalita

发表机构 * University of Colorado Colorado Springs(科罗拉多大学科罗拉多斯普林斯分校) University of Michigan(密歇根大学) University of Notre Dame(圣母大学)

AI总结 针对评估视觉语言模型对安全关键事件推理能力的挑战,提出AUTOPILOT-VQA基准,通过围绕真实驾驶事件的结构化问题评估系统,涵盖多安全相关类别,推动向安全意识推理发展,为自动驾驶系统评估提供标准,助力相关视觉语言系统开发。

Comments CVPR Autopilot Workshop

详情
AI中文摘要

视觉语言模型、大语言模型和多模态大语言模型的进展改善了自动驾驶任务,但评估这些模型能否可靠推理安全关键事件仍具挑战。为此提出AUTOPILOT-VQA,一个以事件为中心的行车记录仪视频理解视觉问答基准。该数据集通过围绕真实驾驶事件及近事件设计的结构化问题评估不同系统,涵盖多种安全相关类别。通过要求模型回答关于上下文场景属性和事件级事件细节的有根据问题,推动从目标识别向时间上有根据、安全意识推理发展。数据集作为AUTOPILOT CVPR 2026竞赛一部分发布,为评估自动驾驶系统在不同场景下的可靠性提供标准化基准,支持开发更具可解释性、鲁棒性和安全意识的视觉语言系统。

英文摘要

Recent advances in Vision-Language Models, Large Language Models, and Multimodal Large Language Models have improved autonomous driving tasks such as scene understanding, decision making, trajectory prediction, and visual question answering. However, evaluating whether these models can reliably reason about safety-critical incidents remains challenging. To address this gap, we present AUTOPILOT-VQA, an incident-centric visual question answering benchmark for dashcam video understanding. The dataset evaluates different systems through structured questions designed around real-world driving incidents and near-incidents. The benchmark covers diverse safety-relevant categories, including weather and lighting conditions, traffic environment, road layout, road surface state, signage, involved entities, accident occurrence, impact location, and avoidability-related reasoning. By requiring models to answer grounded questions about both contextual scene properties and event-level incident details, AUTOPILOT-VQA moves beyond object recognition toward temporally grounded, safety-aware reasoning. The dataset is released as part of the AUTOPILOT CVPR 2026 competition and provides a standardized benchmark for assessing the reliability of autonomous driving systems in different scenarios. Our benchmark support developments for more interpretable, robust, and safety-conscious vision-language systems for real-world autonomous driving.

URL PDF HTML
2607.08742 2026-07-10 cs.RO 新提交

ContactMimic: Humanoid Object Interaction via Contact Control

ContactMimic:通过接触控制实现人形机器人与物体交互

Xinyao Li, Xialin He, Runpei Dong, Saurabh Gupta

发表机构 * University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

AI总结 研究针对人形机器人物体交互任务,提出CONTACTMIMIC学习框架,通过接触跟随奖励和轨迹增强方案,使策略解耦接触行为与关键点几何,实现接触可控性,仿真与现实实验验证其有效性及优于仅关键点跟踪器。

Comments Project page: this https URL (https://lixinyao11.github.io/contactmimic-page)

详情
AI中文摘要

仅关键点跟踪不足以完成诸如坐在椅子上、擦黑板或推家具等物体交互任务,在这些任务中机器人能到达正确姿势却未与物体进行有意义的物理接触。我们提出CONTACTMIMIC,这是一个学习框架,它在跟踪关键点轨迹的同时跟踪明确的部分级二进制接触命令。通过使用接触跟随奖励和旨在打破关键点轨迹与接触标签之间相关性的轨迹增强方案实现CONTACTMIMIC。结果表明该策略成功将接触行为与关键点几何解耦,实现精确物理接触和接触可控性。在10种不同的人机交互运动上的仿真实验证实CONTACTMIMIC具有接触可控性,能在无特定任务奖励下完成操作任务,且在接触相关任务上优于仅关键点跟踪器。消融实验证实了所提出轨迹增强方案的必要性,模拟到现实部署验证了在现实世界中5种不同运动的接触可控性。

英文摘要

Keypoint tracking alone is insufficient for object interaction tasks such as sitting on a chair, wiping a board, or pushing furniture, where the robot can reach the correct pose without making meaningful physical contact with the object. We present CONTACTMIMIC, a learning framework that tracks explicit partlevel binary contact commands alongside keypoint trajectories. CONTACTMIMIC is made possible through the use of contact-following rewards and a trajectory augmentation scheme aimed at breaking the correlations between keypoint trajectories and contact labels. The resulting policy successfully decouples contact behavior from keypoint geometry, and achieves precise physical contact as well as contact-controllability (produce or suppress contact during deployment as desired). Simulation experiments across 10 diverse human-object interaction motions confirm that CONTACTMIMIC exhibits contact controllability that enables it to complete manipulation tasks without task-specific rewards, while also outperforming keypoint-only trackers on contact-relevant tasks. Ablations confirm the necessity of the proposed trajectory augmentation scheme and sim2real deployment validates contact controllability in the real world across 5 different motions. Video results are available on this https URL.

URL PDF HTML
2607.08740 2026-07-10 cs.AI cs.PL cs.SE 新提交

Workflow as Knowledge: Semantic Persistence for LLM-Mediated Workflows

作为知识的工作流:大语言模型介导的工作流的语义持久性

Emanuele Quinto, Carlo Andrea Rozzi, Francesco Zanitti

发表机构 * UNHCR København(联合国难民署哥本哈根办事处) CNR—Istituto Nanoscienze Modena(意大利国家研究委员会-纳米科学研究所摩德纳分所) ZeLe & F ApS København(泽勒与F有限公司哥本哈根分公司)

AI总结 研究大语言模型介导的工作流,提出受Lisp启发的概念模型,用符号形式等作解释视角,将工作流相关元素表示为持久知识对象,区分派生和推理,初步阐述了工作流的语义持久性。

Comments 39 pages, 18 figures

详情
AI中文摘要

大语言模型(LLM)应用越来越多地使用显式工作流进行工具使用、检索、分支、检查点设置和人工审批。现有工作流系统已解决许多执行问题。本文提出了一个受Lisp启发但与语言无关的概念模型,将符号形式、对象标识和实时图像思维用作解释视角而非实现承诺。在该模型中,工作流定义、实例、推理记录、上下文快照和依赖关系被表示为共享知识基础中的持久知识对象。其核心语义区别在于派生和推理,派生是对可用状态的确定性计算,推理是在声明的上下文和执行器控制的能力策略下由LLM介导的判断。结果是对语义持久性的初步概念性说明,工作流不仅产生知识并留下痕迹,还可自身表示为可检查、可恢复和可审查的知识对象,而形式转换语义仍是未来工作。

英文摘要

Large language model (LLM) applications increasingly use explicit workflows for tool use, retrieval, branching, checkpointing, and human approval. Existing workflow systems already address many execution concerns. This paper proposes a Lisp-inspired but language-independent conceptual model: symbolic forms, object identity, and live-image thinking are used as explanatory lenses, not implementation commitments. In this model, workflow definitions, workflow instances, inference records, context snapshots, and dependency relations are represented as persistent knowledge objects in a shared knowledge substrate. Its central semantic distinction is between derive and infer: derive is deterministic computation over available state; infer is mediated LLM judgment under declared context and executor-controlled capability policy. The result is a preliminary conceptual account of semantic persistence: workflows do not merely produce knowledge and leave traces, but can themselves be represented as inspectable, resumable, and reviewable knowledge objects, while formal transition semantics remain future work.

URL PDF HTML
2607.08735 2026-07-10 cs.RO 新提交

Learning Adaptive Solvers for Distributed Factor Graph Optimization on Matrix Lie Groups

学习用于矩阵李群上分布式因子图优化的自适应求解器

Jaeho Shin, Maani Ghaffari, Yulun Tian

发表机构 * University of Michigan(密歇根大学)

AI总结 针对机器人感知中大规模几何优化问题,提出DeepCORD框架,通过展开黎曼优化器为可微迭代,学习自监督反馈策略动态调整参数,实验证明该方法在分布式因子图优化上效果优于现有基线。

详情
AI中文摘要

现代机器人感知涉及跨多个机器人或会话的大规模几何优化问题。现有分布式求解器常依赖脆弱的手动调优且主要针对刚体姿态图。为此,我们提出DeepCORD,一个用于一般矩阵李群上分布式因子图优化的学习增强框架。通过将并行加速的黎曼优化器展开为可微迭代,它学习自监督反馈策略以根据优化阶段和通信状态动态调整求解器参数。实验表明该方法在多数基准测试中目标值更低。

英文摘要

Modern robotic perception increasingly involves large-scale geometric optimization problems distributed across multiple robots or sessions. However, existing distributed solvers often depend on brittle hand tuning and primarily target rigid body pose graphs. To address this, we present DeepCORD, a learning-augmented framework for distributed factor graph optimization on general matrix Lie groups. By unfolding a parallel and accelerated Riemannian optimizer into differentiable iterations, DeepCORD learns a self-supervised feedback policy that dynamically adapts solver parameters according to the optimization phase and communication status. The resulting method enables adaptive distributed optimization over matrix Lie groups under both synchronous and asynchronous communication regimes. Extensive experiments on real-world $\mathrm{SE}$(3) pose graph optimization and $\mathrm{SL}$(4) projective submap alignment show that our method achieves lower objective values than existing distributed baselines on most benchmarks across realistic operating scenarios.

URL PDF HTML
2607.08734 2026-07-10 cs.AI 新提交

The Illusion of Equivalency: Statistical Characterization of Quantization Effects in LLMs

等效性错觉:大语言模型量化效应的统计表征

Baha Rababah, Cuneyt Gurcan Akcora, Carson K. Leung

发表机构 * University of Manitoba(曼尼托巴大学) Red River College Polytechnic(红河理工学院) University of Central Florida(中佛罗里达大学)

AI总结 研究大语言模型量化效应,引入正确性一致性指标,发现适度量化下有行为差异,通过分析量化为结构算子及量化失真,揭示低比特宽度非线性断点等,促使超越传统指标评估行为。

详情
AI中文摘要

训练后量化广泛用于在资源受限环境中部署大语言模型,但其评估几乎完全依赖于准确性和困惑度。我们表明这些指标无法捕捉量化引起的行为变化。我们引入正确性一致性,这是一种决策级指标,用于衡量基础模型与其量化变体之间正确预测的重叠,与绝对准确性无关。在从8位到2位的多个模型和量化方案中,我们发现即使任务性能似乎保持不变,适度量化下也会出现行为差异。为了解释这种效应,我们将量化分析为注意力权重上的结构算子,并使用统计和分布度量来量化逐层失真。我们的结果揭示了低比特宽度下的非线性断点,并表明查询和键投影始终比值和输出投影更敏感。这些发现揭示了基础模型和量化模型之间的等效性错觉,并促使超越传统性能指标进行行为评估。

英文摘要

Post-training quantization is widely used to deploy large language models in resource-constrained settings, yet its evaluation relies almost exclusively on accuracy and perplexity. We show that these metrics fail to capture behavioral changes induced by quantization. We introduce correctness agreement, a decision-level metric that measures overlap in correct predictions between a base model and its quantized variants, independent of absolute accuracy. Across multiple models and quantization schemes from 8-bit to 2-bit, we find that behavioral divergence emerges under moderate quantization even when task performance appears preserved. To explain this effect, we analyze quantization as a structural operator on attention weights and quantify layer-wise distortions using statistical and distributional measures. Our results reveal non-linear breakpoints at low bit-widths and show that query and key projections are consistently more sensitive than value and output projections. These findings expose an illusion of equivalence between base and quantized models and motivate behavioral evaluation beyond conventional performance metrics.

URL PDF HTML
2607.08733 2026-07-10 cs.LG 新提交

Super Weights in LLMs and the Failure of Selective Training

大语言模型中的超级权重与选择性训练的失败

Shreyas Subramanian, Adewale Akinfaderin, Akarsha Sehwag

发表机构 * Amazon Web Services(亚马逊网络服务公司)

AI总结 研究大语言模型中超级权重,发现修剪超级权重致性能下降非普遍适用,孤立训练超级权重失败,普通LoRA更新少量参数成功,表明参数重要性不意味可孤立训练,有效微调依赖层的结构化分解。

Comments Accepted at the Conference on Language Modeling (COLM) 2026

详情
AI中文摘要

近期研究发现了超级权重,即去除后会使模型性能下降几个数量级的单个参数。本文表明,修剪超级权重导致的性能下降并非普遍适用于所有大语言模型。而且,若这些参数如此重要,超级权重感知训练应有效,但事实相反。孤立训练超级权重会使OLMo-1B和OLMo-7B的准确率降至随机猜测水平,扩展到局部邻域也无改善。这种失败特定于超级权重坐标,训练同等数量随机选择位置则有提升。普通LoRA通过低秩结构更新注意力权重矩阵中的每个位置,仅用0.16%的参数就能成功,对下投影应用相同低秩更新也成功。10次种子消融实验证实,在超级权重坐标对应的位置约束LoRA更新会产生统计上无差异的结果。这些发现表明参数重要性并不意味着孤立参数可训练,有效的微调依赖于对整个层的结构化分解而非针对个别重要权重。

英文摘要

Recent work identified Super Weights, individual parameters whose removal degrades model performance by orders of magnitude. We show that this degradation due to pruning Super Weights does not universally apply to all LLMs. Furthermore, if these parameters are so important, Super Weight-aware training should be effective. We show the opposite. Training Super Weights in isolation (100 to 8,192 parameters) drops accuracy to random-guessing levels on both OLMo-1B and OLMo-7B, and expanding to local neighborhoods of up to 36K parameters provides no improvement. The failure is specific to Super Weight coordinates: training an equal number of randomly chosen positions in the same down_proj layers instead improves over the baseline, so the collapse comes from targeting Super Weights, not from sparsity itself. Vanilla LoRA, updating every position in attention weight matrices through low-rank structure, succeeds with only 0.16% of parameters, and applying the same low-rank update to down_proj succeeds as well. A 10-seed ablation confirms that constraining LoRA updates at positions corresponding to Super Weight coordinates yields statistically indistinguishable results. These findings establish that parameter importance does not imply parameter trainability in isolation, and that effective fine-tuning relies on structured decompositions over entire layers rather than targeting individually important weights.

URL PDF HTML
2607.08731 2026-07-10 cs.CL cs.AI cs.CY 新提交

Validity of LLMs as data annotators: AMALIA on authority

大语言模型作为数据标注器的有效性:关于权威的AMALIA研究

Manuel Pita

发表机构 * CICANT, Universidade Lusófona(坎特交互计算与技术研究中心,卢索福纳大学)

AI总结 研究葡萄牙AMALIA大语言模型作为数据标注器标注权威道德基础的有效性,通过恢复差距测试其能否遵循理论,发现校准的英语工具不能转移到该模型,其依赖表面关联,虽能筛选预编码但不能独立衡量,强调基准测试应考察一致性证据路径。

详情
AI中文摘要

国家语言模型为语言社区提供了衡量公民言论和价值观的工具。葡萄牙的AMALIA是一个由公共资金支持的、拥有90亿参数的欧洲葡萄牙语模型,仅在一致性方面就颇具竞争力。然而,一致性是可靠性而非有效性。对于必须从表面特征推断而非直接读取的理论结构,问题在于模型是遵循结构的理论还是通过相关捷径得出正确代码。我们用恢复差距来测试这一点。我们询问经过校准的英语工具是否能转移到AMALIA - 9B和欧洲葡萄牙语中。对于一个结构和一个语料库,结果是否定的。分解仅恢复了AMALIA整体性能的约一半,错误分析表明其依赖表面关联。一个开放的多语言大语言模型在相同指令下缩小了差距,这表明问题不在于语料库。AMALIA仍可大规模筛选和预编码,但还不能很好地衡量该结构以独立使用。该研究虽非对国家模型的定论,但认为主权大语言模型基准测试不仅应测试与人类编码者的一致性,还应测试达成该一致性的证据路径。

英文摘要

A national language model offers a linguistic community its own instrument for measuring what its citizens say and value. Portugal's AMALIA, a publicly funded 9B-parameter model for European Portuguese, appears competitive on agreement alone: asked to code the moral foundation of authority, it agrees with trained human coders to within six F1 points of open models eight to thirteen times its size. Yet agreement is reliability, not validity. For theoretical constructs that must be inferred rather than read from surface features, the question is whether the model follows the construct's theory or reaches the right code by correlated shortcuts. We test this with the recovery gap: the loss in performance when a holistic prompt is decomposed into the codebook's atomic clauses and recombined by the theory's explicit rule. If calibration closes that gap, some portability should survive across models and languages; where it does not, the construct-model instrument is the likely locus of failure. We ask whether a calibrated English instrument transfers to AMALIA-9B and to European Portuguese. For one construct and one corpus, it does not. Decomposition recovers only about half of AMALIA's holistic performance, and error analysis suggests reliance on surface correlates, especially moral outrage near authority figures. An open multilingual LLM closes the gap on the same Portuguese corpus under the same instructions, pointing away from the corpus as the main explanation. AMALIA can still screen and pre-code at scale, but it cannot yet measure this construct well enough to stand alone. The study is a single counterexample, not a verdict on national models; it argues that sovereign-LLM benchmark batteries should test not only agreement with human coders, but the evidential route by which that agreement is warranted.

URL PDF HTML
2607.08729 2026-07-10 cs.CV 新提交

WaspMOT: A Benchmark for Long-Term Multi-Object Tracking of Trichogramma Wasps

WaspMOT:赤眼蜂长期多目标跟踪基准

Tomasz Stanczyk, Yuan Gao, Hardik Agarwal, Seongroo Yoon, Tiantao Zhang, Vincent Calcagno, Francois Bremond

发表机构 * Inria(法国国家信息与自动化技术研究院) INRAE Institut Sophia Agrobiotech(法国国家农业生物技术研究院) Université Côte d'Azur(蔚蓝海岸大学) Indian Institute of Technology Delhi(德里印度理工学院) Institute of Plant Protection, Chinese Academy of Agricultural Sciences(中国农业科学院植物保护研究所)

AI总结 研究针对多目标跟踪在长期身份保持评估不足的问题,引入WaspMOT基准,通过对赤眼蜂长时间跟踪构建数据集,评估五种检测跟踪方法,发现都有轨迹碎片化问题,简单拼接基线可提升性能,揭示了现有方法局限。

详情
AI中文摘要

多目标跟踪(MOT)在以短视频序列为主的基准测试中表现出色,但此类数据集无法充分评估长期身份保持情况。我们引入WaspMOT,这是一个通过在受控生态实验中对赤眼蜂进行长时间跟踪来解决这一差距的基准。该数据集包含10个序列,每个序列约12000帧,有密集的MOTChallenge注释和神谕检测以分离关联性能。与现有基准不同,WaspMOT形成封闭集跟踪场景。我们通过评估五种检测跟踪方法建立基准,结果表明所有方法都存在显著轨迹碎片化问题,一个简单的空间轨迹拼接基线持续提高了性能。WaspMOT为研究长期关联提供了新基准,揭示了当前跟踪方法在传统数据集上无法观察到的局限性。

英文摘要

Multi-object tracking (MOT) has achieved strong performance on benchmarks dominated by short video sequences. However, such datasets do not adequately evaluate long-term identity preservation, where objects must be tracked consistently over extended durations. We introduce WaspMOT, a benchmark designed to address this gap through long-duration tracking of Trichogramma wasps in controlled ecological experiments. The dataset contains 10 sequences of approximately 12,000 frames each (over 8 minutes at 25 FPS), with dense MOTChallenge annotations and oracle detections to isolate association performance. Unlike existing benchmarks, WaspMOT forms a closed-set tracking scenario where all individuals remain present throughout the sequence, requiring consistent identity assignment across thousands of frames despite abrupt jumps, occlusions, and highly similar appearance. We establish a benchmark by evaluating five tracking-by-detection methods, including ByteTrack, BoT-SORT, C-BIoU, OC-SORT, and McByte, under a unified protocol. Results show that all methods suffer from significant trajectory fragmentation, highlighting the difficulty of long-term identity preservation even with perfect detections. A simple spatial tracklet stitching baseline consistently improves performance, indicating that substantial gains remain possible. WaspMOT provides a new benchmark for studying long-term association and reveals limitations of current tracking approaches that are not observable on conventional datasets. The benchmark will be made publicly available at the project repository: this https URL.

URL PDF HTML
2607.08725 2026-07-10 cs.CV cs.AI cs.LG 新提交

Pose-to-Biomechanics: Bridging 3D Human Pose Estimation and Biomechanical Attribute Prediction

姿态到生物力学:连接3D人体姿态估计与生物力学属性预测

Ayda Eghbalian, Kevin Desai

发表机构 * University of Texas at San Antonio(德克萨斯大学圣安东尼奥分校)

AI总结 研究旨在连接3D人体姿态估计与生物力学属性预测。提出BioModule轻量级插件式时间变压器,连接在3D姿态估计器下游预测生物力学属性,无需修改上游模型。构建数据集训练评估,在七个先进姿态估计器上基准测试,成为两者间紧凑模块化桥梁。

Comments 23 pages, 2 figures

详情
AI中文摘要

近期3D人体姿态估计进展使无标记骨骼运动恢复更准确且可扩展。但多数姿态估计器针对几何关键点精度优化,而康复、运动科学等实际应用需描述身体运动、负荷及激活的生物力学量。本文提出BioModule,一种轻量级插件式时间变压器,可连接在任意3D姿态估计器下游,从标准17关节3D骨架预测生物力学属性。它与估计器无关,无需修改上游姿态模型。为训练和评估BioModule,构建了大规模对齐数据集。还在七个最先进3D姿态估计器上对BioModule进行基准测试,结果表明它是视觉姿态估计与生物力学有意义的人体运动分析间的紧凑模块化桥梁。

英文摘要

Recent progress in 3D human pose estimation has made markerless recovery of skeletal motion increasingly accurate and scalable. However, most pose estimators remain optimized for geometric keypoint accuracy, while many real-world applications in rehabilitation, sports science, ergonomics, and clinical movement analysis require biomechanical quantities that describe how the body moves, loads, and activates. In this work, we propose BioModule, a lightweight plug-in temporal transformer that attaches downstream of any 3D pose estimator and predicts biomechanical attributes from standard 17-joint 3D skeletons. BioModule is estimator-agnostic and requires no modification of the upstream pose model, enabling existing pose estimators to be extended toward physically interpretable motion analysis. To train and evaluate BioModule, we construct a large-scale aligned dataset pairing Human3.6M video and 3D keypoints with the biomechanical label space of Human3.6Mplus. We establish and verify anatomical correspondence between coordinate systems of the two datasets, enabling frame-accurate cross-modal supervision. Using this aligned supervision, BioModule predicts biomechanical quantities. We further benchmark BioModule across seven state-of-the-art 3D pose estimators, providing the first systematic analysis of how upstream pose estimation quality propagates to downstream biomechanical prediction fidelity. The results position BioModule as a compact, modular bridge between vision-based pose estimation and biomechanically meaningful human motion analysis.

URL PDF HTML
2607.08724 2026-07-10 cs.LG cs.RO 新提交

Latent Memory Palace: Reasoning for Control as Autoregressive Variational Inference

潜在记忆宫殿:作为自回归变分推理的控制推理

Chuning Zhu, Eva Xu, Jose Barreiros, Krishnan Srinivasan, Paarth Shah, Abhishek Gupta

发表机构 * University of Washington(华盛顿大学) Toyota Research Institute(丰田研究院)

AI总结 研究将语言模型的推理能力应用于连续控制策略的问题,提出潜在记忆宫殿(LMP)方法,通过自回归潜在空间组织信息进行变分推理,推导强化学习技术优化下限,该方法在模拟和现实领域表现良好,还产生高性能动作分词器,为控制的潜在推理提供新视角。

详情
AI中文摘要

人类决策具有高度灵活性,语言模型也展现出类似的自适应“推理”能力,但将此能力转移到连续控制策略具有挑战性。本文表明,通过在类似于记忆宫殿的自回归潜在空间中组织信息,控制策略的推理能够出现,其中检索是迭代且自适应的。我们的方法潜在记忆宫殿(LMP)将推理公式化为具有自回归潜在分布的变分推理。我们推导了一种潜在空间强化学习技术来有效优化其变分下限。结果策略LMP - $\pi$在模拟和现实世界领域取得了强大的经验性能,同时展示了测试时计算的可解释、自适应分配。我们还表明相同框架产生了可变长度动作分词器LMP - $\texttt{tok}$,显著提高了下游自回归策略的性能。这些结果通过变分推理的视角为控制的潜在推理提供了新观点。

英文摘要

Human decision-making is highly flexible -- some actions are taken immediately; others require longer deliberation. Language models have exhibited a similar capacity for adaptive "reasoning." However, transferring this capability to continuous control policies has been challenging, as directly reasoning in language space may lack the granularity for spatial understanding and precise motions. In this work, we show that reasoning for control policies can emerge by organizing information in an autoregressive latent space reminiscent of a memory palace, where retrieval is iterative and adaptive. Our method, Latent Memory Palace (LMP), formulates reasoning as variational inference with an autoregressive latent distribution. We derive a latent-space reinforcement learning technique to tractably optimize its variational lower bound. The resulting policy, LMP-$\pi$, achieves strong empirical performance in simulation and real-world domains while exhibiting interpretable, adaptive allocation of test-time compute. We further show that the same framework yields a variable-length action tokenizer, LMP-$\texttt{tok}$, which significantly improves the performance of downstream autoregressive policies. Together, these results present a new perspective on latent reasoning for control through the lens of variational inference.

URL PDF HTML
2607.08716 2026-07-10 cs.AI cs.CL 新提交

Remember When It Matters: Proactive Memory Agent for Long-Horizon Agents

记住重要时刻:用于长期任务智能体的主动记忆智能体

Yifan Wu, Lizhu Zhang, Yuhang Zhou, Mingyi Wang, Bo Peng, Serena Li, Xiangjun Fan, Zhuokai Zhao

发表机构 * Meta AI(元人工智能公司)

AI总结 研究长期任务中智能体决策时行为状态衰减问题,提出用主动记忆智能体并行干预,更新记忆库并决定是否提醒。该方法在多个基准测试中提升了智能体性能,消融实验证明其优势,还训练模型实现部分迁移。

详情
AI中文摘要

在长期任务中,与决策相关的状态常常分散在不断扩展的轨迹中,而行动智能体必须找出这些状态并采取行动。随着轨迹增长,任务要求、环境事实、先前尝试、诊断和未完成的子目标可能会被埋没在上下文窗口中或超出其范围,无法在需要时影响决策,这种失败模式被称为“行为状态衰减”。我们将记忆视为一种主动干预机制而非被动检索。一个单独的记忆智能体与未修改的行动智能体并行运行,从最近的轨迹更新结构化记忆库,并决定是注入基于记忆的提醒还是保持沉默。该模块可即插即用于前沿行动智能体和现有智能体框架。在Terminal - Bench 2.0和$\tau^2$-Bench上,它提高了较弱和较强行动智能体的pass@1,在Terminal - Bench上提升了8.3个百分点,在$\tau^2$-Bench上提升了6.8个百分点。消融实验表明选择性干预优于被动库暴露、始终注入、仅顾问指导和一般检索。作为迈向开放权重记忆策略的早期步骤,我们使用SFT和GRPO在SETA上训练Qwen3.5 - 27B,提高了验证奖励并实现了向Terminal - Bench的部分迁移。

英文摘要

In long-horizon tasks, decision-relevant state is often scattered across an expanding trajectory, while the action agent must surface it and act. As trajectories grow, task requirements, environment facts, prior attempts, diagnoses, and open subgoals can be buried in the context window or pushed beyond it, failing to influence decisions when needed. We call this failure mode "behavioral state decay". We study memory as an active intervention mechanism rather than passive retrieval. A separate memory agent runs alongside an unmodified action agent, updating a structured memory bank from the recent trajectory and deciding whether to inject a memory-grounded reminder or remain silent. The module is plug-and-play with frontier action agents and existing agent harnesses. Across Terminal-Bench 2.0 and $\tau^2$-Bench, it improves pass@1 for both weaker and stronger action agents, with gains of +8.3 pp on Terminal-Bench and +6.8 pp on $\tau^2$-Bench. Ablations show that selective intervention outperforms passive bank exposure, always-on injection, advisor-only guidance, and general retrieval. As an early step toward open-weight memory policies, we train Qwen3.5-27B on SETA using SFT and GRPO, improving validation reward and achieving partial transfer to Terminal-Bench.

URL PDF HTML
2607.08703 2026-07-10 cs.LG 新提交

MPFlow: Learning Budgeted Max-Flow Optimization on the Lightning Network with Deep Graph Reinforcement Learning

MPFlow:基于深度图强化学习的比特币闪电网络预算最大流优化学习

Harrison Rush, Vincent Davis, Simone Antonelli, Vikash Singh, Jesse Shrader, Emanuele Rossi

发表机构 * Amboss Technologies(Amboss技术公司) CISPA Helmholtz Center for Information Security(CISPA海德堡信息安全中心) Stillmark(Stillmark公司) Sapienza University of Rome(罗马萨皮恩扎大学)

AI总结 研究比特币闪电网络中给定预算下节点如何打开通道最大化路由容量的问题,采用图强化学习方法,结合消息传递策略网络、PPO和动作掩码,在真实网络快照实验中表现优于启发式基线,还用于生产中的对等推荐。

详情
AI中文摘要

我们研究比特币闪电网络中的流动性配置问题:给定固定预算,节点应打开哪些通道以最大化其路由容量?我们将此转化为图上的预算约束组合优化问题,选择\(k\)条边的添加以最大化\(s\)到\(t\)的最大流,这是一种基于理论的路由容量度量,并通过图强化学习解决。我们的轻量级智能体结合了消息传递策略网络、近端策略优化(PPO)和动作掩码,并在中心排除课程下进行训练:从训练子图中移除网络的顶级中心,迫使策略学习容量感知配置而不是中心依附。在对真实闪电网络快照的广泛实验中,我们的方法在多个种子和未见图上始终优于强大的启发式基线。该智能体已在生产中用于对等推荐,执行了4640个通道打开决策,在30个管理节点上累计分配了267.3 BTC超过1600万美元。

英文摘要

We address liquidity placement in the Bitcoin Lightning Network (LN): given a fixed budget, which channels should a node open to maximize its routing capacity? We cast this as a budget-constrained combinatorial optimization problem on graphs, selecting $k$ edge additions that maximize $s$--$t$ max-flow, a theory-grounded measure of routing capacity, and solve it with graph reinforcement learning. Our lightweight agent combines a message-passing policy network with proximal policy optimization (PPO) and action masking, and is trained under a hub-exclusion curriculum: the network's top hubs are removed from training subgraphs, forcing the policy to learn capacity-aware placement rather than hub attachment. In extensive experiments on real Lightning Network snapshots, our method consistently outperforms strong heuristic baselines on the max-flow objective across multiple seeds and unseen graphs. The agent has been deployed in production for peer recommendations, executing 4640 channel-open decisions that cumulatively allocate 267.3 BTC over $16 million across 30 managed nodes.

URL PDF HTML
2607.08700 2026-07-10 cs.CL 新提交

Do You Need a Frontier Model as a Citation Verifier? Benchmarking Rubric LLMs for Deep-Research Source Attribution

深度研究源归因的基准测试:评估用于验证引用的前沿模型

Ethan Leung, Elias Lumer, Corey Feld, Austin Huber, Vamse Kumar Subbiah, Kevin Paul

发表机构 * Commercial Technology and Innovation Office, PricewaterhouseCoopers, U.S.(普华永道商业技术与创新办公室)

AI总结 研究深度研究系统中引用质量校准问题,用现成LLM对1248个评分决策与黄金标准标签对比,发现较便宜模型有竞争力,校准模型是用引用评分作奖励信号的前提,校准不须最昂贵模型。

详情
AI中文摘要

强化学习越来越依赖大语言模型(LLM)来对每个评分标准进行打分,该模型在训练期间充当奖励模型。在信任此信号之前,我们需要了解该模型的能力和偏差程度。我们针对深度研究系统中的引用质量校准问题展开研究,其中基于搜索的LLM必须用引用来源支持其撰写的每个声明。引用质量是一项结构化评分任务,每个归因-引用对需从来源相关性和事实支持这两个维度由LLM进行判断。在一个对抗性的长篇基准测试中,我们对来自3个模型家族的8个现成LLM模型与超过1248个评分决策的黄金标准标签进行评分,所有决策均经过人工审核,其中378个是由模型分歧裁定的疑难案例。较便宜的模型在两个维度上仍具竞争力,GPT-5-mini在来源相关性方面获得最强的通过级F1分数0.908(κ = 0.636),而在事实支持方面,各模型在统计学上无显著差异(置信区间重叠),没有单一模型占主导地位。在可比的F1分数下,各模型在通过率漂移、误报率和漏报率方面仍存在显著差异。标量F1掩盖了这种方向性偏差,但这正是下游强化学习循环会强化的。因此,校准模型是将引用评分用作奖励信号的先决条件,我们的结果表明这种校准不需要最昂贵的可用模型。

英文摘要

Reinforcement learning increasingly relies on an LLM judge to score each rubric criterion, and that judge acts as the reward model during training. Before such a signal can be trusted, we need to know how capable the judge must be and how biased it is. We study this calibration question for citation quality in deep-research systems, where a search-grounded LLM must support each claim it writes with a cited source. Citation quality is a structured rubric task in which each attribution-citation pair is judged along two dimensions that require an LLM, source relevance and factual support. On an adversarial long-form benchmark, we score 8 off-the-shelf LLM judges from 3 model families against gold labels over 1,248 rubric decisions, all of which were human-reviewed and 378 of which were hard cases adjudicated from judge disagreements. Cheaper judges remain competitive across both dimensions, with GPT-5-mini attaining the strongest source-relevance pass-class F1 at 0.908 ($\kappa$=0.636), while on factual support the judges are statistically indistinguishable (overlapping confidence intervals), so no single model dominates. At comparable F1, the judges still differ substantially in pass-rate drift, false positive rate, and false negative rate. Scalar F1 obscures this directional bias, yet it is exactly what a downstream reinforcement learning loop would reinforce. Calibrating the judge is therefore a prerequisite for using citation rubrics as reward signals, and our results show that this calibration does not require the most expensive available model.

URL PDF HTML
2607.08690 2026-07-10 cs.LG cs.AI 新提交

A Practical Investigation of Training-free Relaxed Speculative Decoding

无训练的松弛推测解码的实践研究

Guoxuan Xia, Luka Ribar, Paul Balanca

发表机构 * Graphcore(Graphcore公司)

AI总结 研究无训练的松弛推测解码技术,统一现有方法于共享框架,在当代环境下基准测试,发现松弛需大量能力评估,且许多方法依赖良好语言模型作为起草器,不适用于轻量级专用多令牌预测起草器。

Comments preprint

详情
AI中文摘要

推测解码通过使用更快的辅助模型来起草令牌,然后由自回归语言模型并行验证,从而加速从自回归语言模型中采样。标准推测解码是无损的,而最近的工作认为放宽这种严格保证可以进一步提高速度、实现可控的能力-速度权衡,甚至获得能力提升。我们对无训练的松弛推测解码技术进行了实践研究,将现有方法统一在一个共享框架内,在当代环境下对它们进行基准测试,并为从业者提炼出要点和实证结果。重要要点包括:与无损推测解码不同,松弛可能需要大量的能力评估,而且许多松弛方法依赖于一个良好的语言模型作为起草器,这使得它们不适用于轻量级专用多令牌预测起草器。

英文摘要

Speculative decoding accelerates sampling from an autoregressive LLM by using a faster auxiliary model to draft tokens which are then verified in parallel by the LLM. Standard speculative decoding is lossless: its rejection and resampling steps exactly preserve the LLM's sampling distribution. Recent work argues that relaxing this strict guarantee can yield further speed-ups, controlled capability-speed trade-offs, or even capability gains. We practically investigate training-free relaxed speculative decoding techniques, unify existing approaches within a shared framework, benchmark them on contemporary settings, and distil takeaways and empirical findings for practitioners. Important takeaways include: relaxation can require considerable capability evaluation unlike lossless speculative decoding, and many relaxed approaches rely on a drafter that is a good language model, making them unsuited for lightweight dedicated multi-token-prediction drafters.

URL PDF HTML
2607.08688 2026-07-10 cs.CV 新提交

SAM-MT: Real-Time Interactive Multi-Target Video Segmentation

SAM-MT:实时交互式多目标视频分割

Ruiqi Shen, Chang Liu, Henghui Ding

发表机构 * Fudan University(复旦大学) Shanghai University of Finance and Economics(上海财经大学)

AI总结 研究针对多目标视频分割中帧率随目标数增加而降低的问题,基于SAM2提出SAM-MT。通过显式查询、解耦掩码注意力等方法,实现延迟与目标数解耦,保持分割性能,达到与单目标基线相当的实时速度。

Comments ECCV 2026, Project Page: this https URL (https://henghuiding.com/SAM-MT/)

详情
AI中文摘要

现代视频对象分割(VOS)涉及跟踪和分割用户指定的目标。虽然最近的方法在单目标场景中取得了显著性能,但扩展到多目标设置时,通常会为每个对象复制单目标处理,导致帧率(FPS)降低且延迟无界增加。基于Segment Anything 2(SAM2),我们提出了SAM-MT,通过将模型转变为实时多目标视频分割的交互式框架来解决此问题。SAM-MT使用显式查询表示不同的单个目标,同时具有全局上下文的共享表示。它采用解耦掩码注意力来保持个体身份与跨目标干扰区分开,使用稀疏内存实现稳定的时间演变,还有处理遮挡和防止重叠的专门策略。SAM-MT成功将延迟与目标数量解耦,在保持SAM2强大视频分割性能的同时,实现了与单目标基线相当的实时速度(10个目标时>36 FPS)。

英文摘要

Modern Video Object Segmentation (VOS) involves tracking and segmenting user-specified targets. While recent approaches have achieved remarkable performance in single-target scenarios, extending them to multi-target settings typically involves replicating the single-target processing for each individual object, resulting in reduced frame rates (FPS) with unbounded latency as target count increases. Built upon Segment Anything 2 (SAM2), we propose SAM-MT, which addresses this by transforming the model into an interactive framework for real-time Multi-Target video segmentation. SAM-MT uses explicit queries to represent different individual targets, in parallel with a shared representation for global context. It employs decoupled masked attention to keep individual identities distinct from cross-target interference, and sparse memory for stable temporal evolution, along with specialized strategies for occlusion handling and overlap prevention. SAM-MT successfully decouples latency from the number of targets, achieving real-time speed on par with single-target baselines (>36 FPS for 10 targets) while maintaining SAM2's robust video segmentation performance.

URL PDF HTML
2607.08681 2026-07-10 cs.AI 新提交

SolarChain-Eval: A Physics-Constrained Benchmark for Trustworthy Economic Agents in Decentralized Energy Markets

SolarChain-Eval:去中心化能源市场中可信经济主体的物理约束基准测试

Shilin Ou, Yifan Xu, Luyao Zhang

发表机构 * Duke Kunshan University(杜克昆山大学)

AI总结 针对去中心化能源市场中智能代理评估需兼顾任务性能与可信度的问题,提出物理约束基准测试SolarChain-Eval,将市场治理建模为马尔可夫决策过程,从多维度评估策略,纳入大语言模型规划器/审计器层,实验揭示效用与安全权衡及相关问题。

详情
AI中文摘要

随着智能代理人工智能系统越来越多地应用于网络物理环境,其评估需要同时考量任务性能和可信度。在去中心化能源市场中,自主代理虽能提升市场效用,但也可能利用无效物理数据、制造人为流动性并做出不稳定的治理决策。因此,我们提出了SolarChain-Eval,这是一个用于评估可信经济主体的物理约束基准测试。它将市场治理表述为一个与Gymnasium兼容的马尔可夫决策过程,代理每小时做出决策。SolarChain-Eval从多个维度评估每个策略,包括市场效用、物理安全性、滑点、行动平滑性、空间公平性和可审计性。为支持智能代理评估,SolarChain-Eval纳入了基于大语言模型的规划器/审计器层。规划器定义情节级行动边界和审计规则,审计器审查并修订高风险行动。所有干预都通过结构化日志记录,包括触发信号、提议行动、修订行动和审计理由。对静态、随机、近视、强化学习和强化学习+大语言模型策略的实验揭示了效用与安全之间明显的权衡。强化学习代理提高了市场效用,但仍可能产生不安全行为。去除物理惩罚后,追求奖励最大化的代理会利用无效发电并增加人为流动性。大语言模型规划器/审计器提高了可审计性并减轻了特定风险,但无法完全弥补错误指定的奖励函数。这些结果表明,可信的智能代理人工智能评估既需要物理约束,也需要透明的干预痕迹。我们在GitHub上以开放访问的方式发布数据和代码以确保可重复性。

英文摘要

As agentic AI systems are increasingly applied to cyber-physical environments, their evaluation requires assessment of both task performance and trustworthiness. In decentralized energy markets, autonomous agents may improve market utility, but may also exploit invalid physical data, create artificial liquidity, and produce unstable governance decisions. Therefore, we propose SolarChain-Eval, a physics-constrained benchmark for evaluating trustworthy economic agents. It formulates market governance as a Gymnasium-compatible Markov Decision Process, where agents make hourly decisions. SolarChain-Eval evaluates each policy across multiple dimensions, including market utility, physical safety, slippage, action smoothness, spatial fairness, and auditability. To support agentic evaluation, SolarChain-Eval incorporates an LLM-based Planner/Auditor layer. The Planner defines episode-level action bounds and audit rules, while the Auditor reviews and revises high-risk actions. All interventions are recorded through structured logs, including trigger signals, proposed actions, revised actions, and audit rationales. Experiments with static, random, myopic, RL, and RL+LLM policies reveal a clear utility-safety trade-off. RL agents improve market utility but can still produce unsafe behavior. When the physics penalty is removed, reward-maximizing agents exploit invalid generation and increase artificial liquidity. The LLM Planner/Auditor improves auditability and mitigates selected risks, but it cannot fully compensate for a misspecified reward function. These results indicate that trustworthy agentic AI evaluation requires both physical constraints and transparent intervention traces. We release data and code as open access on GitHub for replicability.

URL PDF HTML
2607.08679 2026-07-10 cs.CV 新提交

Multi-Resolution Feature Stem for Diabetic Retinopathy lesion segmentation

用于糖尿病视网膜病变病变分割的多分辨率特征主干

Indranil Dutta, Taehee Jeong

发表机构 * San Jose State University(圣何塞州立大学)

AI总结 研究糖尿病视网膜病变病变分割中输入分辨率影响,发现其对不同病变类型有相反作用。提出多分辨率特征主干,并行处理多尺度,能捕获细节且不牺牲上下文信息,为相关研究提供关键证据和实用架构。

Comments 2026 International Conference on Advances in Artificial Intelligence and Machine Learning (AAIML), 20-22 March 2026

详情
AI中文摘要

糖尿病视网膜病变(DR)是全球可预防失明的主要原因,需要使用深度学习模型进行自动病变分割以实现早期检测和监测。然而,DR病变大小差异极大,从微小的微动脉瘤到较大的出血和渗出物。这种变异性对模型架构和输入分辨率提出了相互矛盾的要求。通过在512×512和1024×1024分辨率下对多种架构(U-Net、UNet++、视觉Transformer、DeepLabV3+)进行系统实验,发现输入分辨率增加对不同病变类型有相反影响。更高分辨率对解决细粒度微动脉瘤至关重要,但会意外降低对较大出血的性能。为此提出了多分辨率特征主干,一种与UNet++主干集成的输入级金字塔。该架构并行处理多个尺度,在不牺牲上下文信息的情况下捕获细粒度细节。这项工作提供了这种复杂的、分辨率依赖行为的关键经验证据,以及成功解决这种权衡的实用且参数高效的架构。

英文摘要

Diabetic Retinopathy (DR) is a leading cause of preventable blindness worldwide, requiring automated lesion segmentation using deep learning models for early detection and monitoring. However, DR lesions vary dramatically in size from tiny microaneurysms to large hemorrhages and exudates. This variability creates conflicting demands on the model architecture and input resolution, posing a challenge for effective design. This work investigates the impact of input resolution on different lesion types. Through systematic experimentation with multiple architectures (U-Net, UNet++, Vision Transformers, DeepLabV3+) at $512 \times 512$ and $1024 \times 1024$ resolutions, we identify a critical, counter-intuitive phenomenon where increasing input resolution has opposing effects on different lesion types. We demonstrate that while higher resolution is essential for resolving fine-grained microaneurysms, it can unexpectedly degrade performance on larger hemorrhages. This finding challenges the common assumption that higher resolution is uniformly beneficial. To address this, we propose a novel Multi-Resolution Feature Stem, an input-level pyramid integrated with a UNet++ backbone. This architecture processes multiple scales in parallel, capturing fine-grained details without sacrificing contextual information. This work contributes crucial empirical evidence of this complex, resolution-dependent behavior and a practical, parameter-efficient architecture that successfully resolves this trade-off.

URL PDF HTML