arXivDaily arXiv每日学术速递 周一至周五更新

大厂专区

Alibaba

2026-07-16 至 2026-07-16 收录 2
2607.13941 2026-07-16 cs.CV 新提交

Peak-End-Net: A Peak-End Rule Inspired Framework for Generalizable Video Aesthetic Assessment

峰值-结尾网络:一种受峰值-结尾规则启发的通用视频美学评估框架

Geng Li, Haiwen Li, Rui Chen, Jing Tang, Lei Sun, Xiangxiang Chu

发表机构 * Alibaba Group(阿里巴巴集团) Beijing University of Posts and Telecommunications(北京邮电大学)

AI总结 研究视频美学评估问题,提出受峰值-结尾规则启发的Peak-End-Net框架,通过引入预训练IAA头部、设计美学节奏编码器和动态门控融合机制,基于冻结ViT实现,在实验中取得最优性能。

Comments Accepted to ACM MM 2026, Code: https://github.com/AMAP-ML/Peak-End-Net

详情
AI中文摘要

视频美学评估(VAA)旨在预测视频的美学吸引力,但与其他视觉评估任务相比,其探索较少。其进展受到大规模基准稀缺以及美学判断内在主观性的阻碍。本文从心理学角度重新审视VAA,提出了受峰值-结尾规则启发的轻量级且可解释的框架Peak-End-Net。通过引入预训练的图像美学评估(IAA)头部来生成逐帧美学先验,设计美学节奏编码器以及动态门控融合机制,该方法基于冻结的视觉Transformer(ViT),参数少且可扩展。在两个现有VAA基准上的大量实验表明其达到了当前最优性能。

英文摘要

Video aesthetic assessment (VAA) aims to predict how aesthetically pleasing a video is, yet remains far less explored than other visual assessment tasks. Its progress is hindered not only by the scarcity of large-scale benchmarks, but also by the intrinsic subjectivity of aesthetic judgment, which is shaped by human perception. In this paper, we revisit VAA from a psychological perspective and propose \textit{Peak-End-Net}, a lightweight and interpretable framework inspired by the \textit{peak-end rule}, which suggests that people tend to judge a temporal experience mainly according to its salient moments and the ending. Building on this intuition, we first transfer knowledge from image aesthetic assessment (IAA) to VAA by introducing a pretrained IAA head to produce frame-wise aesthetic priors, which serve as surrogate signals for identifying aesthetically salient moments and guiding \textit{peak-end rule}-based temporal aggregation. To further capture how a video evolves aesthetically over time, we design an aesthetic rhythm encoder that models temporal progression beyond isolated moments. Additionally, we refine the overall assessment through a dynamic gated fusion mechanism to improve robustness under distribution shift. Our method is built on a frozen vision transformer (ViT) and requires only a small number of trainable parameters, making it scalable and parameter-efficient. Extensive experiments on two existing VAA benchmarks, including in-domain evaluation on VADB and cross-domain testing on DIVIDE-3K, demonstrate that our approach achieves state-of-the-art performance, affirming the value of psychologically grounded modeling for VAA. Our code and models are available at https://github.com/AMAP-ML/Peak-End-Net.

URL PDF HTML
2607.13639 2026-07-16 cs.CV cs.AI 新提交

OvisOCR2 Technical Report

OvisOCR2技术报告

Shiyin Lu, Yinglun Li, Yu Xia, Yuhui Chen, An-Yang Ji, Jun-Peng Jiang, Qing-Guo Chen, Jianshan Zhao, En Lin, Haijun Li, Cheng Qin, Zhao Xu, Weihua Luo

发表机构 * Alibaba Group(阿里巴巴集团)

AI总结 介绍拥有8亿参数的OvisOCR2文档解析模型,通过构建数据引擎,采用监督微调、强化学习、策略蒸馏和模型融合等方法训练,在多个基准测试中取得优异成绩,展现出良好的泛化性和鲁棒性。

详情
AI中文摘要

我们介绍了OvisOCR2,一个拥有8亿参数的文档解析模型。它被设计为端到端解析器,给定文档页面图像,能按自然阅读顺序生成Markdown表示,涵盖文本、公式、表格和视觉区域。我们构建了数据引擎,结合了经过筛选的真实文档注释与合成页面。训练方法包括监督微调、在一个拥有40亿参数分支上进行多组件奖励设计的强化学习、策略蒸馏到8亿参数模型以及模型融合。在OmniDocBench v1.6上,OvisOCR2取得了96.58的最优综合得分,在PureDocBench上也取得了75.06的最高Avg3得分。在内部基准测试中,OvisOCR2在比较方法中获得了最佳整体性能,证明了其泛化性和鲁棒性。

英文摘要

We introduce OvisOCR2, a 0.8B document parsing model. OvisOCR2 is designed as an end-to-end parser: given a document page image, it generates a Markdown representation in natural reading order, covering text, formulas, tables, and visual regions. We build a data engine that combines filtered real-document annotations with synthetic pages whose rendered images and Markdown targets are derived from the same HTML source. The training recipe includes supervised fine-tuning, reinforcement learning on a 4B branch with a multi-component reward design, on-policy distillation into the 0.8B model, and model fusion. On OmniDocBench v1.6, OvisOCR2 achieves a state-of-the-art overall score of 96.58, placing an end-to-end model at the top of this leaderboard previously dominated by pipeline methods and highlighting the potential of end-to-end document parsing. On PureDocBench, OvisOCR2 also achieves the highest Avg3 score of 75.06. Beyond these two public benchmarks, we evaluate OvisOCR2 on an in-house benchmark designed to cover a broader set of long-tail and challenging scenarios. OvisOCR2 obtains the best overall performance among the compared methods, providing further evidence of its generalization and robustness. OvisOCR2 is available at https://huggingface.co/ATH-MaaS/OvisOCR2.

URL PDF HTML