视频大模型

Free-MoRef: Instantly Multiplexing Context Perception Capabilities of Video-MLLMs within Single Inference

Kuo Wang, Quanlong Zheng, Junlin Xie, Yanhao Zhang, Jinguo Luo, Haonan Lu, Liang Lin, Fan Zhou, Guanbin Li

机构 * Sun Yat-sen University（中山大学） ； Peng Cheng Laboratory（鹏城实验室） ； OPPO AI Center（OPPO人工智能中心） ； Research Institute（研究 institute） ； The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳）） ； Harbin Institute of Technology（哈尔滨工业大学） ； Shenzhen Key Laboratory of Digital Living Network and Content Service（深圳数字生活网络与内容服务重点实验室） ； Guangdong Key Laboratory of Big Data Analysis and Processing（广东省大数据分析与处理重点实验室） 纠错

专题命中 视频理解 ：video understanding(abstract)；long video(abstract)；分类 cs.CV

Comments published in ICCV 2025

PEVLM: Parallel Encoding for Vision-Language Models

Letian Kang, Shixian Luo, Yiqiang Li, Yuxin Yin, Shenxuan Zhou, Xiaoyang Yu, Jin Yang, Yong Wu

机构 * Li Auto Inc.（利自动公司） 纠错

专题命中 视频理解 ：video understanding(abstract)；long video(abstract)；分类 cs.CV

AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning

Yiwu Zhong, Zhuoming Liu, Yin Li, Liwei Wang

机构 * The Chinese University of Hong Kong（香港中文大学） ； University of Wisconsin-Madison（威斯康星大学麦迪逊分校） 纠错

专题命中 视频理解 ：video understanding(abstract)；long video(abstract)；分类 cs.CV

Comments Accepted to ICCV 2025

Bisecle: Binding and Separation in Continual Learning for Video Language Understanding

Yue Tan, Xiaoqian Hu, Hao Xue, Celso De Melo, Flora D. Salim

机构 * School of Computer Science University of New South Wales（计算机科学学院新南威尔士大学） ； School of Computer Science and Engineering University of New South Wales（计算机科学与工程学院新南威尔士大学） ； DEVCOM Army Research Laboratory（陆军研究实验室） 纠错

专题命中 视频理解 ：video understanding(abstract)；video-language(abstract)；分类 cs.CV

Comments 23 pages, 12 figures, 10 tables

HERMES: temporal-coHERent long-forM understanding with Episodes and Semantics

Gueter Josmy Faure, Jia-Fong Yeh, Min-Hung Chen, Hung-Ting Su, Shang-Hong Lai, Winston H. Hsu

机构 * National Taiwan University（国立台湾大学） ； NVIDIA（NVIDIA公司） ； National Tsing Hua University（国立清华大学） 纠错

专题命中 视频理解 ：video understanding(abstract)；video-language(abstract)；分类 cs.CV

Comments Accepted for ICCV 2025. Project page: https://joslefaure.github.io/assets/html/hermes.html

VideoRoPE: What Makes for Good Video Rotary Position Embedding?

Xilin Wei, Xiaoran Liu, Yuhang Zang, Xiaoyi Dong, Pan Zhang, Yuhang Cao, Jian Tong, Haodong Duan, Qipeng Guo, Jiaqi Wang, Xipeng Qiu, Dahua Lin

专题命中 视频理解 ：video understanding(abstract)；long video(abstract)；分类 cs.CV

Clapper: Compact Learning and Video Representation in VLMs

Lingyu Kong, Hongzhi Zhang, Jingyuan Zhang, Jianzhao Huang, Kunze Li, Qi Wang, Fuzheng Zhang

机构 * University of Chinese Academy of Sciences（中国科学院大学） ； Kuaishou Technology（快手科技） ； Xi’an Jiaotong University（西安交通大学） 纠错

专题命中 视频理解 ：video understanding(abstract)；long video(abstract)；分类 cs.CV

ViaRL: Adaptive Temporal Grounding via Visual Iterated Amplification Reinforcement Learning

Ziqiang Xu, Qi Dai, Tian Xie, Yifan Yang, Kai Qiu, DongDong Chen, Zuxuan Wu, Chong Luo

机构 * Fudan University（复旦大学） ； Microsoft（微软公司） 纠错

专题命中 视频理解 ：video understanding(abstract)；long video(abstract)；分类 cs.CV

TimeSoccer: An End-to-End Multimodal Large Language Model for Soccer Commentary Generation

Ling You, Wenxuan Huang, Xinni Xie, Xiangyi Wei, Bangyan Li, Shaohui Lin, Yang Li, Changbo Wang

机构 * East China Normal University（东华大学） 纠错

专题命中 视频理解 ：video understanding(abstract)；long video(abstract)；分类 cs.CV

Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Models

Guo Chen, Zhiqi Li, Shihao Wang, Jindong Jiang, Yicheng Liu, Lidong Lu, De-An Huang, Wonmin Byeon, Matthieu Le, Tuomas Rintamaki, Tyler Poon, Max Ehrlich, Tuomas Rintamaki, Tyler Poon, Tong Lu, Limin Wang, Bryan Catanzaro, Jan Kautz, Andrew Tao, Zhiding Yu, Guilin Liu

专题命中 视频理解 ：video understanding(abstract)；long video(abstract)；分类 cs.CV

VistaDPO: Video Hierarchical Spatial-Temporal Direct Preference Optimization for Large Video Models

Haojian Huang, Haodong Chen, Shengqiong Wu, Meng Luo, Jinlan Fu, Xinya Du, Hanwang Zhang, Hao Fei

专题命中 视频理解 ：video understanding(abstract)；video-language(abstract)；分类 cs.CV

Comments Code and Data: https://github.com/HaroldChen19/VistaDPO

Collaborative Temporal Consistency Learning for Point-supervised Natural Language Video Localization

Zhuo Tao, Liang Li, Qi Chen, Yunbin Tu, Zheng-Jun Zha, Ming-Hsuan Yang, Yuankai Qi, Qingming Huang

专题命中 视频理解 ：video understanding(abstract)；video-language(abstract)；分类 cs.CV

Comments Under review

XAttention: Block Sparse Attention with Antidiagonal Scoring

Ruyi Xu, Guangxuan Xiao, Haofeng Huang, Junxian Guo, Song Han

专题命中 视频理解 ：video generation(abstract)；video understanding(abstract)；分类 cs.CV

Comments The first two authors contributed equally to this work

Impossible Videos

Zechen Bai, Hai Ci, Mike Zheng Shou

专题命中 视频理解 ：video generation(abstract)；video understanding(abstract)；分类 cs.CV

Comments 26 pages

CaReBench: A Fine-Grained Benchmark for Video Captioning and Retrieval

Yifan Xu, Xinhao Li, Yichun Yang, Desen Meng, Rui Huang, Limin Wang

专题命中 视频理解 ：video understanding(abstract)；video-language(abstract)；分类 cs.CV

Valley: Video Assistant with Large Language model Enhanced abilitY

Ruipu Luo, Ziwang Zhao, Min Yang, Zheming Yang, Minghui Qiu, Tao Wang, Zhongyu Wei, Yanhao Wang, Cen Chen

专题命中 视频理解 ：video understanding(abstract)；long video(abstract)；分类 cs.CV

On the Limitations of Vision-Language Models in Understanding Image Transforms

Ahmad Mustafa Anis, Hasnain Ali, Saquib Sarfraz

专题命中 视频理解 ：video generation(abstract)；video understanding(abstract)；分类 cs.CV

Comments 8 pages, 15 images

PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Models

Chenyu Yang, Xuan Dong, Xizhou Zhu, Weijie Su, Jiahao Wang, Hao Tian, Zhe Chen, Wenhai Wang, Lewei Lu, Jifeng Dai

专题命中 视频理解 ：video understanding(abstract)；long video(abstract)；分类 cs.CV

Vript: A Video Is Worth Thousands of Words

Dongjie Yang, Suyuan Huang, Chengqiang Lu, Xiaodong Han, Haoxin Zhang, Yan Gao, Yao Hu, Hai Zhao

专题命中 视频理解 ：video understanding(abstract)；long video(abstract)；分类 cs.CV

Comments Accepted by NeurIPS Dataset & Benchmark track

It's Just Another Day: Unique Video Captioning by Discriminative Prompting

Toby Perrett, Tengda Han, Dima Damen, Andrew Zisserman

专题命中 视频理解 ：text-to-video(abstract)；long video(abstract)；分类 cs.CV

Comments ACCV 2024 Oral. Project page: https://tobyperrett.github.io/its-just-another-day/

VidLPRO: A $\underline{Vid}$eo-$\underline{L}$anguage $\underline{P}$re-training Framework for $\underline{Ro}$botic and Laparoscopic Surgery

Mohammadmahdi Honarmand, Muhammad Abdullah Jamal, Omid Mohareri

专题命中 视频理解 ：video understanding(abstract)；video-language(abstract)；分类 cs.CV

PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioning

Lin Xu, Yilin Zhao, Daquan Zhou, Zhijie Lin, See Kiong Ng, Jiashi Feng

专题命中 视频理解 ：video understanding(abstract)；video-language(abstract)；分类 cs.CV

On the Pitfalls of Batch Normalization for End-to-End Video Learning: A Study on Surgical Workflow Analysis

Dominik Rivoir, Isabel Funke, Stefanie Speidel

专题命中 视频理解 ：video understanding(abstract)；long video(abstract)；分类 cs.CV

Comments Accepted at Medical Image Analysis (MedIA). Publication link: https://www.sciencedirect.com/science/article/pii/S1361841524000513

SnAG: Scalable and Accurate Video Grounding

Fangzhou Mu, Sicheng Mo, Yin Li

专题命中 视频理解 ：video understanding(abstract)；long video(abstract)；分类 cs.CV

Comments Accepted to CVPR 2024. Code available at https://github.com/fmu2/snag_release

ST-LLM: Large Language Models Are Effective Temporal Learners

Ruyang Liu, Chen Li, Haoran Tang, Yixiao Ge, Ying Shan, Ge Li

专题命中 视频理解 ：video understanding(abstract)；long video(abstract)；分类 cs.CV

Towards Multimodal Video Paragraph Captioning Models Robust to Missing Modality

Sishuo Chen, Lei Li, Shuhuai Ren, Rundong Gao, Yuanxin Liu, Xiaohan Bi, Xu Sun, Lu Hou

专题命中 视频理解 ：video understanding(abstract)；long video(abstract)；分类 cs.CV

Comments Code available at https://github.com/lancopku/MR-VPC

Weakly Supervised Video Representation Learning with Unaligned Text for Sequential Videos

Sixun Dong, Huazhang Hu, Dongze Lian, Weixin Luo, Yicheng Qian, Shenghua Gao

专题命中 视频理解 ：video understanding(abstract)；text-to-video(abstract)；分类 cs.CV

Comments CVPR 2023. Code: https://github.com/svip-lab/WeakSVR

Semi-Parametric Video-Grounded Text Generation

Sungdong Kim, Jin-Hwa Kim, Jiyoung Lee, Minjoon Seo

专题命中 视频理解 ：video understanding(abstract)；video-language(abstract)；分类 cs.CV

Comments Preprint (16 pages, 5 figures)

Learning Video Representations from Large Language Models

Yue Zhao, Ishan Misra, Philipp Krähenbühl, Rohit Girdhar

专题命中 视频理解 ：video-language(abstract)；long video(abstract)；分类 cs.CV

Comments Tech report. Project page: https://facebookresearch.github.io/LaViLa; Code is available at http://github.com/facebookresearch/LaViLa

InternVideo: General Video Foundation Models via Generative and Discriminative Learning

Yi Wang, Kunchang Li, Yizhuo Li, Yinan He, Bingkun Huang, Zhiyu Zhao, Hongjie Zhang, Jilan Xu, Yi Liu, Zun Wang, Sen Xing, Guo Chen, Junting Pan, Jiashuo Yu, Yali Wang, Limin Wang, Yu Qiao

专题命中 视频理解 ：video understanding(abstract)；video-language(abstract)；分类 cs.CV

Comments technical report