视频大模型

VidHalluc: Evaluating Temporal Hallucinations in Multimodal Large Language Models for Video Understanding

Chaoyu Li, Eun Woo Im, Pooyan Fazli

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments CVPR 2025

Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R1

Yi Chen, Yuying Ge, Rui Wang, Yixiao Ge, Lu Qiu, Ying Shan, Xihui Liu

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments Technical Report (In Progress); Code released at: https://github.com/TencentARC/SEED-Bench-R1

SlowFast-LLaVA-1.5: A Family of Token-Efficient Video Large Language Models for Long-Form Video Understanding

Mingze Xu, Mingfei Gao, Shiyu Li, Jiasen Lu, Zhe Gan, Zhengfeng Lai, Meng Cao, Kai Kang, Yinfei Yang, Afshin Dehghan

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments Technical report

STOP: Integrated Spatial-Temporal Dynamic Prompting for Video Understanding

Zichen Liu, Kunlun Xu, Bing Su, Xu Zou, Yuxin Peng, Jiahuan Zhou

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Towards Universal Soccer Video Understanding

Jiayuan Rao, Haoning Wu, Hao Jiang, Ya Zhang, Yanfeng Wang, Weidi Xie

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments CVPR 2025; Project Page: https://jyrao.github.io/UniSoccer/

Beyond Training: Dynamic Token Merging for Zero-Shot Video Understanding

Yiming Zhang, Zhuokai Zhao, Zhaorun Chen, Zenghui Ding, Xianjun Yang, Yining Sun

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments Code is available at https://github.com/Jam1ezhang/DYTO

Principles of Visual Tokens for Efficient Video Understanding

Xinyue Hao, Gen Li, Shreyank N Gowda, Robert B Fisher, Jonathan Huang, Anurag Arnab, Laura Sevilla-Lara

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Long-VMNet: Accelerating Long-Form Video Understanding via Fixed Memory

Saket Gurukar, Asim Kadav

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

VideoScan: Enabling Efficient Streaming Video Understanding via Frame-level Semantic Carriers

Ruanjun Li, Yuedong Tan, Yuanming Shi, Jiawei Shao

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments 11 pages, 4 figures

HecVL: Hierarchical Video-Language Pretraining for Zero-shot Surgical Phase Recognition

Kun Yuan, Vinkle Srivastav, Nassir Navab, Nicolas Padoy

专题命中 视频理解 ：video-language(title,abstract)；分类 cs.CV

Comments Accepted by MICCAI2024

VURF: A General-purpose Reasoning and Self-refinement Framework for Video Understanding

Ahmad Mahmood, Ashmal Vayani, Muzammal Naseer, Salman Khan, Fahad Shahbaz Khan

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

VideoWebArena: Evaluating Long Context Multimodal Agents with Video Understanding Web Tasks

Lawrence Jang, Yinheng Li, Dan Zhao, Charles Ding, Justin Lin, Paul Pu Liang, Rogerio Bonatti, Kazuhito Koishida

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Enhancing Video Understanding: Deep Neural Networks for Spatiotemporal Analysis

Amir Hosein Fadaei, Mohammad-Reza A. Dehaqani

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments 29 pages, 25 figures

Exploring the Role of Explicit Temporal Modeling in Multimodal Large Language Models for Video Understanding

Yun Li, Zhe Liu, Yajing Kong, Guangrui Li, Jiyuan Zhang, Chao Bian, Feng Liu, Lina Yao, Zhenbang Sun

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Tarsier2: Advancing Large Vision-Language Models from Detailed Video Description to Comprehensive Video Understanding

Liping Yuan, Jiawei Wang, Haomiao Sun, Yuchen Zhang, Yuan Lin

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

MMVU: Measuring Expert-Level Multi-Discipline Video Understanding

Yilun Zhao, Lujing Xie, Haowei Zhang, Guo Gan, Yitao Long, Zhiyuan Hu, Tongyan Hu, Weiyuan Chen, Chuhan Li, Junyang Song, Zhijian Xu, Chengye Wang, Weifeng Pan, Ziyao Shangguan, Xiangru Tang, Zhenwen Liang, Yixin Liu, Chen Zhao, Arman Cohan

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach

André O. Françani, Marcos R. O. A. Maximo

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments This work has been accepted for publication in IEEE Access

Your Interest, Your Summaries: Query-Focused Long Video Summarization

Nirav Patel, Payal Prajapati, Maitrik Shah

专题命中 视频理解 ：long video(title,abstract)；分类 cs.CV

Comments To appear at the 18th International Conference on Control, Automation, Robotics and Vision (ICARCV), December 2024, Dubai, UAE

Long Story Short: Story-level Video Understanding from 20K Short Films

Ridouane Ghermi, Xi Wang, Vicky Kalogeiton, Ivan Laptev

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

H-MBA: Hierarchical MamBa Adaptation for Multi-Modal Video Understanding in Autonomous Driving

Siran Chen, Yuxiao Luo, Yue Ma, Yu Qiao, Yali Wang

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments 7 pages, 4 figures

Hierarchical Banzhaf Interaction for General Video-Language Representation Learning

Peng Jin, Hao Li, Li Yuan, Shuicheng Yan, Jie Chen

专题命中 视频理解 ：video-language(title,abstract)；分类 cs.CV

Comments Accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI). arXiv admin note: substantial text overlap with arXiv:2303.14369

FriendsQA: A New Large-Scale Deep Video Understanding Dataset with Fine-grained Topic Categorization for Story Videos

Zhengqian Wu, Ruizhe Li, Zijun Xu, Zhongyuan Wang, Chunxia Xiao, Chao Liang

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments Accepted by AAAI 2025

IQViC: In-context, Question Adaptive Vision Compressor for Long-term Video Understanding LMMs

Sosuke Yamao, Natsuki Miyahara, Yuki Harazono, Shun Takeuchi

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments The first and second authors contributed equally to this work

VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by Video Spatiotemporal Augmentation

Weiming Ren, Huan Yang, Jie Min, Cong Wei, Wenhu Chen

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments Project Page: https://tiger-ai-lab.github.io/VISTA/

OmAgent: A Multi-modal Agent Framework for Complex Video Understanding with Task Divide-and-Conquer

Lu Zhang, Tiancheng Zhao, Heting Ying, Yibo Ma, Kyusong Lee

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding

Junming Lin, Zheng Fang, Chi Chen, Zihao Wan, Fuwen Luo, Peng Li, Yang Liu, Maosong Sun

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

TOPA: Extending Large Language Models for Video Understanding via Text-Only Pre-Alignment

Wei Li, Hehe Fan, Yongkang Wong, Mohan Kankanhalli, Yi Yang

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments NeurIPS 2024 (Spotlight)

HENASY: Learning to Assemble Scene-Entities for Egocentric Video-Language Model

Khoa Vo, Thinh Phan, Kashu Yamazaki, Minh Tran, Ngan Le

专题命中 视频理解 ：video-language(title,abstract)；分类 cs.CV

Comments Accepted to NeurIPS 2024

Video Token Merging for Long-form Video Understanding

Seon-Ho Lee, Jue Wang, Zhikang Zhang, David Fan, Xinyu Li

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments 21 pages, NeurIPS 2024

Journal ref NeurIPS 2024

Adaptive Video Understanding Agent: Enhancing efficiency with dynamic frame sampling and feedback-driven reasoning

Sullam Jeoung, Goeric Huybrechts, Bhavana Ganesh, Aram Galstyan, Sravan Bodapati

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV