视频大模型

AViLA: Asynchronous Vision-Language Agent for Streaming Multimodal Data Interaction

Gengyuan Zhang, Tanveer Hannan, Hermine Kleiner, Beste Aydemir, Xinyu Xie, Jian Lan, Thomas Seidl, Volker Tresp, Jindong Gu

机构 * LMU Munich（慕尼黑大学） ； Munich Center for Machine Learning（慕尼黑机器学习中心） ； University of Oxford（牛津大学） 纠错

专题命中 长视频与时序推理 ：video-language(abstract)；分类 cs.CV

Comments preprint version; 23 pages (including references and appendix)

Spatial-Temporal Pre-Training for Embryo Viability Prediction Using Time-Lapse Videos

Zhiyi Shi, Junsik Kim, Helen Y. Yang, Yonghyun Song, Hyun-Jic Oh, Dalit Ben-Yosef, Daniel Needleman, Hanspeter Pfister

机构 * organization= School of Engineering ； Applied Sciences, Harvard University , city= Allston , state= MA , country= USA ； organization= Department of Molecular ； Cellular Biology, Harvard University , city= Cambridge , state= MA , country= USA ； organization= College of Informatics ； Department of Computer Science ； Engineering, \ University , city= Seoul , country= South Korea ； organization= Fertility \& IVF Institute, Tel Aviv Sourasky Medical Center , city= Tel Aviv , country= Israel ； organization= CORAL - Center Of Regeneration And Longevity, Tel Aviv University , city= Tel Aviv , country= Israel ； organization= Center for Computational Biology, Flatiron Institute , city= NY , state= NY , country= USA 纠错

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments Preprint submitted to Medical Image Analysis

FRAME: Pre-Training Video Feature Representations via Anticipation and Memory

Sethuraman TV, Savya Khosla, Vignesh Srinivasakumar, Jiahui Huang, Seoung Wug Oh, Simon Jenni, Derek Hoiem, Joon-Young Lee

机构 * Adobe Research（Adobe研究院） ； University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） 纠错

专题命中 长视频与时序推理 ：video understanding(abstract)；分类 cs.CV

MoviePuzzle: Visual Narrative Reasoning through Multimodal Order Learning

Jianghui Wang, Yuxuan Wang, Dongyan Zhao, Zilong Zheng

机构 * Beijing Institute for General Artificial Intelligence（北京通用人工智能研究院） ； Wangxuan Institute of Computer Technology（王轩计算机技术研究所） 纠错

专题命中 长视频与时序推理 ：video understanding(abstract)；分类 cs.CV

Test-Time Training Done Right

Tianyuan Zhang, Sai Bi, Yicong Hong, Kai Zhang, Fujun Luan, Songlin Yang, Kalyan Sunkavalli, William T. Freeman, Hao Tan

机构 * Massachusetts Institute of Technology（麻省理工学院） ； Adobe Research（Adobe研究） 纠错

专题命中 长视频与时序推理 ：video diffusion(abstract)；分类 cs.CV

Comments 32 pages, 11 figures

Semantics-aware Test-time Adaptation for 3D Human Pose Estimation

Qiuxia Lin, Rongyu Chen, Kerui Gu, Angela Yao

专题命中 长视频与时序推理 ：video understanding(abstract)；分类 cs.CV

Comments 10 pages, 4 figures

Locality-aware Cross-modal Correspondence Learning for Dense Audio-Visual Events Localization

Ling Xing, Hongyu Qu, Rui Yan, Xiangbo Shu, Jinhui Tang

机构 * School of Computer Science and Engineering, Nanjing University of Science and Technology（计算机科学与工程学院，南京理工大学） 纠错

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Learning 3D Persistent Embodied World Models

Siyuan Zhou, Yilun Du, Yuncong Yang, Lei Han, Peihao Chen, Dit-Yan Yeung, Chuang Gan

机构 * Institution1（机构1） ； Institution2（机构2） 纠错

专题命中 长视频与时序推理 ：video diffusion(abstract)；分类 cs.CV

Small Clips, Big Gains: Learning Long-Range Refocused Temporal Information for Video Super-Resolution

Xingyu Zhou, Wei Long, Jingbo Lu, Shiyin Jiang, Weiyi You, Haifeng Wu, Shuhang Gu

机构 * University of Electronic Science and Technology of China（电子科技大学） 纠错

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments 15 pages, 11 figures

Predict-Optimize-Distill: A Self-Improving Cycle for 4D Object Understanding

Mingxuan Wu, Huang Huang, Justin Kerr, Chung Min Kim, Anthony Zhang, Brent Yi, Angjoo Kanazawa

机构 * University of California, Berkeley（加州大学伯克利分校） 纠错

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments See our website at: https://predict-optimize-distill.github.io/pod.github.io First two authors contributed equally

DivPrune: Diversity-based Visual Token Pruning for Large Multimodal Models

Saeed Ranjbar Alvar, Gursimran Singh, Mohammad Akbari, Yong Zhang

专题命中 长视频与时序推理 ：video-language(abstract)；分类 cs.CV

Comments Accepted to CVPR 2025

Exploiting Temporal State Space Sharing for Video Semantic Segmentation

Syed Ariff Syed Hesham, Yun Liu, Guolei Sun, Henghui Ding, Jing Yang, Ender Konukoglu, Xue Geng, Xudong Jiang

专题命中 长视频与时序推理 ：long video(abstract)；分类 eess.IV

Comments IEEE/CVF Conference on Computer Vision and Pattern Recognition 2025

RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concrete

Yuheng Ji, Huajie Tan, Jiayu Shi, Xiaoshuai Hao, Yuan Zhang, Hengyuan Zhang, Pengwei Wang, Mengdi Zhao, Yao Mu, Pengju An, Xinda Xue, Qinghang Su, Huaihai Lyu, Xiaolong Zheng, Jiaming Liu, Zhongyuan Wang, Shanghang Zhang

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Long-Video Audio Synthesis with Multi-Agent Collaboration

Yehang Zhang, Xinli Xu, Xiaojie Xu, Li Liu, Yingcong Chen

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

RealVVT: Towards Photorealistic Video Virtual Try-on via Spatio-Temporal Consistency

Siqi Li, Zhengkai Jiang, Jiawei Zhou, Zhihong Liu, Xiaowei Chi, Haoqian Wang

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments 10 pages (8 pages main text, 2 pages references), 5 figures in the main text, and 4 pages supplementary materials with 3 additional figures

TR-DQ: Time-Rotation Diffusion Quantization

Yihua Shao, Deyang Lin, Fanhu Zeng, Minxi Yan, Muyang Zhang, Siyu Chen, Yuxuan Fan, Ziyang Yan, Haozhe Wang, Jingcai Guo, Yan Wang, Haotong Qin, Hao Tang

专题命中 长视频与时序推理 ：video generation(abstract)；分类 cs.CV

An Egocentric Vision-Language Model based Portable Real-time Smart Assistant

Yifei Huang, Jilan Xu, Baoqi Pei, Yuping He, Guo Chen, Mingfang Zhang, Lijin Yang, Zheng Nie, Jinyao Liu, Guoshun Fan, Dechen Lin, Fang Fang, Kunpeng Li, Chang Yuan, Xinyuan Chen, Yaohui Wang, Yali Wang, Yu Qiao, Limin Wang

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Efficient 4D Gaussian Stream with Low Rank Adaptation

Zhenhuan Liu, Shuai Liu, Yidong Lu, Yirui Chen, Jie Yang, Wei Liu

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments 3 pages draft

Do Language Models Understand Time?

Xi Ding, Lei Wang

专题命中 长视频与时序推理 ：video understanding(abstract)；分类 cs.CV

Comments Accepted for publication in the Companion Proceedings of the ACM Web Conference (WWW Companion 2025)

Masked Generative Nested Transformers with Decode Time Scaling

Sahil Goyal, Debapriya Tula, Gagan Jain, Pradeep Shenoy, Prateek Jain, Sujoy Paul

专题命中 长视频与时序推理 ：video generation(abstract)；分类 cs.CV

From Dashcam Videos to Driving Simulations: Stress Testing Automated Vehicles against Rare Events

Yan Miao, Georgios Fainekos, Bardh Hoxha, Hideki Okamoto, Danil Prokhorov, Sayan Mitra

专题命中 长视频与时序推理 ：video language model(abstract)；分类 cs.CV

Spatial Cognition from Egocentric Video: Out of Sight, Not Out of Mind

Chiara Plizzari, Shubham Goel, Toby Perrett, Jacob Chalk, Angjoo Kanazawa, Dima Damen

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments Accepted at 3DV 2025. 14 pages including references and appendix. Project Webpage: http://dimadamen.github.io/OSNOM/

RMem: Restricted Memory Banks Improve Video Object Segmentation

Junbao Zhou, Ziqi Pang, Yu-Xiong Wang

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments CVPR 2024, Project Page: https://restricted-memory.github.io/

A Flexible and Scalable Framework for Video Moment Search

Chongzhi Zhang, Xizhou Zhu, Aixin Sun

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Embodied VideoAgent: Persistent Memory from Egocentric Videos and Embodied Sensors Enables Dynamic Scene Understanding

Yue Fan, Xiaojian Ma, Rongpeng Su, Jun Guo, Rujie Wu, Xi Chen, Qing Li

专题命中 长视频与时序推理 ：video understanding(abstract)；分类 cs.CV

Comments project page: https://embodied-videoagent.github.io/

A Simple Recipe for Contrastively Pre-training Video-First Encoders Beyond 16 Frames

Pinelopi Papalampidi, Skanda Koppula, Shreya Pathak, Justin Chiu, Joe Heyward, Viorica Patraucean, Jiajun Shen, Antoine Miech, Andrew Zisserman, Aida Nematzadeh

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

RAIN: Real-time Animation of Infinite Video Stream

Zhilei Shu, Ruili Feng, Yang Cao, Zheng-Jun Zha

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

CompactFlowNet: Efficient Real-time Optical Flow Estimation on Mobile Devices

Andrei Znobishchev, Valerii Filev, Oleg Kudashev, Nikita Orlov, Humphrey Shi

专题命中 长视频与时序推理 ：video generation(abstract)；分类 cs.CV

Temporal Contrastive Learning for Video Temporal Reasoning in Large Vision-Language Models

Rafael Souza, Jia-Hao Lim, Alexander Davis

专题命中 长视频与时序推理 ：video-language(abstract)；分类 cs.CV

InfinityDrive: Breaking Time Limits in Driving World Models

Xi Guo, Chenjing Ding, Haoxuan Dou, Xin Zhang, Weixuan Tang, Wei Wu

专题命中 长视频与时序推理 ：video generation(abstract)；分类 cs.CV

Comments project homepage: https://metadrivescape.github.io/papers_project/InfinityDrive/page.html