视频大模型

Scaling Up Video Summarization Pretraining with Large Language Models

Dawit Mureja Argaw, Seunghyun Yoon, Fabian Caba Heilbron, Hanieh Deilamsalehy, Trung Bui, Zhaowen Wang, Franck Dernoncourt, Joon Son Chung

专题命中 视频理解 ：long video(abstract)；分类 cs.CV

Comments Accepted to CVPR 2024

Streaming Dense Video Captioning

Xingyi Zhou, Anurag Arnab, Shyamal Buch, Shen Yan, Austin Myers, Xuehan Xiong, Arsha Nagrani, Cordelia Schmid

专题命中 视频理解 ：long video(abstract)；分类 cs.CV

Comments CVPR 2024. Code is available at https://github.com/google-research/scenic/tree/main/scenic/projects/streaming_dvc

Video-GroundingDINO: Towards Open-Vocabulary Spatio-Temporal Video Grounding

Syed Talal Wasim, Muzammal Naseer, Salman Khan, Ming-Hsuan Yang, Fahad Shahbaz Khan

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Think before You Leap: Content-Aware Low-Cost Edge-Assisted Video Semantic Segmentation

Mingxuan Yan, Yi Wang, Xuedou Xiao, Zhiqing Luo, Jianhua He, Wei Wang

专题命中 视频理解 ：video understanding(abstract)；分类 cs.MM

Comments Accepted by ACM Multimedia 2023

Don't Judge by the Look: Towards Motion Coherent Video Representation

Yitian Zhang, Yue Bai, Huan Wang, Yizhou Wang, Yun Fu

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by ICLR2024

A spatiotemporal style transfer algorithm for dynamic visual stimulus generation

Antonino Greco, Markus Siegel

专题命中 视频理解 ：video generation(abstract)；分类 cs.CV

Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers

Tsai-Shien Chen, Aliaksandr Siarohin, Willi Menapace, Ekaterina Deyneka, Hsiang-wei Chao, Byung Eun Jeon, Yuwei Fang, Hsin-Ying Lee, Jian Ren, Ming-Hsuan Yang, Sergey Tulyakov

专题命中 视频理解 ：video generation(abstract)；分类 cs.CV

Comments CVPR 2024. Project Page: https://snap-research.github.io/Panda-70M

Spatio-temporal Prompting Network for Robust Video Feature Extraction

Guanxiong Sun, Chi Wang, Zhaoyu Zhang, Jiankang Deng, Stefanos Zafeiriou, Yang Hua

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Journal ref 2023 International Conference on Computer Vision (ICCV) 13541-13551

Beyond the Frame: Single and mutilple video summarization method with user-defined length

Vahid Ahmadi Kalkhorani, Qingquan Zhang, Guanqun Song, Ting Zhu

专题命中 视频理解 ：long video(abstract)；分类 cs.CV

ClawCraneNet: Leveraging Object-level Relation for Text-based Video Segmentation

Chen Liang, Yu Wu, Yawei Luo, Yi Yang

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Extended version published in https://ieeexplore.ieee.org/abstract/document/10083244

No More Shortcuts: Realizing the Potential of Temporal Self-Supervision

Ishan Rajendrakumar Dave, Simon Jenni, Mubarak Shah

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments AAAI 2024 (Main Technical Track)

X4D-SceneFormer: Enhanced Scene Understanding on 4D Point Cloud Videos through Cross-modal Knowledge Transfer

Linglin Jing, Ying Xue, Xu Yan, Chaoda Zheng, Dong Wang, Ruimao Zhang, Zhigang Wang, Hui Fang, Bin Zhao, Zhen Li

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

PromptonomyViT: Multi-Task Prompt Learning Improves Video Transformers using Synthetic Scene Data

Roei Herzig, Ofir Abramovich, Elad Ben-Avraham, Assaf Arbelle, Leonid Karlinsky, Ariel Shamir, Trevor Darrell, Amir Globerson

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments WACV 2024

LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models

Yanwei Li, Chengyao Wang, Jiaya Jia

专题命中 视频理解 ：long video(abstract)；分类 cs.CV

Comments Code is available at https://github.com/dvlab-research/LLaMA-VID

EgoEnv: Human-centric environment representations from egocentric video

Tushar Nagarajan, Santhosh Kumar Ramakrishnan, Ruta Desai, James Hillis, Kristen Grauman

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Published in NeurIPS 2023 (Oral)

Rotation Invariant Transformer for Recognizing Object in UAVs

Shuoyi Chen, Mang Ye, Bo Du

专题命中 视频理解 ：video reasoning(abstract)；分类 cs.CV

Comments ACM MM2022

Video-Mined Task Graphs for Keystep Recognition in Instructional Videos

Kumar Ashutosh, Santhosh Kumar Ramakrishnan, Triantafyllos Afouras, Kristen Grauman

专题命中 视频理解 ：long video(abstract)；分类 cs.CV

Comments NeurIPS 2023

Video-Teller: Enhancing Cross-Modal Generation with Fusion and Decoupling

Haogeng Liu, Qihang Fan, Tingkai Liu, Linjie Yang, Yunzhe Tao, Huaibo Huang, Ran He, Hongxia Yang

专题命中 视频理解 ：video-language(abstract)；分类 cs.CV

Language as the Medium: Multimodal Video Classification through text only

Laura Hanu, Anita L. Verő, James Thewlis

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted at "What is Next in Multimodal Foundation Models?" (MMFM) workshop at ICCV 2023

CEFHRI: A Communication Efficient Federated Learning Framework for Recognizing Industrial Human-Robot Interaction

Umar Khalid, Hasan Iqbal, Saeed Vahidian, Jing Hua, Chen Chen

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted in IROS 2023

Parameter-Efficient Transfer Learning for Audio-Visual-Language Tasks

Hongye Liu, Xianhai Xie, Yang Gao, Size Li, Zhou YU

专题命中 视频理解 ：video understanding(abstract)；分类 cs.MM

Masked Spatio-Temporal Structure Prediction for Self-supervised Learning on Point Cloud Videos

Zhiqiang Shen, Xiaoxiao Sheng, Hehe Fan, Longguang Wang, Yulan Guo, Qiong Liu, Hao Wen, Xi Zhou

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by ICCV 2023

Helping Hands: An Object-Aware Ego-Centric Video Recognition Model

Chuhan Zhang, Ankush Gupta, Andrew Zisserman

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments ICCV2023

Vehicle Detection and Classification without Residual Calculation: Accelerating HEVC Image Decoding with Random Perturbation Injection

Muhammet Sebul Beratoğlu, Behçet Uğur Töreyin

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments 10 pages 4 figures

Convolutional Hierarchical Attention Network for Query-Focused Video Summarization

Shuwen Xiao, Zhou Zhao, Zijian Zhang, Xiaohui Yan, Min Yang

专题命中 视频理解 ：long video(abstract)；分类 cs.CV

Comments Accepted by AAAI 2020 Conference

Multimodal Distillation for Egocentric Action Recognition

Gorjan Radevski, Dusan Grujicic, Marie-Francine Moens, Matthew Blaschko, Tinne Tuytelaars

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted at ICCV 2023; Codebase released at https://github.com/gorjanradevski/multimodal-distillation

mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections

Chenliang Li, Haiyang Xu, Junfeng Tian, Wei Wang, Ming Yan, Bin Bi, Jiabo Ye, Hehong Chen, Guohai Xu, Zheng Cao, Ji Zhang, Songfang Huang, Fei Huang, Jingren Zhou, Luo Si

专题命中 视频理解 ：video-language(abstract)；分类 cs.CV

Journal ref EMNLP2022

An overview on the evaluated video retrieval tasks at TRECVID 2022

George Awad, Keith Curtis, Asad Butt, Jonathan Fiscus, Afzal Godil, Yooyoung Lee, Andrew Delgado, Eliot Godard, Lukas Diduch, Jeffrey Liu, Yvette Graham, Georges Quenot

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments arXiv admin note: substantial text overlap with arXiv:2104.13473, arXiv:2009.09984

VideoLLM: Modeling Video Sequence with Large Language Models

Guo Chen, Yin-Dong Zheng, Jiahao Wang, Jilan Xu, Yifei Huang, Junting Pan, Yi Wang, Yali Wang, Yu Qiao, Tong Lu, Limin Wang

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Technical Report

Learning Grounded Vision-Language Representation for Versatile Understanding in Untrimmed Videos

Teng Wang, Jinrui Zhang, Feng Zheng, Wenhao Jiang, Ran Cheng, Ping Luo

专题命中 视频理解 ：video-language(abstract)；分类 cs.CV