视频大模型

MH-DETR: Video Moment and Highlight Detection with Cross-modal Transformer

Yifang Xu, Yunzhuo Sun, Yang Li, Yilei Shi, Xiaoxiang Zhu, Sidan Du

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Search-Map-Search: A Frame Selection Paradigm for Action Recognition

Mingjun Zhao, Yakun Yu, Xiaoli Wang, Lei Yang, Di Niu

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments CVPR 2023

INR-V: A Continuous Representation Space for Video-based Generative Tasks

Bipasha Sen, Aditya Agarwal, Vinay P Namboodiri, C. V. Jawahar

专题命中 视频理解 ：video generation(abstract)；分类 cs.CV

Comments Published in Transactions on Machine Learning Research (10/2022); https://openreview.net/forum?id=aIoEkwc2oB

Whether and When does Endoscopy Domain Pretraining Make Sense?

Dominik Batić, Felix Holm, Ege Özsoy, Tobias Czempiel, Nassir Navab

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Streaming Video Model

Yucheng Zhao, Chong Luo, Chuanxin Tang, Dongdong Chen, Noel Codella, Zheng-Jun Zha

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by CVPR'23

TempCLR: Temporal Alignment Representation with Contrastive Learning

Yuncong Yang, Jiawei Ma, Shiyuan Huang, Long Chen, Xudong Lin, Guangxing Han, Shih-Fu Chang

专题命中 视频理解 ：long video(abstract)；分类 cs.CV

Comments ICLR 2023 Camera Ready. Code Link: https://github.com/yyuncong/TempCLR

TimeBalance: Temporally-Invariant and Temporally-Distinctive Video Representations for Semi-Supervised Action Recognition

Ishan Rajendrakumar Dave, Mamshad Nayeem Rizve, Chen Chen, Mubarak Shah

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments CVPR-2023

Bidirectional Cross-Modal Knowledge Exploration for Video Recognition with Pre-trained Vision-Language Models

Wenhao Wu, Xiaohan Wang, Haipeng Luo, Jingdong Wang, Yi Yang, Wanli Ouyang

专题命中 视频理解 ：text-to-video(abstract)；分类 cs.CV

Comments Accepted by CVPR 2023

Query-Dependent Video Representation for Moment Retrieval and Highlight Detection

WonJun Moon, Sangeek Hyun, SangUk Park, Dongchan Park, Jae-Pil Heo

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted to CVPR 2023. Code is available at https://github.com/wjun0830/QD-DETR

Dual-path Adaptation from Image to Video Transformers

Jungin Park, Jiyoung Lee, Kwanghoon Sohn

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments CVPR 2023. Code is available at https://github.com/park-jungin/DualPath

Spatio-Temporal Crop Aggregation for Video Representation Learning

Sepehr Sameni, Simon Jenni, Paolo Favaro

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Learning Transferable Spatiotemporal Representations from Natural Script Knowledge

Ziyun Zeng, Yuying Ge, Xihui Liu, Bin Chen, Ping Luo, Shu-Tao Xia, Yixiao Ge

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by CVPR 2023; camera-ready version

Video4MRI: An Empirical Study on Brain Magnetic Resonance Image Analytics with CNN-based Video Classification Frameworks

Yuxuan Zhang, Qingzhong Wang, Jiang Bian, Yi Liu, Yanwu Xu, Dejing Dou, Haoyi Xiong

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by IEEE ISBI'23

AIM: Adapting Image Models for Efficient Video Action Recognition

Taojiannan Yang, Yi Zhu, Yusheng Xie, Aston Zhang, Chen Chen, Mu Li

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted to ICLR 2023. Project webpage is at https://adapt-image-models.github.io/

Regeneration Learning: A Learning Paradigm for Data Generation

Xu Tan, Tao Qin, Jiang Bian, Tie-Yan Liu, Yoshua Bengio

专题命中 视频理解 ：video generation(abstract)；分类 cs.CV

Learning from What is Already Out There: Few-shot Sign Language Recognition with Online Dictionaries

Matyáš Boháček, Marek Hrúz

专题命中 视频理解 ：text-to-video(abstract)；分类 cs.CV

Comments 6 pages, 2 figures, IEEE Face & Gestures 2023

Video2Commonsense: Generating Commonsense Descriptions to Enrich Video Captioning

Zhiyuan Fang, Tejas Gokhale, Pratyay Banerjee, Chitta Baral, Yezhou Yang

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments EMNLP 2020. V2C Website: https://asu-apg.github.io/Video2Commonsense/

Joint Engagement Classification using Video Augmentation Techniques for Multi-person Human-robot Interaction

Yubin Kim, Huili Chen, Sharifa Alghowinem, Cynthia Breazeal, Hae Won Park

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Contextual Explainable Video Representation: Human Perception-based Understanding

Khoa Vo, Kashu Yamazaki, Phong X. Nguyen, Phat Nguyen, Khoa Luu, Ngan Le

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted in Asilomar Conference 2022

Masked Contrastive Pre-Training for Efficient Video-Text Retrieval

Fangxun Shu, Biaolong Chen, Yue Liao, Shuwen Xiao, Wenyu Sun, Xiaobo Li, Yousong Zhu, Jinqiao Wang, Si Liu

专题命中 视频理解 ：video-language(abstract)；分类 cs.CV

Comments Technical Report

Bringing Image Scene Structure to Video via Frame-Clip Consistency of Object Tokens

Elad Ben-Avraham, Roei Herzig, Karttikeya Mangalam, Amir Bar, Anna Rohrbach, Leonid Karlinsky, Trevor Darrell, Amir Globerson

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Tech report

Dynamic Appearance: A Video Representation for Action Recognition with Joint Training

Guoxi Huang, Adrian G. Bors

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Contrastive Masked Autoencoders for Self-Supervised Video Hashing

Yuting Wang, Jinpeng Wang, Bin Chen, Ziyun Zeng, Shutao Xia

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments This work is accepted by the AAAI 2023. 9 pages, 6 figures, 6 tables

OperA: Attention-Regularized Transformers for Surgical Phase Recognition

Tobias Czempiel, Magdalini Paschali, Daniel Ostler, Seong Tae Kim, Benjamin Busam, Nassir Navab

专题命中 视频理解 ：long video(abstract)；分类 cs.CV

Comments 10 pages, 3 figures

UniFormerV2: Spatiotemporal Learning by Arming Image ViTs with Video UniFormer

Kunchang Li, Yali Wang, Yinan He, Yizhuo Li, Yi Wang, Limin Wang, Yu Qiao

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments 24 pages, 4 figures, 20 tables

InternVideo-Ego4D: A Pack of Champion Solutions to Ego4D Challenges

Guo Chen, Sen Xing, Zhe Chen, Yi Wang, Kunchang Li, Yizhuo Li, Yi Liu, Jiahao Wang, Yin-Dong Zheng, Bingkun Huang, Zhiyu Zhao, Junting Pan, Yifei Huang, Zun Wang, Jiashuo Yu, Yinan He, Hongjie Zhang, Tong Lu, Yali Wang, Limin Wang, Yu Qiao

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Technical report in 2nd International Ego4D Workshop@ECCV 2022. Code will be released at https://github.com/OpenGVLab/ego4d-eccv2022-solutions

Exploring State Change Capture of Heterogeneous Backbones @ Ego4D Hands and Objects Challenge 2022

Yin-Dong Zheng, Guo Chen, Jiahao Wang, Tong Lu, Limin Wang

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments 5 pages, 3 figures

Transformed ROIs for Capturing Visual Transformations in Videos

Abhinav Rai, Fadime Sener, Angela Yao

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments CVIU 2022 - Computer Vision and Image Understanding

Clean Text and Full-Body Transformer: Microsoft's Submission to the WMT22 Shared Task on Sign Language Translation

Subhadeep Dey, Abhilash Pal, Cyrine Chaabani, Oscar Koller

专题命中 视频理解 ：long video(abstract)；分类 cs.CV

Comments accepted for publication at WMT2022

Grounded Video Situation Recognition

Zeeshan Khan, C. V. Jawahar, Makarand Tapaswi

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted to NeurIPS 2022. Project Page: https://zeeshank95.github.io/grvidsitu