视频大模型

FE-Adapter: Adapting Image-based Emotion Classifiers to Videos

Shreyank N Gowda, Boyan Gao, David A. Clifton

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Open-Set Video-based Facial Expression Recognition with Human Expression-sensitive Prompting

Yuanyuan Liu, Yuxuan Huang, Shuyang Liu, Yibing Zhan, Zijing Chen, Zhe Chen

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by ACM MM2024

Adversarial Robustness in RGB-Skeleton Action Recognition: Leveraging Attention Modality Reweighter

Chao Liu, Xin Liu, Zitong Yu, Yonghong Hou, Huanjing Yue, Jingyu Yang

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by IJCB 2024

Beyond MOT: Semantic Multi-Object Tracking

Yunhao Li, Qin Li, Hao Wang, Xue Ma, Jiali Yao, Shaohua Dong, Heng Fan, Libo Zhang

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted to ECCV2024

Leveraging Temporal Contextualization for Video Action Recognition

Minji Kim, Dongyoon Han, Taekyung Kim, Bohyung Han

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments 26 pages, 11 figures, 16 tables. To be presented at ECCV'24

In My Perspective, In My Hands: Accurate Egocentric 2D Hand Pose and Action Recognition

Wiktor Mucha, Martin Kampel

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted at: The 18th IEEE International Conference on Automatic Face and Gesture Recognition

VideoMamba: Spatio-Temporal Selective State Space Model

Jinyoung Park, Hee-Seon Kim, Kangwook Ko, Minbeom Kim, Changick Kim

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments ECCV 2024. code available at http://github.com/jinyjelly/VideoMamba

Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision

Orr Zohar, Xiaohan Wang, Yonatan Bitton, Idan Szpektor, Serena Yeung-Levy

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Project page: https://orrzohar.github.io/projects/video-star/

Multimodal Language Models for Domain-Specific Procedural Video Summarization

Nafisa Hussain

专题命中 视频理解 ：long video(abstract)；分类 cs.CV

Comments 6 pages, 3 figures

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

Pan Zhang, Xiaoyi Dong, Yuhang Zang, Yuhang Cao, Rui Qian, Lin Chen, Qipeng Guo, Haodong Duan, Bin Wang, Linke Ouyang, Songyang Zhang, Wenwei Zhang, Yining Li, Yang Gao, Peng Sun, Xinyue Zhang, Wei Li, Jingwen Li, Wenhai Wang, Hang Yan, Conghui He, Xingcheng Zhang, Kai Chen, Jifeng Dai, Yu Qiao, Dahua Lin, Jiaqi Wang

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Technical Report. https://github.com/InternLM/InternLM-XComposer

EgoVideo: Exploring Egocentric Foundation Model and Downstream Adaptation

Baoqi Pei, Guo Chen, Jilan Xu, Yuping He, Yicheng Liu, Kanghua Pan, Yifei Huang, Yali Wang, Tong Lu, Limin Wang, Yu Qiao

专题命中 视频理解 ：video-language(abstract)；分类 cs.CV

Comments Champion solutions in the EgoVis CVPR 2024 workshop

BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning

Ruyang Liu, Chen Li, Yixiao Ge, Ying Shan, Thomas H. Li, Ge Li

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Splatter a Video: Video Gaussian Representation for Versatile Processing

Yang-Tian Sun, Yi-Hua Huang, Lin Ma, Xiaoyang Lyu, Yan-Pei Cao, Xiaojuan Qi

专题命中 视频理解 ：video generation(abstract)；分类 cs.CV

EVEREST: Efficient Masked Video Autoencoder by Removing Redundant Spatiotemporal Tokens

Sunil Hwang, Jaehong Yoon, Youngwan Lee, Sung Ju Hwang

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by ICML 2024

GVT2RPM: An Empirical Study for General Video Transformer Adaptation to Remote Physiological Measurement

Hao Wang, Euijoon Ahn, Jinman Kim

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Code is available at https://github.com/Dylan-H-Wang/facial-ai

MeMSVD: Long-Range Temporal Structure Capturing Using Incremental SVD

Ioanna Ntinou, Enrique Sanchez, Georgios Tzimiropoulos

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted to ICIP 2024

ICSVR: Investigating Compositional and Syntactic Understanding in Video Retrieval Models

Avinash Madasu, Vasudev Lal

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

3rd Place Solution for PVUW Challenge 2024: Video Panoptic Segmentation

Ruipu Wu, Jifei Che, Han Li, Chengjing Wu, Ting Liu, Luoqi Liu

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments 3nd Place Solution for CVPR 2024 PVUW VPS Track

2nd Place Solution for PVUW Challenge 2024: Video Panoptic Segmentation

Biao Wu, Diankai Zhang, Si Gao, Chengjian Zheng, Shaoli Liu, Ning Wang

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments 2nd Place Solution for CVPR 2024 PVUW VPS Track

Towards Weakly Supervised End-to-end Learning for Long-video Action Recognition

Jiaming Zhou, Hanjun Li, Kun-Yu Lin, Junwei Liang

专题命中 视频理解 ：long video(abstract)；分类 cs.CV

"Previously on ..." From Recaps to Story Summarization

Aditya Kumar Singh, Dhruv Srivastava, Makarand Tapaswi

专题命中 视频理解 ：long video(abstract)；分类 cs.CV

Comments CVPR 2024; Project page: https://katha-ai.github.io/projects/recap-story-summ/

A Survey on Backbones for Deep Video Action Recognition

Zixuan Tang, Youjun Zhao, Yuhang Wen, Mengyuan Liu

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments This paper has been accepted by ICME workshop

Task-Driven Exploration: Decoupling and Inter-Task Feedback for Joint Moment Retrieval and Highlight Detection

Jin Yang, Ping Wei, Huan Li, Ziyang Ren

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Vision Mamba: A Comprehensive Survey and Taxonomy

Xiao Liu, Chenxu Zhang, Lei Zhang

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments https://github.com/lx6c78/Vision-Mamba-A-Comprehensive-Survey-and-Taxonomy

WorldQA: Multimodal World Knowledge in Videos through Long-Chain Reasoning

Yuanhan Zhang, Kaichen Zhang, Bo Li, Fanyi Pu, Christopher Arif Setiadharma, Jingkang Yang, Ziwei Liu

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

HDBN: A Novel Hybrid Dual-branch Network for Robust Skeleton-based Action Recognition

Jinfu Liu, Baiqiao Yin, Jiaying Lin, Jiajun Wen, Yue Li, Mengyuan Liu

专题命中 视频理解 ：video reasoning(abstract)；分类 cs.CV

VideoXum: Cross-modal Visual and Textural Summarization of Videos

Jingyang Lin, Hang Hua, Ming Chen, Yikang Li, Jenhao Hsiao, Chiuman Ho, Jiebo Luo

专题命中 视频理解 ：long video(abstract)；分类 cs.CV

Comments 13 pages, 7 figures

Journal ref IEEE Transactions on Multimedia, VOL. 26 (2024) 5548-5560

Exploring Missing Modality in Multimodal Egocentric Datasets

Merey Ramazanova, Alejandro Pardo, Humam Alwassel, Bernard Ghanem

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Future

Chaoyang Zhu, Long Chen

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Enhancing Traffic Safety with Parallel Dense Video Captioning for End-to-End Event Analysis

Maged Shoman, Dongdong Wang, Armstrong Aboah, Mohamed Abdel-Aty

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV