视频大模型

On the Content Bias in Fréchet Video Distance

Songwei Ge, Aniruddha Mahapatra, Gaurav Parmar, Jun-Yan Zhu, Jia-Bin Huang

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Comments CVPR 2024. Project webpage: https://content-debiased-fvd.github.io/

SportsHHI: A Dataset for Human-Human Interaction Detection in Sports Videos

Tao Wu, Runyu He, Gangshan Wu, Limin Wang

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by CVPR 2024

Learning Object State Changes in Videos: An Open-World Perspective

Zihui Xue, Kumar Ashutosh, Kristen Grauman

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by CVPR 2024, Project website: https://vision.cs.utexas.edu/projects/VidOSC/

Grounded Question-Answering in Long Egocentric Videos

Shangzhe Di, Weidi Xie

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted to CVPR 2024. Project website at https://dszdsz.cn/GroundVQA

MTMMC: A Large-Scale Real-World Multi-Modal Camera Tracking Benchmark

Sanghyun Woo, Kwanyong Park, Inkyu Shin, Myungchul Kim, In So Kweon

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV

Comments Accepted on CVPR 2024

Video Annotator: A framework for efficiently building video classifiers using vision-language models and active learning

Amir Ziai, Aneesh Vartakavi

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Submitted for review to KDD '24 (ADS Track)

AIGCBench: Comprehensive Evaluation of Image-to-Video Content Generated by AI

Fanda Fan, Chunjie Luo, Wanling Gao, Jianfeng Zhan

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Comments Accepted to BenchCouncil Transactions on Benchmarks, Standards and Evaluations (TBench)

Open-Vocabulary Video Relation Extraction

Wentao Tian, Zheng Wang, Yuqian Fu, Jingjing Chen, Lechao Cheng

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments accpeted by AAAI 2024

Consistent Video-to-Video Transfer Using Synthetic Dataset

Jiaxin Cheng, Tianjun Xiao, Tong He

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV

VBench: Comprehensive Benchmark Suite for Video Generative Models

Ziqi Huang, Yinan He, Jiashuo Yu, Fan Zhang, Chenyang Si, Yuming Jiang, Yuanhan Zhang, Tianxing Wu, Qingyang Jin, Nattapol Chanpaisit, Yaohui Wang, Xinyuan Chen, Limin Wang, Dahua Lin, Yu Qiao, Ziwei Liu

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Comments Equal contributions from first four authors. Project page: https://vchitect.github.io/VBench-project/ Code: https://github.com/Vchitect/VBench

Learning Fine-grained View-Invariant Representations from Unpaired Ego-Exo Videos via Temporal Alignment

Zihui Xue, Kristen Grauman

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by NeurIPS 2023, Project website: https://vision.cs.utexas.edu/projects/AlignEgoExo/

Let's Think Frame by Frame with VIP: A Video Infilling and Prediction Dataset for Evaluating Video Chain-of-Thought

Vaishnavi Himakunthala, Andy Ouyang, Daniel Rose, Ryan He, Alex Mei, Yujie Lu, Chinmay Sonar, Michael Saxon, William Yang Wang

专题命中 视频数据与评测 ：video reasoning(abstract)；分类 cs.CV

Comments Accepted to the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023)

ProBio: A Protocol-guided Multimodal Dataset for Molecular Biology Lab

Jieming Cui, Ziren Gong, Baoxiong Jia, Siyuan Huang, Zilong Zheng, Jianzhu Ma, Yixin Zhu

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Perception Test: A Diagnostic Benchmark for Multimodal Video Models

Viorica Pătrăucean, Lucas Smaira, Ankush Gupta, Adrià Recasens Continente, Larisa Markeeva, Dylan Banarse, Skanda Koppula, Joseph Heyward, Mateusz Malinowski, Yi Yang, Carl Doersch, Tatiana Matejovicova, Yury Sulsky, Antoine Miech, Alex Frechette, Hanna Klimczak, Raphael Koster, Junlin Zhang, Stephanie Winkler, Yusuf Aytar, Simon Osindero, Dima Damen, Andrew Zisserman, João Carreira

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments 37th Conference on Neural Information Processing Systems (NeurIPS 2023) Track on Datasets and Benchmarks

Building an Open-Vocabulary Video CLIP Model with Better Architectures, Optimization and Data

Zuxuan Wu, Zejia Weng, Wujian Peng, Xitong Yang, Ang Li, Larry S. Davis, Yu-Gang Jiang

专题命中 视频数据与评测 ：text-to-video(abstract)；分类 cs.CV

Comments arXiv admin note: substantial text overlap with arXiv:2302.00624

ReLER@ZJU Submission to the Ego4D Moment Queries Challenge 2022

Jiayi Shao, Xiaohan Wang, Yi Yang

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV

Comments Accepted to ECCV 2022 Ego4D Workshop; 3rd place in Ego4D Moment Query Challenge

PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Tracking

Yang Zheng, Adam W. Harley, Bokui Shen, Gordon Wetzstein, Leonidas J. Guibas

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV

HA-ViD: A Human Assembly Video Dataset for Comprehensive Assembly Knowledge Understanding

Hao Zheng, Regina Lee, Yuqian Lu

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Efficient Annotation and Learning for 3D Hand Pose Estimation: A Survey

Takehiko Ohkawa, Ryosuke Furuta, Yoichi Sato

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Egocentric Video Task Translation

Zihui Xue, Yale Song, Kristen Grauman, Lorenzo Torresani

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by CVPR 2023 (Highlight), Project website: https://vision.cs.utexas.edu/projects/egot2/

Fine-grained Audible Video Description

Xuyang Shen, Dong Li, Jinxing Zhou, Zhen Qin, Bowen He, Xiaodong Han, Aixuan Li, Yuchao Dai, Lingpeng Kong, Meng Wang, Yu Qiao, Yiran Zhong

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Comments accepted to CVPR 2023, Xuyang Shen, Dong Li and Jinxing Zhou contribute equally, code link: github.com/OpenNLPLab/FAVDBench, dataset link: www.avlbench.opennlplab.cn

Blind Video Deflickering by Neural Filtering with a Flawed Atlas

Chenyang Lei, Xuanchi Ren, Zhaoxiang Zhang, Qifeng Chen

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Comments To appear in CVPR2023. Code: github.com/ChenyangLEI/All-In-One-Deflicker Website: chenyanglei.github.io/deflicker

Grafting Pre-trained Models for Multimodal Headline Generation

Lingfeng Qiao, Chen Wu, Ye Liu, Haoyuan Peng, Di Yin, Bo Ren

专题命中 视频数据与评测 ：video-language(abstract)；分类 cs.CV

Comments Accepted by EMNLP 2022

Unsupervised Audio-Visual Lecture Segmentation

Darshan Singh S, Anchit Gupta, C. V. Jawahar, Makarand Tapaswi

专题命中 视频数据与评测 ：video-language(abstract)；分类 cs.CV

Comments 17 pages, 14 figures, 14 tables, Accepted to WACV 2023. Project page: https://cvit.iiit.ac.in/research/projects/cvit-projects/avlectures

FineAction: A Fine-Grained Video Dataset for Temporal Action Localization

Yi Liu, Limin Wang, Yali Wang, Xiao Ma, Yu Qiao

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by IEEE T-IP. HomePage: https://deeperaction.github.io/datasets/fineaction

Semantic Video Moments Retrieval at Scale: A New Task and a Baseline

Na Li

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV

Multi-modal Video Chapter Generation

Xiao Cao, Zitan Chen, Canyu Le, Lei Meng

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV

Benchmarking the Robustness of Spatial-Temporal Models Against Corruptions

Chenyu Yi, Siyuan Yang, Haoliang Li, Yap-peng Tan, Alex Kot

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted to NeurIPs 2021 Dataset and Benchmark Track. Our codes are available on https://github.com/Newbeeyoung/Video-Corruption-Robustness

How Severe is Benchmark-Sensitivity in Video Self-Supervised Learning?

Fida Mohammad Thoker, Hazel Doughty, Piyush Bagad, Cees Snoek

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted in ECCV 2022

CelebV-HQ: A Large-Scale Video Facial Attributes Dataset

Hao Zhu, Wayne Wu, Wentao Zhu, Liming Jiang, Siwei Tang, Li Zhang, Ziwei Liu, Chen Change Loy

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Comments ECCV 2022. Project Page: https://celebv-hq.github.io/ ; Dataset: https://github.com/CelebV-HQ/CelebV-HQ