视频大模型

Towards Understanding Camera Motions in Any Video

Zhiqiu Lin, Siyuan Cen, Daniel Jiang, Jay Karhade, Hewei Wang, Chancharik Mitra, Tiffany Ling, Yuhan Huang, Sifan Liu, Mingyu Chen, Rushikesh Zawar, Xue Bai, Yilun Du, Chuang Gan, Deva Ramanan

专题命中 视频数据与评测 ：video-language(abstract)；分类 cs.CV、cs.MM

Comments Project site: https://linzhiqiu.github.io/papers/camerabench/

MagicAnime: A Hierarchically Annotated, Multimodal and Multitasking Dataset with Benchmarks for Cartoon Animation Generation

Shuolin Xu, Bingyuan Wang, Zeyu Cai, Fangteng Fu, Yue Ma, Tongyi Lee, Hongchuan Yu, Zeyu Wang

机构 * National Centre for Computer Animation, Bournemouth University（伯恩茅斯大学计算机动画国家中心） ； Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）） ； Hong Kong University of Science and Technology（香港科技大学） ； Department of Computer Science and Information Engineering, National Cheng Kung University（国立成功大学计算机科学与信息工程系） 纠错

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV、cs.MM

Comments 8 pages,6 figures

TUNA: Comprehensive Fine-grained Temporal Understanding Evaluation on Dense Dynamic Videos

Fanheng Kong, Jingyuan Zhang, Hongzhi Zhang, Shi Feng, Daling Wang, Linhao Yu, Xingguang Ji, Yu Tian, Victoria W., Fuzheng Zhang

机构 * Northeastern University（东北大学） ； Kuaishou Technology（快手科技） 纠错

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV、cs.MM

Comments Accepted to ACL 2025 Main. Project page: https://friedrichor.github.io/projects/TUNA

BioVL-QR: Egocentric Biochemical Vision-and-Language Dataset Using Micro QR Codes

Tomohiro Nishimoto, Taichi Nishimura, Koki Yamamoto, Keisuke Shirai, Hirotaka Kameko, Yuto Haneji, Tomoya Yoshida, Keiya Kajimura, Taiyu Cui, Chihiro Nishiwaki, Eriko Daikoku, Natsuko Okuda, Fumihito Ono, Shinsuke Mori

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV、cs.MM

Comments ICIP2025

Face Consistency Benchmark for GenAI Video

Michal Podstawski, Malgorzata Kudelska, Haohong Wang

机构 * TCL Research Europe（TCL欧洲研究中心） ； TCL Research America（TCL美国研究中心） 纠错

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV、cs.MM

VideoAutoArena: An Automated Arena for Evaluating Large Multimodal Models in Video Analysis through User Simulation

Ziyang Luo, Haoning Wu, Dongxu Li, Jing Ma, Mohan Kankanhalli, Junnan Li

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV、cs.MM

Comments CVPR 2025, Project Page: https://videoautoarena.github.io/

Audio-Visual Instance Segmentation

Ruohao Guo, Xianghua Ying, Yaru Chen, Dantong Niu, Guangyao Li, Liao Qu, Yanyu Qi, Jinxing Zhou, Bowei Xing, Wenzhen Yue, Ji Shi, Qixun Wang, Peiliang Zhang, Buwen Liang

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV、cs.MM

Comments Accepted by CVPR 2025

MMTrail: A Multimodal Trailer Video Dataset with Language and Music Descriptions

Xiaowei Chi, Yatian Wang, Aosong Cheng, Pengjun Fang, Zeyue Tian, Yingqing He, Zhaoyang Liu, Xingqun Qi, Jiahao Pan, Rongyu Zhang, Mengfei Li, Ruibin Yuan, Yanbing Jiang, Wei Xue, Wenhan Luo, Qifeng Chen, Shanghang Zhang, Qifeng Liu, Yike Guo

专题命中 视频数据与评测 ：video-language(abstract)；分类 cs.CV、cs.MM

Comments 15 Pages. Dataset report

GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generation

Baiqi Li, Zhiqiu Lin, Deepak Pathak, Jiayao Li, Yixin Fei, Kewen Wu, Tiffany Ling, Xide Xia, Pengchuan Zhang, Graham Neubig, Deva Ramanan

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV、cs.MM

Comments We open-source our dataset, model, and code at: https://linzhiqiu.github.io/papers/genai_bench ; Project page: https://linzhiqiu.github.io/papers/genai_bench ; GenAI-Bench was first introduced in arxiv:2404.01291. This article extends it with an additional GenAI-Rank benchmark

VideoCLIP-XL: Advancing Long Description Understanding for Video CLIP Models

Jiapeng Wang, Chengyu Wang, Kunzhe Huang, Jun Huang, Lianwen Jin

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV、cs.MM

Comments EMNLP 2024 Main conference

SynopGround: A Large-Scale Dataset for Multi-Paragraph Video Grounding from TV Dramas and Synopses

Chaolei Tan, Zihang Lin, Junfu Pu, Zhongang Qi, Wei-Yi Pei, Zhi Qu, Yexin Wang, Ying Shan, Wei-Shi Zheng, Jian-Fang Hu

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV、cs.MM

Comments Accepted to ACM MM 2024. Project page: https://synopground.github.io/

COM Kitchens: An Unedited Overhead-view Video Dataset as a Vision-Language Benchmark

Koki Maeda, Tosho Hirasawa, Atsushi Hashimoto, Jun Harashima, Leszek Rybicki, Yusuke Fukasawa, Yoshitaka Ushiku

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV、cs.MM

Comments ECCV2024 accepted

Audio-visual training for improved grounding in video-text LLMs

Shivprasad Sagare, Hemachandran S, Kinshuk Sarabhai, Prashant Ullegaddi, Rajeshkumar SA

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV、cs.MM

CLIPVQA:Video Quality Assessment via CLIP

Fengchuang Xing, Mingjie Li, Yuan-Gen Wang, Guopu Zhu, Xiaochun Cao

专题命中 视频数据与评测 ：video-language(abstract)；分类 cs.CV、eess.IV

Evaluating Text-to-Visual Generation with Image-to-Text Generation

Zhiqiu Lin, Deepak Pathak, Baiqi Li, Jiayao Li, Xide Xia, Graham Neubig, Pengchuan Zhang, Deva Ramanan

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV、cs.MM

Comments We open-source our data, model, and code at: https://github.com/linzhiqiu/t2v_metrics ; Project page: https://linzhiqiu.github.io/papers/vqascore

FunQA: Towards Surprising Video Comprehension

Binzhu Xie, Sicheng Zhang, Zitang Zhou, Bo Li, Yuanhan Zhang, Jack Hessel, Jingkang Yang, Ziwei Liu

专题命中 视频数据与评测 ：video reasoning(abstract)；分类 cs.CV、cs.MM

Comments Project Page: https://funqa-benchmark.github.io/ Codebase: https://github.com/Jingkang50/FunQA

Dual-Path Temporal Map Optimization for Make-up Temporal Video Grounding

Jiaxiu Li, Kun Li, Jia Li, Guoliang Chen, Dan Guo, Meng Wang

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV、cs.MM

Knowledge Enhanced Model for Live Video Comment Generation

Jieting Chen, Junkai Ding, Wenping Chen, Qin Jin

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV、cs.MM

TPA-Net: Generate A Dataset for Text to Physics-based Animation

Yuxing Qiu, Feng Gao, Minchen Li, Govind Thattai, Yin Yang, Chenfanfu Jiang

专题命中 视频数据与评测 ：text-to-video(abstract)；分类 cs.CV、eess.IV

DeepSportradar-v1: Computer Vision Dataset for Sports Understanding with High Quality Annotations

Gabriel Van Zandycke, Vladimir Somers, Maxime Istasse, Carlo Del Don, Davide Zambrano

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV、eess.IV

Text2Video: Text-driven Talking-head Video Synthesis with Personalized Phoneme-Pose Dictionary

Sibo Zhang, Jiahong Yuan, Miao Liao, Liangjun Zhang

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV、eess.IV

Comments ICASSP 2022

Piano Skills Assessment

Paritosh Parmar, Jaiden Reddy, Brendan Morris

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV、cs.MM

Comments Dataset is available from: https://github.com/ParitoshParmar/Piano-Skills-Assessment

GEM: A General Evaluation Benchmark for Multimodal Tasks

Lin Su, Nan Duan, Edward Cui, Lei Ji, Chenfei Wu, Huaishao Luo, Yongfei Liu, Ming Zhong, Taroon Bharti, Arun Sacheti

专题命中 视频数据与评测 ：video-language(abstract)；分类 cs.CV、cs.MM

Comments Accepted by Findings of ACL 2021

Understanding Chinese Video and Language via Contrastive Multimodal Pre-Training

Chenyi Lei, Shixian Luo, Yong Liu, Wanggui He, Jiamang Wang, Guoxin Wang, Haihong Tang, Chunyan Miao, Houqiang Li

专题命中 视频数据与评测 ：video-language(abstract)；分类 cs.CV、cs.MM

How Good is a Video Summary? A New Benchmarking Dataset and Evaluation Framework Towards Realistic Video Summarization

Vishal Kaushal, Suraj Kothawade, Anshul Tomar, Rishabh Iyer, Ganesh Ramakrishnan

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV、cs.MM

Comments 19 pages, 6 tables, 4 figures. arXiv admin note: substantial text overlap with arXiv:2007.14560

t-EVA: Time-Efficient t-SNE Video Annotation

Soroosh Poorgholi, Osman Semih Kayhan, Jan C. van Gemert

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV、eess.IV

Comments ICPR 2020 (HCAU)

Realistic Video Summarization through VISIOCITY: A New Benchmark and Evaluation Framework

Vishal Kaushal, Suraj Kothawade, Rishabh Iyer, Ganesh Ramakrishnan

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV、cs.MM

Comments 19 pages, 1 figure, 14 tables

Video Storytelling: Textual Summaries for Events

Junnan Li, Yongkang Wong, Qi Zhao, Mohan S. Kankanhalli

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV、cs.MM

Comments Published in IEEE Transactions on Multimedia

Journal ref J. Li, Y. Wong, Q. Zhao and M. S. Kankanhalli, "Video Storytelling: Textual Summaries for Events," in IEEE Transactions on Multimedia, 2019

Constructing Hierarchical Q&A Datasets for Video Story Understanding

Yu-Jung Heo, Kyoung-Woon On, Seongho Choi, Jaeseo Lim, Jinah Kim, Jeh-Kwang Ryu, Byung-Chull Bae, Byoung-Tak Zhang

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV、cs.MM

Comments Accepted to AAAI 2019 Spring Symposium Series : Story-Enabled Intelligence

Fine-Grain Annotation of Cricket Videos

Rahul Anand Sharma, Pramod Sankar K, CV Jawahar

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV、cs.MM

Comments ACPR 2015