视频大模型

Self-Supervised Learning of Motion Concepts by Optimizing Counterfactuals

Stefan Stojanov, David Wendt, Seungwoo Kim, Rahul Venkatesh, Kevin Feigelis, Jiajun Wu, Daniel LK Yamins

专题命中 动作与事件理解 ：video generation(abstract)；分类 cs.CV

Comments Project webpage: https://neuroailab.github.io/opt_cwm_page/

MVPortrait: Text-Guided Motion and Emotion Control for Multi-view Vivid Portrait Animation

Yukang Lin, Hokit Fung, Jianjin Xu, Zeping Ren, Adela S. M. Lau, Guosheng Yin, Xiu Li

专题命中 动作与事件理解 ：video generation(abstract)；分类 cs.CV

Comments CVPR 2025

Zero-shot Action Localization via the Confidence of Large Vision-Language Models

Josiah Aklilu, Xiaohan Wang, Serena Yeung-Levy

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Temporal Action Detection Model Compression by Progressive Block Drop

Xiaoyong Chen, Yong Guo, Jiaming Liang, Sitong Zhuang, Runhao Zeng, Xiping Hu

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted to CVPR 2025

MASH-VLM: Mitigating Action-Scene Hallucination in Video-LLMs through Disentangled Spatial-Temporal Representations

Kyungho Bae, Jinhyung Kim, Sihaeng Lee, Soonyoung Lee, Gunhee Lee, Jinwoo Choi

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted for CVPR 2025

AUTV: Creating Underwater Video Datasets with Pixel-wise Annotations

Quang Trung Truong, Wong Yuk Kwan, Duc Thanh Nguyen, Binh-Son Hua, Sai-Kit Yeung

专题命中 动作与事件理解 ：video generation(abstract)；分类 cs.CV

Comments under review

Motion-Aware Generative Frame Interpolation

Guozhen Zhang, Yuhan Zhu, Yutao Cui, Xiaotong Zhao, Kai Ma, Limin Wang

专题命中 动作与事件理解 ：video generation(abstract)；分类 cs.CV

TRACE: Temporal Grounding Video LLM via Causal Event Modeling

Yongxin Guo, Jingyu Liu, Mingda Li, Qingbin Liu, Xi Chen, Xiaoying Tang

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Comments ICLR 2025

I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strength

Wanquan Feng, Jiawei Liu, Pengqi Tu, Tianhao Qi, Mingzhen Sun, Tianxiang Ma, Songtao Zhao, Siyu Zhou, Qian He

专题命中 动作与事件理解 ：video generation(abstract)；分类 cs.CV

Comments Accepted to ICLR 2025, Project page: https://wanquanf.github.io/I2VControlCamera

OpenTAD: A Unified Framework and Comprehensive Study of Temporal Action Detection

Shuming Liu, Chen Zhao, Fatimah Zohra, Mattia Soldan, Alejandro Pardo, Mengmeng Xu, Lama Alssum, Merey Ramazanova, Juan León Alcázar, Anthony Cioppa, Silvio Giancola, Carlos Hinojosa, Bernard Ghanem

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Task Graph Maximum Likelihood Estimation for Procedural Activity Understanding in Egocentric Videos

Luigi Seminara, Giovanni Maria Farinella, Antonino Furnari

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:2406.01486

Animate Your Thoughts: Decoupled Reconstruction of Dynamic Natural Vision from Slow Brain Activity

Yizhuo Lu, Changde Du, Chong Wang, Xuanliu Zhu, Liuyun Jiang, Xujin Li, Huiguang He

专题命中 动作与事件理解 ：video generation(abstract)；分类 cs.CV

Learning Real-World Action-Video Dynamics with Heterogeneous Masked Autoregression

Lirui Wang, Kevin Zhao, Chaoqi Liu, Xinlei Chen

专题命中 动作与事件理解 ：video generation(abstract)；分类 cs.CV

Comments Website: https://liruiw.github.io/hma/

Content-Rich AIGC Video Quality Assessment via Intricate Text Alignment and Motion-Aware Consistency

Shangkun Sun, Xiaoyu Liang, Bowen Qu, Wei Gao

专题命中 动作与事件理解 ：video generation(abstract)；分类 cs.CV

A Decade of Action Quality Assessment: Largest Systematic Survey of Trends, Challenges, and Future Directions

Hao Yin, Paritosh Parmar, Daoliang Xu, Yang Zhang, Tianyou Zheng, Weiwei Fu

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Comments 36 Pages, 20 Figures, 12 Tables

Differentiable Task Graph Learning: Procedural Activity Representation and Online Mistake Detection from Egocentric Videos

Luigi Seminara, Giovanni Maria Farinella, Antonino Furnari

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Streaming Detection of Queried Event Start

Cristobal Eyzaguirre, Eric Tang, Shyamal Buch, Adrien Gaidon, Jiajun Wu, Juan Carlos Niebles

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Motion Modes: What Could Happen Next?

Karran Pandey, Matheus Gadelha, Yannick Hold-Geoffroy, Karan Singh, Niloy J. Mitra, Paul Guerrero

专题命中 动作与事件理解 ：video generation(abstract)；分类 cs.CV

VISAGE: Video Synthesis using Action Graphs for Surgery

Yousef Yeganeh, Rachmadio Lazuardi, Amir Shamseddin, Emine Dari, Yash Thirani, Nassir Navab, Azade Farshad

专题命中 动作与事件理解 ：video generation(abstract)；分类 cs.CV

Comments Accepted at MICCAI 2024 Embodied AI and Robotics for HealTHcare (EARTH) Workshop

Dual-Model Distillation for Efficient Action Classification with Hybrid Edge-Cloud Solution

Timothy Wei, Hsien Xin Peng, Elaine Xu, Bryan Zhao, Lei Ding, Diji Yang

专题命中 动作与事件理解 ：video-language(abstract)；分类 cs.CV

DreamVideo-2: Zero-Shot Subject-Driven Video Customization with Precise Motion Control

Yujie Wei, Shiwei Zhang, Hangjie Yuan, Xiang Wang, Haonan Qiu, Rui Zhao, Yutong Feng, Feng Liu, Zhizhong Huang, Jiaxin Ye, Yingya Zhang, Hongming Shan

专题命中 动作与事件理解 ：video generation(abstract)；分类 cs.CV

Comments Project page: https://dreamvideo2.github.io/

GAIA: Rethinking Action Quality Assessment for AI-Generated Videos

Zijian Chen, Wei Sun, Yuan Tian, Jun Jia, Zicheng Zhang, Jiarui Wang, Ru Huang, Xiongkuo Min, Guangtao Zhai, Wenjun Zhang

专题命中 动作与事件理解 ：text-to-video(abstract)；分类 cs.CV

Comments Accepted by NeurIPS2024 Dataset and Benchmark Track as Spotlight. 33 pages, 15 figures

E-Motion: Future Motion Simulation via Event Sequence Diffusion

Song Wu, Zhiyu Zhu, Junhui Hou, Guangming Shi, Jinjian Wu

专题命中 动作与事件理解 ：video diffusion(abstract)；分类 cs.CV

Comments NeurIPS 2024

Grounding Partially-Defined Events in Multimodal Data

Kate Sanders, Reno Kriz, David Etter, Hannah Recknor, Alexander Martin, Cameron Carpenter, Jingyang Lin, Benjamin Van Durme

专题命中 动作与事件理解 ：video-language(abstract)；分类 cs.CV

Comments Preprint; 9 pages; 2024 EMNLP Findings

High Quality Human Image Animation using Regional Supervision and Motion Blur Condition

Zhongcong Xu, Chaoyue Song, Guoxian Song, Jianfeng Zhang, Jun Hao Liew, Hongyi Xu, You Xie, Linjie Luo, Guosheng Lin, Jiashi Feng, Mike Zheng Shou

专题命中 动作与事件理解 ：video diffusion(abstract)；分类 cs.CV

EAGLE: Egocentric AGgregated Language-video Engine

Jing Bi, Yunlong Tang, Luchuan Song, Ali Vosoughi, Nguyen Nguyen, Chenliang Xu

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by ACMMM 24

Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives

Kristen Grauman, Andrew Westbury, Lorenzo Torresani, Kris Kitani, Jitendra Malik, Triantafyllos Afouras, Kumar Ashutosh, Vijay Baiyya, Siddhant Bansal, Bikram Boote, Eugene Byrne, Zach Chavis, Joya Chen, Feng Cheng, Fu-Jen Chu, Sean Crane, Avijit Dasgupta, Jing Dong, Maria Escobar, Cristhian Forigua, Abrham Gebreselasie, Sanjay Haresh, Jing Huang, Md Mohaiminul Islam, Suyog Jain, Rawal Khirodkar, Devansh Kukreja, Kevin J Liang, Jia-Wei Liu, Sagnik Majumder, Yongsen Mao, Miguel Martin, Effrosyni Mavroudi, Tushar Nagarajan, Francesco Ragusa, Santhosh Kumar Ramakrishnan, Luigi Seminara, Arjun Somayazulu, Yale Song, Shan Su, Zihui Xue, Edward Zhang, Jinxu Zhang, Angela Castillo, Changan Chen, Xinzhu Fu, Ryosuke Furuta, Cristina Gonzalez, Prince Gupta, Jiabo Hu, Yifei Huang, Yiming Huang, Weslie Khoo, Anush Kumar, Robert Kuo, Sach Lakhavani, Miao Liu, Mi Luo, Zhengyi Luo, Brighid Meredith, Austin Miller, Oluwatumininu Oguntola, Xiaqing Pan, Penny Peng, Shraman Pramanick, Merey Ramazanova, Fiona Ryan, Wei Shan, Kiran Somasundaram, Chenan Song, Audrey Southerland, Masatoshi Tateno, Huiyu Wang, Yuchen Wang, Takuma Yagi, Mingfei Yan, Xitong Yang, Zecheng Yu, Shengxin Cindy Zha, Chen Zhao, Ziwei Zhao, Zhifan Zhu, Jeff Zhuo, Pablo Arbelaez, Gedas Bertasius, David Crandall, Dima Damen, Jakob Engel, Giovanni Maria Farinella, Antonino Furnari, Bernard Ghanem, Judy Hoffman, C. V. Jawahar, Richard Newcombe, Hyun Soo Park, James M. Rehg, Yoichi Sato, Manolis Savva, Jianbo Shi, Mike Zheng Shou, Michael Wray

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

Comments Expanded manuscript (compared to arxiv v1 from Nov 2023 and CVPR 2024 paper from June 2024) for more comprehensive dataset and benchmark presentation, plus new results on v2 data release

Event-Free Moving Object Segmentation from Moving Ego Vehicle

Zhuyun Zhou, Zongwei Wu, Danda Pani Paudel, Rémi Boutteau, Fan Yang, Luc Van Gool, Radu Timofte, Dominique Ginhac

专题命中 动作与事件理解 ：video understanding(abstract)；分类 cs.CV

PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mamba

Chaoqi Luo, Yiping Xie, Zitong Yu

专题命中 动作与事件理解 ：long video(abstract)；分类 cs.CV

Comments Accepted by CCBR 2024

MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controls

Yuxuan Bian, Ailing Zeng, Xuan Ju, Xian Liu, Zhaoyang Zhang, Wei Liu, Qiang Xu

专题命中 动作与事件理解 ：video generation(abstract)；分类 cs.CV