视频大模型

$^R$FLAV: Rolling Flow matching for infinite Audio Video generation

Alex Ergasti, Giuseppe Gabriele Tarollo, Filippo Botti, Tomaso Fontanini, Claudio Ferrari, Massimo Bertozzi, Andrea Prati

专题命中 视频生成 ：video generation(title)；分类 cs.CV

GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Control

Xuanchi Ren, Tianchang Shen, Jiahui Huang, Huan Ling, Yifan Lu, Merlin Nimier-David, Thomas Müller, Alexander Keller, Sanja Fidler, Jun Gao

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments To appear in CVPR 2025. Website: https://research.nvidia.com/labs/toronto-ai/GEN3C/

Extrapolating and Decoupling Image-to-Video Generation Models: Motion Modeling is Easier Than You Think

Jie Tian, Xiaoye Qu, Zhenyi Lu, Wei Wei, Sichen Liu, Yu Cheng

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments Accepted by CVPR2025

Journal ref Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025

VidSketch: Hand-drawn Sketch-Driven Video Generation with Diffusion Control

Lifan Jiang, Shuang Chen, Boxi Wu, Xiaotong Guan, Jiahui Zhang

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments 17pages, 15 figures

EMO2: End-Effector Guided Audio-Driven Avatar Video Generation

Linrui Tian, Siqi Hu, Qi Wang, Bang Zhang, Liefeng Bo

专题命中 视频生成 ：video generation(title)；分类 cs.CV

SyncFlow: Toward Temporally Aligned Joint Audio-Video Generation from Text

Haohe Liu, Gael Le Lan, Xinhao Mei, Zhaoheng Ni, Anurag Kumar, Varun Nagaraja, Wenwu Wang, Mark D. Plumbley, Yangyang Shi, Vikas Chandra

专题命中 视频生成 ：video generation(title)；分类 cs.MM

Seeing Beyond Views: Multi-View Driving Scene Video Generation with Holistic Attention

Hannan Lu, Xiaohe Wu, Shudong Wang, Xiameng Qin, Xinyu Zhang, Junyu Han, Wangmeng Zuo, Ji Tao

专题命中 视频生成 ：video generation(title)；分类 cs.CV

PoM: Efficient Image and Video Generation with the Polynomial Mixer

David Picard, Nicolas Dufour

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Pose-Guided Fine-Grained Sign Language Video Generation

Tongkai Shi, Lianyu Hu, Fanhua Shang, Jichao Feng, Peidong Liu, Wei Feng

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments ECCV 2024

Panacea+: Panoramic and Controllable Video Generation for Autonomous Driving

Yuqing Wen, Yucheng Zhao, Yingfei Liu, Binyuan Huang, Fan Jia, Yanhui Wang, Chi Zhang, Tiancai Wang, Xiaoyan Sun, Xiangyu Zhang

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments Project page: https://panacea-ad.github.io/. arXiv admin note: text overlap with arXiv:2311.16813

RAVEN: Rethinking Adversarial Video Generation with Efficient Tri-plane Networks

Partha Ghosh, Soubhik Sanyal, Cordelia Schmid, Bernhard Schölkopf

专题命中 视频生成 ：video generation(title)；分类 cs.CV

EchoNet-Synthetic: Privacy-preserving Video Generation for Safe Medical Data Sharing

Hadrien Reynaud, Qingjie Meng, Mischa Dombrowski, Arijit Ghosh, Thomas Day, Alberto Gomez, Paul Leeson, Bernhard Kainz

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments Accepted at MICCAI 2024

I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Models

Wenqi Ouyang, Yi Dong, Lei Yang, Jianlou Si, Xingang Pan

专题命中 视频生成 ：video diffusion(title)；分类 cs.CV

Comments 19 pages

AnimateZoo: Zero-shot Video Generation of Cross-Species Animation via Subject Alignment

Yuanfeng Xu, Yuhao Chen, Zhongzhan Huang, Zijian He, Guangrun Wang, Philip Torr, Liang Lin

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments Technical report,15 pages

Virbo: Multimodal Multilingual Avatar Video Generation in Digital Marketing

Juan Zhang, Jiahao Chen, Cheng Wang, Zhiwang Yu, Tangquan Qi, Can Liu, Di Wu

专题命中 视频生成 ：video generation(title)；分类 cs.MM

StyleLipSync: Style-based Personalized Lip-sync Video Generation

Taekyung Ki, Dongchan Min

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments International Conference on Computer Vision (ICCV) 2023. Project page: https://stylelipsync.github.io

Decouple Content and Motion for Conditional Image-to-Video Generation

Cuifeng Shen, Yulu Gan, Chen Chen, Xiongwei Zhu, Lele Cheng, Tingting Gao, Jinzhi Wang

专题命中 视频生成 ：video generation(title)；分类 cs.CV

DaGAN++: Depth-Aware Generative Adversarial Network for Talking Head Video Generation

Fa-Ting Hong, Li Shen, Dan Xu

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments Accepted at TPAMI; CVPR 2022 extension

Panacea: Panoramic and Controllable Video Generation for Autonomous Driving

Yuqing Wen, Yucheng Zhao, Yingfei Liu, Fan Jia, Yanhui Wang, Chong Luo, Chi Zhang, Tiancai Wang, Xiaoyan Sun, Xiangyu Zhang

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments Project page: https://panacea-ad.github.io/

High-Fidelity and Freely Controllable Talking Head Video Generation

Yue Gao, Yuan Zhou, Jinglu Wang, Xiao Li, Xiang Ming, Yan Lu

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments CVPR 2023

3D-Aware Video Generation

Sherwin Bahmani, Jeong Joon Park, Despoina Paschalidou, Hao Tang, Gordon Wetzstein, Leonidas Guibas, Luc Van Gool, Radu Timofte

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments TMLR 2023; Project page: https://sherwinbahmani.github.io/3dvidgen

Facial Expression Video Generation Based-On Spatio-temporal Convolutional GAN: FEV-GAN

Hamza Bouzid, Lahoucine Ballihi

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments 13 pages, 8 figures, accepted in ISWA journal

Journal ref Intelligent Systems with Applications. 19 (2022)

Multi-object Video Generation from Single Frame Layouts

Yang Wu, Zhibin Liu, Hefeng Wu, Liang Lin

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments 6 pages limit

Conditional Image-to-Video Generation with Latent Flow Diffusion Models

Haomiao Ni, Changhao Shi, Kai Li, Sharon X. Huang, Martin Renqiang Min

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments CVPR 2023

D'ARTAGNAN: Counterfactual Video Generation

Hadrien Reynaud, Athanasios Vlontzos, Mischa Dombrowski, Ciarán Lee, Arian Beqiri, Paul Leeson, Bernhard Kainz

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments Accepted for MICCAI 2022

RoME: Role-aware Mixture-of-Expert Transformer for Text-to-Video Retrieval

Burak Satar, Hongyuan Zhu, Hanwang Zhang, Joo Hwee Lim

专题命中 视频生成 ：text-to-video(title)；分类 cs.CV

Comments Preprint, under review in TCSVT Journal

Controllable Video Generation through Global and Local Motion Dynamics

Aram Davtyan, Paolo Favaro

专题命中 视频生成 ：video generation(title)；分类 cs.CV

VirtualConductor: Music-driven Conducting Video Generation System

Delong Chen, Fan Liu, Zewen Li, Feng Xu

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments Accepted by IEEE International Conference on Multimedia and Expo (ICME) 2021, demo track. Best demo

NWT: Towards natural audio-to-video generation with representation learning

Rayhane Mama, Marc S. Tyndel, Hashiam Kadhim, Cole Clifford, Ragavan Thurairatnam

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Efficient training for future video generation based on hierarchical disentangled representation of latent variables

Naoya Fushishita, Antonio Tejero-de-Pablos, Yusuke Mukuta, Tatsuya Harada

专题命中 视频生成 ：video generation(title)；分类 cs.CV