视频大模型

GenRec: Unifying Video Generation and Recognition with Diffusion Models

Zejia Weng, Xitong Yang, Zhen Xing, Zuxuan Wu, Yu-Gang Jiang

专题命中 视频生成 ：video generation(title,abstract)；video diffusion(abstract)；分类 cs.CV

Comments 19 pages, 6 figures, 12 tables

MarDini: Masked Autoregressive Diffusion for Video Generation at Scale

Haozhe Liu, Shikun Liu, Zijian Zhou, Mengmeng Xu, Yanping Xie, Xiao Han, Juan C. Pérez, Ding Liu, Kumara Kahatapitiya, Menglin Jia, Jui-Chieh Wu, Sen He, Tao Xiang, Jürgen Schmidhuber, Juan-Manuel Pérez-Rúa

专题命中 视频生成 ：video generation(title,abstract)；video diffusion(abstract)；分类 cs.CV

Comments Project Page: https://mardini-vidgen.github.io

MotionClone: Training-Free Motion Cloning for Controllable Video Generation

Pengyang Ling, Jiazi Bu, Pan Zhang, Xiaoyi Dong, Yuhang Zang, Tong Wu, Huaian Chen, Jiaqi Wang, Yi Jin

专题命中 视频生成 ：video generation(title,abstract)；text-to-video(abstract)；分类 cs.CV

Comments 18 pages, 14 figures, https://bujiazi.github.io/motionclone.github.io/

Animating the Past: Reconstruct Trilobite via Video Generation

Xiaoran Wu, Zien Huang, Chonghan Yu

专题命中 视频生成 ：video generation(title,abstract)；text-to-video(abstract)；分类 cs.CV

AnimateLCM: Computation-Efficient Personalized Style Video Generation without Personalized Video Data

Fu-Yun Wang, Zhaoyang Huang, Weikang Bian, Xiaoyu Shi, Keqiang Sun, Guanglu Song, Yu Liu, Hongsheng Li

专题命中 视频生成 ：video generation(title,abstract)；video diffusion(abstract)；分类 cs.CV

Comments Accepted as a Short Paper by SIGGRAPH ASIA 2024 Technical Communications. This is a short version of the original work. Project Page: https://animatelcm.github.io/

Mora: Enabling Generalist Video Generation via A Multi-Agent Framework

Zhengqing Yuan, Yixin Liu, Yihan Cao, Weixiang Sun, Haolong Jia, Ruoxi Chen, Zhaoxu Li, Bin Lin, Li Yuan, Lifang He, Chi Wang, Yanfang Ye, Lichao Sun

专题命中 视频生成 ：video generation(title,abstract)；text-to-video(abstract)；分类 cs.CV

PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generation

Shaowei Liu, Zhongzheng Ren, Saurabh Gupta, Shenlong Wang

专题命中 视频生成 ：video generation(title,abstract)；video diffusion(abstract)；分类 cs.CV

Comments Accepted to ECCV 2024. Project page: https://stevenlsw.github.io/physgen/

Compositional 3D-aware Video Generation with LLM Director

Hanxin Zhu, Tianyu He, Anni Tang, Junliang Guo, Zhibo Chen, Jiang Bian

专题命中 视频生成 ：video generation(title,abstract)；text-to-video(abstract)；分类 cs.CV

Journal ref NeurIPS 2024

DreamVideo: High-Fidelity Image-to-Video Generation with Image Retention and Text Guidance

Cong Wang, Jiaxi Gu, Panwen Hu, Songcen Xu, Hang Xu, Xiaodan Liang

专题命中 视频生成 ：video generation(title,abstract)；video diffusion(abstract)；分类 cs.CV

MyGo: Consistent and Controllable Multi-View Driving Video Generation with Camera Control

Yining Yao, Xi Guo, Chenjing Ding, Wei Wu

专题命中 视频生成 ：video generation(title,abstract)；video diffusion(abstract)；分类 cs.CV

Comments Project Page: https://metadrivescape.github.io/papers_project/MyGo/page.html

T2VSafetyBench: Evaluating the Safety of Text-to-Video Generative Models

Yibo Miao, Yifan Zhu, Yinpeng Dong, Lijia Yu, Jun Zhu, Xiao-Shan Gao

专题命中 视频生成 ：text-to-video(title,abstract)；video generation(abstract)；分类 cs.CV

AMG: Avatar Motion Guided Video Generation

Zhangsihao Yang, Mengyi Shan, Mohammad Farazi, Wenhui Zhu, Yanxi Chen, Xuanzhao Dong, Yalin Wang

专题命中 视频生成 ：video generation(title,abstract)；video diffusion(abstract)；分类 cs.CV

Comments The project page is at https://github.com/zshyang/amg

xGen-VideoSyn-1: High-fidelity Text-to-Video Synthesis with Compressed Representations

Can Qin, Congying Xia, Krithika Ramakrishnan, Michael Ryoo, Lifu Tu, Yihao Feng, Manli Shu, Honglu Zhou, Anas Awadalla, Jun Wang, Senthil Purushwalkam, Le Xue, Yingbo Zhou, Huan Wang, Silvio Savarese, Juan Carlos Niebles, Zeyuan Chen, Ran Xu, Caiming Xiong

专题命中 视频生成 ：text-to-video(title,abstract)；video generation(abstract)；分类 cs.CV

Comments Accepted by ECCV24 AI4VA

Faster Image2Video Generation: A Closer Look at CLIP Image Embedding's Impact on Spatio-Temporal Cross-Attentions

Ashkan Taghipour, Morteza Ghahremani, Mohammed Bennamoun, Aref Miri Rekavandi, Zinuo Li, Hamid Laga, Farid Boussaid

专题命中 视频生成 ：video generation(title,abstract)；video diffusion(abstract)；分类 cs.CV

MagDiff: Multi-Alignment Diffusion for High-Fidelity Video Generation and Editing

Haoyu Zhao, Tianyi Lu, Jiaxi Gu, Xing Zhang, Qingping Zheng, Zuxuan Wu, Hang Xu, Yu-Gang Jiang

专题命中 视频生成 ：video generation(title,abstract)；video diffusion(abstract)；分类 cs.CV

Still-Moving: Customized Video Generation without Customized Video Data

Hila Chefer, Shiran Zada, Roni Paiss, Ariel Ephrat, Omer Tov, Michael Rubinstein, Lior Wolf, Tali Dekel, Tomer Michaeli, Inbar Mosseri

专题命中 视频生成 ：video generation(title,abstract)；text-to-video(abstract)；分类 cs.CV

Comments Webpage: https://still-moving.github.io/ | Video: https://www.youtube.com/watch?v=U7UuV_VIjnA

Compositional Video Generation as Flow Equalization

Xingyi Yang, Xinchao Wang

专题命中 视频生成 ：video generation(title,abstract)；text-to-video(abstract)；分类 cs.CV

Comments Project Page: https://adamdad.github.io/vico/. Source Code: https://github.com/Adamdad/vico

ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generation

Weiming Ren, Huan Yang, Ge Zhang, Cong Wei, Xinrun Du, Wenhao Huang, Wenhu Chen

专题命中 视频生成 ：video generation(title,abstract)；long video(abstract)；分类 cs.CV

Comments Project Page: https://tiger-ai-lab.github.io/ConsistI2V/

Text-Animator: Controllable Visual Text Video Generation

Lin Liu, Quande Liu, Shengju Qian, Yuan Zhou, Wengang Zhou, Houqiang Li, Lingxi Xie, Qi Tian

专题命中 视频生成 ：video generation(title,abstract)；text-to-video(abstract)；分类 cs.CV

Comments Project Page: https://laulampaul.github.io/text-animator.html

SafeSora: Towards Safety Alignment of Text2Video Generation via a Human Preference Dataset

Josef Dai, Tianle Chen, Xuyao Wang, Ziran Yang, Taiye Chen, Jiaming Ji, Yaodong Yang

专题命中 视频生成 ：video generation(title,abstract)；text-to-video(abstract)；分类 cs.CV

Hierarchical Patch Diffusion Models for High-Resolution Video Generation

Ivan Skorokhodov, Willi Menapace, Aliaksandr Siarohin, Sergey Tulyakov

专题命中 视频生成 ：video generation(title,abstract)；text-to-video(abstract)；分类 cs.CV

Comments CVPR 2024

Searching Priors Makes Text-to-Video Synthesis Better

Haoran Cheng, Liang Peng, Linxuan Xia, Yuepeng Hu, Hengjia Li, Qinglin Lu, Xiaofei He, Boxi Wu

专题命中 视频生成 ：text-to-video(title,abstract)；video diffusion(abstract)；分类 cs.CV

CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generation

Dejia Xu, Weili Nie, Chao Liu, Sifei Liu, Jan Kautz, Zhangyang Wang, Arash Vahdat

专题命中 视频生成 ：video generation(title,abstract)；video diffusion(abstract)；分类 cs.CV

Comments Project page: https://ir1d.github.io/CamCo/

ZeroSmooth: Training-free Diffuser Adaptation for High Frame Rate Video Generation

Shaoshu Yang, Yong Zhang, Xiaodong Cun, Ying Shan, Ran He

专题命中 视频生成 ：video generation(title,abstract)；video diffusion(abstract)；分类 cs.CV

GenTron: Diffusion Transformers for Image and Video Generation

Shoufa Chen, Mengmeng Xu, Jiawei Ren, Yuren Cong, Sen He, Yanping Xie, Animesh Sinha, Ping Luo, Tao Xiang, Juan-Manuel Perez-Rua

专题命中 视频生成 ：video generation(title,abstract)；text-to-video(abstract)；分类 cs.CV

Comments CVPR2024 Camera Ready. Website: https://www.shoufachen.com/gentron_website/

RefDrop: Controllable Consistency in Image or Video Generation via Reference Feature Guidance

Jiaojiao Fan, Haotian Xue, Qinsheng Zhang, Yongxin Chen

专题命中 视频生成 ：video generation(title,abstract)；video diffusion(abstract)；分类 cs.CV

Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motion

Shiyuan Yang, Liang Hou, Haibin Huang, Chongyang Ma, Pengfei Wan, Di Zhang, Xiaodong Chen, Jing Liao

专题命中 视频生成 ：video generation(title)；video diffusion(abstract)；text-to-video(abstract)；分类 cs.CV

StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation

Yupeng Zhou, Daquan Zhou, Ming-Ming Cheng, Jiashi Feng, Qibin Hou

专题命中 视频生成 ：video generation(title,abstract)；long video(abstract)；分类 cs.CV

MotionMaster: Training-free Camera Motion Transfer For Video Generation

Teng Hu, Jiangning Zhang, Ran Yi, Yating Wang, Hongrui Huang, Jieyu Weng, Yabiao Wang, Lizhuang Ma

专题命中 视频生成 ：video generation(title,abstract)；text-to-video(abstract)；分类 cs.CV

EvalCrafter: Benchmarking and Evaluating Large Video Generation Models

Yaofang Liu, Xiaodong Cun, Xuebo Liu, Xintao Wang, Yong Zhang, Haoxin Chen, Yang Liu, Tieyong Zeng, Raymond Chan, Ying Shan

专题命中 视频生成 ：video generation(title,abstract)；text-to-video(abstract)；分类 cs.CV

Comments Technical Report, Project page: https://evalcrafter.github.io/