视频大模型

MotionDreamer: Exploring Semantic Video Diffusion features for Zero-Shot 3D Mesh Animation

Lukas Uzolas, Elmar Eisemann, Petr Kellnhofer

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Adaptive Caching for Faster Video Generation with Diffusion Transformers

Kumara Kahatapitiya, Haozhe Liu, Sen He, Ding Liu, Menglin Jia, Chenyang Zhang, Michael S. Ryoo, Tian Xie

专题命中 视频扩散模型 ：video generation(title,abstract)；分类 cs.CV

Comments Project-page is available at https://adacache-dit.github.io

Dynamic Typography: Bringing Text to Life via Video Diffusion Prior

Zichen Liu, Yihao Meng, Hao Ouyang, Yue Yu, Bolin Zhao, Daniel Cohen-Or, Huamin Qu

专题命中 视频扩散模型 ：video diffusion(title)；text-to-video(abstract)；分类 cs.CV

Comments Our demo and code is available at: https://animate-your-word.github.io/demo/

Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillation

Yuanhao Zhai, Kevin Lin, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Chung-Ching Lin, David Doermann, Junsong Yuan, Lijuan Wang

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments NeurIPS 2024; project page: https://yhzhai.github.io/mcm/

Cavia: Camera-controllable Multi-view Video Diffusion with View-Integrated Attention

Dejia Xu, Yifan Jiang, Chen Huang, Liangchen Song, Thorsten Gernoth, Liangliang Cao, Zhangyang Wang, Hao Tang

专题命中 视频扩散模型 ：video diffusion(title)；video generation(abstract)；分类 cs.CV

Comments Project Page: https://ir1d.github.io/Cavia/

MM-LDM: Multi-Modal Latent Diffusion Model for Sounding Video Generation

Mingzhen Sun, Weining Wang, Yanyuan Qiao, Jiahui Sun, Zihan Qin, Longteng Guo, Xinxin Zhu, Jing Liu

专题命中 视频扩散模型 ：video generation(title,abstract)；分类 cs.CV

Comments Accepted by ACM MM 2024

Animate3D: Animating Any 3D Model with Multi-view Video Diffusion

Yanqin Jiang, Chaohui Yu, Chenjie Cao, Fan Wang, Weiming Hu, Jin Gao

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments Project Page: https://animate3d.github.io/

ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis

Wangbo Yu, Jinbo Xing, Li Yuan, Wenbo Hu, Xiaoyu Li, Zhipeng Huang, Xiangjun Gao, Tien-Tsin Wong, Ying Shan, Yonghong Tian

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments Project page: https://drexubery.github.io/ViewCrafter/

DiVE: DiT-based Video Generation with Enhanced Control

Junpeng Jiang, Gangyi Hong, Lijun Zhou, Enhui Ma, Hengtong Hu, Xia Zhou, Jie Xiang, Fan Liu, Kaicheng Yu, Haiyang Sun, Kun Zhan, Peng Jia, Miao Zhang

专题命中 视频扩散模型 ：video generation(title,abstract)；分类 cs.CV

ReToMe-VA: Recursive Token Merging for Video Diffusion-based Unrestricted Adversarial Attack

Ziyi Gao, Kai Chen, Zhipeng Wei, Tingshu Mou, Jingjing Chen, Zhiyu Tan, Hao Li, Yu-Gang Jiang

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Diffusion Reward: Learning Rewards via Conditional Video Diffusion

Tao Huang, Guangqi Jiang, Yanjie Ze, Huazhe Xu

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments Accepted to ECCV 2024. Project page and code: https://diffusion-reward.github.io/

EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions

Linrui Tian, Qi Wang, Bang Zhang, Liefeng Bo

专题命中 视频扩散模型 ：video diffusion(title)；video generation(abstract)；分类 cs.CV

VFusion3D: Learning Scalable 3D Generative Models from Video Diffusion Models

Junlin Han, Filippos Kokkinos, Philip Torr

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments ECCV 2024. Project page: https://junlinhan.github.io/projects/vfusion3d.html

QVD: Post-training Quantization for Video Diffusion Models

Shilong Tian, Hong Chen, Chengtao Lv, Yu Liu, Jinyang Guo, Xianglong Liu, Shengxi Li, Hao Yang, Tao Xie

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments accepted by ACMMM2024

Video Diffusion Alignment via Reward Gradients

Mihir Prabhudesai, Russell Mendonca, Zheyang Qin, Katerina Fragkiadaki, Deepak Pathak

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments Project Webpage: https://vader-vid.github.io; Code available at: https://github.com/mihirp1998/VADER

Live2Diff: Live Stream Translation via Uni-directional Attention in Video Diffusion Models

Zhening Xing, Gereon Fox, Yanhong Zeng, Xingang Pan, Mohamed Elgharib, Christian Theobalt, Kai Chen

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments https://live2diff.github.io/

Precipitation Downscaling with Spatiotemporal Video Diffusion

Prakhar Srivastava, Ruihan Yang, Gavin Kerrigan, Gideon Dresdner, Jeremy McGibbon, Christopher Bretherton, Stephan Mandt

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

AV-DiT: Efficient Audio-Visual Diffusion Transformer for Joint Audio and Video Generation

Kai Wang, Shijian Deng, Jing Shi, Dimitrios Hatzinakos, Yapeng Tian

专题命中 视频扩散模型 ：video generation(title,abstract)；分类 cs.CV

Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusion

Fangfu Liu, Hanyang Wang, Shunyu Yao, Shengjun Zhang, Jie Zhou, Yueqi Duan

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments Project page: https://liuff19.github.io/Physics3D

VividPose: Advancing Stable Video Diffusion for Realistic Human Image Animation

Qilin Wang, Zhengkai Jiang, Chengming Xu, Jiangning Zhang, Yabiao Wang, Xinyi Zhang, Yun Cao, Weijian Cao, Chengjie Wang, Yanwei Fu

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Models

Hanwen Liang, Yuyang Yin, Dejia Xu, Hanxue Liang, Zhangyang Wang, Konstantinos N. Plataniotis, Yao Zhao, Yunchao Wei

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments Project page: https://vita-group.github.io/Diffusion4D

Scaling Diffusion Mamba with Bidirectional SSMs for Efficient Image and Video Generation

Shentong Mo, Yapeng Tian

专题命中 视频扩散模型 ：video generation(title,abstract)；分类 cs.CV

TimeRewind: Rewinding Time with Image-and-Events Video Diffusion

Jingxi Chen, Brandon Y. Feng, Haoming Cai, Mingyang Xie, Christopher Metzler, Cornelia Fermuller, Yiannis Aloimonos

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion

Vikram Voleti, Chun-Han Yao, Mark Boss, Adam Letts, David Pankratz, Dmitry Tochilkin, Christian Laforte, Robin Rombach, Varun Jampani

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments Project page: https://sv3d.github.io/

V3D: Video Diffusion Models are Effective 3D Generators

Zilong Chen, Yikai Wang, Feng Wang, Zhengyi Wang, Huaping Liu

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments Code available at https://github.com/heheyas/V3D Project page: https://heheyas.github.io/V3D/

Feature-Conditioned Cascaded Video Diffusion Models for Precise Echocardiogram Synthesis

Hadrien Reynaud, Mengyun Qiao, Mischa Dombrowski, Thomas Day, Reza Razavi, Alberto Gomez, Paul Leeson, Bernhard Kainz

专题命中 视频扩散模型 ：video diffusion(title)；video generation(abstract)；分类 cs.CV

Comments Published in MICCAI 2023 proceedings. https://link.springer.com/chapter/10.1007/978-3-031-43999-5_14

Animated Stickers: Bringing Stickers to Life with Video Diffusion

David Yan, Winnie Zhang, Luxin Zhang, Anmol Kalia, Dingkang Wang, Ankit Ramchandani, Miao Liu, Albert Pumarola, Edgar Schoenfeld, Elliot Blanchard, Krishna Narni, Yaqiao Luo, Lawrence Chen, Guan Pang, Ali Thabet, Peter Vajda, Amy Bearman, Licheng Yu

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models

Jeong-gi Kwak, Erqun Dong, Yuhe Jin, Hanseok Ko, Shweta Mahajan, Kwang Moo Yi

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments Project page: https://jgkwak95.github.io/ViVid-1-to-3/

VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation

Zhengxiong Luo, Dayou Chen, Yingya Zhang, Yan Huang, Liang Wang, Yujun Shen, Deli Zhao, Jingren Zhou, Tieniu Tan

专题命中 视频扩散模型 ：video generation(title,abstract)；分类 cs.CV

Comments Accepted to CVPR2023

MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation

Ludan Ruan, Yiyang Ma, Huan Yang, Huiguo He, Bei Liu, Jianlong Fu, Nicholas Jing Yuan, Qin Jin, Baining Guo

专题命中 视频扩散模型 ：video generation(title,abstract)；分类 cs.CV

Comments Accepted by CVPR 2023