视频大模型

Phy124: Fast Physics-Driven 4D Content Generation from a Single Image

Jiajing Lin, Zhenzhong Wang, Yongjie Hou, Yuzhou Tang, Min Jiang

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Blended Latent Diffusion under Attention Control for Real-World Video Editing

Deyin Liu, Lin Yuanbo Wu, Xianghua Xie

专题命中 视频扩散模型 ：text-to-video(abstract)；分类 cs.CV

Matryoshka Diffusion Models

Jiatao Gu, Shuangfei Zhai, Yizhe Zhang, Josh Susskind, Navdeep Jaitly

专题命中 视频扩散模型 ：text-to-video(abstract)；分类 cs.CV

Comments Accepted by ICLR2024

VQ4DiT: Efficient Post-Training Vector Quantization for Diffusion Transformers

Juncan Deng, Shuaiting Li, Zeyu Wang, Hong Gu, Kedong Xu, Kejie Huang

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Comments 11 pages, 6 figures

One-Shot Learning Meets Depth Diffusion in Multi-Object Videos

Anisha Jain

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

GenDDS: Generating Diverse Driving Video Scenarios with Prompt-to-Video Generative Model

Yongjie Fu, Yunlong Li, Xuan Di

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Pixel-Aligned Multi-View Generation with Depth Guided Decoder

Zhenggang Tang, Peiye Zhuang, Chaoyang Wang, Aliaksandr Siarohin, Yash Kant, Alexander Schwing, Sergey Tulyakov, Hsin-Ying Lee

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

CT4D: Consistent Text-to-4D Generation with Animatable Meshes

Ce Chen, Shaoli Huang, Xuelin Chen, Guangyi Chen, Xiaoguang Han, Kun Zhang, Mingming Gong

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

WoVoGen: World Volume-aware Diffusion for Controllable Multi-camera Driving Scene Generation

Jiachen Lu, Ze Huang, Zeyu Yang, Jiahui Zhang, Li Zhang

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Comments ECCV 2024

Faster Diffusion Action Segmentation

Shuaibing Wang, Shunli Wang, Mingcheng Li, Dingkang Yang, Haopeng Kuang, Ziyun Qian, Lihua Zhang

专题命中 视频扩散模型 ：long video(abstract)；分类 cs.CV

Comments 25 pages, 6 figures

Motion-aware Latent Diffusion Models for Video Frame Interpolation

Zhilin Huang, Yijie Yu, Ling Yang, Chujun Qin, Bing Zheng, Xiawu Zheng, Zikun Zhou, Yaowei Wang, Wenming Yang

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Comments 17 pages, 4 figures

ProcessPainter: Learn Painting Process from Sequence Data

Yiren Song, Shijie Huang, Chen Yao, Xiaojun Ye, Hai Ci, Jiaming Liu, Yuxuan Zhang, Mike Zheng Shou

专题命中 视频扩散模型 ：text-to-video(abstract)；分类 cs.CV

Accelerating Image Generation with Sub-path Linear Approximation Model

Chen Xu, Tianhui Song, Weixin Feng, Xubin Li, Tiezheng Ge, Bo Zheng, Limin Wang

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

IDOL: Unified Dual-Modal Latent Diffusion for Human-Centric Joint Video-Depth Generation

Yuanhao Zhai, Kevin Lin, Linjie Li, Chung-Ching Lin, Jianfeng Wang, Zhengyuan Yang, David Doermann, Junsong Yuan, Zicheng Liu, Lijuan Wang

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Comments ECCV 2024; project page: https://yhzhai.github.io/idol/

Kinetic Typography Diffusion Model

Seonmi Park, Inhwan Bae, Seunghyun Shin, Hae-Gon Jeon

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Accepted at ECCV 2024, Project page: https://seonmip.github.io/kinety

E2VIDiff: Perceptual Events-to-Video Reconstruction using Diffusion Priors

Jinxiu Liang, Bohan Yu, Yixin Yang, Yiming Han, Boxin Shi

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

MVOC: a training-free multiple video object composition method with diffusion models

Wei Wang, Yaosen Chen, Yuegen Liu, Qi Yuan, Shubin Yang, Yanru Zhang

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Diffusion-Promoted HDR Video Reconstruction

Yuanshen Guan, Ruikang Xu, Mingde Yao, Ruisheng Gao, Lizhi Wang, Zhiwei Xiong

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Arxiv Preprint

Evaluating and Mitigating IP Infringement in Visual Generative AI

Zhenting Wang, Chen Chen, Vikash Sehwag, Minzhou Pan, Lingjuan Lyu

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

LatentMan: Generating Consistent Animated Characters using Image Diffusion Models

Abdelrahman Eldesokey, Peter Wonka

专题命中 视频扩散模型 ：text-to-video(abstract)；分类 cs.CV

Comments CVPRW 2024. Project page: https://abdo-eldesokey.github.io/latentman/

X-Ray: A Sequential 3D Representation For Generation

Tao Hu, Wenhang Ge, Yuyang Zhao, Gim Hee Lee

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

VividDream: Generating 3D Scene with Ambient Dynamics

Yao-Chih Lee, Yi-Ting Chen, Andrew Wang, Ting-Hsuan Liao, Brandon Y. Feng, Jia-Bin Huang

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Project page: https://vivid-dream-4d.github.io

Zero-Shot Video Semantic Segmentation based on Pre-Trained Diffusion Models

Qian Wang, Abdelrahman Eldesokey, Mohit Mendiratta, Fangneng Zhan, Adam Kortylewski, Christian Theobalt, Peter Wonka

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Project webpage: https://qianwangx.github.io/VidSeg_diffusion/

A Unified Approach for Text- and Image-guided 4D Scene Generation

Yufeng Zheng, Xueting Li, Koki Nagano, Sifei Liu, Karsten Kreis, Otmar Hilliges, Shalini De Mello

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Project page: https://research.nvidia.com/labs/nxp/dream-in-4d/

DORSal: Diffusion for Object-centric Representations of Scenes et al

Allan Jabri, Sjoerd van Steenkiste, Emiel Hoogeboom, Mehdi S. M. Sajjadi, Thomas Kipf

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Accepted to ICLR 2024. Project page: https://www.sjoerdvansteenkiste.com/dorsal

Bridge to Non-Barrier Communication: Gloss-Prompted Fine-grained Cued Speech Gesture Generation with Diffusion Model

Wentao Lei, Li Liu, Jun Wang

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Journal ref IJCAI 2024

The Missing U for Efficient Diffusion Models

Sergio Calvo-Ordonez, Chun-Wun Cheng, Jiahao Huang, Lipei Zhang, Guang Yang, Carola-Bibiane Schonlieb, Angelica I Aviles-Rivero

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Comments 23 pages, 14 figures, Accepted at Transactions of Machine Learning Research (04/2024)

Upsample Guidance: Scale Up Diffusion Models without Training

Juno Hwang, Yong-Hyun Park, Junghyo Jo

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments 15 pages, 15 Figures

Sat2Scene: 3D Urban Scene Generation from Satellite Images with Diffusion

Zuoyue Li, Zhenqiang Li, Zhaopeng Cui, Marc Pollefeys, Martin R. Oswald

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Journal ref CVPR 2024

An Intermediate Fusion ViT Enables Efficient Text-Image Alignment in Diffusion Models

Zizhao Hu, Shaochong Jia, Mohammad Rostami

专题命中 视频扩散模型 ：text-to-video(abstract)；分类 cs.CV