视频大模型

High-Fidelity Novel View Synthesis via Splatting-Guided Diffusion

Xiang Zhang, Yang Zhang, Lukas Mehl, Markus Gross, Christopher Schroers

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

MVTokenFlow: High-quality 4D Content Generation using Multiview Token Flow

Hanzhuo Huang, Yuan Liu, Ge Zheng, Jiepeng Wang, Zhiyang Dou, Sibei Yang

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments ICLR 2025. Project page: https://soolab.github.io/MVTokenFlow

Consistent Video Colorization via Palette Guidance

Han Wang, Yuang Zhang, Yuhong Zhang, Lingxiao Lu, Li Song

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

OmniPhysGS: 3D Constitutive Gaussians for General Physics-Based Dynamics Generation

Yuchen Lin, Chenguo Lin, Jianjin Xu, Yadong Mu

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Accepted to ICLR 2025; Project page: https://wgsxm.github.io/projects/omniphysgs/

AniDoc: Animation Creation Made Easier

Yihao Meng, Hao Ouyang, Hanlin Wang, Qiuyu Wang, Wen Wang, Ka Leong Cheng, Zhiheng Liu, Yujun Shen, Huamin Qu

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Project page and code: https://yihao-meng.github.io/AniDoc_demo

Flow-Guided Diffusion for Video Inpainting

Bohai Gu, Yongsheng Yu, Heng Fan, Libo Zhang

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments This paper has been withdrawn as a new iteration of the work has been developed, which includes significant improvements and refinements based on this submission. The withdrawal is made to ensure academic integrity and compliance with publication standards. If you are interested, please refer to the updated work at arXiv:2412.00857

License Plate Images Generation with Diffusion Models

Mariia Shpir, Nadiya Shvai, Amir Nakib

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Journal ref Frontiers in Artificial Intelligence and Applications, Vol. 392, 2024, pp. 4594-4601

Neural Network Diffusion

Kai Wang, Dongwen Tang, Boya Zeng, Yida Yin, Zhaopan Xu, Yukun Zhou, Zelin Zang, Trevor Darrell, Zhuang Liu, Yang You

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Comments We introduce a novel approach for parameter generation, named neural network parameter diffusion (\textbf{p-diff}), which employs a standard latent diffusion model to synthesize a new set of parameters

AdaDiff: Adaptive Step Selection for Fast Diffusion Models

Hui Zhang, Zuxuan Wu, Zhen Xing, Jie Shao, Yu-Gang Jiang

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Comments Accepted by AAAI 2025

TCAQ-DM: Timestep-Channel Adaptive Quantization for Diffusion Models

Haocheng Huang, Jiaxin Chen, Jinyang Guo, Ruiyi Zhan, Yunhong Wang

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Real-time One-Step Diffusion-based Expressive Portrait Videos Generation

Hanzhong Guo, Hongwei Yi, Daquan Zhou, Alexander William Bergman, Michael Lingelbach, Yizhou Yu

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Comments 14 pages

SwiftTry: Fast and Consistent Video Virtual Try-On with Diffusion Models

Hung Nguyen, Quang Qui-Vinh Nguyen, Khoi Nguyen, Rang Nguyen

专题命中 视频扩散模型 ：long video(abstract)；分类 cs.CV

Video Creation by Demonstration

Yihong Sun, Hao Zhou, Liangzhe Yuan, Jennifer J. Sun, Yandong Li, Xuhui Jia, Hartwig Adam, Bharath Hariharan, Long Zhao, Ting Liu

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Comments Project page at https://delta-diffusion.github.io/

HiFiVFS: High Fidelity Video Face Swapping

Xu Chen, Keke He, Junwei Zhu, Yanhao Ge, Wei Li, Chengjie Wang

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Contrastive Sequential-Diffusion Learning: Non-linear and Multi-Scene Instructional Video Synthesis

Vasco Ramos, Yonatan Bitton, Michal Yarom, Idan Szpektor, Joao Magalhaes

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Align3R: Aligned Monocular Depth Estimation for Dynamic Videos

Jiahao Lu, Tianyu Huang, Peng Li, Zhiyang Dou, Cheng Lin, Zhiming Cui, Zhen Dong, Sai-Kit Yeung, Wenping Wang, Yuan Liu

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Project Page: https://igl-hkust.github.io/Align3R.github.io/

One Shot, One Talk: Whole-body Talking Avatar from a Single Image

Jun Xiang, Yudong Guo, Leipeng Hu, Boyang Guo, Yancheng Yuan, Juyong Zhang

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Project Page: https://ustc3dv.github.io/OneShotOneTalk/

DreamDance: Animating Human Images by Enriching 3D Geometry Cues from 2D Poses

Yatian Pang, Bin Zhu, Bin Lin, Mingzhe Zheng, Francis E. H. Tay, Ser-Nam Lim, Harry Yang, Li Yuan

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

StableAnimator: High-Quality Identity-Preserving Human Image Animation

Shuyuan Tu, Zhen Xing, Xintong Han, Zhi-Qi Cheng, Qi Dai, Chong Luo, Zuxuan Wu

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Transforming Static Images Using Generative Models for Video Salient Object Detection

Suhwan Cho, Minhyeok Lee, Jungho Lee, Sangyoun Lee

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers

Lei Chen, Yuan Meng, Chen Tang, Xinzhu Ma, Jingyan Jiang, Xin Wang, Zhi Wang, Wenwu Zhu

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Motion Diffusion-Guided 3D Global HMR from a Dynamic Camera

Jaewoo Heo, Kuan-Chieh Wang, Karen Liu, Serena Yeung-Levy

专题命中 视频扩散模型 ：long video(abstract)；分类 cs.CV

Comments 15 pages, 2 figures, submitted to TMLR

HelloMeme: Integrating Spatial Knitting Attentions to Embed High-Level and Fidelity-Rich Conditions in Diffusion Models

Shengkai Zhang, Nianhong Jiao, Tian Li, Chaojie Yang, Chenhui Xue, Boya Niu, Jun Gao

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Comments 11 pages, 7 figures, 2 tables

DiTFastAttn: Attention Compression for Diffusion Transformer Models

Zhihang Yuan, Hanling Zhang, Pu Lu, Xuefei Ning, Linfeng Zhang, Tianchen Zhao, Shengen Yan, Guohao Dai, Yu Wang

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Efficient Diffusion Models: A Comprehensive Survey from Principles to Practices

Zhiyuan Ma, Yuzhu Zhang, Guoli Jia, Liangliang Zhao, Yichao Ma, Mingjie Ma, Gaofeng Liu, Kaiyan Zhang, Jianjun Li, Bowen Zhou

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Faster Diffusion: Rethinking the Role of the Encoder for Diffusion Model Inference

Senmao Li, Taihang Hu, Joost van de Weijer, Fahad Shahbaz Khan, Tao Liu, Linxuan Li, Shiqi Yang, Yaxing Wang, Ming-Ming Cheng, Jian Yang

专题命中 视频扩散模型 ：text-to-video(abstract)；分类 cs.CV

Comments NeurIPS 2024

Hallo2: Long-Duration and High-Resolution Audio-Driven Portrait Image Animation

Jiahao Cui, Hui Li, Yao Yao, Hao Zhu, Hanlin Shang, Kaihui Cheng, Hang Zhou, Siyu Zhu, Jingdong Wang

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Training-Free Adaptive Diffusion with Bounded Difference Approximation Strategy

Hancheng Ye, Jiakang Yuan, Renqiu Xia, Xiangchao Yan, Tao Chen, Junchi Yan, Botian Shi, Bo Zhang

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Accepted by NeurIPS 2024, Homepage: https://jiakangyuan.github.io/AdaptiveDiffusion-project-page/ The code is available at https://github.com/UniModal4Reasoning/AdaptiveDiffusion

IV-Mixed Sampler: Leveraging Image Diffusion Models for Enhanced Video Synthesis

Shitong Shao, Zikai Zhou, Lichen Bai, Haoyi Xiong, Zeke Xie

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Semantically Consistent Video Inpainting with Conditional Diffusion Models

Dylan Green, William Harvey, Saeid Naderiparizi, Matthew Niedoba, Yunpeng Liu, Xiaoxuan Liang, Jonathan Lavington, Ke Zhang, Vasileios Lioutas, Setareh Dabiri, Adam Scibior, Berend Zwartsenberg, Frank Wood

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV