视频大模型

Dynamic Concepts Personalization from Single Videos

Rameen Abdal, Or Patashnik, Ivan Skorokhodov, Willi Menapace, Aliaksandr Siarohin, Sergey Tulyakov, Daniel Cohen-Or, Kfir Aberman

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

Comments Webpage: https://snap-research.github.io/dynamic_concepts/

Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolation

Xiaojuan Wang, Boyang Zhou, Brian Curless, Ira Kemelmacher-Shlizerman, Aleksander Holynski, Steven M. Seitz

专题命中 视频生成 ：video diffusion(abstract)；分类 cs.CV

Comments Published at ICLR 2025; Project page: https://svd-keyframe-interpolation.github.io/

Every Image Listens, Every Image Dances: Music-Driven Image Animation

Zhikang Dong, Weituo Hao, Ju-Chiang Wang, Peng Zhang, Pawel Polak

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Learnings from Scaling Visual Tokenizers for Reconstruction and Generation

Philippe Hansen-Estruch, David Yan, Ching-Yao Chung, Orr Zohar, Jialiang Wang, Tingbo Hou, Tao Xu, Sriram Vishwanath, Peter Vajda, Xinlei Chen

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments 28 pages, 25 figures, 7 Tables

3D Gaussian Splatting with Normal Information for Mesh Extraction and Improved Rendering

Meenakshi Krishnan, Liam Fowl, Ramani Duraiswami

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments ICASSP 2025: Workshop on Generative Data Augmentation for Real-World Signal Processing Applications

JoyGen: Audio-Driven 3D Depth-Aware Talking-Face Video Editing

Qili Wang, Dajiang Wu, Zihang Xu, Junshi Huang, Jun Lv

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

ILDiff: Generate Transparent Animated Stickers by Implicit Layout Distillation

Ting Zhang, Zhiqiang Yuan, Yeshuang Zhu, Jinchao Zhang

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Generative Video Propagation

Shaoteng Liu, Tianyu Wang, Jui-Hsien Wang, Qing Liu, Zhifei Zhang, Joon-Young Lee, Yijun Li, Bei Yu, Zhe Lin, Soo Ye Kim, Jiaya Jia

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments 11 pages, 18 figures

ManiVideo: Generating Hand-Object Manipulation Video with Dexterous and Generalizable Grasping

Youxin Pang, Ruizhi Shao, Jiajun Zhang, Hanzhang Tu, Yun Liu, Boyao Zhou, Hongwen Zhang, Yebin Liu

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

VidTok: A Versatile and Open-Source Video Tokenizer

Anni Tang, Tianyu He, Junliang Guo, Xinle Cheng, Li Song, Jiang Bian

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Code & Models: https://github.com/microsoft/VidTok

Physical Informed Driving World Model

Zhuoran Yang, Xi Guo, Chenjing Ding, Chiyu Wang, Wei Wu

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments project homepage: https://metadrivescape.github.io/papers_project/DrivePhysica/page.html

UniReal: Universal Image Generation and Editing via Learning Real-world Dynamics

Xi Chen, Zhifei Zhang, He Zhang, Yuqian Zhou, Soo Ye Kim, Qing Liu, Yijun Li, Jianming Zhang, Nanxuan Zhao, Yilin Wang, Hui Ding, Zhe Lin, Hengshuang Zhao

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments webpage: https://xavierchen34.github.io/UniReal-Page/

Ctrl-X: Controlling Structure and Appearance for Text-To-Image Generation Without Guidance

Kuan Heng Lin, Sicheng Mo, Ben Klingher, Fangzhou Mu, Bolei Zhou

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

Comments 22 pages, 17 figures, see project page at https://genforce.github.io/ctrl-x

StyleMaster: Stylize Your Video with Artistic Generation and Translation

Zixuan Ye, Huijuan Huang, Xintao Wang, Pengfei Wan, Di Zhang, Wenhan Luo

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Project webpage available at https://zixuan-ye.github.io/stylemaster

SafeWatch: An Efficient Safety-Policy Following Video Guardrail Model with Transparent Explanations

Zhaorun Chen, Francesco Pinto, Minzhou Pan, Bo Li

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments 43 pages, 20 figures

Movie Gen: SWOT Analysis of Meta's Generative AI Foundation Model for Transforming Media Generation, Advertising, and Entertainment Industries

Abul Ehtesham, Saket Kumar, Aditi Singh, Tala Talaei Khoei

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstruction

Lingteng Qiu, Shenhao Zhu, Qi Zuo, Xiaodong Gu, Yuan Dong, Junfei Zhang, Chao Xu, Zhe Li, Weihao Yuan, Liefeng Bo, Guanying Chen, Zilong Dong

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Project Page: https://lingtengqiu.github.io/2024/AniGS/

PhysMotion: Physics-Grounded Dynamics From a Single Image

Xiyang Tan, Ying Jiang, Xuan Li, Zeshun Zong, Tianyi Xie, Yin Yang, Chenfanfu Jiang

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Project Page: https://supertan0204.github.io/physmotion_website/

DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representation

Guosheng Zhao, Chaojun Ni, Xiaofeng Wang, Zheng Zhu, Xueyang Zhang, Yida Wang, Guan Huang, Xinze Chen, Boyuan Wang, Youyi Zhang, Wenjun Mei, Xingang Wang

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Project Page: https://drivedreamer4d.github.io

A Survey on Vision Autoregressive Model

Kai Jiang, Jiaxing Huang

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments This work will be integrated into another project

MagicStick: Controllable Video Editing via Control Handle Transformations

Yue Ma, Xiaodong Cun, Sen Liang, Jinbo Xing, Yingqing He, Chenyang Qi, Siran Chen, Qifeng Chen

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Accepted by WACV 2025, Project page: https://magic-stick-edit.github.io/ Github repository: https://github.com/mayuelala/MagicStick

HOI-Swap: Swapping Objects in Videos with Hand-Object Interaction Awareness

Zihui Xue, Mi Luo, Changan Chen, Kristen Grauman

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Accepted by NeurIPS 2024, Project website: https://vision.cs.utexas.edu/projects/HOI-Swap/

Framer: Interactive Frame Interpolation

Wen Wang, Qiuyu Wang, Kecheng Zheng, Hao Ouyang, Zhekai Chen, Biao Gong, Hao Chen, Yujun Shen, Chunhua Shen

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Project page: https://aim-uofa.github.io/Framer/

VidPanos: Generative Panoramic Videos from Casual Panning Videos

Jingwei Ma, Erika Lu, Roni Paiss, Shiran Zada, Aleksander Holynski, Tali Dekel, Brian Curless, Michael Rubinstein, Forrester Cole

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Project page at https://vidpanos.github.io/. To appear at SIGGRAPH Asia 2024 (conference track)

SeeClear: Semantic Distillation Enhances Pixel Condensation for Video Super-Resolution

Qi Tang, Yao Zhao, Meiqin Liu, Chao Yao

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Accepted to NeurIPS 2024

Trans4D: Realistic Geometry-Aware Transition for Compositional Text-to-4D Synthesis

Bohan Zeng, Ling Yang, Siyu Li, Jiaming Liu, Zixiang Zhang, Juanxi Tian, Kaixin Zhu, Yongzhen Guo, Fu-Yun Wang, Minkai Xu, Stefano Ermon, Wentao Zhang

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Project: https://github.com/YangLing0818/Trans4D

Improving the Training of Rectified Flows

Sangyun Lee, Zinan Lin, Giulia Fanti

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments NeurIPS2024

ImmersePro: End-to-End Stereo Video Synthesis Via Implicit Disparity Learning

Jian Shi, Zhenyu Li, Peter Wonka

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

JoyHallo: Digital human model for Mandarin

Sheng Shi, Xuyang Cao, Jun Zhao, Guoxin Wang

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

VideoStudio: Generating Consistent-Content and Multi-Scene Videos

Fuchen Long, Zhaofan Qiu, Ting Yao, Tao Mei

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments ECCV 2024. Source code is available at https://github.com/FuchenUSTC/VideoStudio