视频大模型

Next Block Prediction: Video Generation via Semi-Autoregressive Modeling

Shuhuai Ren, Shuming Ma, Xu Sun, Furu Wei

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments project page: https://renshuhuai-andy.github.io/NBP-project/

UniCP: A Unified Caching and Pruning Framework for Efficient Video Generation

Wenzhang Sun, Qirui Hou, Donglin Di, Jiahui Yang, Yongjia Ma, Jianxun Cui

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

MJ-VIDEO: Fine-Grained Benchmarking and Rewarding Video Preferences in Video Generation

Haibo Tong, Zhaoyang Wang, Zhaorun Chen, Haonian Ji, Shi Qiu, Siwei Han, Kexin Geng, Zhongkai Xue, Yiyang Zhou, Peng Xia, Mingyu Ding, Rafael Rafailov, Chelsea Finn, Huaxiu Yao

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Pushing the Boundaries of State Space Models for Image and Video Generation

Yicong Hong, Long Mai, Yuan Yao, Feng Liu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments 21 pages, paper under review

Taming Teacher Forcing for Masked Autoregressive Video Generation

Deyu Zhou, Quan Sun, Yuang Peng, Kun Yan, Runpei Dong, Duomin Wang, Zheng Ge, Nan Duan, Xiangyu Zhang, Lionel M. Ni, Heung-Yeung Shum

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments 12 pages, 9 figures

Through-The-Mask: Mask-based Motion Trajectories for Image-to-Video Generation

Guy Yariv, Yuval Kirstain, Amit Zohar, Shelly Sheynin, Yaniv Taigman, Yossi Adi, Sagie Benaim, Adam Polyak

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

STAR: Spatial-Temporal Augmentation with Text-to-Video Models for Real-World Video Super-Resolution

Rui Xie, Yinhong Liu, Penghao Zhou, Chen Zhao, Jun Zhou, Kai Zhang, Zhenyu Zhang, Jian Yang, Zhenheng Yang, Ying Tai

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV

TrackGo: A Flexible and Efficient Method for Controllable Video Generation

Haitao Zhou, Chuang Wang, Rui Nie, Jinlin Liu, Dongdong Yu, Qian Yu, Changhu Wang

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Accepted by AAAI 2025

ModelGrow: Continual Text-to-Video Pre-training with Model Expansion and Language Understanding Enhancement

Zhefan Rao, Liya Ji, Yazhou Xing, Runtao Liu, Zhaoyang Liu, Jiaxin Xie, Ziqiao Peng, Yingqing He, Qifeng Chen

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV

Comments 18 pages

FFA Sora, video generation as fundus fluorescein angiography simulator

Xinyuan Wu, Lili Wang, Ruoyu Chen, Bowen Liu, Weiyi Zhang, Xi Yang, Yifan Feng, Mingguang He, Danli Shi

专题命中 视频生成 ：video generation(title)；text-to-video(abstract)；分类 cs.CV

Comments 24 pages, 3 figures

VAST 1.0: A Unified Framework for Controllable and Consistent Video Generation

Chi Zhang, Yuanzhi Liang, Xi Qiu, Fangqiu Yi, Xuelong Li

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Generative Inbetweening through Frame-wise Conditions-Driven Video Generation

Tianyi Zhu, Dongwei Ren, Qilong Wang, Xiaohe Wu, Wangmeng Zuo

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

TIV-Diffusion: Towards Object-Centric Movement for Text-driven Image to Video Generation

Xingrui Wang, Xin Li, Yaosi Hu, Hanxin Zhu, Chen Hou, Cuiling Lan, Zhibo Chen

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Accepted by AAAI 2025

LiftImage3D: Lifting Any Single Image to 3D Gaussians with Video Generation Priors

Yabo Chen, Chen Yang, Jiemin Fang, Xiaopeng Zhang, Lingxi Xie, Wei Shen, Wenrui Dai, Hongkai Xiong, Qi Tian

专题命中 视频生成 ：video generation(title)；video diffusion(abstract)；分类 cs.CV

Comments Project page: https://liftimage3d.github.io/

UFO: Enhancing Diffusion-Based Video Generation with a Uniform Frame Organizer

Delong Liu, Zhaohui Hou, Mingjie Zhan, Shihao Han, Zhicheng Zhao, Fei Su

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Code:https://github.com/Delong-liu-bupt/UFO

Stag-1: Towards Realistic 4D Driving Simulation with Video Generation Model

Lening Wang, Wenzhao Zheng, Dalong Du, Yunpeng Zhang, Yilong Ren, Han Jiang, Zhiyong Cui, Haiyang Yu, Jie Zhou, Jiwen Lu, Shanghang Zhang

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Code is available at: https://github.com/wzzheng/Stag

MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generation

Shuwei Shi, Biao Gong, Xi Chen, Dandan Zheng, Shuai Tan, Zizheng Yang, Yuyuan Li, Jingwen He, Kecheng Zheng, Jingdong Chen, Ming Yang, Yinqiang Zheng

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Combining Genre Classification and Harmonic-Percussive Features with Diffusion Models for Music-Video Generation

Leonardo Pina, Yongmin Li

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.MM

Imagine360: Immersive 360 Video Generation from Perspective Anchor

Jing Tan, Shuai Yang, Tong Wu, Jingwen He, Yuwei Guo, Ziwei Liu, Dahua Lin

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Project page: https://ys-imtech.github.io/projects/Imagine360

SINGER: Vivid Audio-driven Singing Video Generation with Multi-scale Spectral Diffusion Model

Yan Li, Ziya Zhou, Zhiqiang Wang, Wei Xue, Wenhan Luo, Yike Guo

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Open-Sora Plan: Open-Source Large Video Generation Model

Bin Lin, Yunyang Ge, Xinhua Cheng, Zongjian Li, Bin Zhu, Shaodong Wang, Xianyi He, Yang Ye, Shenghai Yuan, Liuhan Chen, Tanghui Jia, Junwu Zhang, Zhenyu Tang, Yatian Pang, Bin She, Cen Yan, Zhiheng Hu, Xiaoyi Dong, Lin Chen, Zhang Pan, Xing Zhou, Shaoling Dong, Yonghong Tian, Li Yuan

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments v1.3

Fleximo: Towards Flexible Text-to-Human Motion Video Generation

Yuhang Zhang, Yuan Zhou, Zeyu Liu, Yuxuan Cai, Qiuyue Wang, Aidong Men, Huan Yang

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

SPAgent: Adaptive Task Decomposition and Model Selection for General Video Generation and Editing

Rong-Cheng Tu, Wenhao Sun, Zhao Jin, Jingyi Liao, Jiaxing Huang, Dacheng Tao

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Scene Co-pilot: Procedural Text to Video Generation with Human in the Loop

Zhaofang Qian, Abolfazl Sharifi, Tucker Carroll, Ser-Nam Lim

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Videos are available at our project page: https://abolfazl-sh.github.io/Scene_co-pilot_site/

Medical Video Generation for Disease Progression Simulation

Xu Cao, Kaizhao Liang, Kuei-Da Liao, Tianren Gao, Wenqian Ye, Jintai Chen, Zhiguang Ding, Jianguo Cao, James M. Rehg, Jimeng Sun

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Tech Report. The appendix will release soon. arXiv admin note: text overlap with arXiv:2309.11745

AnimateAnything: Consistent and Controllable Animation for Video Generation

Guojun Lei, Chi Wang, Hong Li, Rong Zhang, Yikai Wang, Weiwei Xu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Artificial Intelligence for Biomedical Video Generation

Linyuan Li, Jianing Qiu, Anujit Saha, Lin Li, Poyuan Li, Mengxian He, Ziyu Guo, Wu Yuan

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaboration

Panwen Hu, Jin Jiang, Jianqi Chen, Mingfei Han, Shengcai Liao, Xiaojun Chang, Xiaodan Liang

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Exploring the Interplay Between Video Generation and World Models in Autonomous Driving: A Survey

Ao Fu, Yi Zhou, Tao Zhou, Yi Yang, Bojun Gao, Qun Li, Guobin Wu, Ling Shao

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

MotionCraft: Physics-based Zero-Shot Video Generation

Luca Savant Aira, Antonio Montanaro, Emanuele Aiello, Diego Valsesia, Enrico Magli

专题命中 视频生成 ：video generation(title)；video diffusion(abstract)；分类 cs.CV

Journal ref NeurIPS 2024