视频大模型

JoyHallo: Digital human model for Mandarin

Sheng Shi, Xuyang Cao, Jun Zhao, Guoxin Wang

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

VideoStudio: Generating Consistent-Content and Multi-Scene Videos

Fuchen Long, Zhaofan Qiu, Ting Yao, Tao Mei

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments ECCV 2024. Source code is available at https://github.com/FuchenUSTC/VideoStudio

G3PT: Unleash the power of Autoregressive Modeling in 3D Generation via Cross-scale Querying Transformer

Jinzhi Zhang, Feng Xiong, Mu Xu

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments 9 pages, 5 figures

JPEG-LM: LLMs as Image Generators with Canonical Codec Representations

Xiaochuang Han, Marjan Ghazvininejad, Pang Wei Koh, Yulia Tsvetkov

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

The Tug-of-War Between Deepfake Generation and Detection

Hannah Lee, Changyeon Lee, Kevin Farhat, Lin Qiu, Steve Geluso, Aerin Kim, Oren Etzioni

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Scene123: One Prompt to 3D Scene Generation via Video-Assisted and Consistency-Enhanced MAE

Yiying Yang, Fukun Yin, Jiayuan Fan, Xin Chen, Wanzhang Li, Gang Yu

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:2305.11588 by other authors

Visual Representation Learning with Stochastic Frame Prediction

Huiwon Jang, Dongyoung Kim, Junsu Kim, Jinwoo Shin, Pieter Abbeel, Younggyo Seo

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments International Conference on Machine Learning (ICML) 2024

Fine-gained Zero-shot Video Sampling

Dengsheng Chen, Jie Hu, Xiaoming Wei, Enhua Wu

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Real Face Video Animation Platform

Xiaokai Chen, Xuan Liu, Donglin Di, Yongjia Ma, Wei Chen, Tonghua Su

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

$R^2$-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding

Ye Liu, Jixuan He, Wanhua Li, Junsik Kim, Donglai Wei, Hanspeter Pfister, Chang Wen Chen

专题命中 视频生成 ：video understanding(abstract)；分类 cs.CV

Comments ECCV 2024 Camera Ready

PoseCrafter: One-Shot Personalized Video Synthesis Following Flexible Pose Control

Yong Zhong, Min Zhao, Zebin You, Xiaofeng Yu, Changwang Zhang, Chongxuan Li

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Multi-Granularity and Multi-modal Feature Interaction Approach for Text Video Retrieval

Wenjun Li, Shudong Wang, Dong Zhao, Shenghui Xu, Zhaoming Pan, Zhimin Zhang

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

DreamMotion: Space-Time Self-Similar Score Distillation for Zero-Shot Video Editing

Hyeonho Jeong, Jinho Chang, Geon Yeong Park, Jong Chul Ye

专题命中 视频生成 ：video diffusion(abstract)；分类 cs.CV

Comments Accepted to ECCV 2024, Project page: https://hyeonho99.github.io/dreammotion/

Rethinking Image-to-Video Adaptation: An Object-centric Perspective

Rui Qian, Shuangrui Ding, Dahua Lin

专题命中 视频生成 ：video understanding(abstract)；分类 cs.CV

Comments ECCV 2024

Sync4D: Video Guided Controllable Dynamics for Physics-Based 4D Generation

Zhoujie Fu, Jiacheng Wei, Wenhao Shen, Chaoyue Song, Xiaofeng Yang, Fayao Liu, Xulei Yang, Guosheng Lin

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments Our project page: https://sync4dphys.github.io/

I2V-Adapter: A General Image-to-Video Adapter for Diffusion Models

Xun Guo, Mingwu Zheng, Liang Hou, Yuan Gao, Yufan Deng, Pengfei Wan, Di Zhang, Yufan Liu, Weiming Hu, Zhengjun Zha, Haibin Huang, Chongyang Ma

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

Qualitative Failures of Image Generation Models and Their Application in Detecting Deepfakes

Ali Borji

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

They're All Doctors: Synthesizing Diverse Counterfactuals to Mitigate Associative Bias

Salma Abdel Magid, Jui-Hsien Wang, Kushal Kafle, Hanspeter Pfister

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

NLDF: Neural Light Dynamic Fields for Efficient 3D Talking Head Generation

Niu Guanchen

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Recent Developments Combining Ensemble Smoother and Deep Generative Networks for Facies History Matching

Smith W. A. Canchumuni, Jose D. B. Castro, Júlia Potratz, Alexandre A. Emerick, Marco Aurelio C. Pacheco

专题命中 视频生成 ：video generation(abstract)；分类 eess.IV

Comments 46 pages, 26 figures

EffiVED:Efficient Video Editing via Text-instruction Diffusion Models

Zhenghao Zhang, Zuozhuo Dai, Long Qin, Weizhi Wang

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

Text Prompting for Multi-Concept Video Customization by Autoregressive Generation

Divya Kothandaraman, Kihyuk Sohn, Ruben Villegas, Paul Voigtlaender, Dinesh Manocha, Mohammad Babaeizadeh

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

Comments Paper accepted to AI4CC Workshop at CVPR 2024

NeuroCine: Decoding Vivid Video Sequences from Human Brain Activties

Jingyuan Sun, Mingxiao Li, Zijiao Chen, Marie-Francine Moens

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Comments under review

NTIRE 2024 Quality Assessment of AI-Generated Content Challenge

Xiaohong Liu, Xiongkuo Min, Guangtao Zhai, Chunyi Li, Tengchuan Kou, Wei Sun, Haoning Wu, Yixuan Gao, Yuqin Cao, Zicheng Zhang, Xiele Wu, Radu Timofte, Fei Peng, Huiyuan Fu, Anlong Ming, Chuanming Wang, Huadong Ma, Shuai He, Zifei Dou, Shu Chen, Huacong Zhang, Haiyi Xie, Chengwei Wang, Baoying Chen, Jishen Zeng, Jianquan Yang, Weigang Wang, Xi Fang, Xiaoxin Lv, Jun Yan, Tianwu Zhi, Yabin Zhang, Yaohui Li, Yang Li, Jingwen Xu, Jianzhao Liu, Yiting Liao, Junlin Li, Zihao Yu, Yiting Lu, Xin Li, Hossein Motamednia, S. Farhad Hosseini-Benvidi, Fengbin Guan, Ahmad Mahmoudi-Aznaveh, Azadeh Mansouri, Ganzorig Gankhuyag, Kihwan Yoon, Yifang Xu, Haotian Fan, Fangyuan Kong, Shiling Zhao, Weifeng Dong, Haibing Yin, Li Zhu, Zhiling Wang, Bingchen Huang, Avinab Saha, Sandeep Mishra, Shashank Gupta, Rajesh Sureddi, Oindrila Saha, Luigi Celona, Simone Bianco, Paolo Napoletano, Raimondo Schettini, Junfeng Yang, Jing Fu, Wei Zhang, Wenzhi Cao, Limei Liu, Han Peng, Weijun Yuan, Zhan Li, Yihang Cheng, Yifan Deng, Haohui Li, Bowen Qu, Yao Li, Shuqing Luo, Shunzhou Wang, Wei Gao, Zihao Lu, Marcos V. Conde, Xinrui Wang, Zhibo Chen, Ruling Liao, Yan Ye, Qiulin Wang, Bing Li, Zhaokun Zhou, Miao Geng, Rui Chen, Xin Tao, Xiaoyu Liang, Shangkun Sun, Xingyuan Ma, Jiaze Li, Mengduo Yang, Haoran Xu, Jie Zhou, Shiding Zhu, Bohan Yu, Pengfei Chen, Xinrui Xu, Jiabin Shen, Zhichao Duan, Erfan Asadi, Jiahe Liu, Qi Yan, Youran Qu, Xiaohui Zeng, Lele Wang, Renjie Liao

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

Generative AI Beyond LLMs: System Implications of Multi-Modal Generation

Alicia Golden, Samuel Hsia, Fei Sun, Bilge Acun, Basil Hosmer, Yejin Lee, Zachary DeVito, Jeff Johnson, Gu-Yeon Wei, David Brooks, Carole-Jean Wu

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.MM

Comments Published at 2024 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS)

Synthesizing Audio from Silent Video using Sequence to Sequence Modeling

Hugo Garrido-Lestache Belinchon, Helina Mulugeta, Adam Haile

专题命中 视频生成 ：video generation(abstract)；分类 cs.CV

Exploring AIGC Video Quality: A Focus on Visual Harmony, Video-Text Consistency and Domain Distribution Gap

Bowen Qu, Xiaoyu Liang, Shangkun Sun, Wei Gao

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

Comments 9 pages, 3 figures, 3 tables. Accepted by CVPR2024 Workshop (3rd place winner of NTIRE2024 Quality Assessment for AI-Generated Content - Track 2 Video)

Semantically consistent Video-to-Audio Generation using Multimodal Language Large Model

Gehui Chen, Guan'an Wang, Xiaowen Huang, Jitao Sang

专题命中 视频生成 ：video generation(abstract)；分类 cs.MM

PCQA: A Strong Baseline for AIGC Quality Assessment Based on Prompt Condition

Xi Fang, Weigang Wang, Xiaoxin Lv, Jun Yan

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

Comments Published in CVPR-2024's NTIRE: New Trends in Image Restoration and Enhancement workshop and challenges

Comp4D: LLM-Guided Compositional 4D Scene Generation

Dejia Xu, Hanwen Liang, Neel P. Bhatt, Hezhen Hu, Hanxue Liang, Konstantinos N. Plataniotis, Zhangyang Wang

专题命中 视频生成 ：text-to-video(abstract)；分类 cs.CV

Comments Project page: https://vita-group.github.io/Comp4D/