GaussianEmoTalker: Real-Time Emotional Talking Head Synthesis with Audio-Driven and Blendshape-Based 3D Gaussian Splatting
GaussianEmoTalker:基于音频驱动和混合形状的3D高斯泼溅实时情感说话头合成
机构 * PCA Lab, Key Lab of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education, School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院,教育部高维信息智能感知与系统重点实验室,PCA实验室) ; Tsientang Institute for Advanced Study(浙江大学前沿交叉研究院) ; School of Intelligence Science and Technology, Nanjing University(南京大学智能科学与技术学院)
AI总结 提出GaussianEmoTalker框架,利用3D高斯泼溅和混合形状,通过中性到情感残差变形实现实时、可控强度的情感说话头合成,兼顾唇同步与渲染质量。