Chen Cao, Hongzhi Wu, Yanlin Weng, Tianjia Shao, Kun Zhou, "Real-time Facial Animation with Image-based Dynamic Avatars", ACM Trans. on Graphics (SIGGRAPH), 2016.
构建和使用基于图像的动态化身的pipeline:(1)image acquisition, (2)avatar construction (3) real-time animation
Overview of our pipeline. From captured images of the user that sparsely sample over head poses and expressions, we build a head blendshape and a morphable hair model to represent the corresponding coarse geometry. Other components such as eyes and teeth are expressed as billboards. During runtime, an actor can drive our avatar using a single-camera-based face tracker. The captured images are warped and blended under the guidance of the coarse geometry to generate real-time facial animation wi