Congratualtions!

Our paper has been accepted to the IEEE International Conference on Image Processing (ICIP) 2024 [LINK]

  • Title: Analyzing Visible Articulatory Movements in Speech Production for Speech-Driven 3D Facial Animation

  • Authors: Hyung Kyu Kim, Sangmin Lee (UIUC), and Hak Gu Kim

  • Abstract: Speech-driven 3D facial animation is a method aimed at generating realistic facial meshes based on input speech signals. However, due to a lack of understanding of visible articulatory movements, current state-of-the-art methods results in inaccurate lip and jaw movements. Traditional evaluation metrics such as lip vertex error (LVE) often fail to represent the quality of visual results. Based on our observation, we reveal the problems of existing evaluation metrics and raise the necessity for separate evaluation approaches for 3D axes. Comprehensive analysis showed that most recent methods struggle to precisely predict lip and jaw movements in a 3D space.