RomanL

Hi All!

We'd be grateful for your help to solve this issue. We're prototyping the animation of the talking head. Our only concern is the visual part as the audio is handled separately.

In Spine we've built mouth shapes (aka visemes)
WhatsApp Image 2019-09-18 at 7.24.04 AM.jpeg
according to this chat.
WhatsApp Image 2019-09-17 at 4.47.07 PM.jpeg
Through Spine Runtime (using Monogame) we are issuing requests to switch between visemes, however transitions that happen are choppy as you can see in the video
.

I have also attached the project file if that could help
After Effects (1).zip


What's the best approach to making shapes transition smoothly between them?
添付ファイルを見るにはパーミッションが必要です
RomanL
  • 記事: 1

Erika

Hello!
I'd recommend to have a look at the approach taken in this thread instead:
Mouth animation using Rhubarb Lip Sync

The swaps are not a long fading transition but several image attachments alternating thanks to the audio track that you give to Rhubarb.



Another approach if you wish to have smooth transitions is to deform your mouth using meshes weighted to bones. In each animation, you arrange the bones to form the shape you need. This way, when you switch from one shape to the other, the interpolation should look smooth and natural.
For this to work well it means that all or most images are already in place, a good approach is to have a separate jaw image or a hole in your face mesh, and the open mouth and teeth below all already visible but hidden by the face when the lips are in a closed position.
アバター
Erika

Erikari
  • 記事: 2410


Return to Runtimes