The realization of speech drive picture 2D characters？

[BeyondLightYear]

It's an amazing project! I want to use speech to drive the people in the picture to make gestures. But after reading the thesis and the project, I didn't have a good idea.

Might I get some Pointers from you in your spare time？

Thanks very much!