ask-fake-ai-karen
ask-fake-ai-karen copied to clipboard
AI-generated talking head video of fake people responding to your input question text.
Talking To AI-Generated People
[Project Video] [Code Tutorial]
Fake Faces, Script, Voice and Lip-Sync Animation with Deep Learning
This notebook combines different state-of-the-art image and speech generation neural networks into one single Google Colab Notebook so that we can generate a random fake person's talking head video replying to our input text question.
Different Tools/Repositories used:-
- Face Generation - www.thispersondoesnotexist.com - StyleGAN2
- Text Generation - www.textsynth.org - OpenAI GPT-2
- Text-to-Speech Conversion - https://github.com/NVIDIA/flowtron - Flowtron
- Lip Animation - https://github.com/Rudrabha/LipGAN - LipGAN
TODO Improvements (Any Volunteers??) :-
- Use motion model to animate the face before performing lip-sync.
- Use the newer GPT-3 model for better, more coherent text responses.