initial data script
I have made the data creation script, this is a dirty implementation though. The way I make it work is by running:
First update the test.yaml with the train video and corresponding audio. Then run:
python -m scripts.data --inference_config configs/inference/test.yaml --folder_name train
Again update the test.yaml with test video and audio and again running:
python -m scripts.data --inference_config configs/inference/test.yaml --folder_name test
This creates folders which contain the image frames and npy files.
I also need to modify the Dataloader.py in train_codes to make the training hapen. I can make the necessary changes before you merge @czk32611 @itechmusic .
https://github.com/TMElyralab/MuseTalk/assets/32771603/e3bba83f-93c3-4908-9213-9da596c39c49
Also attaching a sample to show the trained results, I cant upload more than 10MB so its small.
Just guide me on what changes to make and I'll do it. Thanks for this guys.