Lip2Wav

Lip2Wav copied to clipboard

Teacher forcing on TIMIT and GRID dataset

2

Hi, I want to know how to set teacher forcing in GRID and TCDTIMIT dataset. The same as lip2wav dataset? teacher forcing decay from 29000 steps?

hjzzju

Hi, thanks for the great work. I'm able to reproduce the score claimed in the paper using our [pre-trained model ](https://iiitaphyd-my.sharepoint.com/:f:/g/personal/radrabha_m_research_iiit_ac_in/EgQbOxQI5UBDg3Atmobk834BgMaJBQqeEIvJMu-t7x0sOQ?e=qAYkG1)weights. However, when I tried to train Lip2wav on the...

psui3905

Great work! I wonder how to ensure the consistency of input frame length and output waveform length? When I use GRID datasets to train and test and set the hyper...

rita-zeng

Hi! Thanks for this great work! Now, I'm trying to train this model on other datasets, and I can't find 'mel_overlap' in the training code, does this hyper parameter only...

rita-zeng

The pre-trained model does not seem to work well

10

I tried to use the pre-trained model to generate audio on the test set of the DL speaker, and got the following results: [dl_test_results.zip](https://drive.google.com/file/d/1KJGa6DMd0vpCZeV-21JJ3uBBiOCLsDFQ/view?usp=sharing) The results do not sound very...

enhuiz

How to avoid “CUDA out of memory” in PyTorch

2

hey there. the preprocessing is working but actually it has only generated audio files of 3.9gb's. I think there should be image aswell( i tried on mac without any gpu...

Sagar1998

What's the expected number of steps to achieve a similar result to the pre-trained model of multi-speaker settings (LRW)? The default steps in train.py is 2,000,000.

kavinvin

Train/test split for GRID and TIMIT and WER measurement.

1

Thanks for your great work. Would you like to share the GRID and TIMIT train and test split and the ASR model that calculates the WER for these two datasets...

enhuiz

Pre-processing and training not working on custom dataset?

16

Whenever I preprocess the custom dataset, this is the output: `C:\Users\Graham\Desktop\Lip2Wav-master>python preprocess.py --speaker_root Dataset/larry --speaker larry C:\Users\Graham\AppData\Local\Programs\Python\Python36\lib\site-packages\tensorflow\python\framework\dtypes.py:526: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated;...

graham-eisele