Parcollet Titouan

wav2vec2_hub: is a path to a hub or to a local folder containing ALL the files of the corresponding hub, so it should work if you just set it to:...

Yes, but make sure that it contains ALL the files from the repo :-)

Oh crap it's windows. @Gastron should path downloading be compatible with windows ?

Hi @thadeous and thanks for the PR! Could you please fix the pre-commit tests before I proceed with reviewing? You can install it following the documentation, it's very quick :-)

@RuABraun may I ask you to tell me if this is correct to your understanding of the decay in w2v2? :-) Thanks folks!

Hi @thadeous indeed, it would be lovely if you can make it work with DDP as well. By the way, I encourage you to use DDP, especially with DGX machines,...

What you are experiencing is common for SSL models. The performance you get depends on the decoder as well. If w2v2 is frozen, you'll need a stronger decoder to build...

Because the decoder only is a straightforward DNN. It has no way to model any complex time dependency (my guess). Replace it with an LSTM, and it will work.

I don't know then. We also observed this kind of behavior with BASE model :-(

Great! In practice, I think it would be better to even have a warmup phase: freeze the w2v2 for N steps, and then unfreeze it to fine-tune it.