knn-vc icon indicating copy to clipboard operation
knn-vc copied to clipboard

Published 20 hours ago • verified publisher icon bshall

How to plug-in new finetuned HiFiGAN?

Open youssefabdelm opened this issue 1 year ago • 1 comments

Hey! I know you wrote about this here: https://github.com/bshall/knn-vc/issues/23

I think I'm going to go ahead and try those steps now

However, I did find this 48K HiFiGAN model someone trained (seemingly I could be wrong): https://github.com/vtuber-plan/hifi-gan/releases/tag/v0.3.1

Is it possible to plug that .pt checkpoint into knn-vc as is or does it need to still be trained further?

youssefabdelm avatar Nov 22 '23 15:11 youssefabdelm

I think your mentioned vocoder model is trained with mel-spectrograms, but this repo uses wavLM as audio encoder. Hence I think you should train again.

EmreOzkose avatar Dec 18 '23 17:12 EmreOzkose