validation loss not decreasing after 25k steps, Fine-tuning with small target data

[MuruganR96]

@bshall Thank you for this great work.

validation loss not decreasing after 25k steps, Fine-tuning with small target data (~1-hour dataset).

the best model (25k steps) not working properly. content transferred ok, but the pitch was not converted from the source to the target. and the target speaker's tone does not close.

@bshall can you please give your suggestions?

Thanks

[aeciorc]

What hyperparams did you use @mraj96?