The output encoder

[nkcdy]

it seems that the output encoder should be an extra module with the same structure and the same weight with the input encoder. But it is very difficult to get convergence in my training. Correct me if I am wrong.

[auspicious3000]

decoder and encoder are different, they don't share weights

[nkcdy]

what I mean is the content encoder for the output signal, not the decoder.

[auspicious3000]

yes, just feed the reconstruction back into the encoder

[liveroomand]

@nkcdy Have you solved your speaker feature extraction problem?How you did it.

[liveroomand]

@nkcdy I am also implementing this paper and find that I have encountered many problems like you. Can I communicate with you?I've been able to voice conversion , but there's still a certain amount of background noise.

[Trebolium]

@liveroomand @nkcdy Did either of you finally figure out what the secret sauce is for training a version that converges to 0.0001 and yields audio of a similar quality to what is produced by the pretrained? I get very noisey conversions at 100k iterations, but after 1M iterations, I get conversions of similar quality to those examples produced by the pre-trained network provided. I have also been using the training code that was recently uploaded to the repo 3 months ago.