MMM
MMM copied to clipboard
reset codebook
In the paper you said that you reset the codebook every 20 iterations to prevent codebook collapse. However, in the training loop https://github.com/exitudio/MMM/blob/68d850095a0640405c0d1deb1fc101f11b386736/train_vq.py#L156-L193, I did not find any thing regarding reseting codebook. Could you please clarify this?
Hi, We reset codebook in quantization process here.