vq-vae-2-pytorch icon indicating copy to clipboard operation
vq-vae-2-pytorch copied to clipboard

Update vqvae.py

Open provos opened this issue 2 years ago • 0 comments
trafficstars

correctly initialize the moving counter of codebook entry utilization.

initializing this to 0 leads to divides by ~0 and numerically unstable embeddings at the beginning of training.

provos avatar Feb 15 '23 00:02 provos