vq-vae-2-pytorch icon indicating copy to clipboard operation
vq-vae-2-pytorch copied to clipboard

Codebook for different levels

Open SURABHI-GUPTA opened this issue 5 years ago • 1 comments
trafficstars

@rosinality Is it that there is single codebook for all latent levels, or is it separate for each level ? Also what will be the affect of reducing the number of codebook embeddings, (in paper it is 512)? Will it help to more compact latent representaton ?

SURABHI-GUPTA avatar Oct 15 '20 13:10 SURABHI-GUPTA

  1. Each level has separated codebooks.
  2. It is depend on how you will define the meaning of compact representation. Reducing the size of codebook will not decrease the size of latent or bottleneck feature maps. But definitely it will reduce the size of the codes that needed to represents the feature map.

rosinality avatar Oct 15 '20 14:10 rosinality