Penalty loss seems to be no different from reconstruction loss

[Joechen0130]

It seems that your penalty loss is in a batch of images (xclass) and reordering them (x_new). Then xclass is reordered through the latent code of the encoder. The two reorderings seem to be no different from the reconstruction loss!