improved-diffusion icon indicating copy to clipboard operation
improved-diffusion copied to clipboard

FID not matching on CIFAR10

Open akrlowicz opened this issue 1 year ago • 3 comments

I downloaded CIFAR10 500K checkpoint from readme, sampled it for 10k images and my FID points to > 200. I tested few different implementations of FID calculations and am comparing it to CIFAR10 50k training data. It's ridiculously high, nowhere near 3 and my models trained on CIFAR10 also show high FID after many iterations. What could be wrong in this case?

akrlowicz avatar Jul 23 '23 14:07 akrlowicz

Even I am facing the same issue, computing FID with dims 64 for InceptionNet gives me FID of 1.52

loki-veera avatar Oct 09 '23 09:10 loki-veera

I downloaded CIFAR10 500K checkpoint from readme, sampled it for 10k images and my FID points to > 200. I tested few different implementations of FID calculations and am comparing it to CIFAR10 50k training data. It's ridiculously high, nowhere near 3 and my models trained on CIFAR10 also show high FID after many iterations. What could be wrong in this case?

The FID I got was ridiculously high too.Have you figured out what the problem is?

bigwahaha avatar Oct 19 '23 08:10 bigwahaha

FYI: I was able to get the FID of 4.41 for hybrid loss and 7.88 for VLB loss (3.19 and 11.47 as stated in paper) with dividing the samples with 255. so they are float type instead of uint8 and also the original dataset is saved in JPEG format.

loki-veera avatar Oct 23 '23 09:10 loki-veera