mage icon indicating copy to clipboard operation
mage copied to clipboard

Is it normal for inception score to be different?

Open yxchng opened this issue 1 year ago • 1 comments

Creating feature extractor "inception-v3-compat" with features ['logits_unbiased', '2048']
Extracting features from input1
Looking for samples non-recursivelty in "generation_outputs/mage_vitb_imagenet_val_256x256/temp6.0-iter20" with extensions png,jpg,jpeg
Found 50000 samples
Processing samples                                                                                                                      
Extracting features from input2
Looking for samples non-recursivelty in "generation_outputs/imagenet_val_256x256" with extensions png,jpg,jpeg
Found 50000 samples
Processing samples                                                                                                                      
Inception Score: 80.50368455204321 ± 1.095018840712601
Frechet Inception Distance: 11.180833805524912
inception_score_mean: 80.50368
inception_score_std: 1.095019
frechet_inception_distance: 11.18083

The inception score I get for mage-b is 80.5. But your inception score is 81.2. Is it normal?

yxchng avatar Aug 07 '23 09:08 yxchng

Yes, Inception Score can typically vary a bit. A 1-2 standard deviation is expected.

LTH14 avatar Aug 30 '23 20:08 LTH14