FID score changes a lot during the model training

Open viyjy opened this issue 2 years ago • 2 comments

Hi, I found that FID score becomes larger and larger during the Stage 2 (512x512) training of SD-2.0-base, but the loss keeps at the same level, roughly about 0.12~0.13. Any thoughts? Thanks.

Oct 11 '23 17:10 viyjy

Update: The FID and CLIP score after the Stage 1 (256x256) training of SD-2.0-base is 10.79 and 25.43, respectively. However, the FID/CLIP becomes very weird during the Stage 2 (512x512) training of SD-2.0-base as shown below:

Step | FID   | CLIP
-------------------
400k | 25.22 | 24.19
500k | 13.63 | 25.11
600k | 22.31 | 24.21
720k | 21.94 | 24.5
770k | 23.89 | 24.6
-------------------

Oct 17 '23 00:10 viyjy

This is related to this issue https://github.com/mosaicml/diffusion/issues/88

Oct 20 '23 05:10 viyjy