custom-diffusion icon indicating copy to clipboard operation
custom-diffusion copied to clipboard

Table 1 Metrics

Open jamessealesmith opened this issue 2 years ago • 2 comments

Thank you for this great work! Is there a script or code to help replicate evaluation of your method using text/image alignment and KID metrics?

jamessealesmith avatar Feb 01 '23 18:02 jamessealesmith

Hi, I have added the set of prompts we used for each setting here.

For calculating the metrics, we used clean-fid for FID, and CLIPScore to calculate text alignment. Fo image alignment CLIPScore code was modified to calculate all pairwise target image-generated image similarity.

I aim to update our repo with the script to calculate metrics as well. But don't have an exact timeline for that currently. I hope this is helpful in the meantime.

Please let me know if you have any other questions or doubts.

Thanks.

nupurkmr9 avatar Feb 03 '23 01:02 nupurkmr9

Hi @nupurkmr9,

Wonderful work, thanks for sharing the code.

Are you willing to share with the code for evaluation any soon ?

Thanks !

IemProg avatar Mar 03 '23 09:03 IemProg