glide-text2im icon indicating copy to clipboard operation
glide-text2im copied to clipboard

Why clip_guided works better than text2im, inconsistent with the paper's claim?

Open a43992899 opened this issue 3 years ago • 2 comments

I have tested the glide model for a few days (I tried many kinds of prompts), and my result is that clip_guided works better than classifier-free text2im.

clip_guided can correctly follow the intention of my prompt, like "a boat on the top of the mountain", or "Pablo Picasso: Into the wind", and text2im failed to do that.

However the paper claims that classifier-free text2im > clip_guided. I wonder why? Is there anything wrong with the released model?

a43992899 avatar Feb 02 '22 21:02 a43992899

The glide-text2sim model that is better than clip_guided model is the one trained with a large private dataset and it is not released. Whereas, this released model is trained on a filtered and less diverse dataset.

thunanguyen avatar Feb 04 '22 13:02 thunanguyen

Exactly. A full explanation of the differences is here: https://github.com/openai/glide-text2im/issues/21#issuecomment-1045590329

Arcitec avatar Feb 19 '22 04:02 Arcitec