BLIP icon indicating copy to clipboard operation
BLIP copied to clipboard

How to train itm from itc

Open Raion-Shin opened this issue 1 year ago • 0 comments

Hi, Suppose we have an already pretrained ITC model, for example the openAI CLIP or BLIP-ITC, how can we add image-text-mactching params on top of the ITC model to train the ITM? Have anyone tried it?

Raion-Shin avatar Aug 19 '24 06:08 Raion-Shin