question about the training data

[TianjinTeda]

Hi,

Thanks for this amazing work, really appreciate it!

I am wondering what your training data look like. My understanding is you have a coin dataset containing only coin images without text, and for each type of coin you have images different in perspective, light conditioning etc, and you used this dataset to conduct contrastive learning on the visual encode of the pretrained clip model. Is that correct?

[breezedeus]

Thanks. The training uses image-text pairs, and the text is the description of the contents of the coin.

[youthhou1992]

Thanks. The training uses image-text pairs, and the text is the description of the contents of the coin.

Hello, your work is excellent. I would like to make some fine-tuning based on your work. Could you please share how you obtained the text for the image-text pairing?

[Garry-TI]

@breezedeus how were the coin images formatted for the training set? was each coin isolated with a transparent background?