open_clip icon indicating copy to clipboard operation
open_clip copied to clipboard

questions about coca_roberta-ViT-B-32.json

Open ae86208 opened this issue 2 years ago • 0 comments

With the default config, hugging face text encoder does not add casual mask, which may lead to information leakage in the decoder side. If using text transformers in open_clip, the problem does not exist since casual mask was added.

ae86208 avatar Feb 22 '23 08:02 ae86208