Transformers-Tutorials
Transformers-Tutorials copied to clipboard
About mlm-itm
Hi @NielsRogge ,
I see you have pre-trained a pytorch model
https://huggingface.co/dandelin/vilt-b32-mlm-itm
Could you please give the model structure ?
Or could you please tell us how to pool the hidden status ?
Thanks, Mika