Using other transformer models

[VasilisTz1]

Hello,

I am trying to use the XLMRoberta model instead of BERT and I made the following changes to the bert_pretrained.py:

from transformers import XLMRobertaTokenizer
from transformers import XLMRobertaModel, XLMRobertaConfig

However, I get the following error:

super().__init__(vocab=bert_tokenizer.vocab, AttributeError: 'XLMRobertaTokenizer' object has no attribute 'vocab'

Any guidance would be much appreciated!

[ayushbits]

Hey @VasilisTz1 ,

Were you able to resolve this issue ?

[VasilisTz1]

Hello @ayushbits,

No, there are a couple of changes that should be done I guess.