MixText
MixText copied to clipboard
AttributeError: 'BertConfig' object has no attribute 'chunk_size_feed_forward'
Hello, what version of transformers are you using in the code? Tried to run and instance the MixText model but got an error of no attribute 'chunk_size_feed_forward' when creating the layers.
model = MixText(n_labels, args['mix_option']).cuda()
And using 'bert-base-uncased' as pretrained model.
I have the same issue.
I used a pretty old version of transformers, which is pytorch_transformers. I think that should be the initial version of the current transformers package.