MixText icon indicating copy to clipboard operation
MixText copied to clipboard

AttributeError: 'BertConfig' object has no attribute 'chunk_size_feed_forward'

Open dnnxl opened this issue 2 years ago • 1 comments

Hello, what version of transformers are you using in the code? Tried to run and instance the MixText model but got an error of no attribute 'chunk_size_feed_forward' when creating the layers.

model = MixText(n_labels, args['mix_option']).cuda()

And using 'bert-base-uncased' as pretrained model.

dnnxl avatar Jun 09 '22 23:06 dnnxl

I have the same issue.

TahaAslani avatar Aug 05 '22 16:08 TahaAslani

I used a pretty old version of transformers, which is pytorch_transformers. I think that should be the initial version of the current transformers package.

jiaaoc avatar Sep 21 '22 17:09 jiaaoc