nlp-notebook

nlp-notebook copied to clipboard

zhu1090093659

请问bert中文预训练做4-5的时候的运行时显存要求是多少

2

我目前是在校学生，只能用自己的笔记本进行实验，显卡是GTX2060 6GB的，但是显然是不够的，希望知情的人可以告知，不胜感激

ShengwuZheng

3-2 'tuple' object has no attribute 'last_hidden_state'

2

(pytorch18) z@z:~/code/nlp-notebook-master/3-2.Bert-CRF$ python demo_train.py Some weights of the model checkpoint at ./bert-base-chinese were not used when initializing BertForNER: ['cls.predictions.bias', 'cls.predictions.transform.dense.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.decoder.weight', 'cls.seq_relationship.weight', 'cls.seq_relationship.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.LayerNorm.bias'] This IS expected if...

orangejuice1007