bert4pytorch icon indicating copy to clipboard operation
bert4pytorch copied to clipboard

Published 20 hours ago • verified publisher icon MuQiuJun-AI

KeyError: 'bert.embeddings.LayerNorm.gamma'

Open fangzhaoyi1995 opened this issue 3 years ago • 2 comments

有人知道这个问题改怎么解决吗 File "F:\software\Anaconda\envs\tensor\lib\site-packages\bert4pytorch\modeling.py", line 71, in load_weights_from_pytorch_checkpoint state_dict[new_key] = state_dict.pop(old_key) KeyError: 'bert.embeddings.LayerNorm.gamma'

fangzhaoyi1995 avatar Jan 17 '22 17:01 fangzhaoyi1995

我也遇到了，你解决了吗

Tongjilibo avatar Jan 24 '22 08:01 Tongjilibo

我也遇到了，你解决了吗

解决了，修改了了下variable_mapping里面的映射，把gamma和beta修改为weight和bias

Tongjilibo avatar Jan 25 '22 01:01 Tongjilibo