bert4pytorch icon indicating copy to clipboard operation
bert4pytorch copied to clipboard

Published 20 hours ago • verified publisher icon MuQiuJun-AI

导入hugging face 的bert-base-chinese存在bug

Open DimariaW opened this issue 2 years ago • 1 comments

modelling文件中variable mapping函数中的mapping存在bug. hugging face的模型文件中layerNorm参数用的是gamma和beta, 作者给的是weight bias, 不匹配

DimariaW avatar Apr 23 '22 11:04 DimariaW

modelling文件中variable mapping函数中的mapping存在bug. hugging face的模型文件中layerNorm参数用的是gamma和beta, 作者给的是weight bias, 不匹配

是的，可以看下这个https://github.com/Tongjilibo/bert4torch

Tongjilibo avatar Apr 29 '23 01:04 Tongjilibo