bert4pytorch icon indicating copy to clipboard operation
bert4pytorch copied to clipboard

LayerNorm 类有个小错误

Open di-osc opened this issue 3 years ago • 1 comments

if conditional: self.dense1 = nn.Linear(2 * hidden_size, hidden_size, bias=False) self.dense.weight.data.uniform_(0, 0) -------> 此处应该self.dense1, 下边的self.dense2 也是一样的

di-osc avatar Dec 17 '21 06:12 di-osc

if conditional: self.dense1 = nn.Linear(2 * hidden_size, hidden_size, bias=False) self.dense.weight.data.uniform_(0, 0) -------> 此处应该self.dense1, 下边的self.dense2 也是一样的

确实有点小问题,感谢指出

MuQiuJun-AI avatar Dec 20 '21 08:12 MuQiuJun-AI