BERT-pytorch icon indicating copy to clipboard operation
BERT-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon codertimo

GELU is available in PyTorch

Open hubin-keio opened this issue 2 years ago • 1 comments

the GELU class is available in PyTorch (https://pytorch.org/docs/stable/generated/torch.nn.GELU.html). No need to implement it in utils/GELU.py

hubin-keio avatar Mar 15 '23 02:03 hubin-keio

Nice

ShaohanTian avatar May 17 '23 07:05 ShaohanTian