DCC icon indicating copy to clipboard operation
DCC copied to clipboard

epsilon / np.sqrt(embedding_dim)

Open glcLucky opened this issue 3 years ago • 1 comments

I guess this formula may be wrong. Should we change that to this: np.sqrt(epsilon / embedding_dim)?

glcLucky avatar Feb 17 '21 03:02 glcLucky

Why do you say so ?

shahsohil avatar Jul 14 '21 09:07 shahsohil