word2vec_pytorch icon indicating copy to clipboard operation
word2vec_pytorch copied to clipboard

请问为什么需要初始化为[-0.5/ebd_size,-0.5/ebd_size]

Open JinYang88 opened this issue 6 years ago • 2 comments

如题,这样做有什么好处吗? 谢谢!

JinYang88 avatar May 29 '18 09:05 JinYang88

这个原先的C语言源码好像就是这样初始化的 可以看下下面链接的6.7节. https://blog.csdn.net/itplus/article/details/37999613

DexterZeng avatar Jun 06 '18 09:06 DexterZeng

This is identical to the original word2vec implementation. I tried other implementation methods, it turned out that some of them will make the vector value to NaN or Inf and some other ones will show similar performance.

Adoni avatar Jan 08 '19 03:01 Adoni