embedding matrix initialization

Open zyxue opened this issue 8 years ago • 1 comments

Could anyone please point me to where the embedding matrix is initialized in the code? I would like to know how it is initialized. If random, what random distribution are weights sampled from? Thank you!

Apr 04 '18 04:04 zyxue

I think it's these two lines, https://github.com/zyxue/word2vec/blob/master/src/word2vec.c#L385, is that uniform random distribution? I couldn't understand the c code very well.

Apr 04 '18 05:04 zyxue