word2vec-from-scratch-with-python icon indicating copy to clipboard operation
word2vec-from-scratch-with-python copied to clipboard

Please suggest me how to test this program

Open anjurc opened this issue 5 years ago • 1 comments

anjurc avatar Apr 02 '19 11:04 anjurc

Hi @anjurc

Happy new year!! I guess you are asking about the evaluation method of this program, let me briefly my way to compare his impl to the gensim.

Since the mere comparison of word embeddings between his and gensim by subtraction or MSE seems less meaningful(you know the numerical difference among them can't tell us many things!!), I have decided to visualise the resulting word embeddings on 2-dim space like below.

  • https://github.com/Rowing0914/study_nlp/blob/master/word_embeddings/word2vec_scratch/README.md

Hope this helps you somehow.

Rowing0914 avatar Jan 06 '20 06:01 Rowing0914