word-embedding-dimensionality-selection icon indicating copy to clipboard operation
word-embedding-dimensionality-selection copied to clipboard

Published 20 hours ago • verified publisher icon ziyin-dl

word2vec CBOW

Open ronhab opened this issue 4 years ago • 1 comments

Thanks for sharing the code!

Sorry if the question is silly - my understanding of word embeddings is still premature and lack the required math background: Should the SignalMatrix implementation for word2vec Skip Gram model fit for word2vec CBOW model?

ronhab avatar Jun 29 '20 08:06 ronhab

theoretically they are still different models. However I do think they are not that different in practice. I think whatever hyperparameter (e.g. dimensionality) that works for skipgram will work for cbow too.

ziyin-dl avatar Jul 01 '20 13:07 ziyin-dl