pytorch-sgns icon indicating copy to clipboard operation
pytorch-sgns copied to clipboard

Published 20 hours ago • verified publisher icon theeluwin

Purpose of unks in skipgram function

Open mmlynarik opened this issue 1 year ago • 2 comments

Hi,

Can you please explain, what is the purpose of including the <UNK> tokens in the owords vector produced by skipgram function? What should model learn by using these as training examples?

Also, what is the purpose of variable ws in train function, if it's not used anywhere after its definition?

mmlynarik avatar Nov 30 '22 14:11 mmlynarik