skip-gram-pytorch icon indicating copy to clipboard operation
skip-gram-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon fanglanting

Loss doesnt decrease?

Open ismaeel123 opened this issue 4 years ago • 1 comments

Why do i feel that the loss isnt decreasing? It started at 13 and then jumped to 8 and now i see random losses like 7 or 6 or 5 or 8 again... is that normal?

ismaeel123 avatar Apr 20 '20 04:04 ismaeel123

I think in file word2vec.py line 37 it should NOT be “optim.SGD(model.parameters(),lr=0.2)” but "SGA"(However, pytorch have not SGA) So, the solution is flipping the sign of objective function.

tonggege001 avatar Oct 11 '20 07:10 tonggege001