deepnl icon indicating copy to clipboard operation
deepnl copied to clipboard

dl-sentiword.py word2vec variant training is extremely slow !

Open waniss opened this issue 7 years ago • 4 comments

Hi, dl-sentiwords.py training.tsv --vocab SSWE_words.txt --vectorsSSWE_vectors.txt --variant word2vec --w 3 -e 50 --eps 10 --min-occur 10 --threads 30 My training set is a file of 1.5 million tweet, and the execution for 17h hours just moved by 1 or 2 epochs ? Any ideas to make things little faster please ?

Regards.

waniss avatar Feb 16 '18 09:02 waniss

There is the same problem with my data. Anyone have idea?

fuzihaofzh avatar Feb 20 '18 01:02 fuzihaofzh

I am also facing the same issue. But more importantly, with each epoch error value is increasing and accuracy always remains 0.00 . Can anyone explain why the error value is not decreasing?

rudra0713 avatar Oct 12 '18 20:10 rudra0713

WhatsApp Image 2019-08-27 at 11 07 07 Total 64G RAM is used after 3 days and the code just reach 13 epochs!!!! See the graphic.....

samoliver360 avatar Aug 31 '19 21:08 samoliver360

Anyone has the solution???????

samoliver360 avatar Aug 31 '19 21:08 samoliver360