word2word icon indicating copy to clipboard operation
word2word copied to clipboard

kill:9 issue for large dataset

Open colingair opened this issue 3 years ago • 0 comments

I am able to train and get result as expected for a medium size dataset. But when I increase the dataset, it gets killed after step 5, even if I increase the no of workers which is less than my cpu_count (e.g., 40<60). How to use large dataset for training in w2w? Any help is appreciated. Thanks.

colingair avatar Aug 23 '20 11:08 colingair