word2word
word2word copied to clipboard
kill:9 issue for large dataset
I am able to train and get result as expected for a medium size dataset. But when I increase the dataset, it gets killed after step 5, even if I increase the no of workers which is less than my cpu_count (e.g., 40<60). How to use large dataset for training in w2w? Any help is appreciated. Thanks.