sentence-similarity icon indicating copy to clipboard operation
sentence-similarity copied to clipboard

30G memory limited

Open db12138 opened this issue 4 years ago • 1 comments

hi. I run the code in a 30G memory RAM but when the code run to cls.TEXT.build_vocab(train, vectors=vectors) in SICK.iters() using glove. the program will be killed because of no enough memory. image image

I want to know is this situation nomal ? how to fix it ? how much memory in needed at less?

db12138 avatar Jul 24 '19 03:07 db12138

May I know the vocab size of the dataset you are dealing with please? If the vocab size is too large it may cause out of memory.

tuzhucheng avatar Aug 11 '19 22:08 tuzhucheng