csv2es icon indicating copy to clipboard operation
csv2es copied to clipboard

Published 20 hours ago • verified publisher icon rholder

Out of memory

Open gsvijayraajaa opened this issue 8 years ago • 0 comments

I am trying to index a huge CSV file (~35GB). I have kept the --docs-per-chunk as 500 and --bytes-per-chunk to 100000. But then the RAM gets filled up as and when the csv file is continuously read. Any thoughts on the same?

I am working on a 16GB RAM machine with 4 core processor.

Regards, Vijay Raajaa G S

gsvijayraajaa avatar May 03 '16 10:05 gsvijayraajaa