hdt-cpp icon indicating copy to clipboard operation
hdt-cpp copied to clipboard

failed to open/create index for wikidata hdt file file

Open ahmad88me opened this issue 6 years ago • 3 comments

It works with the HDT of DBpedia, but it stopped after some time. I open the HDT as follows: hdt = hdt::HDTManager::mapIndexedHDT(hdt_file.c_str()); I also copy the output.

Predicate Bitmap in 2 min 22 sec 128 ms 336 us
Count predicates in 46 min 14 sec 182 ms 540 us
Count Objects in 31 min 14 sec 235 ms 430 us Max was: 543914579
Bitmap in 48 sec 474 ms 86 us
Bitmap bits: 7230127313 Ones: 1190479283
make: *** [run] Killed: 9

ahmad88me avatar Jan 09 '19 16:01 ahmad88me

Hi Ahmad! Did you run it on a server? Probably a sysadmin killed your run. Otherwise, possibly the kernel did due to memory + swap space gone.

dinikolop avatar Jan 09 '19 17:01 dinikolop

I ran it locally on my machine (maybe the OS killed the process), I had 8 GB ram. Is there a way/option to trade time and space (like a parameter or something like that?) @dinikolop

ahmad88me avatar Jan 09 '19 17:01 ahmad88me

8GB is probably too little RAM for Wikidata.

wouterbeek avatar Jan 09 '19 21:01 wouterbeek