dbpedia-neo4j icon indicating copy to clipboard operation
dbpedia-neo4j copied to clipboard

Fails when importing large dataset (~100gb)

Open rushilagr opened this issue 7 years ago • 0 comments

While trying to import the current DBpedia dataset (144gb uncompressed), after a certain point, the program stops making any progress.

For the first few hours of the run, the importer runs superb. But after that, the graph db size always stagnates at 43GB. The logger continues printing , but there is no real progress happening.

I have tried using high performance machines (100gb ram) but still no success.

Would really appreciate any help. Thanks for the time.

rushilagr avatar May 31 '17 10:05 rushilagr