neosemantics icon indicating copy to clipboard operation
neosemantics copied to clipboard

Import large RDF files

Open dinani65 opened this issue 2 years ago • 2 comments

Hello, I am importing a turtle file into the database using CALL n10s.rdf.import.fetch("file:///path_file/file.ttl","Turtle"); The problem is that the database would not be available after a while. I guess it is because of the size of the file, it is around 620 MB. Once I try it with a small file, it is fine and works. can someone tell me how to tackle this issue? Thanks

dinani65 avatar Mar 14 '23 10:03 dinani65

Hi @dinani65

The database should stay online during the import process. That's independent of the size of the file. The n10s.rdf.import.* methods do periodic commits as the RDF is parsed from the file so not only the DB should be up but also results should be visible incrementally. Check your DB settings (memory etc) to make sure all is ok.

what behavior are you seeing? does the DB come back online once the process is complete?

Is the RDF file public so we can try to reproduce the issue in case is some problem with the RDF file? Also, could you share the n10s.graphconfig settings?

jbarrasa avatar Mar 15 '23 14:03 jbarrasa

It was because of DB settings. Thank you for your reply.

dinani65 avatar Mar 17 '23 09:03 dinani65