import-wikidata-dump-to-couchdb icon indicating copy to clipboard operation
import-wikidata-dump-to-couchdb copied to clipboard

Published 20 hours ago • verified publisher icon maxlath

use CouchDB bulk insert API

Open maxlath opened this issue 8 years ago • 0 comments

maxlath : hello! Any recommendation on how to import a data dump of 40GB+ of newline delimited JSON in CouchDB? I assume I should go with the bulk import API, but I can't just throw the whole dump at Couch at once, right? What would be the optimal/sustainable split size? thanks in advance :) jan____ : maxlath: 1k-10k batches should do

maxlath avatar Mar 08 '17 17:03 maxlath