nodebb-plugin-import icon indicating copy to clipboard operation
nodebb-plugin-import copied to clipboard

How do I change the batch size?

Open djensen47 opened this issue 7 years ago • 2 comments

It looks like the batch size may not be configurable and it is hardcoded to 600000. But I might be wrong. Is there a way to configure a smaller batch size. I think I have a query that is running long.

djensen47 avatar Oct 28 '18 20:10 djensen47

not yet, but I can add it, if you can't wait, find this file node_module/nodebb-plugin-import/server/exporter/index.js and change these 2 values, see if this helps

var COUNT_BATCH_SIZE = 600000;
var DEFAULT_EXPORT_BATCH_SIZE = 600000;

https://github.com/akhoury/nodebb-plugin-import/blob/master/server/exporter/index.js#L8-L9

akhoury avatar Oct 31 '18 06:10 akhoury

Note that there also seems to be a bug where it always skips 1 record after each batch. Change batch + 1 to batch in the same file to fix that (there is only one occurence).

CherryDT avatar Aug 22 '22 09:08 CherryDT