kindly

Results 22 comments of kindly

Going to close this issue. Happy for you add any individual feature requests as new issues.

@jpmckinney Yes, it fails on datasets where the amount of rows is less than the amount of threads, i.e when a thread in effect will have nothing to do. I...

I have added a comment in the docs about this and may investigate a way to avoid this error in future.

@jpmckinney I understand. It is surprisingly tricky to fix without either a lot of special casing for this issue, without compromising the check that determines if a single threaded run...

I think this was fixed with #52 as I just tested with lots of threads and few rows and it appears to work for ndjson, json-stream and when selecting a...

I can not think of an easy way to do this. I would consider using somthing like https://github.com/jqnatividad/qsv to manipulate the CSVs after produced.

@tooptoop4 For individual JSON like this (not in a list or in json lines), if you want pushdown to work, you will need to add the `--json-stream` option. This will...

The above comment fixes this, at least for data that fits in memory. It is very difficult to do this when streaming objects in arrays, as what data is pushdown,...

@jpmckinney It looks like it currently does not support low memory mode, which I think is a requirement for large files. See: https://github.com/jmcnamara/rust_xlsxwriter/issues/1 Once that is implemented I think this...

@jmcnamara great, it is now using `rust_xlsxwriter` and everything worked well.