fst
fst copied to clipboard
Add benchmark vs `arrow::read/write_parquet`
trafficstars
The new arrow package is now online, so can add arrow::read/write_parquet/arrow. I don't mind contributing to this but I will need to finish off a couple of CRAN submissions.
Hi @xiaodaigh, thanks for your request!
Indeed, we should create some extensive benchmarks to compare arrow and fst. Perhaps we could take the benchmark code from #177 (posted [here])(https://gist.github.com/fstpackage/e710cf2adaa02f96bc8dbee9318ba733) as a start as it compares the performance for various types, number of rows and threads.
Your contribution would be much appreciated!