dtype_diet icon indicating copy to clipboard operation
dtype_diet copied to clipboard

pickle vs parquet?

Open ianozsvald opened this issue 4 years ago • 0 comments

Some experiments suggest (e.g. companies house raw data) that a parquet file is bigger than a pickled zip and that it loads back in slower (e.g. 30% slower). Do a couple of tests on larger files and see if there's a consistent story?

ianozsvald avatar Jun 05 '20 15:06 ianozsvald