dtype_diet
dtype_diet copied to clipboard
pickle vs parquet?
Some experiments suggest (e.g. companies house raw data) that a parquet file is bigger than a pickled zip and that it loads back in slower (e.g. 30% slower). Do a couple of tests on larger files and see if there's a consistent story?