pandas-formats-benchmark icon indicating copy to clipboard operation
pandas-formats-benchmark copied to clipboard

A little benchmark comparing Pandas data frames serialization formats

Results 3 pandas-formats-benchmark issues
Sort by recently updated
recently updated
newest added

Firstly, thank you for the great post comparing various storage formats: https://towardsdatascience.com/the-best-format-to-save-pandas-data-414dca023e0d. I was interested in your code, especially to track memory, and trying to use it to reproduce the...

In 2019, pandas deprecated the msgpack io interface formats = [ ('hdf', {'key': 'data', 'format': 'table'}), ('pickle',), ('feather',), ('parquet', {'engine': 'pyarrow'}) ]