django-redis-cache icon indicating copy to clipboard operation
django-redis-cache copied to clipboard

Compressed variants of the serializers.

Open KommuSoft opened this issue 2 years ago • 0 comments

Often JSON/YAML/pickle can produce large blobs with a lot of duplicated data.

By using a fast compressor, this can result in both faster writing and reading because the "bandwidth" between the Django layer and the database is smaller, and therefore more efficient. Yes, compressing takes some time as well, but for certain types of data (like pickled dataframes for example), this might pay off, and overall speed up processing.

KommuSoft avatar Feb 17 '23 14:02 KommuSoft