docker-postgres-backup-local icon indicating copy to clipboard operation
docker-postgres-backup-local copied to clipboard

Allow multithreading compression

Open dmd opened this issue 3 years ago • 2 comments

Is there any reason not to use pigz? It's an apt-get install away, it's perfectly gzip compatible, and it's multi-core so vastly faster.

dmd avatar Mar 15 '21 22:03 dmd

Currently only in case of a compressing using pg_dumpall it relays on the actual gzip command line, and this only applies to postgress clusters.

So the project is mainly using the gzip implementation of pg_dump, not sure if they use threads per database.

Beeing this a backup solution it would only relay on well maintained and well tested software.

Also, in case of needing threading compression there are also xz-utils.

I left this open to see what are the demand for this feature, and in what cases (Cluster or Non cluster).

prodrigestivill avatar Mar 16 '21 10:03 prodrigestivill

Oh, you know what - I didn't notice that you're not doing the gzip yourself. I agree that keeping it simple and without undue dependencies is better than whatever benefit this change would provide.

dmd avatar Mar 16 '21 15:03 dmd