cubed
cubed copied to clipboard
Zarr compression settings for local intermediate files
When running some benchmarks recently I noticed that turning off Zarr compression resulted in faster IO performance when writing random data to Zarr files on a local SSD. This post seems to confirm that.
So perhaps we should turn off compression for intermediate Zarr data stored on the local filesystem.