cubed icon indicating copy to clipboard operation
cubed copied to clipboard

Zarr compression settings for local intermediate files

Open tomwhite opened this issue 1 year ago • 1 comments

When running some benchmarks recently I noticed that turning off Zarr compression resulted in faster IO performance when writing random data to Zarr files on a local SSD. This post seems to confirm that.

So perhaps we should turn off compression for intermediate Zarr data stored on the local filesystem.

tomwhite avatar Jul 22 '24 10:07 tomwhite