YAXArrays.jl icon indicating copy to clipboard operation
YAXArrays.jl copied to clipboard

savecube very slow for small chunksizes

Open felixcremer opened this issue 2 years ago • 1 comments

When I save a cube with small chunk sizes the buffer size is not corrected in get_copy_buffer_size which leads to a very slow saving of the data cube. We might want to increase the buffer size in line 67 of Cubes/Rechunker.jl

felixcremer avatar Nov 02 '23 15:11 felixcremer

Hello, what would be an example of a "small chunksizes"? Is it an absolute size or is it relative to the size of the Dataset/Cube?

I'm wondering if my writing speed is due to the small chunksizes or the compression. Thanks!

Balinus avatar Jan 18 '24 13:01 Balinus