YAXArrays.jl icon indicating copy to clipboard operation
YAXArrays.jl copied to clipboard

Huge overhead for InDims("X", "Y") compared to loading the whole dataset into memory

Open felixcremer opened this issue 2 years ago • 0 comments

I am implementing the Multiple Testing functions and I need to compute the clusters on a 15000x15000 tile. When I try to use mapCube with InDims("X", "Y") this has a huge overhead compared to loading the memory and doing the computation on the in-memory array. I don't have proper benchmarks at the moment and this is more a reminder for myself to look into it in more depth.

felixcremer avatar Jul 27 '23 16:07 felixcremer