uxarray icon indicating copy to clipboard operation
uxarray copied to clipboard

Avoid whole-array computations required for Numba for now

Open erogluorhan opened this issue 7 months ago • 0 comments
trafficstars

There are a lot of places in the code where we convert Xarray data arrays to Numpy arrays (by calling .values) because they need to be used in a Numba-decorated function.

While this is understandable, this will need to be avoided for cases where the whole data array is bigger than or close to the available memory and hence is chunked, but such conversion of the whole data array into Numpy array would either break the execution or not run efficiently, respectively.

We will likely need to incorporate use of apply_ufunc-like mechanisms for such cases.

erogluorhan avatar Apr 17 '25 23:04 erogluorhan