Rasters.jl icon indicating copy to clipboard operation
Rasters.jl copied to clipboard

Trying to `combine`multiple lazy loaded files kills julia

Open felixcremer opened this issue 2 years ago • 1 comments
trafficstars

When I try to combine multiple large files that are loaded lazily into a RasterSeries into a new Raster this kills my Julia process. I suspect, that the views load all the data from disk into RAM and that gets Julia killed with OOM. Could we have a lazy version of combine so that only the metadata is handled and the data will be loaded later when it is actually needed?

I will post a MWE that breaks my julia process tomorrow.

felixcremer avatar Jul 25 '23 21:07 felixcremer

I have a PR to DiskArrays that adds lazy cat, which should be a solution to this?

If you want to review it ;)

rafaqz avatar Jul 25 '23 23:07 rafaqz