xarrayutils
xarrayutils copied to clipboard
Utilities for file handling - Temp file writer
It would be nice to have some utilities for handling temporary file writing in a flexible way.
I have written multiple attemps for such functions. Here are the key features I would like to have.
- Keeping track of written paths. This is especially important for zarr stores, to avoid accidental
rm -rf
distasters - Splitting a large input dataset along a given dimension and write those out as seperate files/stores
- Checking for existing files, printing filepaths and showing progress (this can all be nicely handled with a decorator I think).