xarrayutils icon indicating copy to clipboard operation
xarrayutils copied to clipboard

Utilities for file handling - Temp file writer

Open jbusecke opened this issue 3 years ago • 0 comments

It would be nice to have some utilities for handling temporary file writing in a flexible way.

I have written multiple attemps for such functions. Here are the key features I would like to have.

  1. Keeping track of written paths. This is especially important for zarr stores, to avoid accidental rm -rf distasters
  2. Splitting a large input dataset along a given dimension and write those out as seperate files/stores
  3. Checking for existing files, printing filepaths and showing progress (this can all be nicely handled with a decorator I think).

jbusecke avatar Jan 20 '21 19:01 jbusecke