mpifileutils
mpifileutils copied to clipboard
File utilities designed for scalability and performance.
I would like to be able to exclude files following a pattern, like tar does: `mpirun -np 128 dtar --verbose --exclude="n*" --create --file /tmp/toto.tar *` This is like feature request...
When one runs dtar inside Slurm for instance, and when the allocated time is not sufficient, the tar file is not complete. I would be happy to have some append...
As part of Near Node Flash (NNF) Data Movement implementation, there is the need to specify the User ID and Group ID when running dcp (explained [here](https://github.com/NearNodeFlash/nnf-dm/issues/30#issuecomment-1206798489)). For dcp, this...
improves performance massively and moots #535 Signed-off-by: Andrew Robbins
…s preserved (if the platform supports it). Signed-off-by: Doug Johnson . Lightly tested dsync on Linux (Red Hat 7.9). Not sure if this covers the bases for what's needed to...
--daos-prefix was previously deprecated/hidden. Remove it entirely. Signed-off-by: Dalton Bohning
This adds a draft version of an ``mpifileutils.py`` interface to libmfu. It uses CFFI: https://cffi.readthedocs.io/en/latest/index.html It's currently written assuming python 2, and it is hardcoded to assume that the library...
This is a quick mockup for separating xattrs from normal preserve, in rsync preserving xattrs is off by default and only enabled if explicitly requested. dsync should behave the same...
Fixes issue https://github.com/hpc/mpifileutils/issues/400 Signed-off-by: Åke Sandgren
adds a large number of filters (predicates) from dfind to dwalk