mpifileutils
mpifileutils copied to clipboard
hpc
File utilities designed for scalability and performance.
when checking out and configuring with cmake ../mpifileutils \ -DENABLE_LUSTRE=ON \ -DWITH_DTCMP_PREFIX=../install \ -DWITH_LibCircle_PREFIX=../install \ -DCMAKE_INSTALL_PREFIX=../install make install I get [ 43%] Linking C executable dbcast ../common/libmfu.so.3.0.0: undefined reference to...
Hello mpifileutils developpers, When tar'ing very big directories, tar files may exceed system accepted size for a file (typically 500 GB). This is why one can tar and pipe with...
Currently we only copy lustre stripe params if user adds -p, but it's likely they want this, even if they don't want to update timestamps and permissions. Enable lustre striping...
Running the dbcast command and I encounter a segfault; I'm using a main node to manage two worker nodes, and the crash has so far always occurred on the second...
We would like to use dfind in combination with dwalk to find hardlinks. The dfind command line tool does not provide this option as of now. I am wondering how...
It would be useful to have a mode for `dsync` to sync a full file system. The main enhancements would entail splitting up directories to sync into sub-jobs and taking...
It would be advantageous to have an option to exclude file and directory paths when doing a large copy or sync, much like rsync's --exclude. For instance, dsync --exclude DONTMOVE...
Return an error if the list size has increased since the first time it was called.
In `mfu_create_file` there is an `lstat` call to make sure the file exists before calling `truncate`, but `mknod` was just called above, so the file should already exist under normal...
Generally, most tools set `mfu_debug_level = MFU_LOG_VERBOSE` by default, and have a `-q` option which sets `mfu_debug_level = MFU_LOG_NONE`. But there are several levels defined: https://github.com/hpc/mpifileutils/blob/05055d2ad2f99291af96cd863ae59dec3d328657/src/common/mfu_util.h#L63-L71 Some tools have a...