mpifileutils
mpifileutils copied to clipboard
hpc
File utilities designed for scalability and performance.
Getting the following error when source is Lustre and I request spare support (-S) ``` [2023-01-30T21:48:23] [1] [/home/harms/working/daos/mpifileutils/src/common/mfu_flist_copy.c:1853] ERROR: fiemap ioctl() failed for src '/soft/daos/mpifileutils/share/man/man1/dsync.1' (errno=22 Invalid argument) ``` I'm...
Currently, there doesn't seem to be a way to set the SETUID or SETGID bits on file permissions, i.e. u+s and g+s. We use that feature on various large file...
What could possibly lead to errno being set to 7 at the following line: https://github.com/hpc/mpifileutils/blob/0a4c530bca5dc2476418a3833a15ab812d636e78/src/common/mfu_io.c#L1051 This is triggered when making a Tio sized copy of many small files on a...
Hello, I have been seeing this issue when using `dcp` to recursive copy a directory from one lustre filesystem to another. This is being ran via `mpirun` and over multiple...
Update the dist, specfile used for rpm, and documentation to specify v0.12 for the release.
It is great to get the file check-sum and file path in the ddup output. Could file size and other attributes (atime) be included in output? This is more of...
Please add --output opiton to ddup such that results are sent to specific file and separate from other output messages. Thanks! - Mark
Hi, It would be create if ddup had a size limit filter? For example --min-size=10G could have ddup run much faster by only looking at files of 10GB in size...
Hello, we are trying to migrate data from an old Lustre filesystem to a new Lustre filesystem using dsync. Now we see that most of the data will be located...
Hi, We are looking at ways to increase the performance of dsync -c (content) compare. As you would imagine, this can be very time-consuming but at the same time users...