hermes icon indicating copy to clipboard operation
hermes copied to clipboard
verified publisher icon HDFGroup

Optimize stage-in / stage-out for small files

Open lukemartinlogan opened this issue 3 years ago • 0 comments

Stage-in / stage-out currently parallelizes work by dividing files equally among MPI ranks. This isn't efficient if each rank is handling I/O smaller than the file page size. It will cause contention during blob Put operations.

lukemartinlogan avatar Oct 13 '22 08:10 lukemartinlogan