E3SM-Project
I/O replay tool
Develop an I/O replay tool that replays the I/O patterns from an actual PIO application run (E3SM simulation).
We also need to add the necessary logging required for this tool for replaying the I/O pattern.
Running the replay tool using logs captured from an actual PIO application run should accurately simulate the I/O behaviour (wrt to read and write performance) of the application.
Note that the ADIOS BP file is kind of a log, as in, it has info on each process' block of data. It does not know the order the variables were written though. Also, the skeldump tool is available to generate a fortran/c app that replays the IO (with adios calls). We also had and have research to add extras for mimicking app behavior even more (communication, computation load). Only the ADIOS metadata file is required for this to work. The large data portion is not needed.
A collaboration on this topic could be useful for PIO. Of course, the generated adios calls needs to be replaced with pio calls.
On Mon, Feb 5, 2018 at 2:43 PM, jayeshkrishna [email protected] wrote:
Develop an I/O replay tool that replays the I/O patterns from an actual PIO application run (E3SM simulation).
We also need to add the necessary logging required for this tool for replaying the I/O pattern.
Running the replay tool using logs captured from an actual PIO application run should accurately simulate the I/O behaviour (wrt to read and write performance) of the application.
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/ACME-Climate/ParallelIO/issues/58, or mute the thread https://github.com/notifications/unsubscribe-auth/ADGMLVwmf70O1EAr2wSVQRWE6XivRK3Fks5tR1nUgaJpZM4R5_hN .
