omnitrace
omnitrace copied to clipboard
ROCm
Omnitrace: Application Profiling, Tracing, and Analysis
- Testing workflows for Ubuntu 22.04 (Jammy Jellyfish) - ROCm not currently supported on Ubuntu 22.04 - Replace cancelling workflow with concurrency
- moved rccl_comm_data to comm_data - comm_data includes communication data for MPI
``` $ omnitrace -v 3 -r 64 -i 1024 --min-address-range-loop 64 -o $(basename /opt/cray/libfabric/1.15.0.0/lib64/libfabric.so.1) -- /opt/cray/libfabric/1.15.0.0/lib64/libfabric.so.1 [omnitrace][exe] [omnitrace][exe] command :: '/opt/cray/libfabric/1.15.0.0/lib64/libfabric.so.1.17.0'... [omnitrace][exe] [omnitrace][exe] Option '--min-address-range-loop' specified but '--min-instructions-loop ' was...
So I have been having trouble with compiling Omnitrace (Ubuntu 22.04) with recommended build configuration with various compilation failures within various Dyninst parts ( TBB, ELFUTILS, BOOST). But was able...
Supporting writing output to both/either of these formats will allow to leverage the GUI's of other tools easily - [Common Trace Format (CTF)](https://diamon.org/ctf/) - [Open Trace Format 2 (OTF2)](https://perftools.pages.jsc.fz-juelich.de/cicd/otf2/tags/otf2-3.0/html/)
- Record the necessary information to create perfetto flow events for which kernels `hipDeviceSynchronize` or `hipStreamSynchronize` are waiting on
To reproduce on Crusher: ``` source sw/omnitrace-devel/share/omnitrace/setup-env.sh module load craype-accel-amd-gfx90a module load PrgEnv-cray module load rocm omnitrace -o $(basename /opt/cray/pe/lib64/libmpi_cray.so.12) -v 3 -- /opt/cray/pe/lib64/libmpi_cray.so.12 ... ``` Looking at the core...
- print line info when termination signal handler is invoked (e.g. after segfault, etc.) - print backtrace after SIGINT during finalization
When I attempt to instrument a particular library in the [Trilinos](https://github.com/trilinos/Trilinos) project, the process doesn't finish, even running overnight. This is with omnitrace release 1.7 on crusher. The library in...
