Theodor Badea

icon company Keysight icon location Bucharest icon location Keysight - AI/ML R&D | University Politehnica of Bucharest - Graph Machine Learning

Results 15 comments of Theodor Badea

wrong linkage between GPU ops and their CPU parents

Hey, @JoongunPark , thanks for sharing this. As far as I can see, @briancoutinho did not align, i.e. increment, the external id, but added record function id to the p...

wrong linkage between GPU ops and their CPU parents

Hey, @JoongunPark . Yep, I think in order to have this fixed and also have a robust linkage, PyTorch needs to also dump the rf id for kernel nodes. I...

trace_linker: An error occurred when following the user-guide

Hey, @sunboyZgz . Can you share your code use to capture the traces? The profiler part. Would be interesting to see how you ended up having only cpu nodes.

Can't get rf_id in kineto trace!!!, trace_link.py can't find relation of cpu_op.

@32HD can you please try https://github.com/mlcommons/chakra/pull/190 ? It may be related.

trace_linker: [WARNING]: No CUDA runtime operator found for correlation ID

Can you check your kineto to see if you can find such cudaLaunchKernelExC with same correlation as your failing collective? ![Image](https://github.com/user-attachments/assets/f28af95b-b68e-4468-925a-f232f3965c76)