torchtitan icon indicating copy to clipboard operation
torchtitan copied to clipboard
verified publisher icon pytorch

How are the TP, CP, and PP marked in PyTorch profiler traces ?

Open githubsgi opened this issue 8 months ago • 1 comments

How are TP, CP and PP labelled in PyTorch profiler traces ? FSDP appears to be clearly marked.

githubsgi avatar Apr 02 '25 22:04 githubsgi

There were no profiler labelled for some of the parallelisms, at this moment. We can go through these parallelisms to understand if it is reasonable or how clear it is to add these labels.

fegin avatar Apr 03 '25 18:04 fegin