kineto icon indicating copy to clipboard operation
kineto copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

Module View doesn't show backward pass operations

Open danielsnider opened this issue 2 years ago • 3 comments

The backward pass doesn't appear in the Module View. Is there a plan to add this?

The two red arrows below mark where the backward pass should appear: image

Here is the backward pass as seen in the Trace View: image

This profile was generated using your sample script resnet50_profiler_api.py and with python3.10, pytorch 1.12.0.dev20220408+cu113, and Ubuntu 20.04.

Many thanks for your great work on Kineto!

danielsnider avatar Apr 08 '22 19:04 danielsnider

Is this a feature request for tensorboard plugin? looks like the trace from libkineto has the information right?

briancoutinho avatar Apr 08 '22 23:04 briancoutinho

@danielsnider, there is a bug in PyTorch profiler related to forward/backward correlation which would cause the profiler crash. We deliberately disable the forward/backward correlation in nightly build. Once the bug is fixed, the forward/backward correlation would be reeanbled again. At that time, the backward module would be shown in tb_plugin.

guotuofeng avatar Apr 09 '22 06:04 guotuofeng

Hello @guotuofeng , Is there any progress on this bug?

SolenoidWGT avatar Apr 27 '23 09:04 SolenoidWGT