kineto icon indicating copy to clipboard operation
kineto copied to clipboard

datapipe profiler showing too much information

Open msaroufim opened this issue 3 years ago • 1 comments

The long spikes are datapipes calls when a datapipe gets constructed and they're too deep to be helpful Screen Shot 2022-05-31 at 12 01 32 PM

A closeup showing the relative lengths, long rectangle to the left is datapipe stuff and the wide rectangle to the right is model training

Screen Shot 2022-05-31 at 12 01 40 PM

This is not super readable and would be nice to capture the profiles differently

Repro https://github.com/pytorch/data/pull/422

msaroufim avatar May 31 '22 19:05 msaroufim

There is no functionality for this now, let's continue the discussion about this internally (on your post). Thank you.

aaronenyeshi avatar Jun 03 '22 20:06 aaronenyeshi