kineto
kineto copied to clipboard
datapipe profiler showing too much information
The long spikes are datapipes calls when a datapipe gets constructed and they're too deep to be helpful

A closeup showing the relative lengths, long rectangle to the left is datapipe stuff and the wide rectangle to the right is model training

This is not super readable and would be nice to capture the profiles differently
Repro https://github.com/pytorch/data/pull/422
There is no functionality for this now, let's continue the discussion about this internally (on your post). Thank you.