PiPPy
PiPPy copied to clipboard
pytorch
use torchDynamo instead of tracing to get graph?
hi guys, this project is awesome comparing with torch pipe, I have some models that are not supported by tracing. Would you guys have plan to support torchDynamo to get fx.graph?
torchDynamo creates this FX Graph through bytecode analysis and is designed to mix Python execution with compiled backends to get the best of both worlds: usability and performance.
Yes, definitely. We do plan to support torchdynamo as the frontend in the near future.
Yes, definitely. We do plan to support torchdynamo as the frontend in the near future.
cool, glad to hear that, I will test it once released!
Hi @anj-s, is TorchDynamo support being worked on? I see dynamo mentioned in some of the code/comments under spmd/compiler and pippy/fx (and the pippy_dynamo.py example) but wasn't sure if the integration is a work in process or completed?
Happy to try contributing any missing pieces if you think that will be helpful!
