TensorRT icon indicating copy to clipboard operation
TensorRT copied to clipboard

feature request: support pytorch torchdynamo

Open Jack47 opened this issue 2 years ago • 1 comments

Torch-TensorRT acts as an extension to TorchScript. But there are models that are not supported by pytorch jit tracing, see warning in jit tracing doc. Would you guys have plan to support torchDynamo to get torch.fx.GraphModule instead of jit.ScriptModule?

torchDynamo creates this FX Graph through bytecode analysis and is designed to mix Python execution with compiled backends to get the best of both worlds: usability and performance.

Jack47 avatar Sep 15 '22 06:09 Jack47

@kevinch-nv for viz

zerollzeng avatar Sep 18 '22 14:09 zerollzeng

@Jack47 maybe https://github.com/pytorch/TensorRT this is the right place to ask this feature? since the tool is not owned by TensorRT, thanks!

ttyio avatar Dec 06 '22 02:12 ttyio