TensorRT
TensorRT copied to clipboard
feature request: support pytorch torchdynamo
Torch-TensorRT acts as an extension to TorchScript. But there are models that are not supported by pytorch jit tracing, see warning in jit tracing doc. Would you guys have plan to support torchDynamo to get torch.fx.GraphModule instead of jit.ScriptModule?
torchDynamo creates this FX Graph through bytecode analysis and is designed to mix Python execution with compiled backends to get the best of both worlds: usability and performance.
@kevinch-nv for viz
@Jack47 maybe https://github.com/pytorch/TensorRT this is the right place to ask this feature? since the tool is not owned by TensorRT, thanks!