TensorRT
TensorRT copied to clipboard
pytorch
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
### 🐛 Describe the bug I'm trying to convert a resnet18 to TensorRT. It works fine when setting `enabled_precisions` to `torch.float` and to `torch.float16`. It doesn't work with `torch.int8`. ```python...
When I try to complie torchscript model, I get this log ``` DEBUG: [TRTorch Conversion Context] - Found IValue containing object of type Double(requires_grad=0, device=cpu) terminate called after throwing an...
## Bug Description DETR network obtained from: ``` model = torch.hub.load('facebookresearch/detr:main', 'detr_resnet50', pretrained=True) ``` Scripting doesn't work with PyTorch. So we're following the tracing path. ``` traced_model = torch.jit.trace(model, [torch.randn((128,...
## Bug Description Hi, I have hard times to export retinanet or mask-rcnn. I successfully traced models both from torchvision and detectron, but it fails to compile. Since there are...
## Bug Description I installed all the dependencies correctly. I'm using CUDA 11.5, CUDNN 8.3.1, TensorRT 8.2.3.0, PyTorch 1.10.2 with CUDA 11.3 support. However when I try to install TorchTensorRT...
## ❓ Question when i convert jit model, got the error this is my forward code: input `x` shape is `(batch, 6, height, width)`, first step is to split `x`...
## ❓ Question I am wondering how to build the torch_tensorrt.lib on Windows. ## What you have already tried I have followed #960 and #856 (with the same WORKSPACE as...
## Bug Description ## To Reproduce Steps to reproduce the behavior: ``` import torch import torchvision.models as models import torch_tensorrt # get inception_v3 pretrained model # It also implicitly sets...
## Bug Description If a tensorrt calibrator implemented using TRT python API is passed to Torch-TRT compilation, it fails due to the object not being recognized. Error : ``` ======================================================================...
**Is your feature request related to a problem? Please describe.** More information here: https://pytorch.org/docs/stable/generated/torch.jit.trace_module.html#torch.jit.trace_module Compile specific methods on a module (specified in `inputs`), Convert a constructed `ScriptModule` with `forward` and...
