TensorRT
TensorRT copied to clipboard
pytorch
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
## ❓ Question I am trying to use YOLOv5 with Torch-TensorRT. When I load the model, I get the following error message (among others): ``` ERROR: [Torch-TensorRT TorchScript Conversion Context]...
## Question1 I find the Torchscript model optimized by TRTorch 0.2.0 faster than TensorRT model(All models are Python API)，such as common ResNet series, RapVGG series models and so on, shouldn't...
**Describe the solution you'd like** Improve this error to provide both the found hardware and the expected hardware ``` No compatible device was found for instantiating TensorRT **engine** ```
## Bug Description Program crashes when running the following benchmarking script: ``` import torch import torch_tensorrt import timm import time import numpy as np import torch.backends.cudnn as cudnn torch.hub._validate_not_a_forked_repo=lambda a,b,c:...
Currently, Torch-TensorRT can't optimize two-stage models like faster-rcnn, which get detection boxes firstly and then predict label for each box ; Because the number of detection boxes can only get...
Could we get support for aten::group_norm? Original PyTorch API: https://pytorch.org/docs/stable/generated/torch.nn.GroupNorm.html
Signed-off-by: Anurag Dixit # Description Bumping the range check for torch version in setup.py Fixes # (issue) ## Type of change Please delete options that are not relevant and/or add...
**Is your feature request related to a problem? Please describe.** Many converters have this sort of pattern. ```c++ out_tensor = ctx->AssociateValueAndTensor(n->outputs()[0], out_tensor); LOG_DEBUG("Output tensor shape: " getDimensions()); ``` Which provides...
## Bug Description Torch_tensorrt compile doesn’t support pretrained torchvision Mask_RCNN model. **Error:** RuntimeError: temporary: the only valid use of a module is looking up an attribute but found = prim::SetAttr[name=“_has_warned”](%self,...
## Bug Description I get an error when converting a conformer transducer enecoder to tensorrt. (asr task) ## To Reproduce [requirenments.txt](https://github.com/pytorch/TensorRT/files/12343005/requirenments.txt) CODE: ``` import nemo.collections.asr as nemo_asr import torch import...
