torch2trt
torch2trt copied to clipboard
An easy to use PyTorch to TensorRT converter
Addresses issue #848. Depends on PR #847. This PR adds functions for automatic type promotion, by (converting to and) relying on the `torch.promote_type` function. This functionality is added to the...
Fix always-true assert statement
Resolves issue #830, where `torch.stack` does not currently correctly handle dynamic shapes during TRT conversion. Checked with included test: ``` python torch2trt/converters/stack_test.py ```
Hello, dear developer. I used jetson xavier nx, ubuntu 18.04, cuda 10.2, tensorRT 8.0.1.6, jetpack 4.6, to compile the model, and I found the following error, which caused the model...
I tried to install torch2trt with plugins with the command **' python setup.py install --plugins'** on Windows 10 after changing the lines among from No.6 to No.10 in **setup.py** as:...
请问有C++版本吗?
I'm getting the following error: [03/31/2023-13:51:06] [TRT] [E] 1: [resizingAllocator.cpp::deallocate::100] Error Code 1: Cuda Runtime (invalid argument) Segmentation fault (core dumped) I am converting a model to TRT with roughly...
When I call the TORCH2TRT module for Yolo series algorithm reasoning, encountered such error, I hope to get the answer. D:\Anaconda3\envs\python37\lib\site-packages\torch\_tensor.py:1013: UserWarning: The .grad attribute of a Tensor that is...
tensorrt 6.0.18 ubuntu 18.04 python 3.7 I want to convert model ( https://github.com/shariqfarooq123/AdaBins) import torch from torch2trt import torch2trt from models import UnetAdaptiveBins import model_io # NYU MIN_DEPTH = 1e-3...
Hi John @jaybdub, Thank you for your reply of torch.flip, I continue my research. However, I met other error: ``` Warning: Encountered known unsupported method torch.is_grad_enabled Warning: Encountered known unsupported...