TensorRT
TensorRT copied to clipboard
NVIDIA
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
## Description ## Environment **TensorRT Version**: **NVIDIA GPU**: **NVIDIA Driver Version**: **CUDA Version**: **CUDNN Version**: **Operating System**: **Python Version (if applicable)**: **Tensorflow Version (if applicable)**: **PyTorch Version (if applicable)**: **Baremetal...
Error Code 4: Internal Error (Conv_1840: number of kernel weights does not match tensor dimensions)
## Description I found out that the required weight count is twice as in the onnx model, but it's not clear how to fix this error ``` [08/17/2022-17:06:41] [TRT] [E]...
The EfficientDet notebook example had incorrect argument name in the `create_onnx.py` invocation. This PR fixes it. I've checked locally and with the fix below, the notebook runs successfully. Signed-off-by: szalpal
## Description Failed to run sample program `sample_mnist` ## Environment **TensorRT Version**:8.2.5.1 **NVIDIA GPU**: Quadro P4000 **NVIDIA Driver Version**: Quadro P4000 **CUDA Version**: 11.6 **CUDNN Version**: 8.4 **Operating System**: Ubuntu...
When parsing an ONNX model to build a TRT network, it would be useful to expose the additional parameters from the ONNX protobuf. Currently only the graph is exposed. ```...
## Description Running the sample works with out utilizing DLA-s. Passing `--useDLACore=0 ` does not work and will end with an error message: > NVMEDIA_DLA : 528, ERROR: load from...
- Fix DTRT_INCLUDE path - Build Release instead of Debug version of plugin with all dependencies in the final .dll file
## Description Is there a corresponding py interface to implement the three functions of export_times, export_profile and export_layer_info of trtexec? If not, is there a plan?
## Description ```log [W] [TRT] Skipping tactic 0 due to Myelin error: myelinTargetSetPropertyMemorySize called with invalid memory size (0). [E] Error[10]: [optimizer.cpp::computeCosts::2011] Error Code 10: Internal Error (Could not find...
## Description #Python 3.10.11 (tags/v3.10.11:7d4cc5a, Apr 5 2023, 00:38:17) [MSC v.1929 64 bit (AMD64)] Version: v1.8.0-72-g45b8a499 Commit hash: 45b8a499a7e6d732b1711a0016c211f2b3c19232 *** Error running install.py for extension C:\Data\Packages\stable-diffusion-webui\extensions\Stable-Diffusion-WebUI-TensorRT. *** Command: "C:\Data\Packages\stable-diffusion-webui\venv\Scripts\python.exe" "C:\Data\Packages\stable-diffusion-webui\extensions\Stable-Diffusion-WebUI-TensorRT\install.py"...
