TensorRT
TensorRT copied to clipboard
pytorch
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
This PR addresses the case of empty tensor in torchTRT based on https://docs.nvidia.com/deeplearning/tensorrt/latest/inference-library/advanced.html#empty-tensors, and also focuses on concat operation edge case involving empty tensor TODO: Might have to separate the...
# Description Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change....
**Is your feature request related to a problem? Please describe.** **Describe the solution you'd like** **Describe alternatives you've considered** **Additional context**
Add an example on how to use cuTile kernels with Torch-TensorRT QDP Plugins
**Is your feature request related to a problem? Please describe.** **Describe the solution you'd like** **Describe alternatives you've considered** **Additional context**
## TL;DR ## Goal(s) ## Tasks ```[tasklist] ### Tasks ``` ## Additional context
**Is your feature request related to a problem? Please describe.** Expose TRT-RTX Runtime cache via Torch-TRT Engine Cache **Describe the solution you'd like** **Describe alternatives you've considered** **Additional context**
**Is your feature request related to a problem? Please describe.** **Describe the solution you'd like** **Describe alternatives you've considered** **Additional context**
**Is your feature request related to a problem? Please describe.** **Describe the solution you'd like** **Describe alternatives you've considered** **Additional context**
## TL;DR ## Goal(s) ## Tasks ```[tasklist] ### Tasks ``` ## Additional context
