CarterYancey issues

Repositories
Issues
Comments

Results 1 issues of


                                            CarterYancey

Prebuilt Triton Server 24.05-trtllm-python-py3 does not have correct TensorRT version

**Description** According to the Framework matrix (https://docs.nvidia.com/deeplearning/frameworks/support-matrix/index.html#framework-matrix-2024), 24.05 is supposed to support TensorRT 10.0.6.1. The 24.05-py3 image does, but the prebuilt image with tensorrtllm_backend support does not. **Triton Information** What...

question