tensorrtllm_backend icon indicating copy to clipboard operation
tensorrtllm_backend copied to clipboard

Other backends are missing

Open Godlovecui opened this issue 1 year ago • 0 comments

System Info

rtx4090

Who can help?

@

Information

  • [ ] The official example scripts
  • [ ] My own modified scripts

Tasks

  • [ ] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
  • [ ] My own task or dataset (give details below)

Reproduction

I use this docker image: nvcr.io/nvidia/tritonserver:24.04-trtllm-python-py3, however, when I run and enter container, there are two backends: image why?

Expected behavior

Normal backends: image

actual behavior

image

additional notes

None

Godlovecui avatar May 23 '24 12:05 Godlovecui