server icon indicating copy to clipboard operation
server copied to clipboard

triton infer server docker image not working on Jetson Orin NX 16 GB JP 5.1.1

Open allan-navarro opened this issue 1 year ago • 3 comments

Description triton infer server with the docker image not working on Jetson Orin NX 16 GB JP 5.1.1

See attached log server.log

Triton Information tritonserver:23.01-py3 (docker image)

To Reproduce docker run --rm --net host -it --runtime nvidia --gpus=1 -v ./triton:/models nvcr.io/nvidia/tritonserver:23.01-py3 tritonserver --model-repository=/models

Expected behavior tritonserver should start successfully

allan-navarro avatar May 09 '24 13:05 allan-navarro

Hi @allan-navarro, Triton's -py3-igpu* containers should support Jetpack 6.X. For JP 5.1.1, @nv-kmcgill53 do you know we have supported contaienrs?

krishung5 avatar May 09 '24 22:05 krishung5

Mark this issue,same issue here

Chaoran-F avatar May 11 '24 02:05 Chaoran-F

Same issue

rsemihkoca avatar Oct 19 '24 22:10 rsemihkoca