server
server copied to clipboard
triton infer server docker image not working on Jetson Orin NX 16 GB JP 5.1.1
Description triton infer server with the docker image not working on Jetson Orin NX 16 GB JP 5.1.1
See attached log server.log
Triton Information tritonserver:23.01-py3 (docker image)
To Reproduce
docker run --rm --net host -it --runtime nvidia --gpus=1 -v ./triton:/models nvcr.io/nvidia/tritonserver:23.01-py3 tritonserver --model-repository=/models
Expected behavior tritonserver should start successfully
Hi @allan-navarro, Triton's -py3-igpu* containers should support Jetpack 6.X. For JP 5.1.1, @nv-kmcgill53 do you know we have supported contaienrs?
Mark this issue,same issue here
Same issue