server icon indicating copy to clipboard operation
server copied to clipboard

Failed to customize triton container with vllm backend.

Open Saigut opened this issue 1 year ago • 0 comments

Failed to customize triton container with vllm backend.

server code: current main (6cab4bb)

command to customize triton container:

sudo python3 compose.py --backend vllm --container-version 24.02

output:

using container version 24.02
pulling container:nvcr.io/nvidia/tritonserver:24.02-py3
24.02-py3: Pulling from nvidia/tritonserver
Digest: sha256:a28ad116eeb5502c34d3b9be95715430c03674898cd78fda1f139d505f77b81d
Status: Image is up to date for nvcr.io/nvidia/tritonserver:24.02-py3
nvcr.io/nvidia/tritonserver:24.02-py3
24.02-py3-min: Pulling from nvidia/tritonserver
Digest: sha256:f5aa202c99df0259198cab8def151f9c68f6add2e6f0a8d38a197bf1d39e8550
Status: Image is up to date for nvcr.io/nvidia/tritonserver:24.02-py3-min
nvcr.io/nvidia/tritonserver:24.02-py3-min
Traceback (most recent call last):
  File "compose.py", line 518, in <module>
    start_dockerfile(FLAGS.work_dir, images, argmap, dockerfile_name, FLAGS.backend)
  File "compose.py", line 97, in start_dockerfile
    df += build.dockerfile_prepare_container_linux(
  File "/NFS/ai_test/triton/server/build.py", line 1287, in dockerfile_prepare_container_linux
    TRITON_VERSION_MAP[FLAGS.version][7]
AttributeError: 'NoneType' object has no attribute 'version'

Saigut avatar Apr 02 '24 07:04 Saigut