server
server copied to clipboard
Failed to customize triton container with vllm backend.
Failed to customize triton container with vllm backend.
server code: current main (6cab4bb)
command to customize triton container:
sudo python3 compose.py --backend vllm --container-version 24.02
output:
using container version 24.02
pulling container:nvcr.io/nvidia/tritonserver:24.02-py3
24.02-py3: Pulling from nvidia/tritonserver
Digest: sha256:a28ad116eeb5502c34d3b9be95715430c03674898cd78fda1f139d505f77b81d
Status: Image is up to date for nvcr.io/nvidia/tritonserver:24.02-py3
nvcr.io/nvidia/tritonserver:24.02-py3
24.02-py3-min: Pulling from nvidia/tritonserver
Digest: sha256:f5aa202c99df0259198cab8def151f9c68f6add2e6f0a8d38a197bf1d39e8550
Status: Image is up to date for nvcr.io/nvidia/tritonserver:24.02-py3-min
nvcr.io/nvidia/tritonserver:24.02-py3-min
Traceback (most recent call last):
File "compose.py", line 518, in <module>
start_dockerfile(FLAGS.work_dir, images, argmap, dockerfile_name, FLAGS.backend)
File "compose.py", line 97, in start_dockerfile
df += build.dockerfile_prepare_container_linux(
File "/NFS/ai_test/triton/server/build.py", line 1287, in dockerfile_prepare_container_linux
TRITON_VERSION_MAP[FLAGS.version][7]
AttributeError: 'NoneType' object has no attribute 'version'