fastertransformer_backend
fastertransformer_backend copied to clipboard
Failing to build with triton 23.04
Description
System H100 and L40, driver 530.30.02 and cuda 12.1
Build is failing with following error, no mather the branch used (main, v1.4, fix/multi_instance, etc..)
[ 54%] Built target online_softmax_beamsearch_kernels
make: *** [Makefile:136: all] Error 2
The command '/bin/sh -c make -j"$(grep -c ^processor /proc/cpuinfo)" install' returned a non-zero code: 2
error: docker build tritonserver_with_ft failed
a couple weeks ago I was able to build it without any problems but now is not working.
Reproduced Steps
install using python3 docker/create_dockerfile_and_build.py --triton-version 23.04
or
docker build --rm \
--build-arg TRITON_VERSION=${CONTAINER_VERSION} \
-t ${TRITON_DOCKER_IMAGE} \
-f docker/Dockerfile \
.
show the same error
How about try it in version 22.12? I had the same error as you, and I changed the version to 22.12, but it didn't fix the error.
with 22.12 the build worked, but in my case I need to use 23.04 for using Model Analyzer, since the 22.12 is much older and Model Analyzer is giving errors