fastertransformer_backend icon indicating copy to clipboard operation
fastertransformer_backend copied to clipboard

Failing to build with triton 23.04

Open bronzafa opened this issue 1 year ago • 2 comments

Description

System H100 and L40, driver 530.30.02 and cuda 12.1

Build is failing with following error, no mather the branch used (main, v1.4, fix/multi_instance, etc..)

[ 54%] Built target online_softmax_beamsearch_kernels
make: *** [Makefile:136: all] Error 2
The command '/bin/sh -c make -j"$(grep -c ^processor /proc/cpuinfo)" install' returned a non-zero code: 2
error: docker build tritonserver_with_ft failed

a couple weeks ago I was able to build it without any problems but now is not working.

Reproduced Steps

install using python3 docker/create_dockerfile_and_build.py --triton-version 23.04
or 
docker build --rm   \
    --build-arg TRITON_VERSION=${CONTAINER_VERSION}   \
    -t ${TRITON_DOCKER_IMAGE} \
    -f docker/Dockerfile \
    .
show the same error

bronzafa avatar Jun 30 '23 02:06 bronzafa

How about try it in version 22.12? I had the same error as you, and I changed the version to 22.12, but it didn't fix the error.

SeungjaeLim avatar Jul 02 '23 15:07 SeungjaeLim

with 22.12 the build worked, but in my case I need to use 23.04 for using Model Analyzer, since the 22.12 is much older and Model Analyzer is giving errors

bronzafa avatar Jul 03 '23 13:07 bronzafa