fastertransformer_backend icon indicating copy to clipboard operation
fastertransformer_backend copied to clipboard

Published 20 hours ago • verified publisher icon triton-inference-server

FasterTransformer Backend fails to build using latest version of Triton Server

Open mshuffett opened this issue 1 year ago • 2 comments

Description

The Docker built fine using the older version mentioned in readme (22.12), but when trying to build using the latest docker (23.05) it fails.

See this log file: https://gist.github.com/mshuffett/dc9e36921de15f9a9e5bc81b097430d8

Reproduced Steps

`python docker/create_dockerfile_and_build.py --triton-version 23.05`

mshuffett avatar Jun 02 '23 21:06 mshuffett

Confirmed that this was a regression specifically with 23.05 -- 23.04 builds successfully.

mshuffett avatar Jun 06 '23 00:06 mshuffett

me too... and if i using 22.12 on example, i can not showing nvidia-smi maybe, i used cuda 12.1...so not compatibility.... how can i use it?

YooSungHyun avatar Jun 19 '23 03:06 YooSungHyun