FasterTransformer
FasterTransformer copied to clipboard
fastertransformer/utils/nccl_utils.cc:62 'unhandled cuda error'
Branch/Tag/Commit
main
Docker Image Version
mini
GPU name
p100
CUDA Driver
470.199.02
Reproduced Steps
1. tritonserver --model-repository=/path
2. fastertransformer/utils/nccl_utils.cc:62 'unhandled cuda error'
But when export FT_LOG_LEVEL=DEBUG it's ok.