fastertransformer_backend icon indicating copy to clipboard operation
fastertransformer_backend copied to clipboard

When hot-loading a large model, a segmentation fault will occur.

Open ppppppppig opened this issue 1 year ago • 1 comments

Description

I start triton server with '--model-control-mode poll'. Segmentation fault occurs when modifying the model directory.

Reproduced Steps

1.CUDA_VISIBLE_DEVICES=3,4,5,6 /opt/tritonserver/bin/tritonserver  --model-repository=/ft_workspace/all_models/t5/ --http-port 8008 --model-control-mode poll
2.Navigate to the directory containing the config.pbtxt file, and exec 'cp -rf 1 2'
3.client send request and segmentation fault will happen

ppppppppig avatar May 18 '23 04:05 ppppppppig

image

ppppppppig avatar May 18 '23 04:05 ppppppppig