model_analyzer icon indicating copy to clipboard operation
model_analyzer copied to clipboard

Connection refused

Open Qilewuqiong opened this issue 2 years ago • 1 comments

Hi, Using command like: model-analyzer profile --model-repository ~/triton-deploy/resnet50fp16 --profile-models resnet50fp16 --triton-launch-mode=local --output-model-repository-path ~/resnet50fp16_model_analyzer --run-config-search-max-concurrency 64 --run-config-search-max-model-batch-size 64 --run-config-search-max-instance-count 16 --override-output-model-repository get "ConnectionRefusedError: [Errno 111] Connection refused" and "model_analyzer.model_analyzer_exceptions.TritonModelAnalyzerException: [Errno 111] Connection refused"

The version of triton I use is 21.07

Thanks

Qilewuqiong avatar Oct 07 '22 01:10 Qilewuqiong

Please add the --triton-output-path option to get a triton server log. I would expect an error to be reported there that can help.

For example: --triton_output_path ~/triton_output.log

tgerdesnv avatar Oct 07 '22 14:10 tgerdesnv