model_analyzer
model_analyzer copied to clipboard
Connection refused
Hi, Using command like: model-analyzer profile --model-repository ~/triton-deploy/resnet50fp16 --profile-models resnet50fp16 --triton-launch-mode=local --output-model-repository-path ~/resnet50fp16_model_analyzer --run-config-search-max-concurrency 64 --run-config-search-max-model-batch-size 64 --run-config-search-max-instance-count 16 --override-output-model-repository get "ConnectionRefusedError: [Errno 111] Connection refused" and "model_analyzer.model_analyzer_exceptions.TritonModelAnalyzerException: [Errno 111] Connection refused"
The version of triton I use is 21.07
Thanks
Please add the --triton-output-path
option to get a triton server log. I would expect an error to be reported there that can help.
For example:
--triton_output_path ~/triton_output.log