onnxruntime_backend icon indicating copy to clipboard operation
onnxruntime_backend copied to clipboard

Published 20 hours ago • verified publisher icon triton-inference-server

OnnxLoader singleton has not been initialized

Open AhmetTelceken opened this issue 3 years ago • 2 comments
trafficstars

Description What have i done?

  • Building the Triton Inference Server on Ubuntu 20.04 without Docker
  • Building the Onnxruntime Backend

The Error : I dont know exactly error but I think "OnnxLoader : Unavailable - OnnxLoader - singleton has not been itilizalied".

Triton Information What version of Triton are you using? 2.17.0

Are you using the Triton container or did you build it yourself? without Docker

To Reproduce I'm trying this code for "Load Model and Test Triton".

/opt/tritonserver/bin/tritonserver --strict-model-config=false --model-repository=/opt/tritonserver/triton_model_repository/ --backend-directory=/opt/tritonserver/backends/

Error_2

My file directory like this ; <triton_model_repository>/ <segmentation_model>/ 1/ model.onnx

Expected behavior

How can I fix this issue?

AhmetTelceken avatar Sep 05 '22 07:09 AhmetTelceken

What is your model config?

GuanLuo avatar Sep 06 '22 16:09 GuanLuo

We run it without model config

AhmetTelceken avatar Sep 09 '22 13:09 AhmetTelceken