openvinotoolkit
Failed to find a working yolov8 client on model server.
I generated a yolov8 int8 OpenVINO model based on the following link, but the triton server crashed when deploying it. https://docs.openvino.ai/2023.2/notebooks/122-yolov8-quantization-with-accuracy-control-with-output.html
and I tried to deploy it on model server and the server looks ok. then I tried many clients in the demo. but all failed. Can anyone give some hints or a working example?
I have the same issue. OVMS: v2024.3
[2024-10-17 10:30:34.491][102][modelmanager][error][modelinstance.cpp:368] Error during layout configuration
[2024-10-17 10:30:34.491][102][serving][info][modelversionstatus.cpp:109] STATUS CHANGE: Version 1 of model yolo11n-int8 status change. New status: ( "state": "LOADING", "error_code": "UNKNOWN" )
[2024-10-17 10:30:34.491][102][serving][error][model.cpp:276] Error occurred while loading model: yolo11n-int8; version: 1; error: Unknown error
[2024-10-17 10:30:34.491][102][modelmanager][error][modelmanager.cpp:1365] Error occurred while reloading model: yolo11n-int8; versions; error: Unknown error
[2024-10-17 10:30:34.491][102][serving][info][model.cpp:190] Will clean up model: yolo11n-int8; version: 1 ...
[2024-10-17 10:30:34.491][102][serving][info][model.cpp:88] Updating default version for model: yolo11n-int8, from: 0
[2024-10-17 10:30:34.491][102][serving][info][model.cpp:100] Model: yolo11n-int8 will not have default version since no version is available.
[2024-10-17 10:30:34.491][102][serving][info][modelversionstatus.cpp:109] STATUS CHANGE: Version 1 of model yolo11n-int8 status change. New status: ( "state": "LOADING", "error_code": "UNKNOWN" )
As far as I know YoloV11 is not supported by OV now. Version 2024.5 will likely support it.
Check out: https://docs.openvino.ai/2024/about-openvino/compatibility-and-support/supported-models.html You can search for the model of interest on that list.
