openvino_backend
openvino_backend copied to clipboard
OpenVINO backend for Triton.
Hi experts. Recently Triton team upgrades OpenVINO version from 23.3.0 to 24.4.0 for model generation. OpenVINO Inference Engine Python API is deprecated in the 2024.0 release ([source](https://docs.openvino.ai/2023.3/api/ie_python_api/_autosummary/openvino.inference_engine.IENetwork.html#)). Therefore, we updated...
tried to load openvino public model - person-detection-0303 with config name: "person-detection-0303" backend: "openvino" max_batch_size: 0 input [ { name: "image" data_type: TYPE_FP32 dims: [ 1, 3, 720,1280] } ]...
The Linux build can fail with the error specified in the PR title if `docker create` is called without a command.