openvino_backend icon indicating copy to clipboard operation
openvino_backend copied to clipboard

OpenVINO backend for Triton.

Results 13 openvino_backend issues
Sort by recently updated
recently updated
newest added

Hi experts. Recently Triton team upgrades OpenVINO version from 23.3.0 to 24.4.0 for model generation. OpenVINO Inference Engine Python API is deprecated in the 2024.0 release ([source](https://docs.openvino.ai/2023.3/api/ie_python_api/_autosummary/openvino.inference_engine.IENetwork.html#)). Therefore, we updated...

bug

tried to load openvino public model - person-detection-0303 with config name: "person-detection-0303" backend: "openvino" max_batch_size: 0 input [ { name: "image" data_type: TYPE_FP32 dims: [ 1, 3, 720,1280] } ]...

The Linux build can fail with the error specified in the PR title if `docker create` is called without a command.