Adrian Tobiszewski

OpenVINO 2023.3

3

ONNX backend: https://github.com/triton-inference-server/onnxruntime_backend/pull/234

Triton Server OpenVINO backend not working with Tensorflow saved models

5

**Description** Triton is unable to load models with Tensorflow saved model format with OpenVINO backend. **Triton Information** What version of Triton are you using? 23.10,23.11,23.12,24.03,24.04 don't work. Are you using...

### 🛠 Summary * Upb patch + compilation fixes on ubi9 * Fix hadolint * Remove dockerfile label version It is not used at all TODO: * CUDA build -...

### 🛠 Summary Describe the changes. ID:CVS-141578 ### 🧪 Checklist - [ ] Unit tests added. - [ ] The documentation updated. - [ ] Change follows security best practices....

Remote tensor enablement via C-API

1

* Enable usage of OpenCL buffers via OVMS C-API * Enable usage of VA surfaces via OVMS C-API * Enable setting output buffers for C-API inference to avoid copy *...

### 🛠 Summary JIRA/Issue if applicable. Describe the changes. ### 🧪 Checklist - [ ] Unit tests added. - [ ] The documentation updated. - [ ] Change follows security...

### 🛠 Summary JIRA/Issue if applicable. Describe the changes. ### 🧪 Checklist - [ ] Unit tests added. - [ ] The documentation updated. - [ ] Change follows security...