model_server
model_server copied to clipboard
A scalable inference server for models optimized with OpenVINO™
### 🛠 Summary CVS-149701 ### 🧪 Checklist - [x] Unit tests added. - [x] The documentation updated. - [x] Change follows security best practices.
### 🛠 Summary JIRA/Issue if applicable. Describe the changes. ### 🧪 Checklist - [ ] Unit tests added. - [ ] The documentation updated. - [ ] Change follows security...
* Enable usage of OpenCL buffers via OVMS C-API * Enable usage of VA surfaces via OVMS C-API * Enable setting output buffers for C-API inference to avoid copy *...
### 🛠 Summary CVS-146231 ### 🧪 Checklist - [x] Unit tests added. - not needed - [x] The documentation updated. - not needed - [x] Change follows security best practices.
### 🛠 Summary ### 🧪 Checklist - [ ] Unit tests added. - [ ] The documentation updated. - [ ] Change follows security best practices. ``
Bumps [nltk](https://github.com/nltk/nltk) from 3.8.1 to 3.9. Changelog Sourced from nltk's changelog. Version 3.9.1 2024-08-19 Fixed bug that prevented wordnet from loading Version 3.9 2024-08-18 Avoid need for pickled models, resolves...
**Describe the bug** pip3 install failed following [setup instructions](https://github.com/openvinotoolkit/model_server/tree/main/demos/person_vehicle_bike_detection/python). **To Reproduce** Steps to reproduce the behavior: follow [the setup instructions](https://github.com/openvinotoolkit/model_server/tree/main/demos/person_vehicle_bike_detection/python). All steps were OK until `pip3 install -r requirements.txt` **Expected...
### 🛠 Summary JIRA/Issue if applicable. Describe the changes. ### 🧪 Checklist - [ ] Unit tests added. - [ ] The documentation updated. - [ ] Change follows security...
### 🛠 Summary JIRA/Issue if applicable. Describe the changes. ### 🧪 Checklist - [ ] Unit tests added. - [ ] The documentation updated. - [ ] Change follows security...
Can OVMS support modifying the queue policy, for example by supporting priority levels? For example, when OVMS is serving multiple models, it might make sense to support different priority levels...