model_server

model_server copied to clipboard

### 🛠 Summary CVS-145090 * update info about llm demos * recommend building latest image * fix links ### 🧪 Checklist - [ ] Unit tests added. - [x] The...

dtrawins

### 🛠 Summary Updated openvino runtime backend ### 🧪 Checklist - [ ] Unit tests added. - [ ] The documentation updated. - [ ] Change follows security best practices....

dtrawins

**Describe the bug** I followed the vehicle detection example below to setup pipeline through ovms using openvino [product-detection-100 model](https://docs.openvino.ai/2022.3/omz_models_model_product_detection_0001.html#) https://github.com/openvinotoolkit/model_server/blob/main/demos/vehicle_analysis_pipeline/python/vehicles_analysis_pipeline.py I was able to preprocess data & pass it to...

NeethuES-intel

### 🛠 Summary Modified the streaming text generation demo to make it flicker free text display. The original one clears the screen every time a new token is generated, which...

yas-sim

### 🛠 Summary Added a real-time webcam holistic tracking demo. The demo program is based on mediapipe_holistic_tracking.py. I simply added a new file. No other modifications were made.

yas-sim

### 🛠 Summary * Upb patch + compilation fixes on ubi9 * Fix hadolint * Remove dockerfile label version It is not used at all TODO: * CUDA build -...

atobiszei

### 🛠 Summary CVS-129299 Example buikd: OVMS_CPP_DOCKER_IMAGE="arm" BASE_IMAGE="arm64v8/ubuntu:20.04" OV_USE_BINARY="1" DLDT_PACKAGE_URL="https://storage.openvinotoolkit.org/repositories/openvino/packages/2024.1/linux/l_openvino_toolkit_ubuntu20_2024.1.0.15008.f4afc983258_arm64.tgz" TOKENIZERS=0 BASE_OS="ubuntu20" MEDIAPIPE_DISABLE=1 PYTHON_DISABLE=1 RUN_TESTS=0 make docker_build ### 🧪 Checklist - [ ] Unit tests added. - [ ] The...

bstrzele

### 🛠 Summary Describe the changes. ID:CVS-141578 ### 🧪 Checklist - [ ] Unit tests added. - [ ] The documentation updated. - [ ] Change follows security best practices....

atobiszei

### 🛠 Summary https://jira.devtools.intel.com/browse/CVS-143223 ### 🧪 Checklist ~- [ ] Unit tests added.~ ~- [ ] The documentation updated.~ - [ ] Change follows security best practices. ``

michalkulakowski

installing requirements.txt failed

1

**Describe the bug** Python module `distutils` unavailable in python 3.12.3. Installed setuptools. a Different error happened. **To Reproduce** Steps to reproduce the behavior: Follow the steps to [install](https://github.com/openvinotoolkit/model_server/blob/6a7b27173f48d4dffa5eb33612f185b344043140/demos/real_time_stream_analysis/python/README.md?plain=1#L62) up to...

hilliao