Trawinski, Dariusz comments

Results 52 comments of


                                            Trawinski, Dariusz

add CORS headers to responses

This is good approach to enable the connection over CORS. For merging, we would need to make those parameters allow_origins=["*"], # list of strings allow_credentials=True, # bool allow_methods=["*"], # list...

add CORS headers to responses

ok, we can do it in steps

Removed tokenizer param

we have in docs building minimal image make release_image GPU=0 MEDIAPIPE_DISABLE=1 PYTHON_DISABLE=1 TOKENIZERS=0

Python demos requirement incompatibility

@RH-steve-grubb we will enforce using newer version of the transformers without the vulnerability. With that we will drop also old python node demo with seq2seq use case. It is based...

I hope the official will add sample code for grpc's java, Android, and web clients. The server deployment is very easy, but the grpc client is not easy.

@yg-dickson did you try the triton client? It is compatible with ovms via KServer API. https://github.com/openvinotoolkit/model_server/tree/main/client/java/kserve-api

The first time result of `rerank` is wrong each time restarting the `ovms`

@Septa2112 I was unable to reproduce such behavior. Were you using the latest version 2025.1? Can you send the server logs in debug model with --log_level DEBUG Did you get...

The first time result of `rerank` is wrong each time restarting the `ovms`

@Septa2112 The issue with NUM_STREAMS is now fixed on main and releases/2025/1 branches. There was corrected export_model.py script to generate proper format of the plugin parameters. Reexporting the rerank model...

Downgrade opencl headers to 2.* version for RedHat source build

was it tested in runtime?

[release branch] Public packages

pip requirements should be also updated

Failed to find a working yolov8 client on model server.

Yolo8 and yolo11 are now supported.