Rahul Pal

Metrics provided by Seldon core for monitoring ML models' performance in production

2

Hello, For monitoring the **ml models in production** (deployed via seldon core) I came across the following link which talks about integration with Prometheus: https://docs.seldon.io/projects/seldon-core/en/latest/analytics/analytics.html As far as I understood...

Inference Speed comparison

1

Hello everyone, - I am trying to serve `TheBloke/Mistral-7B-Instruct-v0.1-GPTQ` model. - I'm currently serving the model via `jina` and internally I am doing the predictions as: ``` input_ids = text_tokenizer.encode(prompt,...

Hi all, I am currently using Seldon Code v1 and using the mlflow server v1.16.0 When we pass the s3 artifacts URI, the serving container first creates a conda env...

grafana_monitoring_service example compatibility with v4.0

1

Hello all, I have been following the [prometheus-grafana integration example](https://github.com/evidentlyai/evidently/tree/v0.4.2/examples/integrations/grafana_monitoring_service) few months ago. I was on v1.59.dev3. Now I check that evidently has been updated a lot since then. So...

llama stack build on Windows

4

Hello I'm trying to `llama stack build` on my Windows 10 machine. Facing following issue: > ModuleNotFoundError: No module named 'termios' Full error trace: ``` Traceback (most recent call last):...