seldon-core
seldon-core copied to clipboard
SeldonIO
An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
For seldon-core v2, are there plans to support bidirectional and/or server/client gRPC streaming? Some scenarios require sending a very big bulk of data between server-client. In such cases, allowing streaming...
Hi all, I am currently using Seldon Code v1 and using the mlflow server v1.16.0 When we pass the s3 artifacts URI, the serving container first creates a conda env...
There is a page with examples for `Model` CRD but one for `SeldonDeployment` is missing. Example: https://docs.seldon.io/projects/seldon-core/en/v2/contents/kubernetes/resources/model/index.html
## Describe the bug inside the seldon-runtime helm chart, the scheduler `replicas` [value](https://github.com/SeldonIO/seldon-core/blob/v2/k8s/helm-charts/seldon-core-v2-runtime/values.yaml) is not propergated to the Chart. ## Expected behaviour The replica count of the scheduler inside the...
I noticed the follow error from `seldon-core` when I am returning a large payload: ``` {"level":"error","ts":1695348874.48736,"logger":"SeldonRestApi","msg":"Failed to write response","error":"write tcp 172.16.2.137:8000->10.0.0.247:44006: write: broken pipe","stacktrace":"github.com/seldonio/seldon-core/executor/api/rest.(*SeldonRestApi).predictions\n\t/workspace/api/rest/server.go:330\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2047\ngithub.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerDuration.func1\n\t/go/pkg/mod/github.com/prometheus/[email protected]/prometheus/promhttp/instrument_server.go:76\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2047\ngithub.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerDuration.func1\n\t/go/pkg/mod/github.com/prometheus/[email protected]/prometheus/promhttp/instrument_server.go:76\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2047\ngithub.com/seldonio/seldon-core/executor/api/rest.handleCORSRequests.func1\n\t/workspace/api/rest/middlewares.go:64\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2047\ngithub.com/gorilla /mux.CORSMethodMiddleware.func1.1\n\t/go/pkg/mod/github.com/gorilla/[email protected]/middleware.go:51\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2047\ngithub.com/seldonio/seldon-core/executor/api/rest.xssMiddleware.func1\n\t/workspace/api/rest/middlewares.go:87\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2047\ngithub.com/seldonio/seldon-core/executor/api/rest.(*CloudeventHeaderMiddleware).Middleware.func1 \n\t/workspace/api/rest/middlewares.go:47\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2047\ngithub.com/seldonio/seldon-core/executor/api/rest.puidHeader.func1\n\t/workspace/api/rest/middlewares.go:79\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2047\ngithub.com/gorilla/mux.(*Router).ServeHTTP\n\t/go/pkg/mod/github.com/gorilla/[email protected]/mux.go:210\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2879\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:1930"} ```
Hello! I've installed the Prometheus operator as suggested here https://docs.seldon.io/projects/seldon-core/en/latest/analytics/analytics.html#metrics-with-prometheus-operator to monitor the deployed ML service. I'm able to reach the prometheus UI. However, I could not find any information...
## Describe the bug I try to install seldon core components in a restricted environment where it is mandatory to specify ephemeral storage limit to any container that runs on...
https://github.com/SeldonIO/seldon-core/blob/1748a22f36d34843e2a3c40b14e45580c7f841fe/operator/controllers/seldondeployment_engine.go#L405 The Seldon service orchestrator pod is not created with the Prometheus metrics port annotation (`prometheus.io/port`) which leads to the Prometheus pod scraper trying to scrape the gRPC port and...
## Describe the bug We found below vulnerabilities while scanning seldon core 1.16.0 deployed on Kubernetes 1.24.X version using [Tenable-SC](https://www.tenable.com/products/tenable-sc) **Issue 1**: TLS version 1.0 and 1.1 protocol detection in...
## Describe the bug When trying to set an MLServer `replicas` > 1 in Seldon-Core V2, I'm getting an error related to the PVC: > Multi-Attach error for volume "pvc-*****************"...
