MLServer

MLServer copied to clipboard

seldondev

seldondev

Discussion points fromGraduation of Alibi-detect runtime in MLServer

seldondev

seldondev

Passing dataframe index for pandas requests

7

When trying to infer on mlserver I get the error below, I think mlserver is failing to convert the InferenceRequest to mlflow compatible input. `mlflow.exceptions.MlflowException: Expected input to be DataFrame...

BFAnas

Error failed to load model from model_dir

1

The xgboost models from `model_dir` are not loading, throws an error `Invalid model uri provided`. It's working if we provide `model_uri`. The sklearn model are loading properly without `model_uri`. xgboost...

Suresh-Nakkeran

in order to provide feature completion with the current implementation of seldon core python v1 servers (service orchestrator) it is required to support cloudevent headers, which would include the standard...

axsaucedo

Ported from https://github.com/SeldonIO/seldon-core/issues/1525

adriangonz

adriangonz

Slow compare to seldon-core-microservice with multiple workers

3

I have ported an existing seldon-core model service into mlserver but found the performance dropped a lot. Below is my load test config and result of Rest endpoint seldon-core 2...

cksac