MLServer
MLServer copied to clipboard
SeldonIO
An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more
It could be beneficial for first-time user if the main examples, e.g. [mnist-sklearn](https://mlserver.readthedocs.io/en/latest/examples/sklearn/README.html), contained in addition to REST a gRPC request code for example using `grpcurl`. Another idea, probably to...
Hi, I'm having this error ([full log](https://gist.github.com/yc2984/70c6690555db0b352956d28a7160fcd2)) when serving two sklearn models on my local kind cluster following this [guide](https://mlserver.readthedocs.io/en/latest/examples/mms/README.html) Chatted with Alejandro on slack about this issue, he was...
Bumps python from 3.8-slim to 3.10.6-slim. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [flake8](https://github.com/pycqa/flake8) from 5.0.1 to 5.0.4. Commits 6027577 Release 5.0.4 213e006 Merge pull request #1653 from asottile/lower-bound-importlib-metadata e94ee2b require sufficiently new importlib-metadata 318a86a Merge pull request #1646 from televi/main 7b8b374...
Bumps [aiohttp-retry](https://github.com/inyutin/aiohttp_retry) from 2.5.2 to 2.7.0. Release notes Sourced from aiohttp-retry's releases. Release 2.7.0 Add a callback to evaluate response Release 2.6.1 No release notes provided. Release 2.5.6 Add response...
## TL;DR - It is hard to encode/decode batches of time series in MLServer - An idiomatic example would be helpful - An new content type and/or inference runtime could...
We are having some difficulties with Uvicorn configuration. We need to apply some custom settings on the rest server like using custom timeouts or applying a custom ssl certificate. This...
We get this error on startup of the inference server with `mlserver==1.0.1` so that the server is completely blocked from working on requests. ``` Traceback (most recent call last): File...
Looking for feedback to possibly create a PR. ## Problem: LightGBM expects inference requests to set columns to `category` if the model was trained with categorical column(s). As is, mlserver...
