MLServer
MLServer copied to clipboard
SeldonIO
An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more
I played around with the custom json example and adaptive batching and found that adaptive batching only behaves correctly if we specify the shape of the input data (one byte...
[](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) You can trigger a rebase of this PR by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- Dependabot commands and options You can trigger Dependabot...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
It's a newly recommended way to serialise scimitar learn Models https://scikit-learn.org/stable/model_persistence.html#a-more-secure-format-skops
## How to reproduce Define a MLFlow model, using a custom `params` parameter. Example from the [MLFlow documentation](https://mlflow.org/docs/latest/traditional-ml/creating-custom-pyfunc/notebooks/override-predict.html#Defining-our-custom-PythonModel): ``` class ModelWrapper(PythonModel): def __init__(self): self.model = None def load_context(self, context): from...
Hi MLServer - To start off, this is an awesome tool and the team has impressive work to get to this point. I'm currently using MLServer in a high-throughput, low-latency...
I followed this documentation https://mlserver.readthedocs.io/en/stable/examples/sklearn/README.html After running mlserver, I can get the correct results according to this operation. I took a look at the source code of mlserver and registered...
Bumps [tqdm](https://github.com/tqdm/tqdm) from 4.66.2 to 4.66.3. Release notes Sourced from tqdm's releases. tqdm v4.66.3 stable cli: eval safety (fixes CVE-2024-34062, GHSA-g7vv-2v7x-gj9p) Commits 4e613f8 Merge pull request from GHSA-g7vv-2v7x-gj9p b53348c cli:...
Bumps [tqdm](https://github.com/tqdm/tqdm) from 4.66.2 to 4.66.3. Release notes Sourced from tqdm's releases. tqdm v4.66.3 stable cli: eval safety (fixes CVE-2024-34062, GHSA-g7vv-2v7x-gj9p) Commits 4e613f8 Merge pull request from GHSA-g7vv-2v7x-gj9p b53348c cli:...
Bumps [tqdm](https://github.com/tqdm/tqdm) from 4.66.2 to 4.66.3. Release notes Sourced from tqdm's releases. tqdm v4.66.3 stable cli: eval safety (fixes CVE-2024-34062, GHSA-g7vv-2v7x-gj9p) Commits 4e613f8 Merge pull request from GHSA-g7vv-2v7x-gj9p b53348c cli:...
Bumps [tqdm](https://github.com/tqdm/tqdm) from 4.66.2 to 4.66.3. Release notes Sourced from tqdm's releases. tqdm v4.66.3 stable cli: eval safety (fixes CVE-2024-34062, GHSA-g7vv-2v7x-gj9p) Commits 4e613f8 Merge pull request from GHSA-g7vv-2v7x-gj9p b53348c cli:...