MLServer
MLServer copied to clipboard
An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more
Bumps [torch](https://github.com/pytorch/pytorch) from 2.2.2 to 2.3.1. Release notes Sourced from torch's releases. PyTorch 2.3.1 Release, bug fix release This release is meant to fix the following issues (regressions / silent...
Bumps [filelock](https://github.com/tox-dev/py-filelock) from 3.15.1 to 3.15.4. Release notes Sourced from filelock's releases. 3.15.4 What's Changed Pass file_lock as positional argument by @kwist-sgr in tox-dev/filelock#347 Full Changelog: https://github.com/tox-dev/filelock/compare/3.15.3...3.15.4 3.15.3 What's Changed...
Bumps [pytorch-lightning](https://github.com/Lightning-AI/lightning) from 2.2.0.post0 to 2.3.1. Release notes Sourced from pytorch-lightning's releases. Patch release v2.3.1 Includes minor bugfixes and stability improvements. Full Changelog: https://github.com/Lightning-AI/pytorch-lightning/compare/2.3.0...2.3.1 Lightning v2.3: Tensor Parallelism and 2D...
Bumps [pytorch-lightning](https://github.com/Lightning-AI/lightning) from 2.3.0 to 2.3.1. Release notes Sourced from pytorch-lightning's releases. Patch release v2.3.1 Includes minor bugfixes and stability improvements. Full Changelog: https://github.com/Lightning-AI/pytorch-lightning/compare/2.3.0...2.3.1 Commits 8b69285 Patch release 2.3.1 (#20021)...
Bumps [scikit-learn](https://github.com/scikit-learn/scikit-learn) from 1.4.2 to 1.5.0. Release notes Sourced from scikit-learn's releases. Scikit-learn 1.5.0 We're happy to announce the 1.5.0 release. You can read the release highlights under https://scikit-learn.org/stable/auto_examples/release_highlights/plot_release_highlights_1_5_0.html and...
Bumps [joblib](https://github.com/joblib/joblib) from 1.4.0 to 1.4.2. Release notes Sourced from joblib's releases. 1.4.2 What's Changed TST add a test that ensures conservation of byte order during IPC by @fcharras in...
Bumps [mypy](https://github.com/python/mypy) from 1.9.0 to 1.10.0. Changelog Sourced from mypy's changelog. Mypy Release Notes Next release Mypy 1.10 We’ve just uploaded mypy 1.10 to the Python Package Index (PyPI). Mypy...
Bumps [xgboost](https://github.com/dmlc/xgboost) from 2.0.3 to 2.1.0. Release notes Sourced from xgboost's releases. Release 2.1.0 stable 2.1.0 (2024 Jun 20) We are thrilled to announce the XGBoost 2.1 release. This note...
The to_metadata_tensors method should take self._signature as input, rather than self._signature.inputs. https://github.com/SeldonIO/MLServer/blob/53db78eba6bfbf4c645293b11d0854ed732ec8f4/runtimes/mlflow/mlserver_mlflow/runtime.py#L175
Hi! I am sending 100 data samples in a single request (1 request with `data` containing 100 examples) When I set adaptive batching to these values: ```toml max_batch_time = 0.25...