Edward Oakes
Edward Oakes
## Why are these changes needed? This PR is stacked on: https://github.com/ray-project/ray/pull/43167 Adds a `max_queued_requests` parameter to deployments. Once this limit is reached in the number of requests queued to...
Hi all, I work on [Ray](https://github.com/ray-project/ray) and we have users who are interested in using Ion in conjunction with Ray. We use the [pickle 5 serialization protocol](https://www.python.org/dev/peps/pep-0574/) internally, so if...
One big advantage of Serve being python-native is easy integration with model registries (e.g., MLFlow) and feature stores (e.g., Feast). We should call this out in a separate docs page.