Sihan Wang
Sihan Wang
Signed-off-by: Sihan Wang ## Why are these changes needed? ## Related issue number Closes #27436 ## Checks - [ ] I've signed off every commit(by using the -s flag, i.e.,...
## Why are these changes needed? 1. Add rpc driver and update the controller to deploy the driver node 2. Add schema 3. Add test 4. Add benchmark release/serve_tests/workloads/serve_grpc_benchmark.py, gRPC...
### Search before asking - [X] I searched the [issues](https://github.com/ray-project/kuberay/issues) and found no similar issues. ### KubeRay Component ray-operator ### What happened + What you expected to happen Change the...
Signed-off-by: Sihan Wang ## Why are these changes needed? ### Serve API Change - Add `route_prefix` and `app_name` arguments into 'serve.run' API. - Add `serve.delete` API. ### Serve Agent API...
### Description Since Ray 2.0, Ray Serve has recommended using the [serve.run](https://docs.ray.io/en/latest/serve/package-ref.html#core-apis) API over the previous `.deploy()` API. However, this introduces a limitation that the user can only run a...
test
## Why are these changes needed? ## Related issue number ## Checks - [ ] I've signed off every commit(by using the -s flag, i.e., `git commit -s`) in this...
## Why are these changes needed? ## Related issue number ## Checks - [ ] I've signed off every commit(by using the -s flag, i.e., `git commit -s`) in this...
### Description Currently autoscaling event will trigger deployment to be 'UPDATING'. It is useful to differentiate the autoscaling state out of the UPDATING state for better observability. (Sometimes autoscaling will...
## Why are these changes needed? ## Related issue number ## Checks - [ ] I've signed off every commit(by using the -s flag, i.e., `git commit -s`) in this...
## Why are these changes needed? - User can set environment variable to setup controller and http proxy callback function path. test_callback.py ``` from starlette.middleware import Middleware import logging logger...