Sihan Wang
Sihan Wang
> @simon-mo @edoakes could you take a look at this ASAP? Please check the PR to get some ideas of what might be wrong. Please let me know if there...
> Nice work so far! I left a few comments. > > One high-level comment– the `DriverDeployment` is a special-case that adds a lot of complexity. Please correct me if...
> Nice! The main thing I wanted to ask about is the new concept of "Driver deployment" introduced in this PR. Right now does it just mean "one replica per...
Overall looks good, leave a comment to better structure the code
Hi @andreapiso , for this use case, how would you imagine sending requests to these two models? If two models are trained separately, you can directly use different route_prefix (e.g....
Hi `serve.run` for multi-application will be available on 2.3, it is available on master already! We are working on the CLI & REST API to support further advanced deployment for...
> Thanks for the 2.3 release with Python API. When can we expect the 2.4 release with CLI and REST API for multi applications? Also in the docs, in the...
Yes, with 2.4 you should be able to deploy multi applications by using CLI and REST API.
> @sihanwang41 Still seeing this behavior in Ray 2.3.0 when using serve.run for multiple deployments. Can you confirm you this functionality working? Hi @peterghaddad, can you share your script?