Sihan Wang
Sihan Wang
Hi @peterghaddad , yeah, if you don't want your old app to be killed, you need to set "name" attribute.
> @sihanwang41 what is the status of Multi Apps in Ray Serve? The documentation still shows only the `serve.run` method with centralised YAML file which I am not sure whether...
Hi, please provide repo step if possible, so that our team can help to take a look!
Hi @AIApprentice101, We don't have the functionality in the ray-llm, you have to set it up by yourself. For redis solution, do you see any issue or pain points? Or...
Hi @rifkybujana , what if you change num_workers to 2, and keep num gpu per worker as it is.
> @sihanwang41 is this issue resolved by your change in #1014? yes!
added context: https://ray-distributed.slack.com/archives/C01DLHZHRBJ/p1670178518671469
@edoakes @shrekris-anyscale @zcin please take look,
Hi @akshay-anyscale , can you take a look?
> while we are changing this, can you update the example to not use deployment graphs? Currently the deployments are fairly easy. Is there any reasons to change the example?