akshay-anyscale
akshay-anyscale
hi @harsh-goglocal are you referring to this file - https://github.com/ray-project/ray-llm/blob/master/deploy/ray/rayllm-cluster.yaml ? It has been updated to reflect the new docker image
Some docs improvements here - https://github.com/ray-project/ray-llm/pull/85
T5 is not supported with vLLM right now. We can pick this one when vLLM has support - https://github.com/vllm-project/vllm/issues/187
@shrekris-anyscale what's the priority and impact of this issue now?
can you rebase with @angelinalg's latest changes
while we are changing this, can you update the example to not use deployment graphs?
> > while we are changing this, can you update the example to not use deployment graphs? > > Currently the deployments are fairly easy. Is there any reasons to...