Update Ray tutorial to use Ray job submission method
Is your feature request related to a problem?
Currently Ray tutorials are using Ray client endpoint:
- https://www.getdaft.io/projects/docs/en/stable/distributed/?h=dashboard
- https://www.getdaft.io/projects/docs/en/stable/integrations/ray/
Ray client (10001) is not recommended way based on the message from Ray team: https://github.com/ray-project/kuberay/issues/1645#issuecomment-1809503409
It would be great to update the Ray tutorial, thanks! ☺️
Hmm interesting. I wasn't aware that they discouraged use of Ray client.
We have noticed performance issues when using Ray client vs running in a job, but for the most part we do encourage use of Daft from a Ray job.
Thanks for bringing this up. We will chat with Ray folks!
@jaychia @ccmao1130 tagging for visibility on updates to tutorials/docs
We have docs on both https://docs.daft.ai/en/v0.6.14/distributed/ray/#using-ray-jobs