Daft icon indicating copy to clipboard operation
Daft copied to clipboard

Update Ray tutorial to use Ray job submission method

Open hongbo-miao opened this issue 9 months ago • 1 comments

Is your feature request related to a problem?

Currently Ray tutorials are using Ray client endpoint:

  • https://www.getdaft.io/projects/docs/en/stable/distributed/?h=dashboard
  • https://www.getdaft.io/projects/docs/en/stable/integrations/ray/

Ray client (10001) is not recommended way based on the message from Ray team: https://github.com/ray-project/kuberay/issues/1645#issuecomment-1809503409

It would be great to update the Ray tutorial, thanks! ☺️

hongbo-miao avatar Mar 02 '25 01:03 hongbo-miao

Hmm interesting. I wasn't aware that they discouraged use of Ray client.

We have noticed performance issues when using Ray client vs running in a job, but for the most part we do encourage use of Daft from a Ray job.

Thanks for bringing this up. We will chat with Ray folks!

jaychia avatar Mar 02 '25 02:03 jaychia

@jaychia @ccmao1130 tagging for visibility on updates to tutorials/docs

rchowell avatar Aug 05 '25 22:08 rchowell

We have docs on both https://docs.daft.ai/en/v0.6.14/distributed/ray/#using-ray-jobs

colin-ho avatar Nov 18 '25 09:11 colin-ho