Carson Wang
Carson Wang
Ray master now uses gcs bootstrap mode by default and doesn't start redis. Need to update RayDP to work with latest Ray. Also need to reenable the RayDP test in...
The requirements would be to take a Spark Streaming job and output to a DatasetPipeline that can be used to read the data for training.
We can start with supporting Spark 3.1 and 3.2. This is useful for users who wants to use RayDP with some Spark tools/plugins that only supports an older Spark version....