raydp icon indicating copy to clipboard operation
raydp copied to clipboard

Published 20 hours ago • verified publisher icon oap-project

Integrate Spark Streaming with Ray/Ray Datasets

Open carsonwang opened this issue 3 years ago • 3 comments

The requirements would be to take a Spark Streaming job and output to a DatasetPipeline that can be used to read the data for training.

carsonwang avatar Feb 11 '22 01:02 carsonwang

Is there any progress for this feature ?

DimitarSirakov avatar Jan 26 '24 07:01 DimitarSirakov

Hi @DimitarSirakov Unfortunately, due to not enough bandwidth, we are not developing new features for this project now.

kira-lin avatar Jan 30 '24 01:01 kira-lin

Is it possible to release the pyspark version lift @kira-lin

DimitarSirakov avatar Jan 30 '24 05:01 DimitarSirakov