Zhi Lin

icon company Intel icon location Shanghai icon location ML engineer

Results 84 comments of Zhi Lin

How do I store the full graph data in the ObjectStore of each node?

close as stale

java.lang.StackOverflowError upon raydp.init_spark(

close as stale

Cannot start Spark session on my laptop

close as stale

Can't init spark on multi-nodes ray cluster on k8s

close as stale

`val_accuracy` equals to 0 when runing pytorch_nyctaxi.py

close as stale

Can I use spark.createDataFrame() with a list of ObjectRef from various remote Ray workers?

close as stale. This has been fixed by implementing getPreferredLocations.

Error while using foreachBatch in writeStreaming

close as stale

What are the disadvantages when the data Preprocessing and model training pipelines are integrated via raydp?

close as stale

RuntimeError: A Ray actor died during training and the maximum number of retries (1) is exhausted

close as stale

Integrate Spark Streaming with Ray/Ray Datasets

Hi @DimitarSirakov Unfortunately, due to not enough bandwidth, we are not developing new features for this project now.