elephas

elephas copied to clipboard

Bumps [pyspark](https://github.com/apache/spark) from 3.2 to 3.2.2. Commits 78a5825 Preparing Spark release v3.2.2-rc1 ba978b3 [SPARK-39099][BUILD] Add dependencies to Dockerfile for building Spark releases 001d8b0 [SPARK-37554][BUILD] Add PyArrow, pandas and plotly to...

dependabot[bot]

Regression seems to be broken with new versions.

4

It seems to be broken with new versions. I ran [regression](https://github.com/maxpumperla/elephas/blob/master/examples/ml_mlp_regression.py) example on Google colab and gave these results: ``` print(metrics.r2) print(metrics.meanAbsoluteError) print(metrics.rootMeanSquaredError) -57287.893765051085 22.850576681614513 24.626286489524432 ``` _Originally posted by...

SumeyyeSuslu

Hi everyone, i'have a problem with the method transform. The keras model translate in elephas fit in a pyspark correctly but when i try to transform the validation set, it...

AlessandroMinervini

Integrate callback functionality into elephas (History, checkpoints, etc.)

12

https://github.com/keras-team/keras/blob/master/keras/callbacks.py#L341 The fit function in Keras returns a graph that can be used to determine if the model is overfitting or not. This would be very useful from Elephas.

sd12832

Hi all Can we write CNN with elephas, i mean if we can add 2d conv layers in keras model and load 2d images. Can we load pretrained models like...

Asif-Ejaz

Py4JJavaError: An error occurred while calling z:org.apache.spark.api.python.PythonRDD.collectAndServe.

11

Hi, I'm trying to use elephas for my deep learning models on spark but so far I couldn't even get anything to work on 3 different machines and on multiple...

diogoribeiro09

java.lang.NullPointerException while showing predicted output.

6

Dear @maxpumperla / other authors of this repo. A big thanks for developing this library, I have been successful in running it some datasets but I am facing issue with...

aman1931998

Does support LSTM or GRU models?

5

Hi, Does this package support LSTM or GRU models for training on spark? Thanks for your great work :)

ghorbani-mohammad

moseshu

pickle.PicklingError: Could not serialize object: Py4JError: An error occurred while calling o24.__getnewargs__. Trace:

4

Hi All I am trying to use a broadcasted dataframe inside a Pyspark UDF and i am getting pickle error when i register the UDF. Please find my code below....

vickyasokan26