spark-deep-learning
spark-deep-learning copied to clipboard
databricks
Deep Learning Pipelines for Apache Spark
Hello all I am trying to run the following deep learning pipeline example: Introducing Deep Learning Pipelines for Apache Spark: https://community.cloud.databricks.com/?o=4841533921079887#notebook/4444902769053336/command/4444902769053351 I have successfully installed all libraries but when I...
Hello all I am wondering if there is any method to install sparkdl within Anaconda and using conda command? I am trying to run a project in ipython using pyspark...
Hello all I am wondering if there is any method to install sparkdl within Anaconda and using conda command? I am trying to run a project in ipython using pyspark...
Thanks for open sourcing this project. It is said that it does not perform single-model distributed training - this is an area of active research, and here we aim to...
In the examples you are using pyspark.ml library but what if I have to do the classification using SVM via the pyspark.mllib library . How can i implement the 'fit()'...
I run the unit tests command sparkdl$ SPARK_HOME=/usr/local/lib/spark-2.1.1-bin-hadoop2.7 PYSPARK_PYTHON=python2 SCALA_VERSION=2.11.8 SPARK_VERSION=2.1.1 ./python/run-tests.sh but I obtained the next error : py4j.java_gateway: DEBUG: Answer received: !xspy4j.Py4JException: Method listToVectorFunction([class org.apache.spark.sql.Column]) does not exist\n...
Hello, folks! I am using HorovodRunner within Databricks runtime LTS 14.2 ML with Tensorflow 14.0 through sparkdl. My data is in TFRecords format, and this issue started to happen after...
