spark-deep-learning
spark-deep-learning copied to clipboard
databricks
Deep Learning Pipelines for Apache Spark
When I run a spark job with this library downloaded as a package, I get an error that `tensorflow` is not found. I would expect that downloading this library as...
Hello, I am running a jupyter notebook on a EMR instance, without access to the web. I have downloaded the .jar file of sparkdl to an s3 bucket. I tried...
Using the command `$SPARK_HOME/bin/spark-shell --packages databricks:spark-deep-learning:1.1.0-spark2.3-s_2.11 ` to install sparkdl on mac, I got the following error: ``` Ivy Default Cache set to: /Users/mm/.ivy2/cache The jars for the packages stored...
Hello everyone, i am facing this issue while running build/sbt command can anybody guide me what is error about and its solution please :) build/sbt assembly Using /usr/lib/jvm/java-8-oracle as default...
What changes are proposed in this pull request? Adding some kinds of Running mode. For now, it support "Normal" and "TFos" Here is the code show how it works: ```...
This PR proposes tools and scripts to help getting started with developing Spark Deep Learning Pipelines. - SBT plugin to locate Spark package dependencies - Shell script to build Spark...
What changes are proposed in this pull request? Creating a Spark MLlib Estimator API which can integrated with tensorflow code, with a reference implementation. Creating a Spark MLlib Transformer convert...
We have been using this library over at [GIPHY](https://github.com/Giphy) and love it. We had to adapt it to work with GIFs, and we thought we'd share some of the changes...
Linter
## What changes are proposed in this pull request? Add prospector for style checking, etc.
[WIP] Preparation for moving stuff to Spark. Moved utilities for image schema numpy array conversion to (copy pasted from spark 2.3) Image schema code. 1. Extended ImageSchema scala code with...
