spark-deep-learning

spark-deep-learning copied to clipboard

Hi I am not able to save and load my model using the MLeap, I got this error: java.util.NoSuchElementException: key not found: com.databricks.sparkdl.DeepImageFeaturizer 

mohaissa

I didn't understand how training works with SparkDeepLearning. 1) i saw in the Databricks website that this is a library for single node training, so i was wondering if the...

DragonBanana

MLlib’s tooling for tuning the hyperparameters from Keras model and tensors (no images)

1

Hi Team, Is there any plan to extend functionality so that we are able to use MLlib's tooling for tunning the hyperparameters of a keras model in e.g. numeric data...

anamf

Broken scaladoc link on https://databricks.github.io/spark-deep-learning

1

The "API Docs" link "Deep Learning Pipelines Scala API (Scaladoc)" on https://databricks.github.io/spark-deep-learning/docs/_site/index.html points to https://databricks.github.io/spark-deep-learning/docs/_site/api/scala/index.html#com.databricks.sparkdl.package which is broken: 404 not found.

huonw

pyspark --master yarn --packages databricks:spark-deep-learning:0.1.0-spark2.1-s_2.11 start have errors

1

hi， when I start in local mode pyspark --master local[1] --packages databricks:spark-deep-learning:0.1.0-spark2.1-s_2.11 It can work,and I can use sparkdl interface, but when I start in yarn cluster pyspark --master yarn...

yixiu00001

Hi! From a dataframe of images, how could I run a detection model, and retrieve in one pass both the detection boxes and the detection classes? I can currently use...

gyscos

How to pass custom objects to KerasImageFileTransformer. keras load_model supports custom_objects

4

Hi, I am using dice_loss custom object to train my model. Is there anyway to pass custom objects to load model in spark DL? Or is it that spark DL...

vvivek921

Curious about the status of the Scala API

12

Thank you for creating this library. I haven't tried it yet but I'm assuming that there is a Scala API for this ?

redsofa

Can you use this with Scala?

1

lolaclinton

PyTorch dataframe batching and loading

2

Dear all, I really appreciate your effort in bridging the gaps between Spark and some automatic-differentiation libraries. However, I'm currently working with Spark and PyTorch, where Spark is used to...

andompesta