spark-deep-learning
spark-deep-learning copied to clipboard
databricks
Deep Learning Pipelines for Apache Spark
We should exclude them in the release and keep docker tests working.
I was try trying to train one of my own build model on a gpu cluster using pyspark. With smaller sample the training was successful. But when I run it...
Hi Team, I received the following error when try to the Distributed Hyperparameter Tuning ValueError: Error when checking target: expected predictions to have shape (1000,) but got array with shape...
When attempting to read millions of images from s3 (all in a single bucket) with `readImages`, the command just hangs for several hours. Is this expected? Are they any best...
We're developing machine vision solutions for in-process monitoring of manufacturing processes, including collecting wide-field absorbance maps. The camera is 16-bit and optimized for collecting low-noise quantitative data suitable for feeding...
I've tried using the GraphModelFactory() to load the estimator-based model exported in [this regression example](https://www.google.com/url?q=https%3A%2F%2Fgithub.com%2FGoogleCloudPlatform%2Ftf-estimator-tutorials%2Fblob%2Fmaster%2F01_Regression%2F02.0%2520-%2520TF%2520Regression%2520Model%2520-%2520Estimator%2520APIs%2520%252B%2520Pandas.ipynb&sa=D&sntz=1&usg=AFQjCNGU3fDdVukvk3_xGmSwAy9N1Zpt2Q), but when I try to register the UDF like this: ``` val graph = new...
` featurizer = DeepImageFeaturizer(inputCol="image", outputCol="features", modelName="ResNet50")` ` lr = LogisticRegression(maxIter=20, regParam=0.05, elasticNetParam=0.3, labelCol="label")` `p = Pipeline(stages=[featurizer, lr])` `p_model = p.fit(train_df)` Traceback (most recent call last): File "", line 1, in...
Somewhere in there you are probably dropping down into RDD apis.
Hi, when using sparkdl v0.3.0 with spark v2.2.0 by pyspark when fitting the pipeline with image training data as follows: **featurizer = DeepImageFeaturizer(inputCol="image", outputCol="features", modelName="InceptionV3") lr = LogisticRegression(maxIter=20, regParam=0.05, elasticNetParam=0.3,...
#139 switches to sbt-release to update version numbers. We should make it manage the entire release so we can save some manual effort.