spark-standalone-cluster-on-docker
spark-standalone-cluster-on-docker copied to clipboard
Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker. :zap:
Hi, I met an issue. Anyone can help? Thanks in advance. After deploy spark-standalone-cluster-on-docker (images: andreper/spark-master:3.0.0) on a server (192.XX.X.X), I try to test by another PC (192.XX.X.Y). cmd steps:...
## Introduction The project is very helpful but I think the principal issue that I faced is not able to access to other container when putting their IP ## Bug...
Hey! Thank you very much for the project, it helps us a lot. However, it looks like during the last update (about 15 hours ago) there was the problems in...
The URL to download Apache Spark has changed. ## Introduction This PR is to fix the URL format since the download URL for Apache Spark has change the structure. ##...
Hey! Thank you very much for the project, it helps us a lot. The bug is that the URL for download spark has changed its structure to https://dlcdn.apache.org/spark/spark-${spark_version}/spark-${spark_version}-bin-hadoop${hadoop_version}.tgz it seems...
## Pull Request ### Issue - #38 ### Changes - *Update bash script to accept an argument `mac`, this awaits `ggrep` installed via Homebrew* - *Update README.md to describe build...
Add support for apache-airflow.
## Building on Mac OSX ### Description I have tried to build your images on Mac OSX which failed as awaited, BUT it is pretty easy to solve and I...
## Introduction I am unable to start all the services on my Ubuntu Server 20.10. Cloned the current master and only executed the build.sh. ## Bug When I then try...
## Ability to split Spark Master and Workers Nodes and run on different cluster nodes ### Description As this repository is a really nice start for creating a small Spark...