spark-standalone-cluster-on-docker
spark-standalone-cluster-on-docker copied to clipboard
[BUG] Unable to start service with Docker Compose
Introduction
I am unable to start all the services on my Ubuntu Server 20.10. Cloned the current master and only executed the build.sh.
Bug
When I then try to start the services, the following error occures:
thomas@srv:/srv/spark/build$ sudo rm -rf /var/lib/docker/volumes/hadoop-distributed-file-system/
thomas@srv/srv/spark/build$ docker-compose up
jupyterlab is up-to-date
Creating spark-master ... error
ERROR: for spark-master Cannot create container for service spark-master: open /var/lib/docker/volumes/hadoop-distributed-file-system/_data: no such file or directory
ERROR: for spark-master Cannot create container for service spark-master: open /var/lib/docker/volumes/hadoop-distributed-file-system/_data: no such file or directory
ERROR: Encountered errors while bringing up the project.
Checklist
Please provide the following:
- [ ] Docker Engine version: 20.10.2
- [ ] Docker Compose version: 1.25.0