docker-airflow-spark
docker-airflow-spark copied to clipboard
Your dockerfile for airflow-spark docker doesn't work
I can't build this Dockerfile: https://github.com/pyjaime/docker-airflow-spark/blob/master/airflow/Dockerfile Error at line 68: && pip install --use-feature=2020-resolver apache-airflow[crypto,celery,postgres,hive,jdbc,mysql,ssh${AIRFLOW_DEPS:+,}${AIRFLOW_DEPS}]==${AIRFLOW_VERSION} \
especially at the --use-feature=2020-resolve part Please check again
@quangbilly79 Please use --use-feature=fast-deps. There might be some other issues
I had to add below lines as well to the Dockerfile
&& pip install black==20.8b1 \ && pip install --upgrade click==8.0.2 \
I am getting image errror

Same on:
DISTRIB_ID=Ubuntu DISTRIB_RELEASE=22.04 DISTRIB_CODENAME=jammy DISTRIB_DESCRIPTION="Ubuntu 22.04.2 LTS" PRETTY_NAME="Ubuntu 22.04.2 LTS" NAME="Ubuntu" VERSION_ID="22.04" VERSION="22.04.2 LTS (Jammy Jellyfish)" VERSION_CODENAME=jammy ID=ubuntu ID_LIKE=debian HOME_URL="https://www.ubuntu.com/" SUPPORT_URL="https://help.ubuntu.com/" BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" UBUNTU_CODENAME=jammy
netcat -> netcat-traditional openjdk-8-jdk -> default-jre pip install --use-feature=2020 -> --use-feature=fast-deps
airflow-webserver_1 | /usr/bin/env: ‘bash\r’: No such file or directory airflow-webserver_1 | /usr/bin/env: use -[v]S to pass options in shebang lines
I'm doing something different from what's in README.md
I got the same because I tried to run it on a new Ubuntu version. When I first installed it in Turbolader Ubuntu version it worked.