docker-airflow-spark icon indicating copy to clipboard operation
docker-airflow-spark copied to clipboard

Your dockerfile for airflow-spark docker doesn't work

Open quangbilly79 opened this issue 3 years ago • 5 comments

I can't build this Dockerfile: https://github.com/pyjaime/docker-airflow-spark/blob/master/airflow/Dockerfile Error at line 68: && pip install --use-feature=2020-resolver apache-airflow[crypto,celery,postgres,hive,jdbc,mysql,ssh${AIRFLOW_DEPS:+,}${AIRFLOW_DEPS}]==${AIRFLOW_VERSION} \

especially at the --use-feature=2020-resolve part Please check again

quangbilly79 avatar Nov 18 '22 18:11 quangbilly79

@quangbilly79 Please use --use-feature=fast-deps. There might be some other issues I had to add below lines as well to the Dockerfile && pip install black==20.8b1 \ && pip install --upgrade click==8.0.2 \

lijoabraham avatar Dec 29 '22 05:12 lijoabraham

I am getting image errror image

Kukreti12 avatar Mar 13 '23 21:03 Kukreti12

Same on:

DISTRIB_ID=Ubuntu DISTRIB_RELEASE=22.04 DISTRIB_CODENAME=jammy DISTRIB_DESCRIPTION="Ubuntu 22.04.2 LTS" PRETTY_NAME="Ubuntu 22.04.2 LTS" NAME="Ubuntu" VERSION_ID="22.04" VERSION="22.04.2 LTS (Jammy Jellyfish)" VERSION_CODENAME=jammy ID=ubuntu ID_LIKE=debian HOME_URL="https://www.ubuntu.com/" SUPPORT_URL="https://help.ubuntu.com/" BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" UBUNTU_CODENAME=jammy

netcat -> netcat-traditional openjdk-8-jdk -> default-jre pip install --use-feature=2020 -> --use-feature=fast-deps

airflow-webserver_1 | /usr/bin/env: ‘bash\r’: No such file or directory airflow-webserver_1 | /usr/bin/env: use -[v]S to pass options in shebang lines

ronniemo avatar Sep 06 '23 12:09 ronniemo

I'm doing something different from what's in README.md

image

weldermartins avatar Jan 19 '24 22:01 weldermartins

I got the same because I tried to run it on a new Ubuntu version. When I first installed it in Turbolader Ubuntu version it worked.

ronniemo avatar Jan 20 '24 18:01 ronniemo