data-engineering-zoomcamp icon indicating copy to clipboard operation
data-engineering-zoomcamp copied to clipboard

Timecodes for "DE Zoomcamp 2.3.1 - Setup Airflow Environment with Docker-Compose"

Open alexeygrigorev opened this issue 2 years ago • 1 comments

Youtube video: https://www.youtube.com/watch?v=lqDMzReAtrw

alexeygrigorev avatar May 20 '22 05:05 alexeygrigorev

Hi,

I found something

I followed the steps and updated the version numbers (Airflow 2.5.0 and Google Cloud SDK/CLI 412.0.0) in the Dockerfile.

But at 10:00, with docker-compose build, I get this error :

> [airflow-airflow-init 4/8] RUN pip install --no-cache-dir -r requirements.txt:
#0 0.187 
#0 0.187 You are running pip as root. Please use 'airflow' user to run pip!
#0 0.187 
#0 0.187 See: https://airflow.apache.org/docs/docker-stack/build.html#adding-a-new-pypi-package
#0 0.187 
------
failed to solve: executor failed running [/bin/bash -o pipefail -o errexit 
-o nounset -o nolog -c pip install --no-cache-dir -r requirements.txt]: exit code: 1

I don't know it's related, but this post (https://stackoverflow.com/a/72296552) says that this bug was introduced in 2.3.0.

If I keep the initial versions 2.2.3 for Airflow and 322.0.0 for Google Cloud SDK/CLI in Dockerfile, everything works fine.

Alain

boisalai avatar Jan 07 '23 20:01 boisalai

0:00:03 - Airflow workshop: Docker setup, injection pipeline 0:02:54 - Configure Docker settings, download Airflow image 0:05:57 - Dags, logs, plugins, docker, requirements, examples 0:09:19 - Confusing setup, build image, initialize Docker 0:12:36 - Initialize airflow container with default credentials

dimzachar avatar Sep 09 '23 17:09 dimzachar

Updated timecodes! Thanks :)

amitfrancis avatar Sep 11 '23 05:09 amitfrancis