barney-s
barney-s
Would you have time to take this up ? @raam86 I can help you with the setup and tests
Thanks. What did you mean by lifted you setup into helm/charts ? If you are using both i would love to hear you feedback on helm/charts vs the operator.
Ah i see. GCS sync is a side-car. The default value of `.spec.dags.gcs.once` is `false`. Which helm chart are you using ?
Let me check and get back.
Verified and it works. I followed the instructions in quickstart guide which i updated as well. @darkmane FYI
Seeing this error: ``` 2019-01-28 03:50:50,394] {{__init__.py:51}} INFO - Using executor CeleryExecutor DB: mysql://v9dbimx6cr3mbgzw:***@cc-base-sql:3306/e9qcv7p27gi36b5m [2019-01-28 03:50:50,676] {{db.py:338}} INFO - Creating tables INFO [alembic.runtime.migration] Context impl MySQLImpl. INFO [alembic.runtime.migration] Will assume...
Update: Google Composer patched airflow to work around this issue. Will wait for that to be open-sourced in airflow.
Would you care to elaborate this issue ?
By DAG reliability do you mean what happens if i restart pods (mapping to airflow tasks) often. My understanding is airflow Tasks are meant to be designed to be idempotent...
Puckel image does not support MySQL yet. Once it is in we can refactor refactor and support it. https://github.com/puckel/docker-airflow/pull/206