airflow-operator
airflow-operator copied to clipboard
GoogleCloudPlatform
Kubernetes custom controller and CRDs to managing Airflow
Hello, I found Airflow operators on two repositories: https://github.com/apache/airflow-on-k8s-operator https://github.com/GoogleCloudPlatform/airflow-operator What are the differences between these repositories? Is it worth putting this information in README.md? For me it is very...
PostGres has a lot fewer connections available than MySQL. PGBouncer is a good way to avoid max connections being hit. An example deployment is available here: https://github.com/astronomer/helm.astronomer.io/blob/master/charts/airflow/templates/pgbouncer/pgbouncer-deployment.yaml
The vendors/k8s.io/ directory structure has changed since the guide was written and the Makefile needs to be updated to reflect the change
First of all, I am thrilled you're working on this operator! Also, great work on Composer. I was wondering if anyone was prepared to discuss achieving DAG reliability whilst a...
Currently the env variables injected are specific to this docker image https://github.com/barney-s/docker-airflow Align it with https://github.com/puckel/docker-airflow and make necessary changes in the operator to make it work with both. related...
Create a docs folder for explaining the design and the Custom Resources. As well as proposals.
I am trying to run Airflow Operator on OpenShift 4 and I am hitting an interesting issue: ``` ERROR: logging before flag.Parse: E0930 15:45:08.736404 1 genericreconciler.go:52] Failed: [*v1alpha1.AirflowBase/airflowop-system/pc-base(cmpnt:*airflowbase.Postgres)] Create. statefulsets.apps...
When we run our workers using the Local executor, the worker logs are placed in a local folder (/usr/local/airflow/logs/). It would be nice if we could also see these logs...
Metadata
Owner
Metadata
Kubernetes custom controller and CRDs to managing Airflow