barney-s

Results 30 comments of barney-s

Thanks. Will take a look.

controller-reconciler is a manually vendored project. We are trying to fix that. For now copy that from master into your vendor directory.

Would you ensure that the CRDs are installed ? do a kubectl get crd and see if AirflowBase and AirflowCluster are available.

@dimberman how do we redirect the logs to stdout instead of usr/local/logs ?

Since i dont know what DAGs you are running can you try this ? Set these to false: https://github.com/GoogleCloudPlatform/airflow-operator/blob/master/templates/airflow-configmap.yaml#L172 https://github.com/GoogleCloudPlatform/airflow-operator/blob/master/pkg/apis/airflow/v1alpha1/airflow.go#L194 Try running again and look at the logs from the...

Sent a patch. Could you please test if it works ?

Potential fix here: https://github.com/barney-s/airflow-operator/commit/5bc91cc37f01cdc4367de4984418e2b63ca49c80 Would you be able to verify/use this ?

Design, Development Guide, Quick start guide, Readme added via https://github.com/GoogleCloudPlatform/airflow-operator/pull/7 pending: API guide, User guide.

There isnt unfortunately. Thinking restarting the workers would pull the latest. But not a clean solution.

@pacuna Did the config `dag_dir_list_interval` not help you ? I believe thats the canonical way airflow supports refreshing DAGs. https://cwiki.apache.org/confluence/display/AIRFLOW/Scheduler+Basics#Configuration You can set that config using `cluster.spec.config.airflow`. Set the env...