Airflow service auto stopping

[satheanirudha18]

Hi! I went through the steps written in the repo. I have given all the necessary configurations in the xml(s). The Airflow is successfully getting installed but it is auto stopping. Just after couple of minutes, it automatically stops. The worker node stops and whatever the port (eg: 8088 or 8085) I'm giving, it is saying, "Connection refused", and no other service is running on that port. Can you please help me in starting the Airflow service?

[miho120]

Hi @satheanirudha18. Worker nodes are used only when you configured airflow with CeleryExecutor, otherwise you don't need workers and they will not work unless you configure celery. Nice article how to do it: https://medium.com/wbaa/airflow-ha-environment-c60ddca825a9

[aman1505]

Hi @miho120 We have followed all the above steps and Ambari worker are not used, still Airflow service is auto stopping

[aman1505]

Hi @miho120 Any updates on the above issue?

[miho120]

Hi @aman1505, Did you configure celery executor?

[asath04]

Hi @aman1505, We tried modifying a file located at

ambari-airflow-mpack/airflow-service-mpack/common-services/AIRFLOW/1.9.0/package/scripts/airflow_setup.py

, in which, there's a line which it exports (export AIRFLOW_HOME={airflow_home} && /usr/bin/airflow $1 --pid {airflow_home}/airflow-sys-$1.pid). In this line, we changed /usr/bin/airflow to /usr/local/bin/airflow. Then the airflow started and it did not auto stop further. Let me know if it helps.

[aman1505]

@miho120 No , I have not configured celery executor

[miho120]

Should be fixed now with commit d54b960.