Introduce new config variable to control whether DAG processor outputs to stdout

Open Owen-CH-Leung opened this issue 1 year ago • 1 comments

fixes #37122

This PR adds a new config variable under logging called dag_processor_manager_log_stdout, which is set to False by default. If being set to True, the DagFileProcessorAgent will also output logs to the stdout of airflow scheduler, in addition to writing logs to the designated log file defined by dag_processor_manager_log_location

Feb 15 '24 10:02 Owen-CH-Leung

CAn you resolve conflicts and rebase please?

Feb 21 '24 22:02 potiuk

CAn you resolve conflicts and rebase please?

Sure & rebased

Feb 22 '24 03:02 Owen-CH-Leung

How to select output ONLY to stdout? If I write to both locations I risk getting OOM in container environment and I don't want to persist it perpetually in PVC.

Apr 08 '24 21:04 dimon222