airflow icon indicating copy to clipboard operation
airflow copied to clipboard

Add messages to task log about moving to queued

Open collinmcnulty opened this issue 1 year ago • 2 comments


When troubleshooting a task that failed somewhere other than the main execute function, it is necessary to look across multiple logs and amidst many unrelated messages in the scheduler. This change adds the messages relevant to a particular task to the task log so that the full history of relevant actions across Airflow can be seen from the task log. This is still in its initial stages, and I need to get a better understanding of the performance impact of this logging.

collinmcnulty avatar Mar 06 '24 20:03 collinmcnulty

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for your contributions.

github-actions[bot] avatar Apr 23 '24 00:04 github-actions[bot]

I didn't progress further on this because of concern that the task context calls in the critical section would slow down scheduler performance

collinmcnulty avatar Apr 26 '24 19:04 collinmcnulty