airflow icon indicating copy to clipboard operation
airflow copied to clipboard

Published 20 hours ago • verified publisher icon apache

fixing emr-operator-deferral-logic

Open laksh-krishna-sharma opened this issue 6 months ago • 12 comments

Summary of Changes

This PR addresses issue #40966 by modifying the logic in the EmrCreateJobFlowOperator to ensure that the deferrable argument only activates the deferral trigger when wait_for_completion is also set to True. Previously, the deferral trigger would be added regardless of the wait_for_completion setting, leading to unintended behavior.

Changes Made:

  • Updated the condition for deferring to check both deferrable and wait_for_completion.
  • Adjusted the condition for synchronous waiting to occur only when wait_for_completion=True and deferrable=False.

Please review the changes, and let me know if further adjustments are needed.

laksh-krishna-sharma avatar Aug 18 '24 12:08 laksh-krishna-sharma