bdit_data-sources icon indicating copy to clipboard operation
bdit_data-sources copied to clipboard

End of Year Dag did not run

Open chmnata opened this issue 1 year ago • 1 comments

eoy_table_dag creates a bunch of yearly partition tables, including bt, here, and congestion. It failed this year cause it was not scheduled. Next execution date showed by running cli airflow dags next-execution eoy_table_create shows the next execution date is 2023-12-01 which is in the past.

Also should probably change over to taskflow + it is still reading paths in etc.

chmnata avatar Jan 02 '24 14:01 chmnata

I think execution date of 2023-12-01 is correct, as the actual run date would be execution date + 1 year. The below screenshot shows the logical date for next run is 2024-12-01, which is correct.

image

chmnata avatar Jan 02 '24 21:01 chmnata