dagster
dagster copied to clipboard
[DS][39/n] Use FailedSchedulingCondition and ScheduledSince condition in eager policy
Summary & Motivation
As title. This was alluded to in the initial eager policy PR, this is putting them in action. In the case that the latest run for an asset partition failed, we will not request the asset if we've already requested it within the last hour. This puts a natural "rate limit" on the asset in the case that it is repeatedly failing, but does not interfere if the asset is materializing as expected.
How I Tested These Changes
-
#21788
-
#21741
👈
-
#21740
-
#21739
-
#21712
-
#21793
-
#21704
-
#21703
-
#21677
-
#21737
-
#21671
: 1 other dependent PR (#21705
)
-
#21641
: 1 other dependent PR (#21670
)
-
#21640
-
#21648
-
#21615
-
#21613
-
#21612
-
#21573
-
#21546
-
#21545
-
#21541
-
#21540
-
#21539
-
#21538
-
#21537
-
#21536
-
#21535
-
#21521
-
#21520
-
#21511
: 1 other dependent PR (#21512
)
-
#21510
-
#21508
-
#21507
-
#21505
-
#21504
-
#21503
-
#21502
-
#21501
-
#21500
-
#21499
-
master
This stack of pull requests is managed by Graphite. Learn more about stacking.
Join @OwenKephart and the rest of your teammates on Graphite