open-bus all processing should be idempotent and make sure data is available for last X days

all processing should be idempotent and make sure data is available for last X days

Open OriHoch opened this issue 2 years ago • 2 comments

Jul 01 '22 10:07 OriHoch

gtfs-etl: done (dags: gtfs-etl-download-upload, gtfs-etl-process)
stride-etl-gtfs-update-ride-aggregations: done, currently running with update for all past dates, when done need to set check_missing_dates to False so it will rely on DB only for state

Need to keep track for a few days, then move on to the other dags

Jul 12 '22 14:07 OriHoch

stride-etl-gtfs-update-ride-aggregations: all past dates were proessed, set check_missing_dates to False

Aug 08 '22 13:08 OriHoch