data.gov icon indicating copy to clipboard operation
data.gov copied to clipboard

gha job scheduler

Open rshewitt opened this issue 10 months ago • 3 comments

User Story

In order to create jobs on a schedule, datagov wants to create a gha to add jobs to the harvest jobs table every day.

Acceptance Criteria

[ACs should be clearly demoable/verifiable whenever possible. Try specifying them using BDD.]

  • [ ] GIVEN a list of sources to harvest daily
    WHEN a time of day is reached
    THEN the action will be kicked off
    AND harvest tasks will be run on cloud foundry

Background

[Any helpful contextual notes or links to artifacts/evidence, if needed]

Security Considerations (required)

[Any security concerns that might be implicated in the change. "None" is OK, just be explicit here!]

Sketch

  • let's start off having the action be manually dispatched instead of on cron.

rshewitt avatar Mar 27 '24 16:03 rshewitt

TO DO: discuss whether this should be a gha

hkdctol avatar Mar 28 '24 20:03 hkdctol

@rshewitt, does anything changed on this ticket regarding job scheduling work listed under these tickets?

https://github.com/GSA/data.gov/issues/4683 https://github.com/GSA/data.gov/issues/4319

gujral-rei avatar May 28 '24 16:05 gujral-rei

@rshewitt, does anything changed on this ticket regarding job scheduling work listed under these tickets?

#4683 #4319

@gujral-rei we're replacing github actions as our scheduler for our load manager. related to #4707

rshewitt avatar May 28 '24 16:05 rshewitt