webstatus.dev icon indicating copy to clipboard operation
webstatus.dev copied to clipboard

[ENHANCEMENT] Convert web feature consumer from service to job

Open jcscottiii opened this issue 7 months ago • 0 comments

Is your feature request related to a problem? Please describe. Currently, the web feature consumer ingestion step is a http service that starts when it receives a http request. This was originally setup because we leverage Google Cloud Workflows and I thought that was the only way to do custom steps. However, it turns out that we can make the step be a cloud run job instead.

Describe the solution you'd like

  • Make the web feature consumer step an executable like the wpt consumer step
    • Remove the http code from web feature consumer
  • Modify the terrarform to deploy a cloud run job instead of a cloud run service.
  • Remove the OpenAPI spec for the web feature consume step
    • Remove the generation of an OpenAPI code in the Makefile
    • Remove all util code that uses the client in util/cmd/local_web_feature_workflow/main.go
  • Remove the skaffold.yaml for the web feature consumer
    • Remove the pod.yaml for the web feature consumer and make a job.yaml (look at the ones for BCD and WPT)
  • Modify the Makefile to use the new job.yaml and remove the call to util/cmd/local_web_feature_workflow/main.go

jcscottiii avatar Jul 02 '24 14:07 jcscottiii