armada icon indicating copy to clipboard operation
armada copied to clipboard

[Lookout] Use orig_job_spec rather than job column for displaying the job yaml

Open d80tb7 opened this issue 3 years ago • 1 comments

Lookout uses the job.job database column to display the job yaml. This is a binary json column, which is unfortunately slow to ingest.

To solve this, lookout ingester has started populating the job.orig_job_spec column which is the same data contains gzip compressed proto data stored in a postres bytea column,

We are now populating both columns, and have been for some time, so we can move over to the new column and delete the old one. To do this we need to:

a) change lookout to take the job yaml from the orig_job_spec column. b) change lookout ingester to no longer populate the old job column c) change the lookout schema to drop the old job column.

d80tb7 avatar Sep 11 '22 15:09 d80tb7

Hey team! Please add your planning poker estimate with Zenhub @dejanzele @jayofdoom @kannon92 @richscott @suprjinx

dave-gantenbein avatar Sep 21 '22 17:09 dave-gantenbein