ci-tools icon indicating copy to clipboard operation
ci-tools copied to clipboard

TRT-1135: Stop uploading Test Run Data and the Job Run tables

Open dgoodwin opened this issue 1 year ago • 6 comments

As a followup to #4129 , this PR continues by removing the actual upload of test run data which we should not be referencing anymore after that previous PR merged.

In addition, last year I undertook work to partition the alert/disruption tables, which involved adding job run data to every row. However we never made it far enough to actually stop using/uploading three copies of job run data to three separate tables. (JobRuns, Alerts_JobRuns, BackendDisruption_JobRuns)

This PR completes that work, Job run data is now read by examining the JobRun columns in Alerts and BackendDisruption tables, using the partition column (JobRunStartDate) to keep query sizes comparable. The three JobRun tables are no longer being populated leading to a more concise and less complicated code base.

dgoodwin avatar May 16 '24 16:05 dgoodwin

/hold

I want to let #4096 bake for a bit to make sure it's healthy.

dgoodwin avatar May 16 '24 16:05 dgoodwin

@dgoodwin: This pull request references TRT-1135 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.16.0" version, but no target version was set.

In response to this:

As a followup to #4096 , this PR continues by removing the actual upload of test run data which we should not be referencing anymore after that previous PR merged.

In addition, last year I undertook work to partition the alert/disruption tables, which involved adding job run data to every row. However we never made it far enough to actually stop using/uploading three copies of job run data to three separate tables. (JobRuns, Alerts_JobRuns, BackendDisruption_JobRuns)

This PR completes that work, Job run data is now read by examining the JobRun columns in Alerts and BackendDisruption tables, using the partition column (JobRunStartDate) to keep query sizes comparable. The three JobRun tables are no longer being populated leading to a more concise and less complicated code base.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar May 16 '24 16:05 openshift-ci-robot

/test remaining-required

openshift-ci-robot avatar May 16 '24 17:05 openshift-ci-robot

@dgoodwin: This pull request references TRT-1135 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.17.0" version, but no target version was set.

In response to this:

As a followup to #4129 , this PR continues by removing the actual upload of test run data which we should not be referencing anymore after that previous PR merged.

In addition, last year I undertook work to partition the alert/disruption tables, which involved adding job run data to every row. However we never made it far enough to actually stop using/uploading three copies of job run data to three separate tables. (JobRuns, Alerts_JobRuns, BackendDisruption_JobRuns)

This PR completes that work, Job run data is now read by examining the JobRun columns in Alerts and BackendDisruption tables, using the partition column (JobRunStartDate) to keep query sizes comparable. The three JobRun tables are no longer being populated leading to a more concise and less complicated code base.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar May 22 '24 11:05 openshift-ci-robot

/hold cancel

dgoodwin avatar Jun 03 '24 11:06 dgoodwin

/lgtm

neisw avatar Jun 03 '24 16:06 neisw

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dgoodwin, neisw

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

openshift-ci[bot] avatar Jun 03 '24 16:06 openshift-ci[bot]

/retest-required

Remaining retests: 0 against base HEAD 383fa761f404dc454f1086eafa56185d2b6d0a74 and 2 for PR HEAD 2e31ca598ffe40a935f941e23e4e57f15aa0f316 in total

openshift-ci-robot avatar Jun 03 '24 17:06 openshift-ci-robot

/retest

dgoodwin avatar Jun 04 '24 11:06 dgoodwin

/retest-required

Remaining retests: 0 against base HEAD cd4a99392491ac61eb889c60514150e082053ab4 and 1 for PR HEAD 2e31ca598ffe40a935f941e23e4e57f15aa0f316 in total

openshift-ci-robot avatar Jun 04 '24 13:06 openshift-ci-robot

/hold

due to ack critical fixes

dgoodwin avatar Jun 04 '24 14:06 dgoodwin

/hold cancel

dgoodwin avatar Jun 05 '24 14:06 dgoodwin

/retest

dgoodwin avatar Jun 05 '24 14:06 dgoodwin

/retest-required

Remaining retests: 0 against base HEAD 2a1306346255d37fee6781cf19f56e122890e269 and 0 for PR HEAD 2e31ca598ffe40a935f941e23e4e57f15aa0f316 in total

openshift-ci-robot avatar Jun 05 '24 16:06 openshift-ci-robot

/hold

Revision 2e31ca598ffe40a935f941e23e4e57f15aa0f316 was retested 3 times: holding

openshift-ci-robot avatar Jun 05 '24 19:06 openshift-ci-robot

/test images

dgoodwin avatar Jun 06 '24 10:06 dgoodwin

@dgoodwin: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/security 2e31ca598ffe40a935f941e23e4e57f15aa0f316 link false /test security

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

openshift-ci[bot] avatar Jun 06 '24 12:06 openshift-ci[bot]

/hold cancel

dgoodwin avatar Jun 07 '24 10:06 dgoodwin

/retest-required

Remaining retests: 0 against base HEAD f6f93c90019d0711bebb082301eb5b2d13e2ceff and 2 for PR HEAD 2e31ca598ffe40a935f941e23e4e57f15aa0f316 in total

openshift-ci-robot avatar Jun 07 '24 11:06 openshift-ci-robot