Accelerate db performance of queries to pipeline_runs table
This should significantly speed up queries from the core node to the pipeline_runs table.
The two main things affected by this are:
- Loading of job runs to return to the UI
- The batched deletion of old job runs by the reaper
With high traffic chains, this database can become quite large, and will have new rows being rapidly inserted.
These changes should reduce the required amount of CPU resources needed by the db in order for the reaper to keep pace with the newly added rows, and avoid UI slowness.
I've also added a longer timeout for the reaper. Under normal operation with sufficient CPU and memory resources, this should never be needed. However, if for any reason the resources do become constrained, and the reaper gets slow enough to hit the timeout, timing out will only make the problem worse. Since it only runs once per hour, it doesn't hurt to err on the cautious side and allow it to take far longer than we expect it to run.
I see that you haven't updated any CHANGELOG files. Would it make sense to do so?
EVM Smoke Test Results
19 tests 0 :heavy_check_mark: 1m 3s :stopwatch: 1 suites 11 :zzz: 1 files 8 :x:
For more details on these failures, see this check.
Results for commit 2f9c971b.
EVM Smoke Test Results
19 tests 0 :heavy_check_mark: 4m 31s :stopwatch: 1 suites 11 :zzz: 1 files 0 :x: 8 :fire:
For more details on these errors, see this check.
Results for commit fd87d014.
EVM Smoke Test Results
19 tests 8 :heavy_check_mark: 2m 21s :stopwatch: 1 suites 11 :zzz: 1 files 0 :x:
Results for commit a692ff75.
EVM Smoke Test Results
19 tests 0 :heavy_check_mark: 4m 26s :stopwatch: 1 suites 11 :zzz: 1 files 0 :x: 8 :fire:
For more details on these errors, see this check.
Results for commit 9121231b.
EVM Smoke Test Results
19 tests 8 :heavy_check_mark: 2m 42s :stopwatch: 1 suites 11 :zzz: 1 files 0 :x:
Results for commit 027e5295.
EVM Smoke Test Results
52 tests 22 :heavy_check_mark: 6m 7s :stopwatch: 1 suites 30 :zzz: 1 files 0 :x:
Results for commit 57e8d450.
:recycle: This comment has been updated with latest results.
Solana Smoke Test Results
1 tests 1 :heavy_check_mark: 4m 52s :stopwatch: 1 suites 0 :zzz: 1 files 0 :x:
Results for commit 57e8d450.
:recycle: This comment has been updated with latest results.