Performance Regression or Improvement: sideinpts_python_batch_1gb_1kb_10workers_1000window_99key_percent_dict:runtime
Performance change found in the
test: sideinpts_python_batch_1gb_1kb_10workers_1000window_99key_percent_dict for the metric: runtime.
For more information on how to triage the alerts, please look at
Triage performance alert issues section of the README.
Test description: python | Side Input | 1 GB dictionary, 99% of keys, 1000 fixed windows
Test Link - https://github.com/apache/beam/blob/5e38decf9e723a385057131b01bbd33d8c60bda3/.test-infra/jenkins/job_LoadTests_SideInput_Python.groovy#L133
Test Dashboard - http://metrics.beam.apache.org/d/-E9aGlFGk/side-input-load-tests?orgId=1&from=now-90d&to=now&viewPanel=9
timestamp: Fri Apr 19 18:58:46 2024, metric_value: 220.00
timestamp: Thu Apr 18 18:59:40 2024, metric_value: 226.00
timestamp: Wed Apr 17 18:58:17 2024, metric_value: 203.00 <---- Anomaly
timestamp: Tue Apr 16 18:50:44 2024, metric_value: 114.00
timestamp: Mon Apr 15 18:48:08 2024, metric_value: 149.00
timestamp: Sun Apr 14 21:04:00 2024, metric_value: 149.00
timestamp: Sat Apr 13 18:39:25 2024, metric_value: 165.00
timestamp: Thu Apr 11 19:00:02 2024, metric_value: 117.00
timestamp: Wed Apr 10 18:46:19 2024, metric_value: 168.00
timestamp: Tue Apr 9 18:44:07 2024, metric_value: 134.00
timestamp: Mon Apr 8 18:49:49 2024, metric_value: 109.00
timestamp: Sun Apr 7 18:42:00 2024, metric_value: 134.00
timestamp: Sat Apr 6 18:41:50 2024, metric_value: 97.00
This is suspicious. Let's wait for few more runs to get it back to normal
let us keep this open for more runs