beam icon indicating copy to clipboard operation
beam copied to clipboard

Performance Regression or Improvement: sideinpts_python_batch_1gb_1kb_10workers_1000window_99key_percent_dict:runtime

Open github-actions[bot] opened this issue 1 year ago • 2 comments

Performance change found in the test: sideinpts_python_batch_1gb_1kb_10workers_1000window_99key_percent_dict for the metric: runtime.

For more information on how to triage the alerts, please look at Triage performance alert issues section of the README.

Test description: python | Side Input | 1 GB dictionary, 99% of keys, 1000 fixed windows Test Link - https://github.com/apache/beam/blob/5e38decf9e723a385057131b01bbd33d8c60bda3/.test-infra/jenkins/job_LoadTests_SideInput_Python.groovy#L133 Test Dashboard - http://metrics.beam.apache.org/d/-E9aGlFGk/side-input-load-tests?orgId=1&from=now-90d&to=now&viewPanel=9


timestamp: Fri Apr 19 18:58:46 2024, metric_value: 220.00
timestamp: Thu Apr 18 18:59:40 2024, metric_value: 226.00
timestamp: Wed Apr 17 18:58:17 2024, metric_value: 203.00 <---- Anomaly
timestamp: Tue Apr 16 18:50:44 2024, metric_value: 114.00
timestamp: Mon Apr 15 18:48:08 2024, metric_value: 149.00
timestamp: Sun Apr 14 21:04:00 2024, metric_value: 149.00
timestamp: Sat Apr 13 18:39:25 2024, metric_value: 165.00
timestamp: Thu Apr 11 19:00:02 2024, metric_value: 117.00
timestamp: Wed Apr 10 18:46:19 2024, metric_value: 168.00
timestamp: Tue Apr  9 18:44:07 2024, metric_value: 134.00
timestamp: Mon Apr  8 18:49:49 2024, metric_value: 109.00
timestamp: Sun Apr  7 18:42:00 2024, metric_value: 134.00
timestamp: Sat Apr  6 18:41:50 2024, metric_value: 97.00

github-actions[bot] avatar Apr 19 '24 22:04 github-actions[bot]

This is suspicious. Let's wait for few more runs to get it back to normal

riteshghorse avatar May 07 '24 17:05 riteshghorse

let us keep this open for more runs

liferoad avatar May 14 '24 17:05 liferoad