localstack icon indicating copy to clipboard operation
localstack copied to clipboard

Investigate CI analytics pollution

Open joe4dev opened this issue 7 months ago β€’ 10 comments

DO NOT MERGE, only for internal testing!

Motivation

Investigate why we receive analytic events in CI.

Changes

Introduce new test counter and raise intentional exception upon trying to publish CI metrics

joe4dev avatar May 28 '25 08:05 joe4dev

Test Results - Preflight, Unit

21β€ˆ613 tests  Β±0   19β€ˆ955 βœ…  -β€Š3   6m 10s ⏱️ -14s β€‡β€‡β€ˆβ€‡β€‡1 suites Β±0    1β€ˆ658 πŸ’€ +3  β€‡β€‡β€ˆβ€‡β€‡1 files   Β±0β€‚β€ƒβ€ƒβ€‡β€‡β€ˆβ€‡β€‡0 ❌ Β±0 

Results for commit fca8e3e5. ± Comparison against base commit 02ad74e6.

This pull request skips 3 tests.
tests.unit.cli.test_cli ‑ test_publish_analytics_event_on_command_invocation[--debug config show --format plain-localstack config show-expected_params2]
tests.unit.cli.test_cli ‑ test_publish_analytics_event_on_command_invocation[config show-localstack config show-expected_params1]
tests.unit.cli.test_cli ‑ test_publish_analytics_event_on_command_invocation[stop-localstack stop-expected_params0]

:recycle: This comment has been updated with latest results.

github-actions[bot] avatar May 28 '25 08:05 github-actions[bot]

Test Results - Alternative Providers

987 tests   589 βœ…β€ƒβ€ƒ30m 15s ⏱️   4 suites  398 πŸ’€   4 files      0 ❌

Results for commit fca8e3e5.

:recycle: This comment has been updated with latest results.

github-actions[bot] avatar May 28 '25 08:05 github-actions[bot]

LocalStack Community integration with Pro

β€‡β€ˆβ€‡β€‡2 filesβ€„β€ƒβ€‡β€ˆβ€‡β€‡2 suites   1h 44m 10s ⏱️ 4β€ˆ873 tests 4β€ˆ096 βœ…β€ƒ777 πŸ’€β€ƒ0 ❌ 4β€ˆ875 runsβ€Šβ€ƒ4β€ˆ096 βœ…β€ƒ779 πŸ’€β€ƒ0 ❌

Results for commit fca8e3e5.

:recycle: This comment has been updated with latest results.

github-actions[bot] avatar May 28 '25 09:05 github-actions[bot]

S3 Image Test Results (AMD64 / ARM64)

  2 files    2 suites   8m 11s ⏱️ 495 tests 445 βœ…β€ƒβ€‡50 πŸ’€β€ƒ0 ❌ 990 runsβ€Šβ€ƒ890 βœ…β€ƒ100 πŸ’€β€ƒ0 ❌

Results for commit fca8e3e5.

:recycle: This comment has been updated with latest results.

github-actions[bot] avatar May 28 '25 10:05 github-actions[bot]

Test Results (amd64) - Acceptance

7 tests  Β±0   5 βœ… Β±0   3m 7s ⏱️ Β±0s 1 suites Β±0   2 πŸ’€ Β±0  1 files   Β±0   0 ❌ Β±0 

Results for commit fca8e3e5. ± Comparison against base commit 02ad74e6.

:recycle: This comment has been updated with latest results.

github-actions[bot] avatar Jun 02 '25 16:06 github-actions[bot]

Test Results (amd64) - Integration, Bootstrap

β€‡β€ˆβ€‡β€‡5 filesβ€„β€ƒβ€‡β€ˆβ€‡β€‡5 suites   2h 20m 43s ⏱️ 5β€ˆ230 tests 4β€ˆ300 βœ…β€ƒ929 πŸ’€β€ƒ1 ❌ 5β€ˆ236 runsβ€Šβ€ƒ4β€ˆ300 βœ…β€ƒ935 πŸ’€β€ƒ1 ❌

For more details on these failures, see this check.

Results for commit fca8e3e5.

:recycle: This comment has been updated with latest results.

github-actions[bot] avatar Jun 02 '25 16:06 github-actions[bot]

Test Results (MA/MR) - Preflight, Unit

21β€ˆ613 tests   19β€ˆ955 βœ…β€ƒβ€ƒ6m 1s ⏱️ β€‡β€‡β€ˆβ€‡β€‡1 suites   1β€ˆ658 πŸ’€ β€‡β€‡β€ˆβ€‡β€‡1 filesβ€„β€‚β€ƒβ€ƒβ€‡β€‡β€ˆβ€‡β€‡0 ❌

Results for commit fca8e3e5.

:recycle: This comment has been updated with latest results.

github-actions[bot] avatar Jun 03 '25 15:06 github-actions[bot]

Test Results (amd64, MA/MR) - Acceptance

7 tests   5 βœ…β€ƒβ€ƒ3m 8s ⏱️ 1 suites  2 πŸ’€ 1 files    0 ❌

Results for commit fca8e3e5.

:recycle: This comment has been updated with latest results.

github-actions[bot] avatar Jun 03 '25 16:06 github-actions[bot]

Test Results (MA/MR) - Alternative Providers

987 tests   589 βœ…β€ƒβ€ƒ30m 22s ⏱️   4 suites  398 πŸ’€   4 files      0 ❌

Results for commit fca8e3e5.

:recycle: This comment has been updated with latest results.

github-actions[bot] avatar Jun 03 '25 16:06 github-actions[bot]

Test Results (amd64, MA/MR) - Integration, Bootstrap

β€‡β€ˆβ€‡β€‡5 filesβ€„β€ƒβ€‡β€ˆβ€‡β€‡5 suites   2h 23m 3s ⏱️ 5β€ˆ230 tests 4β€ˆ301 βœ…β€ƒ929 πŸ’€β€ƒ0 ❌ 5β€ˆ236 runsβ€Šβ€ƒ4β€ˆ301 βœ…β€ƒ935 πŸ’€β€ƒ0 ❌

Results for commit fca8e3e5.

:recycle: This comment has been updated with latest results.

github-actions[bot] avatar Jun 03 '25 16:06 github-actions[bot]