DataDog
chore(llmobs): skip flaky forking test until tests are rewritten
Description
I believe the forking tests for the llmobs service tests are causing timeouts in the CI in this repo, and should be subprocess tests. Should be a simple fix, but until someone from our team has time, I'll just skip them for now. I have created a follow-up ticket for this: https://datadoghq.atlassian.net/browse/MLOB-4843 to hold us accountable
CODEOWNERS have been resolved as:
tests/llmobs/test_llmobs_service.py @DataDog/ml-observability
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
Bootstrap import analysis
Comparison of import times between this PR and base.
Summary
The average import time from this PR is: 251 ± 2 ms.
The average import time from base is: 254 ± 3 ms.
The import time difference between this PR and base is: -3.4 ± 0.1 ms.
Import time breakdown
The following import paths have shrunk:
ddtrace.auto
2.710 ms
(1.08%)
ddtrace
1.364 ms
(0.54%)
ddtrace._logger
0.678 ms
(0.27%)
ddtrace.internal.telemetry
0.678 ms
(0.27%)
ddtrace.internal.telemetry.writer
0.678 ms
(0.27%)
ddtrace.internal.utils.version
0.678 ms
(0.27%)
ddtrace.version
0.678 ms
(0.27%)
ddtrace.internal._unpatched
0.029 ms
(0.01%)
json
0.029 ms
(0.01%)
json.decoder
0.029 ms
(0.01%)
re
0.029 ms
(0.01%)
enum
0.029 ms
(0.01%)
types
0.029 ms
(0.01%)
ddtrace.bootstrap.sitecustomize
1.346 ms
(0.54%)
ddtrace.bootstrap.preload
1.346 ms
(0.54%)
ddtrace.internal.remoteconfig.client
0.648 ms
(0.26%)
Performance SLOs
Comparing candidate sabrenner/skip-flaky-llmobs-tests-for-now (5c14fcaf) with baseline main (d2389080)
📈 Performance Regressions (2 suites)
📈 iastaspectsospath - 24/24
✅ ospathbasename_aspect
Time: ✅ 5.174µs (SLO: <10.000µs 📉 -48.3%) vs baseline: 📈 +26.0%
Memory: ✅ 40.108MB (SLO: <41.000MB -2.2%) vs baseline: +4.3%
✅ ospathbasename_noaspect
Time: ✅ 1.082µs (SLO: <10.000µs 📉 -89.2%) vs baseline: -1.4%
Memory: ✅ 40.128MB (SLO: <41.000MB -2.1%) vs baseline: +4.6%
✅ ospathjoin_aspect
Time: ✅ 6.173µs (SLO: <10.000µs 📉 -38.3%) vs baseline: +0.1%
Memory: ✅ 40.069MB (SLO: <41.000MB -2.3%) vs baseline: +4.1%
✅ ospathjoin_noaspect
Time: ✅ 2.284µs (SLO: <10.000µs 📉 -77.2%) vs baseline: -0.1%
Memory: ✅ 40.265MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +5.2%
✅ ospathnormcase_aspect
Time: ✅ 3.412µs (SLO: <10.000µs 📉 -65.9%) vs baseline: -0.2%
Memory: ✅ 40.167MB (SLO: <41.000MB -2.0%) vs baseline: +4.7%
✅ ospathnormcase_noaspect
Time: ✅ 0.568µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -0.2%
Memory: ✅ 40.265MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +5.3%
✅ ospathsplit_aspect
Time: ✅ 4.702µs (SLO: <10.000µs 📉 -53.0%) vs baseline: -0.7%
Memory: ✅ 40.246MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +4.8%
✅ ospathsplit_noaspect
Time: ✅ 1.581µs (SLO: <10.000µs 📉 -84.2%) vs baseline: -0.9%
Memory: ✅ 40.265MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +5.0%
✅ ospathsplitdrive_aspect
Time: ✅ 3.613µs (SLO: <10.000µs 📉 -63.9%) vs baseline: -1.7%
Memory: ✅ 40.442MB (SLO: <41.000MB 🟡 -1.4%) vs baseline: +5.2%
✅ ospathsplitdrive_noaspect
Time: ✅ 0.698µs (SLO: <10.000µs 📉 -93.0%) vs baseline: -0.1%
Memory: ✅ 40.128MB (SLO: <41.000MB -2.1%) vs baseline: +4.7%
✅ ospathsplitext_aspect
Time: ✅ 4.547µs (SLO: <10.000µs 📉 -54.5%) vs baseline: +1.1%
Memory: ✅ 40.147MB (SLO: <41.000MB -2.1%) vs baseline: +4.5%
✅ ospathsplitext_noaspect
Time: ✅ 1.385µs (SLO: <10.000µs 📉 -86.1%) vs baseline: +0.4%
Memory: ✅ 40.187MB (SLO: <41.000MB 🟡 -2.0%) vs baseline: +4.7%
📈 telemetryaddmetric - 30/30
✅ 1-count-metric-1-times
Time: ✅ 3.480µs (SLO: <20.000µs 📉 -82.6%) vs baseline: 📈 +16.8%
Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.2%
✅ 1-count-metrics-100-times
Time: ✅ 200.865µs (SLO: <220.000µs -8.7%) vs baseline: +0.1%
Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.5%
✅ 1-distribution-metric-1-times
Time: ✅ 3.378µs (SLO: <20.000µs 📉 -83.1%) vs baseline: -0.4%
Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.7%
✅ 1-distribution-metrics-100-times
Time: ✅ 217.651µs (SLO: <230.000µs -5.4%) vs baseline: -0.6%
Memory: ✅ 35.055MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +4.7%
✅ 1-gauge-metric-1-times
Time: ✅ 2.236µs (SLO: <20.000µs 📉 -88.8%) vs baseline: -1.0%
Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.6%
✅ 1-gauge-metrics-100-times
Time: ✅ 137.816µs (SLO: <150.000µs -8.1%) vs baseline: +0.6%
Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.2%
✅ 1-rate-metric-1-times
Time: ✅ 3.180µs (SLO: <20.000µs 📉 -84.1%) vs baseline: +0.8%
Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.2%
✅ 1-rate-metrics-100-times
Time: ✅ 213.667µs (SLO: <250.000µs 📉 -14.5%) vs baseline: -0.7%
Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.2%
✅ 100-count-metrics-100-times
Time: ✅ 20.498ms (SLO: <22.000ms -6.8%) vs baseline: +1.1%
Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.6%
✅ 100-distribution-metrics-100-times
Time: ✅ 2.310ms (SLO: <2.550ms -9.4%) vs baseline: +0.3%
Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.0%
✅ 100-gauge-metrics-100-times
Time: ✅ 1.418ms (SLO: <1.550ms -8.5%) vs baseline: +0.6%
Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.9%
✅ 100-rate-metrics-100-times
Time: ✅ 2.229ms (SLO: <2.550ms 📉 -12.6%) vs baseline: -0.5%
Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.7%
✅ flush-1-metric
Time: ✅ 4.689µs (SLO: <20.000µs 📉 -76.6%) vs baseline: +0.7%
Memory: ✅ 35.036MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +4.6%
✅ flush-100-metrics
Time: ✅ 174.354µs (SLO: <250.000µs 📉 -30.3%) vs baseline: ~same
Memory: ✅ 35.095MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.4%
✅ flush-1000-metrics
Time: ✅ 2.188ms (SLO: <2.500ms 📉 -12.5%) vs baseline: ~same
Memory: ✅ 35.960MB (SLO: <36.500MB 🟡 -1.5%) vs baseline: +4.8%
🟡 Near SLO Breach (18 suites)
🟡 coreapiscenario - 10/10 (1 unstable)
⚠️ context_with_data_listeners
Time: ⚠️ 13.213µs (SLO: <20.000µs 📉 -33.9%) vs baseline: +0.4%
Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +5.0%
✅ context_with_data_no_listeners
Time: ✅ 3.271µs (SLO: <10.000µs 📉 -67.3%) vs baseline: +1.4%
Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.6%
✅ get_item_exists
Time: ✅ 0.578µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.1%
Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.9%
✅ get_item_missing
Time: ✅ 0.633µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -0.8%
Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.5%
✅ set_item
Time: ✅ 24.060µs (SLO: <30.000µs 📉 -19.8%) vs baseline: +0.1%
Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +5.1%
🟡 djangosimple - 30/30
✅ appsec
Time: ✅ 19.558ms (SLO: <22.300ms 📉 -12.3%) vs baseline: +0.4%
Memory: ✅ 68.144MB (SLO: <70.500MB -3.3%) vs baseline: +4.8%
✅ exception-replay-enabled
Time: ✅ 1.363ms (SLO: <1.450ms -6.0%) vs baseline: -0.3%
Memory: ✅ 66.265MB (SLO: <67.500MB 🟡 -1.8%) vs baseline: +4.8%
✅ iast
Time: ✅ 19.585ms (SLO: <22.250ms 📉 -12.0%) vs baseline: +0.4%
Memory: ✅ 68.203MB (SLO: <70.000MB -2.6%) vs baseline: +4.9%
✅ profiler
Time: ✅ 15.397ms (SLO: <16.550ms -7.0%) vs baseline: +0.1%
Memory: ✅ 56.316MB (SLO: <57.500MB -2.1%) vs baseline: +4.8%
✅ resource-renaming
Time: ✅ 19.508ms (SLO: <21.750ms 📉 -10.3%) vs baseline: -0.2%
Memory: ✅ 68.213MB (SLO: <70.500MB -3.2%) vs baseline: +4.8%
✅ span-code-origin
Time: ✅ 19.936ms (SLO: <28.200ms 📉 -29.3%) vs baseline: +0.5%
Memory: ✅ 68.132MB (SLO: <71.000MB -4.0%) vs baseline: +4.8%
✅ tracer
Time: ✅ 19.606ms (SLO: <21.750ms -9.9%) vs baseline: +0.3%
Memory: ✅ 68.125MB (SLO: <70.000MB -2.7%) vs baseline: +4.7%
✅ tracer-and-profiler
Time: ✅ 21.741ms (SLO: <23.500ms -7.5%) vs baseline: ~same
Memory: ✅ 69.265MB (SLO: <71.000MB -2.4%) vs baseline: +4.8%
✅ tracer-dont-create-db-spans
Time: ✅ 19.622ms (SLO: <21.500ms -8.7%) vs baseline: -0.1%
Memory: ✅ 68.164MB (SLO: <70.000MB -2.6%) vs baseline: +4.8%
✅ tracer-minimal
Time: ✅ 16.753ms (SLO: <17.500ms -4.3%) vs baseline: -0.1%
Memory: ✅ 67.869MB (SLO: <70.000MB -3.0%) vs baseline: +4.8%
✅ tracer-native
Time: ✅ 19.560ms (SLO: <21.750ms 📉 -10.1%) vs baseline: +0.9%
Memory: ✅ 68.184MB (SLO: <72.500MB -6.0%) vs baseline: +4.8%
✅ tracer-no-caches
Time: ✅ 17.633ms (SLO: <19.650ms 📉 -10.3%) vs baseline: ~same
Memory: ✅ 67.849MB (SLO: <70.000MB -3.1%) vs baseline: +4.5%
✅ tracer-no-databases
Time: ✅ 19.061ms (SLO: <20.100ms -5.2%) vs baseline: +0.1%
Memory: ✅ 67.849MB (SLO: <70.000MB -3.1%) vs baseline: +4.9%
✅ tracer-no-middleware
Time: ✅ 19.327ms (SLO: <21.500ms 📉 -10.1%) vs baseline: +0.5%
Memory: ✅ 68.056MB (SLO: <70.000MB -2.8%) vs baseline: +4.8%
✅ tracer-no-templates
Time: ✅ 19.675ms (SLO: <22.000ms 📉 -10.6%) vs baseline: +1.4%
Memory: ✅ 68.243MB (SLO: <70.500MB -3.2%) vs baseline: +5.1%
🟡 errortrackingdjangosimple - 6/6
✅ errortracking-enabled-all
Time: ✅ 16.273ms (SLO: <19.850ms 📉 -18.0%) vs baseline: -0.1%
Memory: ✅ 69.874MB (SLO: <70.000MB 🟡 -0.2%) vs baseline: +5.0%
✅ errortracking-enabled-user
Time: ✅ 16.354ms (SLO: <19.400ms 📉 -15.7%) vs baseline: +0.4%
Memory: ✅ 69.874MB (SLO: <70.000MB 🟡 -0.2%) vs baseline: +5.0%
✅ tracer-enabled
Time: ✅ 16.339ms (SLO: <19.450ms 📉 -16.0%) vs baseline: ~same
Memory: ✅ 69.835MB (SLO: <70.000MB 🟡 -0.2%) vs baseline: +4.8%
🟡 errortrackingflasksqli - 6/6
✅ errortracking-enabled-all
Time: ✅ 2.067ms (SLO: <2.300ms 📉 -10.1%) vs baseline: ~same
Memory: ✅ 55.758MB (SLO: <56.500MB 🟡 -1.3%) vs baseline: +4.9%
✅ errortracking-enabled-user
Time: ✅ 2.072ms (SLO: <2.250ms -7.9%) vs baseline: ~same
Memory: ✅ 55.738MB (SLO: <56.500MB 🟡 -1.3%) vs baseline: +4.8%
✅ tracer-enabled
Time: ✅ 2.063ms (SLO: <2.300ms 📉 -10.3%) vs baseline: ~same
Memory: ✅ 55.719MB (SLO: <56.500MB 🟡 -1.4%) vs baseline: +4.8%
🟡 flasksimple - 18/18
✅ appsec-get
Time: ✅ 3.366ms (SLO: <4.750ms 📉 -29.1%) vs baseline: -0.3%
Memory: ✅ 55.389MB (SLO: <66.500MB 📉 -16.7%) vs baseline: +4.8%
✅ appsec-post
Time: ✅ 2.856ms (SLO: <6.750ms 📉 -57.7%) vs baseline: ~same
Memory: ✅ 55.723MB (SLO: <66.500MB 📉 -16.2%) vs baseline: +4.9%
✅ appsec-telemetry
Time: ✅ 3.403ms (SLO: <4.750ms 📉 -28.4%) vs baseline: +1.0%
Memory: ✅ 55.430MB (SLO: <66.500MB 📉 -16.6%) vs baseline: +4.9%
✅ debugger
Time: ✅ 1.869ms (SLO: <2.000ms -6.6%) vs baseline: +0.2%
Memory: ✅ 47.976MB (SLO: <49.500MB -3.1%) vs baseline: +5.0%
✅ iast-get
Time: ✅ 1.857ms (SLO: <2.000ms -7.1%) vs baseline: ~same
Memory: ✅ 44.536MB (SLO: <49.000MB -9.1%) vs baseline: +4.7%
✅ profiler
Time: ✅ 1.907ms (SLO: <2.100ms -9.2%) vs baseline: -0.3%
Memory: ✅ 48.743MB (SLO: <50.000MB -2.5%) vs baseline: +4.8%
✅ resource-renaming
Time: ✅ 3.344ms (SLO: <3.650ms -8.4%) vs baseline: -0.4%
Memory: ✅ 55.408MB (SLO: <56.000MB 🟡 -1.1%) vs baseline: +4.7%
✅ tracer
Time: ✅ 3.372ms (SLO: <3.650ms -7.6%) vs baseline: +0.1%
Memory: ✅ 55.410MB (SLO: <56.500MB 🟡 -1.9%) vs baseline: +4.8%
✅ tracer-native
Time: ✅ 3.373ms (SLO: <3.650ms -7.6%) vs baseline: +0.2%
Memory: ✅ 55.449MB (SLO: <60.000MB -7.6%) vs baseline: +4.7%
🟡 flasksqli - 6/6
✅ appsec-enabled
Time: ✅ 2.060ms (SLO: <4.200ms 📉 -51.0%) vs baseline: ~same
Memory: ✅ 55.719MB (SLO: <66.000MB 📉 -15.6%) vs baseline: +4.7%
✅ iast-enabled
Time: ✅ 2.067ms (SLO: <2.800ms 📉 -26.2%) vs baseline: +0.1%
Memory: ✅ 55.797MB (SLO: <62.500MB 📉 -10.7%) vs baseline: +4.9%
✅ tracer-enabled
Time: ✅ 2.054ms (SLO: <2.250ms -8.7%) vs baseline: ~same
Memory: ✅ 55.797MB (SLO: <56.500MB 🟡 -1.2%) vs baseline: +4.9%
🟡 httppropagationextract - 60/60
✅ all_styles_all_headers
Time: ✅ 81.562µs (SLO: <100.000µs 📉 -18.4%) vs baseline: ~same
Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.7%
✅ b3_headers
Time: ✅ 14.234µs (SLO: <20.000µs 📉 -28.8%) vs baseline: +0.6%
Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.9%
✅ b3_single_headers
Time: ✅ 13.391µs (SLO: <20.000µs 📉 -33.0%) vs baseline: +0.7%
Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.4%
✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match
Time: ✅ 64.508µs (SLO: <80.000µs 📉 -19.4%) vs baseline: +0.8%
Memory: ✅ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +4.4%
✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match
Time: ✅ 66.462µs (SLO: <80.000µs 📉 -16.9%) vs baseline: +0.5%
Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.8%
✅ empty_headers
Time: ✅ 1.622µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.7%
Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%
✅ full_t_id_datadog_headers
Time: ✅ 22.647µs (SLO: <30.000µs 📉 -24.5%) vs baseline: +1.0%
Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.9%
✅ invalid_priority_header
Time: ✅ 6.491µs (SLO: <10.000µs 📉 -35.1%) vs baseline: -0.9%
Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.2%
✅ invalid_span_id_header
Time: ✅ 6.514µs (SLO: <10.000µs 📉 -34.9%) vs baseline: -0.4%
Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.2%
✅ invalid_tags_header
Time: ✅ 6.545µs (SLO: <10.000µs 📉 -34.5%) vs baseline: +0.6%
Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.7%
✅ invalid_trace_id_header
Time: ✅ 6.509µs (SLO: <10.000µs 📉 -34.9%) vs baseline: ~same
Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%
✅ large_header_no_matches
Time: ✅ 27.579µs (SLO: <30.000µs -8.1%) vs baseline: -0.3%
Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%
✅ large_valid_headers_all
Time: ✅ 28.766µs (SLO: <40.000µs 📉 -28.1%) vs baseline: -0.2%
Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.4%
✅ medium_header_no_matches
Time: ✅ 9.859µs (SLO: <20.000µs 📉 -50.7%) vs baseline: ~same
Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.4%
✅ medium_valid_headers_all
Time: ✅ 11.458µs (SLO: <20.000µs 📉 -42.7%) vs baseline: -0.4%
Memory: ✅ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +4.3%
✅ none_propagation_style
Time: ✅ 1.726µs (SLO: <10.000µs 📉 -82.7%) vs baseline: +0.3%
Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%
✅ tracecontext_headers
Time: ✅ 34.986µs (SLO: <40.000µs 📉 -12.5%) vs baseline: ~same
Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.1%
✅ valid_headers_all
Time: ✅ 6.513µs (SLO: <10.000µs 📉 -34.9%) vs baseline: -0.1%
Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.6%
✅ valid_headers_basic
Time: ✅ 6.097µs (SLO: <10.000µs 📉 -39.0%) vs baseline: -0.1%
Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.3%
✅ wsgi_empty_headers
Time: ✅ 1.600µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.9%
Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%
✅ wsgi_invalid_priority_header
Time: ✅ 6.553µs (SLO: <10.000µs 📉 -34.5%) vs baseline: -0.4%
Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.0%
✅ wsgi_invalid_span_id_header
Time: ✅ 1.610µs (SLO: <10.000µs 📉 -83.9%) vs baseline: -0.5%
Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.9%
✅ wsgi_invalid_tags_header
Time: ✅ 6.552µs (SLO: <10.000µs 📉 -34.5%) vs baseline: -0.6%
Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.7%
✅ wsgi_invalid_trace_id_header
Time: ✅ 6.651µs (SLO: <10.000µs 📉 -33.5%) vs baseline: +1.3%
Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.4%
✅ wsgi_large_header_no_matches
Time: ✅ 28.718µs (SLO: <40.000µs 📉 -28.2%) vs baseline: +0.2%
Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.7%
✅ wsgi_large_valid_headers_all
Time: ✅ 29.916µs (SLO: <40.000µs 📉 -25.2%) vs baseline: +0.3%
Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%
✅ wsgi_medium_header_no_matches
Time: ✅ 10.173µs (SLO: <20.000µs 📉 -49.1%) vs baseline: +0.9%
Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.7%
✅ wsgi_medium_valid_headers_all
Time: ✅ 11.563µs (SLO: <20.000µs 📉 -42.2%) vs baseline: +0.1%
Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.6%
✅ wsgi_valid_headers_all
Time: ✅ 6.559µs (SLO: <10.000µs 📉 -34.4%) vs baseline: -0.5%
Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.6%
✅ wsgi_valid_headers_basic
Time: ✅ 6.103µs (SLO: <10.000µs 📉 -39.0%) vs baseline: +0.2%
Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.3%
🟡 httppropagationinject - 16/16
✅ ids_only
Time: ✅ 21.996µs (SLO: <30.000µs 📉 -26.7%) vs baseline: +4.0%
Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.3%
✅ with_all
Time: ✅ 27.738µs (SLO: <40.000µs 📉 -30.7%) vs baseline: -0.6%
Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.7%
✅ with_dd_origin
Time: ✅ 25.047µs (SLO: <30.000µs 📉 -16.5%) vs baseline: +0.7%
Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%
✅ with_priority_and_origin
Time: ✅ 24.500µs (SLO: <40.000µs 📉 -38.7%) vs baseline: +0.1%
Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%
✅ with_sampling_priority
Time: ✅ 21.165µs (SLO: <30.000µs 📉 -29.5%) vs baseline: -0.2%
Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.7%
✅ with_tags
Time: ✅ 26.055µs (SLO: <40.000µs 📉 -34.9%) vs baseline: ~same
Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%
✅ with_tags_invalid
Time: ✅ 27.491µs (SLO: <40.000µs 📉 -31.3%) vs baseline: -0.1%
Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.2%
✅ with_tags_max_size
Time: ✅ 26.368µs (SLO: <40.000µs 📉 -34.1%) vs baseline: -0.5%
Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%
🟡 iast_aspects - 40/40
✅ re_expand_aspect
Time: ✅ 34.001µs (SLO: <40.000µs 📉 -15.0%) vs baseline: +6.7%
Memory: ✅ 40.206MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.9%
✅ re_expand_noaspect
Time: ✅ 28.284µs (SLO: <40.000µs 📉 -29.3%) vs baseline: -0.7%
Memory: ✅ 40.226MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.8%
✅ re_findall_aspect
Time: ✅ 2.917µs (SLO: <10.000µs 📉 -70.8%) vs baseline: ~same
Memory: ✅ 40.285MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +4.9%
✅ re_findall_noaspect
Time: ✅ 1.411µs (SLO: <10.000µs 📉 -85.9%) vs baseline: -0.1%
Memory: ✅ 40.265MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +5.0%
✅ re_finditer_aspect
Time: ✅ 4.425µs (SLO: <10.000µs 📉 -55.8%) vs baseline: -0.8%
Memory: ✅ 40.265MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +5.1%
✅ re_finditer_noaspect
Time: ✅ 1.387µs (SLO: <10.000µs 📉 -86.1%) vs baseline: -1.5%
Memory: ✅ 40.246MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +4.7%
✅ re_fullmatch_aspect
Time: ✅ 2.702µs (SLO: <10.000µs 📉 -73.0%) vs baseline: +0.2%
Memory: ✅ 40.128MB (SLO: <41.000MB -2.1%) vs baseline: +4.3%
✅ re_fullmatch_noaspect
Time: ✅ 1.332µs (SLO: <10.000µs 📉 -86.7%) vs baseline: -2.4%
Memory: ✅ 40.226MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +5.1%
✅ re_group_aspect
Time: ✅ 3.007µs (SLO: <10.000µs 📉 -69.9%) vs baseline: ~same
Memory: ✅ 40.226MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.9%
✅ re_group_noaspect
Time: ✅ 1.638µs (SLO: <10.000µs 📉 -83.6%) vs baseline: ~same
Memory: ✅ 40.285MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +5.0%
✅ re_groups_aspect
Time: ✅ 3.164µs (SLO: <10.000µs 📉 -68.4%) vs baseline: +2.0%
Memory: ✅ 40.226MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.9%
✅ re_groups_noaspect
Time: ✅ 1.737µs (SLO: <10.000µs 📉 -82.6%) vs baseline: +1.6%
Memory: ✅ 40.167MB (SLO: <41.000MB -2.0%) vs baseline: +4.6%
✅ re_match_aspect
Time: ✅ 2.763µs (SLO: <10.000µs 📉 -72.4%) vs baseline: +1.7%
Memory: ✅ 40.226MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.9%
✅ re_match_noaspect
Time: ✅ 1.318µs (SLO: <10.000µs 📉 -86.8%) vs baseline: -1.3%
Memory: ✅ 40.226MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.9%
✅ re_search_aspect
Time: ✅ 2.565µs (SLO: <10.000µs 📉 -74.4%) vs baseline: -1.0%
Memory: ✅ 40.187MB (SLO: <41.000MB 🟡 -2.0%) vs baseline: +5.0%
✅ re_search_noaspect
Time: ✅ 1.199µs (SLO: <10.000µs 📉 -88.0%) vs baseline: -0.5%
Memory: ✅ 40.206MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.6%
✅ re_sub_aspect
Time: ✅ 3.500µs (SLO: <10.000µs 📉 -65.0%) vs baseline: +1.8%
Memory: ✅ 40.187MB (SLO: <41.000MB 🟡 -2.0%) vs baseline: +4.6%
✅ re_sub_noaspect
Time: ✅ 1.533µs (SLO: <10.000µs 📉 -84.7%) vs baseline: +0.2%
Memory: ✅ 40.285MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +4.9%
✅ re_subn_aspect
Time: ✅ 3.663µs (SLO: <10.000µs 📉 -63.4%) vs baseline: -0.7%
Memory: ✅ 40.088MB (SLO: <41.000MB -2.2%) vs baseline: +4.2%
✅ re_subn_noaspect
Time: ✅ 1.592µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.9%
Memory: ✅ 40.147MB (SLO: <41.000MB -2.1%) vs baseline: +4.9%
🟡 iastaspectssplit - 12/12
✅ rsplit_aspect
Time: ✅ 1.542µs (SLO: <10.000µs 📉 -84.6%) vs baseline: +6.4%
Memory: ✅ 40.265MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +4.7%
✅ rsplit_noaspect
Time: ✅ 0.572µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -0.7%
Memory: ✅ 40.167MB (SLO: <41.000MB -2.0%) vs baseline: +4.7%
✅ split_aspect
Time: ✅ 1.425µs (SLO: <10.000µs 📉 -85.7%) vs baseline: -0.1%
Memory: ✅ 40.128MB (SLO: <41.000MB -2.1%) vs baseline: +4.8%
✅ split_noaspect
Time: ✅ 0.569µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +0.1%
Memory: ✅ 40.088MB (SLO: <41.000MB -2.2%) vs baseline: +4.6%
✅ splitlines_aspect
Time: ✅ 1.406µs (SLO: <10.000µs 📉 -85.9%) vs baseline: -0.3%
Memory: ✅ 40.285MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +5.3%
✅ splitlines_noaspect
Time: ✅ 0.585µs (SLO: <10.000µs 📉 -94.1%) vs baseline: ~same
Memory: ✅ 40.226MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +5.1%
🟡 otelsdkspan - 24/24
✅ add-event
Time: ✅ 40.482ms (SLO: <42.000ms -3.6%) vs baseline: +0.5%
Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.1%
✅ add-link
Time: ✅ 36.257ms (SLO: <38.550ms -5.9%) vs baseline: ~same
Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%
✅ add-metrics
Time: ✅ 220.524ms (SLO: <232.000ms -4.9%) vs baseline: +1.0%
Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +4.7%
✅ add-tags
Time: ✅ 210.988ms (SLO: <221.600ms -4.8%) vs baseline: -0.2%
Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +4.5%
✅ get-context
Time: ✅ 29.208ms (SLO: <31.300ms -6.7%) vs baseline: -0.6%
Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%
✅ is-recording
Time: ✅ 29.270ms (SLO: <31.000ms -5.6%) vs baseline: +0.2%
Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%
✅ record-exception
Time: ✅ 63.136ms (SLO: <65.850ms -4.1%) vs baseline: -0.2%
Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +5.1%
✅ set-status
Time: ✅ 31.909ms (SLO: <34.150ms -6.6%) vs baseline: -0.8%
Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.5%
✅ start
Time: ✅ 29.558ms (SLO: <30.150ms 🟡 -2.0%) vs baseline: +2.8%
Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.8%
✅ start-finish
Time: ✅ 34.071ms (SLO: <35.350ms -3.6%) vs baseline: +0.8%
Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.4%
✅ start-finish-telemetry
Time: ✅ 34.067ms (SLO: <35.450ms -3.9%) vs baseline: -0.4%
Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +4.8%
✅ update-name
Time: ✅ 31.414ms (SLO: <33.400ms -5.9%) vs baseline: +0.7%
Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%
🟡 otelspan - 22/22
✅ add-event
Time: ✅ 40.226ms (SLO: <47.150ms 📉 -14.7%) vs baseline: ~same
Memory: ✅ 39.496MB (SLO: <47.000MB 📉 -16.0%) vs baseline: +4.9%
✅ add-metrics
Time: ✅ 261.199ms (SLO: <344.800ms 📉 -24.2%) vs baseline: -0.3%
Memory: ✅ 43.848MB (SLO: <47.500MB -7.7%) vs baseline: +4.9%
✅ add-tags
Time: ✅ 317.697ms (SLO: <321.000ms 🟡 -1.0%) vs baseline: -0.2%
Memory: ✅ 43.693MB (SLO: <47.500MB -8.0%) vs baseline: +4.8%
✅ get-context
Time: ✅ 80.406ms (SLO: <92.350ms 📉 -12.9%) vs baseline: ~same
Memory: ✅ 39.934MB (SLO: <46.500MB 📉 -14.1%) vs baseline: +4.8%
✅ is-recording
Time: ✅ 37.981ms (SLO: <44.500ms 📉 -14.6%) vs baseline: ~same
Memory: ✅ 39.519MB (SLO: <47.500MB 📉 -16.8%) vs baseline: +4.6%
✅ record-exception
Time: ✅ 58.956ms (SLO: <67.650ms 📉 -12.9%) vs baseline: ~same
Memory: ✅ 40.083MB (SLO: <47.000MB 📉 -14.7%) vs baseline: +5.1%
✅ set-status
Time: ✅ 44.308ms (SLO: <50.400ms 📉 -12.1%) vs baseline: +0.3%
Memory: ✅ 39.404MB (SLO: <47.000MB 📉 -16.2%) vs baseline: +5.0%
✅ start
Time: ✅ 38.035ms (SLO: <43.450ms 📉 -12.5%) vs baseline: +2.1%
Memory: ✅ 39.591MB (SLO: <47.000MB 📉 -15.8%) vs baseline: +5.1%
✅ start-finish
Time: ✅ 82.681ms (SLO: <88.000ms -6.0%) vs baseline: +0.5%
Memory: ✅ 37.297MB (SLO: <46.500MB 📉 -19.8%) vs baseline: +4.9%
✅ start-finish-telemetry
Time: ✅ 84.301ms (SLO: <89.000ms -5.3%) vs baseline: +0.2%
Memory: ✅ 37.356MB (SLO: <46.500MB 📉 -19.7%) vs baseline: +4.7%
✅ update-name
Time: ✅ 38.648ms (SLO: <45.150ms 📉 -14.4%) vs baseline: -0.1%
Memory: ✅ 39.672MB (SLO: <47.000MB 📉 -15.6%) vs baseline: +4.8%
🟡 packagespackageforrootmodulemapping - 4/4
✅ cache_off
Time: ✅ 339.374ms (SLO: <354.300ms -4.2%) vs baseline: -1.0%
Memory: ✅ 41.011MB (SLO: <41.500MB 🟡 -1.2%) vs baseline: +4.6%
✅ cache_on
Time: ✅ 0.381µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.2%
Memory: ✅ 39.312MB (SLO: <41.000MB -4.1%) vs baseline: +5.1%
🟡 ratelimiter - 12/12
✅ defaults
Time: ✅ 2.347µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -0.6%
Memory: ✅ 35.134MB (SLO: <35.500MB 🟡 -1.0%) vs baseline: +5.3%
✅ high_rate_limit
Time: ✅ 2.427µs (SLO: <10.000µs 📉 -75.7%) vs baseline: -0.4%
Memory: ✅ 35.095MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.6%
✅ long_window
Time: ✅ 2.352µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -1.1%
Memory: ✅ 35.036MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +4.6%
✅ low_rate_limit
Time: ✅ 2.347µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -0.7%
Memory: ✅ 35.095MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +5.0%
✅ no_rate_limit
Time: ✅ 0.828µs (SLO: <10.000µs 📉 -91.7%) vs baseline: -0.2%
Memory: ✅ 35.114MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +5.0%
✅ short_window
Time: ✅ 2.491µs (SLO: <10.000µs 📉 -75.1%) vs baseline: -0.8%
Memory: ✅ 35.075MB (SLO: <35.500MB 🟡 -1.2%) vs baseline: +4.6%
🟡 recursivecomputation - 8/8
✅ deep
Time: ✅ 309.071ms (SLO: <320.950ms -3.7%) vs baseline: +0.2%
Memory: ✅ 35.920MB (SLO: <36.500MB 🟡 -1.6%) vs baseline: +4.8%
✅ deep-profiled
Time: ✅ 328.100ms (SLO: <359.150ms -8.6%) vs baseline: +0.2%
Memory: ✅ 39.774MB (SLO: <40.500MB 🟡 -1.8%) vs baseline: +4.9%
✅ medium
Time: ✅ 7.005ms (SLO: <7.400ms -5.3%) vs baseline: +0.1%
Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.9%
✅ shallow
Time: ✅ 0.951ms (SLO: <1.050ms -9.5%) vs baseline: +1.2%
Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.8%
🟡 sethttpmeta - 32/32
✅ all-disabled
Time: ✅ 10.545µs (SLO: <20.000µs 📉 -47.3%) vs baseline: +0.3%
Memory: ✅ 35.724MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +5.1%
✅ all-enabled
Time: ✅ 41.038µs (SLO: <50.000µs 📉 -17.9%) vs baseline: +2.6%
Memory: ✅ 35.409MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +4.1%
✅ collectipvariant_exists
Time: ✅ 40.759µs (SLO: <50.000µs 📉 -18.5%) vs baseline: ~same
Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +4.2%
✅ no-collectipvariant
Time: ✅ 40.092µs (SLO: <50.000µs 📉 -19.8%) vs baseline: ~same
Memory: ✅ 35.389MB (SLO: <36.000MB 🟡 -1.7%) vs baseline: +4.0%
✅ no-useragentvariant
Time: ✅ 38.824µs (SLO: <50.000µs 📉 -22.4%) vs baseline: ~same
Memory: ✅ 35.429MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +4.0%
✅ obfuscation-no-query
Time: ✅ 40.689µs (SLO: <50.000µs 📉 -18.6%) vs baseline: +0.5%
Memory: ✅ 35.409MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +4.0%
✅ obfuscation-regular-case-explicit-query
Time: ✅ 75.982µs (SLO: <90.000µs 📉 -15.6%) vs baseline: ~same
Memory: ✅ 35.802MB (SLO: <36.500MB 🟡 -1.9%) vs baseline: +5.4%
✅ obfuscation-regular-case-implicit-query
Time: ✅ 76.573µs (SLO: <90.000µs 📉 -14.9%) vs baseline: -0.4%
Memory: ✅ 35.625MB (SLO: <36.500MB -2.4%) vs baseline: +4.8%
✅ obfuscation-send-querystring-disabled
Time: ✅ 154.284µs (SLO: <170.000µs -9.2%) vs baseline: -0.1%
Memory: ✅ 35.625MB (SLO: <36.500MB -2.4%) vs baseline: +4.7%
✅ obfuscation-worst-case-explicit-query
Time: ✅ 148.589µs (SLO: <160.000µs -7.1%) vs baseline: -0.2%
Memory: ✅ 35.724MB (SLO: <36.500MB -2.1%) vs baseline: +5.1%
✅ obfuscation-worst-case-implicit-query
Time: ✅ 155.346µs (SLO: <170.000µs -8.6%) vs baseline: +0.3%
Memory: ✅ 35.724MB (SLO: <36.500MB -2.1%) vs baseline: +4.9%
✅ useragentvariant_exists_1
Time: ✅ 39.592µs (SLO: <50.000µs 📉 -20.8%) vs baseline: +0.3%
Memory: ✅ 35.330MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +3.9%
✅ useragentvariant_exists_2
Time: ✅ 40.536µs (SLO: <50.000µs 📉 -18.9%) vs baseline: +0.1%
Memory: ✅ 35.330MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +3.7%
✅ useragentvariant_exists_3
Time: ✅ 40.103µs (SLO: <50.000µs 📉 -19.8%) vs baseline: ~same
Memory: ✅ 35.311MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +3.7%
✅ useragentvariant_not_exists_1
Time: ✅ 39.557µs (SLO: <50.000µs 📉 -20.9%) vs baseline: +0.2%
Memory: ✅ 35.291MB (SLO: <36.000MB 🟡 -2.0%) vs baseline: +3.9%
✅ useragentvariant_not_exists_2
Time: ✅ 39.419µs (SLO: <50.000µs 📉 -21.2%) vs baseline: -0.4%
Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +4.2%
🟡 span - 26/26
✅ add-event
Time: ✅ 18.165ms (SLO: <22.500ms 📉 -19.3%) vs baseline: -0.3%
Memory: ✅ 36.817MB (SLO: <53.000MB 📉 -30.5%) vs baseline: +4.4%
✅ add-metrics
Time: ✅ 87.798ms (SLO: <93.500ms -6.1%) vs baseline: -0.9%
Memory: ✅ 41.052MB (SLO: <53.000MB 📉 -22.5%) vs baseline: +4.7%
✅ add-tags
Time: ✅ 141.818ms (SLO: <155.000ms -8.5%) vs baseline: -0.6%
Memory: ✅ 41.038MB (SLO: <53.000MB 📉 -22.6%) vs baseline: +4.5%
✅ get-context
Time: ✅ 17.027ms (SLO: <20.500ms 📉 -16.9%) vs baseline: ~same
Memory: ✅ 36.726MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +4.7%
✅ is-recording
Time: ✅ 17.083ms (SLO: <20.500ms 📉 -16.7%) vs baseline: -0.5%
Memory: ✅ 36.745MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +5.0%
✅ record-exception
Time: ✅ 36.836ms (SLO: <40.000ms -7.9%) vs baseline: +0.4%
Memory: ✅ 37.333MB (SLO: <53.000MB 📉 -29.6%) vs baseline: +4.7%
✅ set-status
Time: ✅ 18.720ms (SLO: <22.000ms 📉 -14.9%) vs baseline: -0.3%
Memory: ✅ 36.781MB (SLO: <53.000MB 📉 -30.6%) vs baseline: +5.0%
✅ start
Time: ✅ 17.372ms (SLO: <20.500ms 📉 -15.3%) vs baseline: +3.2%
Memory: ✅ 36.723MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +4.7%
✅ start-finish
Time: ✅ 51.012ms (SLO: <52.500ms -2.8%) vs baseline: +0.2%
Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.7%
✅ start-finish-telemetry
Time: ✅ 52.445ms (SLO: <54.500ms -3.8%) vs baseline: +0.2%
Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +5.0%
✅ start-finish-traceid128
Time: ✅ 54.164ms (SLO: <57.000ms -5.0%) vs baseline: +0.1%
Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%
✅ start-traceid128
Time: ✅ 17.370ms (SLO: <22.500ms 📉 -22.8%) vs baseline: +0.9%
Memory: ✅ 36.703MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +4.9%
✅ update-name
Time: ✅ 17.374ms (SLO: <22.000ms 📉 -21.0%) vs baseline: -0.1%
Memory: ✅ 36.770MB (SLO: <53.000MB 📉 -30.6%) vs baseline: +4.5%
🟡 tracer - 6/6
✅ large
Time: ✅ 29.263ms (SLO: <32.950ms 📉 -11.2%) vs baseline: +0.3%
Memory: ✅ 35.940MB (SLO: <36.500MB 🟡 -1.5%) vs baseline: +4.9%
✅ medium
Time: ✅ 2.892ms (SLO: <3.200ms -9.6%) vs baseline: -0.1%
Memory: ✅ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +4.8%
✅ small
Time: ✅ 330.984µs (SLO: <370.000µs 📉 -10.5%) vs baseline: +1.5%
Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.3%
⚠️ Unstable Tests (1 suite)
⚠️ packagesupdateimporteddependencies - 24/24 (1 unstable)
✅ import_many
Time: ✅ 155.063µs (SLO: <170.000µs -8.8%) vs baseline: -0.3%
Memory: ✅ 39.404MB (SLO: <41.000MB -3.9%) vs baseline: +4.2%
✅ import_many_cached
Time: ✅ 120.683µs (SLO: <130.000µs -7.2%) vs baseline: -0.5%
Memory: ✅ 39.630MB (SLO: <41.000MB -3.3%) vs baseline: +4.6%
✅ import_many_stdlib
Time: ✅ 0.750ms (SLO: <1.750ms 📉 -57.1%) vs baseline: -0.2%
Memory: ✅ 39.483MB (SLO: <41.000MB -3.7%) vs baseline: +3.8%
⚠️ import_many_stdlib_cached
Time: ⚠️ 0.171ms (SLO: <1.100ms 📉 -84.4%) vs baseline: ~same
Memory: ✅ 39.597MB (SLO: <41.000MB -3.4%) vs baseline: +4.9%
✅ import_many_unknown
Time: ✅ 830.530µs (SLO: <890.000µs -6.7%) vs baseline: -0.6%
Memory: ✅ 39.916MB (SLO: <41.000MB -2.6%) vs baseline: +5.3%
✅ import_many_unknown_cached
Time: ✅ 792.873µs (SLO: <870.000µs -8.9%) vs baseline: -0.4%
Memory: ✅ 39.756MB (SLO: <41.000MB -3.0%) vs baseline: +5.1%
✅ import_one
Time: ✅ 19.675µs (SLO: <30.000µs 📉 -34.4%) vs baseline: +0.5%
Memory: ✅ 39.600MB (SLO: <41.000MB -3.4%) vs baseline: +4.4%
✅ import_one_cache
Time: ✅ 6.270µs (SLO: <10.000µs 📉 -37.3%) vs baseline: -0.7%
Memory: ✅ 39.700MB (SLO: <41.000MB -3.2%) vs baseline: +4.7%
✅ import_one_stdlib
Time: ✅ 18.511µs (SLO: <20.000µs -7.4%) vs baseline: -0.2%
Memory: ✅ 39.755MB (SLO: <41.000MB -3.0%) vs baseline: +4.5%
✅ import_one_stdlib_cache
Time: ✅ 6.268µs (SLO: <10.000µs 📉 -37.3%) vs baseline: -0.8%
Memory: ✅ 39.676MB (SLO: <41.000MB -3.2%) vs baseline: +5.0%
✅ import_one_unknown
Time: ✅ 45.267µs (SLO: <50.000µs -9.5%) vs baseline: ~same
Memory: ✅ 39.934MB (SLO: <41.000MB -2.6%) vs baseline: +5.5%
✅ import_one_unknown_cache
Time: ✅ 6.268µs (SLO: <10.000µs 📉 -37.3%) vs baseline: -0.8%
Memory: ✅ 39.820MB (SLO: <41.000MB -2.9%) vs baseline: +4.9%
✅ All Tests Passing (3 suites)
✅ iastaspects - 118/118
✅ add_aspect
Time: ✅ 0.401µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -1.6%
Memory: ✅ 40.108MB (SLO: <41.500MB -3.4%) vs baseline: +4.7%
✅ add_inplace_aspect
Time: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.1%
Memory: ✅ 40.195MB (SLO: <41.500MB -3.1%) vs baseline: +4.4%
✅ add_inplace_noaspect
Time: ✅ 0.322µs (SLO: <10.000µs 📉 -96.8%) vs baseline: +1.6%
Memory: ✅ 40.040MB (SLO: <41.500MB -3.5%) vs baseline: +3.5%
✅ add_noaspect
Time: ✅ 0.280µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.6%
Memory: ✅ 40.178MB (SLO: <41.500MB -3.2%) vs baseline: +4.6%
✅ bytearray_aspect
Time: ✅ 1.358µs (SLO: <10.000µs 📉 -86.4%) vs baseline: +1.1%
Memory: ✅ 40.144MB (SLO: <41.500MB -3.3%) vs baseline: +4.1%
✅ bytearray_extend_aspect
Time: ✅ 1.503µs (SLO: <10.000µs 📉 -85.0%) vs baseline: -0.3%
Memory: ✅ 40.202MB (SLO: <41.500MB -3.1%) vs baseline: +3.9%
✅ bytearray_extend_noaspect
Time: ✅ 0.616µs (SLO: <10.000µs 📉 -93.8%) vs baseline: +0.1%
Memory: ✅ 40.178MB (SLO: <41.500MB -3.2%) vs baseline: +4.8%
✅ bytearray_noaspect
Time: ✅ 0.479µs (SLO: <10.000µs 📉 -95.2%) vs baseline: ~same
Memory: ✅ 40.199MB (SLO: <41.500MB -3.1%) vs baseline: +4.3%
✅ bytes_aspect
Time: ✅ 1.285µs (SLO: <10.000µs 📉 -87.1%) vs baseline: +0.2%
Memory: ✅ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +4.6%
✅ bytes_noaspect
Time: ✅ 0.491µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.6%
Memory: ✅ 40.284MB (SLO: <41.500MB -2.9%) vs baseline: +5.2%
✅ bytesio_aspect
Time: ✅ 1.347µs (SLO: <10.000µs 📉 -86.5%) vs baseline: +1.6%
Memory: ✅ 40.163MB (SLO: <41.500MB -3.2%) vs baseline: +4.4%
✅ bytesio_noaspect
Time: ✅ 0.497µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.8%
Memory: ✅ 40.243MB (SLO: <41.500MB -3.0%) vs baseline: +4.9%
✅ capitalize_aspect
Time: ✅ 0.740µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.6%
Memory: ✅ 40.177MB (SLO: <41.500MB -3.2%) vs baseline: +4.8%
✅ capitalize_noaspect
Time: ✅ 0.434µs (SLO: <10.000µs 📉 -95.7%) vs baseline: -0.1%
Memory: ✅ 40.119MB (SLO: <41.500MB -3.3%) vs baseline: +4.2%
✅ casefold_aspect
Time: ✅ 0.734µs (SLO: <10.000µs 📉 -92.7%) vs baseline: ~same
Memory: ✅ 40.142MB (SLO: <41.500MB -3.3%) vs baseline: +4.1%
✅ casefold_noaspect
Time: ✅ 0.365µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -0.9%
Memory: ✅ 40.088MB (SLO: <41.500MB -3.4%) vs baseline: +4.4%
✅ decode_aspect
Time: ✅ 0.725µs (SLO: <10.000µs 📉 -92.8%) vs baseline: +0.1%
Memory: ✅ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +5.0%
✅ decode_noaspect
Time: ✅ 0.415µs (SLO: <10.000µs 📉 -95.8%) vs baseline: -1.9%
Memory: ✅ 40.221MB (SLO: <41.500MB -3.1%) vs baseline: +4.4%
✅ encode_aspect
Time: ✅ 0.704µs (SLO: <10.000µs 📉 -93.0%) vs baseline: -0.1%
Memory: ✅ 40.482MB (SLO: <41.500MB -2.5%) vs baseline: +5.8%
✅ encode_noaspect
Time: ✅ 0.401µs (SLO: <10.000µs 📉 -96.0%) vs baseline: +0.7%
Memory: ✅ 40.302MB (SLO: <41.500MB -2.9%) vs baseline: +4.6%
✅ format_aspect
Time: ✅ 3.435µs (SLO: <10.000µs 📉 -65.6%) vs baseline: -1.1%
Memory: ✅ 40.321MB (SLO: <41.500MB -2.8%) vs baseline: +5.0%
✅ format_map_aspect
Time: ✅ 3.533µs (SLO: <10.000µs 📉 -64.7%) vs baseline: -1.0%
Memory: ✅ 40.082MB (SLO: <41.500MB -3.4%) vs baseline: +4.6%
✅ format_map_noaspect
Time: ✅ 0.772µs (SLO: <10.000µs 📉 -92.3%) vs baseline: -0.3%
Memory: ✅ 40.080MB (SLO: <41.500MB -3.4%) vs baseline: +4.2%
✅ format_noaspect
Time: ✅ 0.591µs (SLO: <10.000µs 📉 -94.1%) vs baseline: -0.6%
Memory: ✅ 40.223MB (SLO: <41.500MB -3.1%) vs baseline: +4.8%
✅ index_aspect
Time: ✅ 0.357µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -0.7%
Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.9%
✅ index_noaspect
Time: ✅ 0.278µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.3%
Memory: ✅ 40.144MB (SLO: <41.500MB -3.3%) vs baseline: +4.5%
✅ join_aspect
Time: ✅ 1.343µs (SLO: <10.000µs 📉 -86.6%) vs baseline: +1.8%
Memory: ✅ 40.324MB (SLO: <41.500MB -2.8%) vs baseline: +5.2%
✅ join_noaspect
Time: ✅ 0.491µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.2%
Memory: ✅ 40.177MB (SLO: <41.500MB -3.2%) vs baseline: +4.6%
✅ ljust_aspect
Time: ✅ 2.625µs (SLO: <20.000µs 📉 -86.9%) vs baseline: +2.3%
Memory: ✅ 40.195MB (SLO: <41.500MB -3.1%) vs baseline: +4.1%
✅ ljust_noaspect
Time: ✅ 0.401µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.3%
Memory: ✅ 40.146MB (SLO: <41.500MB -3.3%) vs baseline: +4.6%
✅ lower_aspect
Time: ✅ 2.318µs (SLO: <10.000µs 📉 -76.8%) vs baseline: +3.7%
Memory: ✅ 40.215MB (SLO: <41.500MB -3.1%) vs baseline: +4.4%
✅ lower_noaspect
Time: ✅ 0.368µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -1.1%
Memory: ✅ 40.243MB (SLO: <41.500MB -3.0%) vs baseline: +5.0%
✅ lstrip_aspect
Time: ✅ 2.273µs (SLO: <20.000µs 📉 -88.6%) vs baseline: +0.9%
Memory: ✅ 40.123MB (SLO: <41.500MB -3.3%) vs baseline: +4.5%
✅ lstrip_noaspect
Time: ✅ 0.386µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +2.3%
Memory: ✅ 40.182MB (SLO: <41.500MB -3.2%) vs baseline: +4.9%
✅ modulo_aspect
Time: ✅ 1.053µs (SLO: <10.000µs 📉 -89.5%) vs baseline: +4.9%
Memory: ✅ 40.128MB (SLO: <41.500MB -3.3%) vs baseline: +4.6%
✅ modulo_aspect_for_bytearray_bytearray
Time: ✅ 1.543µs (SLO: <10.000µs 📉 -84.6%) vs baseline: -1.0%
Memory: ✅ 40.183MB (SLO: <41.500MB -3.2%) vs baseline: +4.5%
✅ modulo_aspect_for_bytes
Time: ✅ 0.974µs (SLO: <10.000µs 📉 -90.3%) vs baseline: -0.5%
Memory: ✅ 40.163MB (SLO: <41.500MB -3.2%) vs baseline: +3.6%
✅ modulo_aspect_for_bytes_bytearray
Time: ✅ 1.257µs (SLO: <10.000µs 📉 -87.4%) vs baseline: +3.0%
Memory: ✅ 40.044MB (SLO: <41.500MB -3.5%) vs baseline: +3.6%
✅ modulo_noaspect
Time: ✅ 0.624µs (SLO: <10.000µs 📉 -93.8%) vs baseline: -0.5%
Memory: ✅ 40.223MB (SLO: <41.500MB -3.1%) vs baseline: +5.0%
✅ replace_aspect
Time: ✅ 4.861µs (SLO: <10.000µs 📉 -51.4%) vs baseline: -1.3%
Memory: ✅ 40.143MB (SLO: <41.500MB -3.3%) vs baseline: +4.4%
✅ replace_noaspect
Time: ✅ 0.462µs (SLO: <10.000µs 📉 -95.4%) vs baseline: +0.5%
Memory: ✅ 40.066MB (SLO: <41.500MB -3.5%) vs baseline: +3.9%
✅ repr_aspect
Time: ✅ 0.909µs (SLO: <10.000µs 📉 -90.9%) vs baseline: +0.5%
Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.9%
✅ repr_noaspect
Time: ✅ 0.415µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -1.8%
Memory: ✅ 40.318MB (SLO: <41.500MB -2.8%) vs baseline: +4.8%
✅ rstrip_aspect
Time: ✅ 1.956µs (SLO: <20.000µs 📉 -90.2%) vs baseline: +1.5%
Memory: ✅ 40.204MB (SLO: <41.500MB -3.1%) vs baseline: +4.8%
✅ rstrip_noaspect
Time: ✅ 0.389µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +2.9%
Memory: ✅ 40.262MB (SLO: <41.500MB -3.0%) vs baseline: +5.1%
✅ slice_aspect
Time: ✅ 0.491µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.8%
Memory: ✅ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.9%
✅ slice_noaspect
Time: ✅ 0.449µs (SLO: <10.000µs 📉 -95.5%) vs baseline: +1.1%
Memory: ✅ 40.281MB (SLO: <41.500MB -2.9%) vs baseline: +5.2%
✅ stringio_aspect
Time: ✅ 1.545µs (SLO: <10.000µs 📉 -84.5%) vs baseline: +2.2%
Memory: ✅ 40.242MB (SLO: <41.500MB -3.0%) vs baseline: +4.8%
✅ stringio_noaspect
Time: ✅ 0.712µs (SLO: <10.000µs 📉 -92.9%) vs baseline: +0.2%
Memory: ✅ 40.284MB (SLO: <41.500MB -2.9%) vs baseline: +5.3%
✅ strip_aspect
Time: ✅ 2.234µs (SLO: <20.000µs 📉 -88.8%) vs baseline: ~same
Memory: ✅ 40.135MB (SLO: <41.500MB -3.3%) vs baseline: +4.3%
✅ strip_noaspect
Time: ✅ 0.384µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.8%
Memory: ✅ 40.205MB (SLO: <41.500MB -3.1%) vs baseline: +4.5%
✅ swapcase_aspect
Time: ✅ 2.512µs (SLO: <10.000µs 📉 -74.9%) vs baseline: +1.3%
Memory: ✅ 40.240MB (SLO: <41.500MB -3.0%) vs baseline: +4.6%
✅ swapcase_noaspect
Time: ✅ 0.539µs (SLO: <10.000µs 📉 -94.6%) vs baseline: +0.7%
Memory: ✅ 40.243MB (SLO: <41.500MB -3.0%) vs baseline: +5.0%
✅ title_aspect
Time: ✅ 2.434µs (SLO: <10.000µs 📉 -75.7%) vs baseline: +2.7%
Memory: ✅ 40.316MB (SLO: <41.500MB -2.9%) vs baseline: +4.9%
✅ title_noaspect
Time: ✅ 0.506µs (SLO: <10.000µs 📉 -94.9%) vs baseline: +1.3%
Memory: ✅ 40.261MB (SLO: <41.500MB -3.0%) vs baseline: +4.9%
✅ translate_aspect
Time: ✅ 3.327µs (SLO: <10.000µs 📉 -66.7%) vs baseline: +0.6%
Memory: ✅ 40.182MB (SLO: <41.500MB -3.2%) vs baseline: +4.6%
✅ translate_noaspect
Time: ✅ 1.042µs (SLO: <10.000µs 📉 -89.6%) vs baseline: +0.7%
Memory: ✅ 40.158MB (SLO: <41.500MB -3.2%) vs baseline: +4.1%
✅ upper_aspect
Time: ✅ 2.285µs (SLO: <10.000µs 📉 -77.1%) vs baseline: +1.3%
Memory: ✅ 40.235MB (SLO: <41.500MB -3.0%) vs baseline: +4.6%
✅ upper_noaspect
Time: ✅ 0.370µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.3%
Memory: ✅ 40.084MB (SLO: <41.500MB -3.4%) vs baseline: +4.2%
✅ iastpropagation - 8/8
✅ no-propagation
Time: ✅ 48.814µs (SLO: <60.000µs 📉 -18.6%) vs baseline: +0.6%
Memory: ✅ 40.088MB (SLO: <42.000MB -4.6%) vs baseline: +4.8%
✅ propagation_enabled
Time: ✅ 174.608µs (SLO: <190.000µs -8.1%) vs baseline: -0.1%
Memory: ✅ 40.069MB (SLO: <42.000MB -4.6%) vs baseline: +5.0%
✅ propagation_enabled_100
Time: ✅ 1.922ms (SLO: <2.300ms 📉 -16.4%) vs baseline: -0.4%
Memory: ✅ 40.088MB (SLO: <42.000MB -4.6%) vs baseline: +4.7%
✅ propagation_enabled_1000
Time: ✅ 32.486ms (SLO: <34.550ms -6.0%) vs baseline: -0.2%
Memory: ✅ 40.049MB (SLO: <42.000MB -4.6%) vs baseline: +4.7%
✅ samplingrules - 8/8
✅ average_match
Time: ✅ 138.272µs (SLO: <290.000µs 📉 -52.3%) vs baseline: +0.9%
Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.8%
✅ high_match
Time: ✅ 173.886µs (SLO: <480.000µs 📉 -63.8%) vs baseline: ~same
Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +5.0%
✅ low_match
Time: ✅ 98.653µs (SLO: <120.000µs 📉 -17.8%) vs baseline: -0.2%
Memory: ✅ 603.570MB (SLO: <700.000MB 📉 -13.8%) vs baseline: +4.9%
✅ very_low_match
Time: ✅ 2.675ms (SLO: <8.500ms 📉 -68.5%) vs baseline: -0.8%
Memory: ✅ 71.066MB (SLO: <75.000MB -5.2%) vs baseline: +4.8%
ℹ️ Scenarios Missing SLO Configuration (10 scenarios)
The following scenarios exist in candidate data but have no SLO thresholds configured:
coreapiscenario-core_dispatch_listenerscoreapiscenario-core_dispatch_no_listenerscoreapiscenario-core_dispatch_with_results_listenerscoreapiscenario-core_dispatch_with_results_no_listenersdjangosimple-baselineerrortrackingdjangosimple-baselineerrortrackingflasksqli-baselineflasksimple-baselineflasksqli-baselinesethttpmeta-obfuscation-disabled
![pr-commenter[bot] avatar](https://avatars.githubusercontent.com/u/365230?v=4 "Published by a pub.dev verified publisher"){kind=small}