feat(pydantic_ai): support `stream_output` in `pydantic_ai>=1.0.0`
Note: Most LOC are from regenerating riot lockfiles.
Description
Supports stream_output on Pydantic AI agent results, which was added in pydantic_ai>=1.0.0. To help accomplish testing this, I've bumped the range of our testing support, and updated tests. The only real change was that for agent manifests, empty instructions are now an empty array [] instead of None. I didn't change source and instead changed the test assertion to be conditional on the version since I don't think it makes sense to normalize it.
Testing
Updated riotfile.py with newest pydantic_ai versions
Risks
None, all other tests passed with minimal source & test changes
CODEOWNERS have been resolved as:
.riot/requirements/12c713a.txt @DataDog/apm-python
.riot/requirements/1565727.txt @DataDog/apm-python
.riot/requirements/17d5494.txt @DataDog/apm-python
.riot/requirements/1845af7.txt @DataDog/apm-python
.riot/requirements/1dc9ee8.txt @DataDog/apm-python
.riot/requirements/3aa62d6.txt @DataDog/apm-python
.riot/requirements/c9fcfdb.txt @DataDog/apm-python
.riot/requirements/f9ab665.txt @DataDog/apm-python
releasenotes/notes/support-pydantic-ai-v-1-8608cb1d8729a6e8.yaml @DataDog/apm-python
tests/contrib/pydantic_ai/cassettes/agent_run_stream_output.yaml @DataDog/ml-observability
.riot/requirements/100a87a.txt @DataDog/apm-python
.riot/requirements/1290cab.txt @DataDog/apm-python
.riot/requirements/14202a0.txt @DataDog/apm-python
.riot/requirements/14b1398.txt @DataDog/apm-python
.riot/requirements/15511f1.txt @DataDog/apm-python
.riot/requirements/1a74311.txt @DataDog/apm-python
.riot/requirements/3e17f97.txt @DataDog/apm-python
.riot/requirements/4156286.txt @DataDog/apm-python
.riot/requirements/4c0cb2f.txt @DataDog/apm-python
.riot/requirements/adebd36.txt @DataDog/apm-python
ddtrace/contrib/integration_registry/registry.yaml @DataDog/apm-core-python @DataDog/apm-idm-python
ddtrace/contrib/internal/pydantic_ai/utils.py @DataDog/ml-observability
riotfile.py @DataDog/apm-python
supported_versions_output.json @DataDog/apm-core-python
supported_versions_table.csv @DataDog/apm-core-python
tests/contrib/pydantic_ai/test_pydantic_ai_llmobs.py @DataDog/ml-observability
tests/contrib/pydantic_ai/utils.py @DataDog/ml-observability
.riot/requirements/1176a2d.txt @DataDog/apm-python
.riot/requirements/17c62a0.txt @DataDog/apm-python
Bootstrap import analysis
Comparison of import times between this PR and base.
Summary
The average import time from this PR is: 252 ยฑ 4 ms.
The average import time from base is: 254 ยฑ 3 ms.
The import time difference between this PR and base is: -2.2 ยฑ 0.2 ms.
Import time breakdown
The following import paths have shrunk:
ddtrace.auto
2.629 ms
(1.04%)
ddtrace
1.350 ms
(0.54%)
ddtrace._logger
0.671 ms
(0.27%)
ddtrace.internal.telemetry
0.671 ms
(0.27%)
ddtrace.internal.telemetry.writer
0.671 ms
(0.27%)
ddtrace.internal.utils.version
0.671 ms
(0.27%)
ddtrace.version
0.671 ms
(0.27%)
ddtrace.internal._unpatched
0.027 ms
(0.01%)
json
0.027 ms
(0.01%)
json.decoder
0.027 ms
(0.01%)
re
0.027 ms
(0.01%)
enum
0.027 ms
(0.01%)
types
0.027 ms
(0.01%)
ddtrace.bootstrap.sitecustomize
1.279 ms
(0.51%)
ddtrace.bootstrap.preload
1.279 ms
(0.51%)
ddtrace.internal.remoteconfig.client
0.637 ms
(0.25%)
Performance SLOs
Comparing candidate sabrenner/more-pydantic-support (73a734c3) with baseline main (d2389080)
๐ Performance Regressions (3 suites)
๐ iastaspectsospath - 24/24
โ ospathbasename_aspect
Time: โ 5.155ยตs (SLO: <10.000ยตs ๐ -48.5%) vs baseline: ๐ +24.7%
Memory: โ 40.187MB (SLO: <41.000MB ๐ก -2.0%) vs baseline: +4.7%
โ ospathbasename_noaspect
Time: โ 1.090ยตs (SLO: <10.000ยตs ๐ -89.1%) vs baseline: +0.2%
Memory: โ 40.187MB (SLO: <41.000MB ๐ก -2.0%) vs baseline: +4.4%
โ ospathjoin_aspect
Time: โ 6.140ยตs (SLO: <10.000ยตs ๐ -38.6%) vs baseline: ~same
Memory: โ 40.285MB (SLO: <41.000MB ๐ก -1.7%) vs baseline: +5.1%
โ ospathjoin_noaspect
Time: โ 2.291ยตs (SLO: <10.000ยตs ๐ -77.1%) vs baseline: -0.5%
Memory: โ 40.226MB (SLO: <41.000MB ๐ก -1.9%) vs baseline: +4.9%
โ ospathnormcase_aspect
Time: โ 3.449ยตs (SLO: <10.000ยตs ๐ -65.5%) vs baseline: +0.4%
Memory: โ 40.305MB (SLO: <41.000MB ๐ก -1.7%) vs baseline: +5.2%
โ ospathnormcase_noaspect
Time: โ 0.568ยตs (SLO: <10.000ยตs ๐ -94.3%) vs baseline: -0.6%
Memory: โ 40.383MB (SLO: <41.000MB ๐ก -1.5%) vs baseline: +4.9%
โ ospathsplit_aspect
Time: โ 4.772ยตs (SLO: <10.000ยตs ๐ -52.3%) vs baseline: +0.3%
Memory: โ 40.265MB (SLO: <41.000MB ๐ก -1.8%) vs baseline: +4.5%
โ ospathsplit_noaspect
Time: โ 1.589ยตs (SLO: <10.000ยตs ๐ -84.1%) vs baseline: -0.9%
Memory: โ 40.285MB (SLO: <41.000MB ๐ก -1.7%) vs baseline: +4.8%
โ ospathsplitdrive_aspect
Time: โ 3.642ยตs (SLO: <10.000ยตs ๐ -63.6%) vs baseline: -0.7%
Memory: โ 40.344MB (SLO: <41.000MB ๐ก -1.6%) vs baseline: +5.2%
โ ospathsplitdrive_noaspect
Time: โ 0.695ยตs (SLO: <10.000ยตs ๐ -93.1%) vs baseline: -1.3%
Memory: โ 40.305MB (SLO: <41.000MB ๐ก -1.7%) vs baseline: +4.6%
โ ospathsplitext_aspect
Time: โ 4.519ยตs (SLO: <10.000ยตs ๐ -54.8%) vs baseline: ~same
Memory: โ 40.364MB (SLO: <41.000MB ๐ก -1.6%) vs baseline: +5.5%
โ ospathsplitext_noaspect
Time: โ 1.382ยตs (SLO: <10.000ยตs ๐ -86.2%) vs baseline: -0.5%
Memory: โ 40.265MB (SLO: <41.000MB ๐ก -1.8%) vs baseline: +4.9%
๐ iastaspectssplit - 12/12
โ rsplit_aspect
Time: โ 1.587ยตs (SLO: <10.000ยตs ๐ -84.1%) vs baseline: ๐ +10.1%
Memory: โ 40.088MB (SLO: <41.000MB -2.2%) vs baseline: +4.3%
โ rsplit_noaspect
Time: โ 0.579ยตs (SLO: <10.000ยตs ๐ -94.2%) vs baseline: ~same
Memory: โ 40.305MB (SLO: <41.000MB ๐ก -1.7%) vs baseline: +5.0%
โ split_aspect
Time: โ 1.419ยตs (SLO: <10.000ยตs ๐ -85.8%) vs baseline: +0.6%
Memory: โ 40.364MB (SLO: <41.000MB ๐ก -1.6%) vs baseline: +5.4%
โ split_noaspect
Time: โ 0.571ยตs (SLO: <10.000ยตs ๐ -94.3%) vs baseline: -0.2%
Memory: โ 40.246MB (SLO: <41.000MB ๐ก -1.8%) vs baseline: +4.7%
โ splitlines_aspect
Time: โ 1.427ยตs (SLO: <10.000ยตs ๐ -85.7%) vs baseline: -0.8%
Memory: โ 40.108MB (SLO: <41.000MB -2.2%) vs baseline: +4.8%
โ splitlines_noaspect
Time: โ 0.581ยตs (SLO: <10.000ยตs ๐ -94.2%) vs baseline: -1.2%
Memory: โ 40.265MB (SLO: <41.000MB ๐ก -1.8%) vs baseline: +4.9%
๐ telemetryaddmetric - 30/30
โ 1-count-metric-1-times
Time: โ 3.438ยตs (SLO: <20.000ยตs ๐ -82.8%) vs baseline: ๐ +17.1%
Memory: โ 34.878MB (SLO: <35.500MB ๐ก -1.8%) vs baseline: +5.3%
โ 1-count-metrics-100-times
Time: โ 202.810ยตs (SLO: <220.000ยตs -7.8%) vs baseline: -0.9%
Memory: โ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.7%
โ 1-distribution-metric-1-times
Time: โ 3.289ยตs (SLO: <20.000ยตs ๐ -83.6%) vs baseline: -0.8%
Memory: โ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.4%
โ 1-distribution-metrics-100-times
Time: โ 218.210ยตs (SLO: <230.000ยตs -5.1%) vs baseline: -1.3%
Memory: โ 35.055MB (SLO: <35.500MB ๐ก -1.3%) vs baseline: +4.7%
โ 1-gauge-metric-1-times
Time: โ 2.193ยตs (SLO: <20.000ยตs ๐ -89.0%) vs baseline: +0.4%
Memory: โ 34.800MB (SLO: <35.500MB ๐ก -2.0%) vs baseline: +5.0%
โ 1-gauge-metrics-100-times
Time: โ 138.569ยตs (SLO: <150.000ยตs -7.6%) vs baseline: +0.5%
Memory: โ 34.819MB (SLO: <35.500MB ๐ก -1.9%) vs baseline: +4.6%
โ 1-rate-metric-1-times
Time: โ 3.083ยตs (SLO: <20.000ยตs ๐ -84.6%) vs baseline: -0.5%
Memory: โ 34.977MB (SLO: <35.500MB ๐ก -1.5%) vs baseline: +5.5%
โ 1-rate-metrics-100-times
Time: โ 215.896ยตs (SLO: <250.000ยตs ๐ -13.6%) vs baseline: -0.5%
Memory: โ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.6%
โ 100-count-metrics-100-times
Time: โ 20.508ms (SLO: <22.000ms -6.8%) vs baseline: +0.2%
Memory: โ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.9%
โ 100-distribution-metrics-100-times
Time: โ 2.326ms (SLO: <2.550ms -8.8%) vs baseline: +1.2%
Memory: โ 34.918MB (SLO: <35.500MB ๐ก -1.6%) vs baseline: +4.5%
โ 100-gauge-metrics-100-times
Time: โ 1.438ms (SLO: <1.550ms -7.2%) vs baseline: +1.2%
Memory: โ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.7%
โ 100-rate-metrics-100-times
Time: โ 2.230ms (SLO: <2.550ms ๐ -12.5%) vs baseline: +0.1%
Memory: โ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +5.0%
โ flush-1-metric
Time: โ 4.653ยตs (SLO: <20.000ยตs ๐ -76.7%) vs baseline: +0.7%
Memory: โ 35.134MB (SLO: <35.500MB ๐ก -1.0%) vs baseline: +4.9%
โ flush-100-metrics
Time: โ 175.510ยตs (SLO: <250.000ยตs ๐ -29.8%) vs baseline: ~same
Memory: โ 35.252MB (SLO: <35.500MB ๐ก -0.7%) vs baseline: +5.3%
โ flush-1000-metrics
Time: โ 2.185ms (SLO: <2.500ms ๐ -12.6%) vs baseline: ~same
Memory: โ 35.999MB (SLO: <36.500MB ๐ก -1.4%) vs baseline: +4.6%
๐ก Near SLO Breach (15 suites)
๐ก coreapiscenario - 10/10 (1 unstable)
โ ๏ธ context_with_data_listeners
Time: โ ๏ธ 13.306ยตs (SLO: <20.000ยตs ๐ -33.5%) vs baseline: +0.6%
Memory: โ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +4.5%
โ context_with_data_no_listeners
Time: โ 3.268ยตs (SLO: <10.000ยตs ๐ -67.3%) vs baseline: +0.1%
Memory: โ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +5.0%
โ get_item_exists
Time: โ 0.582ยตs (SLO: <10.000ยตs ๐ -94.2%) vs baseline: -0.2%
Memory: โ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.6%
โ get_item_missing
Time: โ 0.639ยตs (SLO: <10.000ยตs ๐ -93.6%) vs baseline: +0.5%
Memory: โ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +5.0%
โ set_item
Time: โ 24.284ยตs (SLO: <30.000ยตs ๐ -19.1%) vs baseline: +1.4%
Memory: โ 34.800MB (SLO: <35.500MB ๐ก -2.0%) vs baseline: +5.0%
๐ก djangosimple - 30/30
โ appsec
Time: โ 19.625ms (SLO: <22.300ms ๐ -12.0%) vs baseline: +0.3%
Memory: โ 68.164MB (SLO: <70.500MB -3.3%) vs baseline: +4.8%
โ exception-replay-enabled
Time: โ 1.354ms (SLO: <1.450ms -6.6%) vs baseline: -0.1%
Memory: โ 66.191MB (SLO: <67.500MB ๐ก -1.9%) vs baseline: +4.7%
โ iast
Time: โ 19.596ms (SLO: <22.250ms ๐ -11.9%) vs baseline: +0.1%
Memory: โ 68.243MB (SLO: <70.000MB -2.5%) vs baseline: +4.9%
โ profiler
Time: โ 15.410ms (SLO: <16.550ms -6.9%) vs baseline: -0.2%
Memory: โ 56.360MB (SLO: <57.500MB ๐ก -2.0%) vs baseline: +4.9%
โ resource-renaming
Time: โ 19.489ms (SLO: <21.750ms ๐ -10.4%) vs baseline: -0.1%
Memory: โ 68.243MB (SLO: <70.500MB -3.2%) vs baseline: +4.8%
โ span-code-origin
Time: โ 20.019ms (SLO: <28.200ms ๐ -29.0%) vs baseline: +1.2%
Memory: โ 68.185MB (SLO: <71.000MB -4.0%) vs baseline: +4.8%
โ tracer
Time: โ 19.566ms (SLO: <21.750ms ๐ -10.0%) vs baseline: +0.1%
Memory: โ 68.184MB (SLO: <70.000MB -2.6%) vs baseline: +5.0%
โ tracer-and-profiler
Time: โ 21.703ms (SLO: <23.500ms -7.6%) vs baseline: +0.1%
Memory: โ 69.265MB (SLO: <71.000MB -2.4%) vs baseline: +4.9%
โ tracer-dont-create-db-spans
Time: โ 19.683ms (SLO: <21.500ms -8.5%) vs baseline: +0.8%
Memory: โ 68.184MB (SLO: <70.000MB -2.6%) vs baseline: +4.9%
โ tracer-minimal
Time: โ 16.794ms (SLO: <17.500ms -4.0%) vs baseline: -0.2%
Memory: โ 67.830MB (SLO: <70.000MB -3.1%) vs baseline: +4.9%
โ tracer-native
Time: โ 19.432ms (SLO: <21.750ms ๐ -10.7%) vs baseline: -0.4%
Memory: โ 68.243MB (SLO: <72.500MB -5.9%) vs baseline: +4.8%
โ tracer-no-caches
Time: โ 17.619ms (SLO: <19.650ms ๐ -10.3%) vs baseline: +0.2%
Memory: โ 67.849MB (SLO: <70.000MB -3.1%) vs baseline: +4.8%
โ tracer-no-databases
Time: โ 19.061ms (SLO: <20.100ms -5.2%) vs baseline: ~same
Memory: โ 67.849MB (SLO: <70.000MB -3.1%) vs baseline: +4.9%
โ tracer-no-middleware
Time: โ 19.323ms (SLO: <21.500ms ๐ -10.1%) vs baseline: +0.1%
Memory: โ 68.046MB (SLO: <70.000MB -2.8%) vs baseline: +4.9%
โ tracer-no-templates
Time: โ 19.487ms (SLO: <22.000ms ๐ -11.4%) vs baseline: +0.9%
Memory: โ 68.085MB (SLO: <70.500MB -3.4%) vs baseline: +4.8%
๐ก errortrackingdjangosimple - 6/6
โ errortracking-enabled-all
Time: โ 16.300ms (SLO: <19.850ms ๐ -17.9%) vs baseline: ~same
Memory: โ 69.881MB (SLO: <70.000MB ๐ก -0.2%) vs baseline: +4.9%
โ errortracking-enabled-user
Time: โ 16.344ms (SLO: <19.400ms ๐ -15.8%) vs baseline: +0.1%
Memory: โ 69.855MB (SLO: <70.000MB ๐ก -0.2%) vs baseline: +4.8%
โ tracer-enabled
Time: โ 16.331ms (SLO: <19.450ms ๐ -16.0%) vs baseline: -0.2%
Memory: โ 69.805MB (SLO: <70.000MB ๐ก -0.3%) vs baseline: +4.9%
๐ก errortrackingflasksqli - 6/6
โ errortracking-enabled-all
Time: โ 2.067ms (SLO: <2.300ms ๐ -10.1%) vs baseline: ~same
Memory: โ 55.738MB (SLO: <56.500MB ๐ก -1.3%) vs baseline: +4.8%
โ errortracking-enabled-user
Time: โ 2.074ms (SLO: <2.250ms -7.8%) vs baseline: ~same
Memory: โ 55.719MB (SLO: <56.500MB ๐ก -1.4%) vs baseline: +4.8%
โ tracer-enabled
Time: โ 2.060ms (SLO: <2.300ms ๐ -10.4%) vs baseline: ~same
Memory: โ 55.778MB (SLO: <56.500MB ๐ก -1.3%) vs baseline: +5.0%
๐ก flasksimple - 18/18
โ appsec-get
Time: โ 3.386ms (SLO: <4.750ms ๐ -28.7%) vs baseline: ~same
Memory: โ 55.472MB (SLO: <66.500MB ๐ -16.6%) vs baseline: +4.9%
โ appsec-post
Time: โ 2.856ms (SLO: <6.750ms ๐ -57.7%) vs baseline: ~same
Memory: โ 55.726MB (SLO: <66.500MB ๐ -16.2%) vs baseline: +4.6%
โ appsec-telemetry
Time: โ 3.396ms (SLO: <4.750ms ๐ -28.5%) vs baseline: +0.8%
Memory: โ 55.564MB (SLO: <66.500MB ๐ -16.4%) vs baseline: +5.1%
โ debugger
Time: โ 1.867ms (SLO: <2.000ms -6.7%) vs baseline: ~same
Memory: โ 47.940MB (SLO: <49.500MB -3.2%) vs baseline: +4.9%
โ iast-get
Time: โ 1.856ms (SLO: <2.000ms -7.2%) vs baseline: ~same
Memory: โ 44.537MB (SLO: <49.000MB -9.1%) vs baseline: +4.9%
โ profiler
Time: โ 1.907ms (SLO: <2.100ms -9.2%) vs baseline: ~same
Memory: โ 48.765MB (SLO: <50.000MB -2.5%) vs baseline: +4.7%
โ resource-renaming
Time: โ 3.349ms (SLO: <3.650ms -8.3%) vs baseline: ~same
Memory: โ 55.506MB (SLO: <56.000MB ๐ก -0.9%) vs baseline: +4.9%
โ tracer
Time: โ 3.365ms (SLO: <3.650ms -7.8%) vs baseline: -0.1%
Memory: โ 55.509MB (SLO: <56.500MB ๐ก -1.8%) vs baseline: +4.8%
โ tracer-native
Time: โ 3.365ms (SLO: <3.650ms -7.8%) vs baseline: ~same
Memory: โ 55.509MB (SLO: <60.000MB -7.5%) vs baseline: +4.9%
๐ก httppropagationextract - 60/60
โ all_styles_all_headers
Time: โ 81.024ยตs (SLO: <100.000ยตs ๐ -19.0%) vs baseline: ~same
Memory: โ 34.819MB (SLO: <35.500MB ๐ก -1.9%) vs baseline: +4.6%
โ b3_headers
Time: โ 14.170ยตs (SLO: <20.000ยตs ๐ -29.1%) vs baseline: -0.5%
Memory: โ 34.839MB (SLO: <35.500MB ๐ก -1.9%) vs baseline: +4.6%
โ b3_single_headers
Time: โ 13.457ยตs (SLO: <20.000ยตs ๐ -32.7%) vs baseline: +0.2%
Memory: โ 34.859MB (SLO: <35.500MB ๐ก -1.8%) vs baseline: +4.9%
โ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match
Time: โ 63.964ยตs (SLO: <80.000ยตs ๐ -20.0%) vs baseline: +0.2%
Memory: โ 34.800MB (SLO: <35.500MB ๐ก -2.0%) vs baseline: +4.7%
โ datadog_tracecontext_tracestate_propagated_on_trace_id_match
Time: โ 69.439ยตs (SLO: <80.000ยตs ๐ -13.2%) vs baseline: +4.9%
Memory: โ 34.859MB (SLO: <35.500MB ๐ก -1.8%) vs baseline: +5.3%
โ empty_headers
Time: โ 1.640ยตs (SLO: <10.000ยตs ๐ -83.6%) vs baseline: +1.4%
Memory: โ 34.819MB (SLO: <35.500MB ๐ก -1.9%) vs baseline: +4.9%
โ full_t_id_datadog_headers
Time: โ 22.523ยตs (SLO: <30.000ยตs ๐ -24.9%) vs baseline: +0.8%
Memory: โ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.6%
โ invalid_priority_header
Time: โ 6.572ยตs (SLO: <10.000ยตs ๐ -34.3%) vs baseline: +0.7%
Memory: โ 34.859MB (SLO: <35.500MB ๐ก -1.8%) vs baseline: +5.2%
โ invalid_span_id_header
Time: โ 6.524ยตs (SLO: <10.000ยตs ๐ -34.8%) vs baseline: -0.4%
Memory: โ 34.898MB (SLO: <35.500MB ๐ก -1.7%) vs baseline: +5.2%
โ invalid_tags_header
Time: โ 6.571ยตs (SLO: <10.000ยตs ๐ -34.3%) vs baseline: +1.1%
Memory: โ 34.898MB (SLO: <35.500MB ๐ก -1.7%) vs baseline: +4.6%
โ invalid_trace_id_header
Time: โ 6.544ยตs (SLO: <10.000ยตs ๐ -34.6%) vs baseline: -0.3%
Memory: โ 34.898MB (SLO: <35.500MB ๐ก -1.7%) vs baseline: +5.2%
โ large_header_no_matches
Time: โ 27.644ยตs (SLO: <30.000ยตs -7.9%) vs baseline: +0.1%
Memory: โ 34.800MB (SLO: <35.500MB ๐ก -2.0%) vs baseline: +5.0%
โ large_valid_headers_all
Time: โ 28.679ยตs (SLO: <40.000ยตs ๐ -28.3%) vs baseline: -0.2%
Memory: โ 34.859MB (SLO: <35.500MB ๐ก -1.8%) vs baseline: +5.0%
โ medium_header_no_matches
Time: โ 9.918ยตs (SLO: <20.000ยตs ๐ -50.4%) vs baseline: +0.1%
Memory: โ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.5%
โ medium_valid_headers_all
Time: โ 11.417ยตs (SLO: <20.000ยตs ๐ -42.9%) vs baseline: -0.7%
Memory: โ 34.839MB (SLO: <35.500MB ๐ก -1.9%) vs baseline: +5.2%
โ none_propagation_style
Time: โ 1.719ยตs (SLO: <10.000ยตs ๐ -82.8%) vs baseline: +0.3%
Memory: โ 34.800MB (SLO: <35.500MB ๐ก -2.0%) vs baseline: +4.6%
โ tracecontext_headers
Time: โ 34.744ยตs (SLO: <40.000ยตs ๐ -13.1%) vs baseline: -0.3%
Memory: โ 34.839MB (SLO: <35.500MB ๐ก -1.9%) vs baseline: +5.0%
โ valid_headers_all
Time: โ 6.516ยตs (SLO: <10.000ยตs ๐ -34.8%) vs baseline: -0.3%
Memory: โ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +4.4%
โ valid_headers_basic
Time: โ 6.140ยตs (SLO: <10.000ยตs ๐ -38.6%) vs baseline: +0.2%
Memory: โ 34.859MB (SLO: <35.500MB ๐ก -1.8%) vs baseline: +5.3%
โ wsgi_empty_headers
Time: โ 1.612ยตs (SLO: <10.000ยตs ๐ -83.9%) vs baseline: +0.4%
Memory: โ 34.878MB (SLO: <35.500MB ๐ก -1.8%) vs baseline: +4.7%
โ wsgi_invalid_priority_header
Time: โ 6.582ยตs (SLO: <10.000ยตs ๐ -34.2%) vs baseline: ~same
Memory: โ 34.918MB (SLO: <35.500MB ๐ก -1.6%) vs baseline: +5.1%
โ wsgi_invalid_span_id_header
Time: โ 1.638ยตs (SLO: <10.000ยตs ๐ -83.6%) vs baseline: +2.0%
Memory: โ 34.918MB (SLO: <35.500MB ๐ก -1.6%) vs baseline: +5.2%
โ wsgi_invalid_tags_header
Time: โ 6.620ยตs (SLO: <10.000ยตs ๐ -33.8%) vs baseline: ~same
Memory: โ 34.819MB (SLO: <35.500MB ๐ก -1.9%) vs baseline: +4.7%
โ wsgi_invalid_trace_id_header
Time: โ 6.683ยตs (SLO: <10.000ยตs ๐ -33.2%) vs baseline: +2.0%
Memory: โ 34.977MB (SLO: <35.500MB ๐ก -1.5%) vs baseline: +5.4%
โ wsgi_large_header_no_matches
Time: โ 28.855ยตs (SLO: <40.000ยตs ๐ -27.9%) vs baseline: +0.5%
Memory: โ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.7%
โ wsgi_large_valid_headers_all
Time: โ 29.888ยตs (SLO: <40.000ยตs ๐ -25.3%) vs baseline: ~same
Memory: โ 34.898MB (SLO: <35.500MB ๐ก -1.7%) vs baseline: +5.1%
โ wsgi_medium_header_no_matches
Time: โ 10.153ยตs (SLO: <20.000ยตs ๐ -49.2%) vs baseline: +0.4%
Memory: โ 34.918MB (SLO: <35.500MB ๐ก -1.6%) vs baseline: +4.9%
โ wsgi_medium_valid_headers_all
Time: โ 11.538ยตs (SLO: <20.000ยตs ๐ -42.3%) vs baseline: -0.5%
Memory: โ 34.878MB (SLO: <35.500MB ๐ก -1.8%) vs baseline: +4.9%
โ wsgi_valid_headers_all
Time: โ 6.555ยตs (SLO: <10.000ยตs ๐ -34.4%) vs baseline: -0.6%
Memory: โ 34.839MB (SLO: <35.500MB ๐ก -1.9%) vs baseline: +4.9%
โ wsgi_valid_headers_basic
Time: โ 6.121ยตs (SLO: <10.000ยตs ๐ -38.8%) vs baseline: -0.2%
Memory: โ 34.859MB (SLO: <35.500MB ๐ก -1.8%) vs baseline: +4.9%
๐ก httppropagationinject - 16/16
โ ids_only
Time: โ 22.046ยตs (SLO: <30.000ยตs ๐ -26.5%) vs baseline: +4.6%
Memory: โ 34.839MB (SLO: <35.500MB ๐ก -1.9%) vs baseline: +4.9%
โ with_all
Time: โ 27.894ยตs (SLO: <40.000ยตs ๐ -30.3%) vs baseline: +0.5%
Memory: โ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.6%
โ with_dd_origin
Time: โ 24.905ยตs (SLO: <30.000ยตs ๐ -17.0%) vs baseline: +0.4%
Memory: โ 34.839MB (SLO: <35.500MB ๐ก -1.9%) vs baseline: +4.7%
โ with_priority_and_origin
Time: โ 24.215ยตs (SLO: <40.000ยตs ๐ -39.5%) vs baseline: -0.2%
Memory: โ 34.918MB (SLO: <35.500MB ๐ก -1.6%) vs baseline: +5.3%
โ with_sampling_priority
Time: โ 21.044ยตs (SLO: <30.000ยตs ๐ -29.9%) vs baseline: -0.2%
Memory: โ 34.878MB (SLO: <35.500MB ๐ก -1.8%) vs baseline: +4.9%
โ with_tags
Time: โ 25.939ยตs (SLO: <40.000ยตs ๐ -35.2%) vs baseline: -0.4%
Memory: โ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.8%
โ with_tags_invalid
Time: โ 27.475ยตs (SLO: <40.000ยตs ๐ -31.3%) vs baseline: -0.3%
Memory: โ 34.918MB (SLO: <35.500MB ๐ก -1.6%) vs baseline: +5.2%
โ with_tags_max_size
Time: โ 26.750ยตs (SLO: <40.000ยตs ๐ -33.1%) vs baseline: +1.0%
Memory: โ 34.839MB (SLO: <35.500MB ๐ก -1.9%) vs baseline: +5.0%
๐ก iast_aspects - 40/40
โ re_expand_aspect
Time: โ 34.371ยตs (SLO: <40.000ยตs ๐ -14.1%) vs baseline: +7.8%
Memory: โ 40.206MB (SLO: <41.000MB ๐ก -1.9%) vs baseline: +4.6%
โ re_expand_noaspect
Time: โ 28.715ยตs (SLO: <40.000ยตs ๐ -28.2%) vs baseline: -0.5%
Memory: โ 40.265MB (SLO: <41.000MB ๐ก -1.8%) vs baseline: +4.8%
โ re_findall_aspect
Time: โ 2.916ยตs (SLO: <10.000ยตs ๐ -70.8%) vs baseline: +0.4%
Memory: โ 40.187MB (SLO: <41.000MB ๐ก -2.0%) vs baseline: +4.8%
โ re_findall_noaspect
Time: โ 1.407ยตs (SLO: <10.000ยตs ๐ -85.9%) vs baseline: -0.5%
Memory: โ 40.246MB (SLO: <41.000MB ๐ก -1.8%) vs baseline: +4.6%
โ re_finditer_aspect
Time: โ 4.490ยตs (SLO: <10.000ยตs ๐ -55.1%) vs baseline: +0.6%
Memory: โ 40.285MB (SLO: <41.000MB ๐ก -1.7%) vs baseline: +5.1%
โ re_finditer_noaspect
Time: โ 1.407ยตs (SLO: <10.000ยตs ๐ -85.9%) vs baseline: ~same
Memory: โ 40.383MB (SLO: <41.000MB ๐ก -1.5%) vs baseline: +5.3%
โ re_fullmatch_aspect
Time: โ 2.710ยตs (SLO: <10.000ยตs ๐ -72.9%) vs baseline: -1.2%
Memory: โ 40.187MB (SLO: <41.000MB ๐ก -2.0%) vs baseline: +4.7%
โ re_fullmatch_noaspect
Time: โ 1.328ยตs (SLO: <10.000ยตs ๐ -86.7%) vs baseline: -0.3%
Memory: โ 40.305MB (SLO: <41.000MB ๐ก -1.7%) vs baseline: +5.2%
โ re_group_aspect
Time: โ 2.996ยตs (SLO: <10.000ยตs ๐ -70.0%) vs baseline: ~same
Memory: โ 40.206MB (SLO: <41.000MB ๐ก -1.9%) vs baseline: +4.7%
โ re_group_noaspect
Time: โ 1.633ยตs (SLO: <10.000ยตs ๐ -83.7%) vs baseline: +0.1%
Memory: โ 40.187MB (SLO: <41.000MB ๐ก -2.0%) vs baseline: +4.6%
โ re_groups_aspect
Time: โ 3.125ยตs (SLO: <10.000ยตs ๐ -68.7%) vs baseline: -0.3%
Memory: โ 40.187MB (SLO: <41.000MB ๐ก -2.0%) vs baseline: +4.3%
โ re_groups_noaspect
Time: โ 1.705ยตs (SLO: <10.000ยตs ๐ -83.0%) vs baseline: -1.2%
Memory: โ 40.265MB (SLO: <41.000MB ๐ก -1.8%) vs baseline: +4.8%
โ re_match_aspect
Time: โ 2.758ยตs (SLO: <10.000ยตs ๐ -72.4%) vs baseline: ~same
Memory: โ 40.147MB (SLO: <41.000MB -2.1%) vs baseline: +4.8%
โ re_match_noaspect
Time: โ 1.311ยตs (SLO: <10.000ยตs ๐ -86.9%) vs baseline: -1.1%
Memory: โ 40.206MB (SLO: <41.000MB ๐ก -1.9%) vs baseline: +5.0%
โ re_search_aspect
Time: โ 2.575ยตs (SLO: <10.000ยตs ๐ -74.3%) vs baseline: -0.4%
Memory: โ 40.147MB (SLO: <41.000MB -2.1%) vs baseline: +5.0%
โ re_search_noaspect
Time: โ 1.196ยตs (SLO: <10.000ยตs ๐ -88.0%) vs baseline: -1.5%
Memory: โ 40.246MB (SLO: <41.000MB ๐ก -1.8%) vs baseline: +4.7%
โ re_sub_aspect
Time: โ 3.436ยตs (SLO: <10.000ยตs ๐ -65.6%) vs baseline: +0.1%
Memory: โ 40.324MB (SLO: <41.000MB ๐ก -1.6%) vs baseline: +5.2%
โ re_sub_noaspect
Time: โ 1.534ยตs (SLO: <10.000ยตs ๐ -84.7%) vs baseline: +0.3%
Memory: โ 40.285MB (SLO: <41.000MB ๐ก -1.7%) vs baseline: +5.3%
โ re_subn_aspect
Time: โ 3.668ยตs (SLO: <10.000ยตs ๐ -63.3%) vs baseline: -0.4%
Memory: โ 40.305MB (SLO: <41.000MB ๐ก -1.7%) vs baseline: +5.0%
โ re_subn_noaspect
Time: โ 1.605ยตs (SLO: <10.000ยตs ๐ -83.9%) vs baseline: -0.1%
Memory: โ 40.167MB (SLO: <41.000MB -2.0%) vs baseline: +4.9%
๐ก iastaspects - 118/118
โ add_aspect
Time: โ 0.407ยตs (SLO: <10.000ยตs ๐ -95.9%) vs baseline: +1.0%
Memory: โ 40.344MB (SLO: <41.500MB -2.8%) vs baseline: +5.1%
โ add_inplace_aspect
Time: โ 0.404ยตs (SLO: <10.000ยตs ๐ -96.0%) vs baseline: ~same
Memory: โ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +5.0%
โ add_inplace_noaspect
Time: โ 0.319ยตs (SLO: <10.000ยตs ๐ -96.8%) vs baseline: +0.4%
Memory: โ 40.383MB (SLO: <41.500MB -2.7%) vs baseline: +5.0%
โ add_noaspect
Time: โ 0.279ยตs (SLO: <10.000ยตs ๐ -97.2%) vs baseline: +1.4%
Memory: โ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.7%
โ bytearray_aspect
Time: โ 1.339ยตs (SLO: <10.000ยตs ๐ -86.6%) vs baseline: -1.1%
Memory: โ 40.147MB (SLO: <41.500MB -3.3%) vs baseline: +4.3%
โ bytearray_extend_aspect
Time: โ 1.500ยตs (SLO: <10.000ยตs ๐ -85.0%) vs baseline: -1.5%
Memory: โ 40.167MB (SLO: <41.500MB -3.2%) vs baseline: +4.2%
โ bytearray_extend_noaspect
Time: โ 0.612ยตs (SLO: <10.000ยตs ๐ -93.9%) vs baseline: -0.3%
Memory: โ 40.088MB (SLO: <41.500MB -3.4%) vs baseline: +4.5%
โ bytearray_noaspect
Time: โ 0.483ยตs (SLO: <10.000ยตs ๐ -95.2%) vs baseline: +0.6%
Memory: โ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +5.1%
โ bytes_aspect
Time: โ 1.306ยตs (SLO: <10.000ยตs ๐ -86.9%) vs baseline: +1.3%
Memory: โ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.9%
โ bytes_noaspect
Time: โ 0.494ยตs (SLO: <10.000ยตs ๐ -95.1%) vs baseline: +0.4%
Memory: โ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +5.2%
โ bytesio_aspect
Time: โ 1.336ยตs (SLO: <10.000ยตs ๐ -86.6%) vs baseline: +1.5%
Memory: โ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +4.7%
โ bytesio_noaspect
Time: โ 0.494ยตs (SLO: <10.000ยตs ๐ -95.1%) vs baseline: -0.7%
Memory: โ 40.678MB (SLO: <41.500MB ๐ก -2.0%) vs baseline: +6.3%
โ capitalize_aspect
Time: โ 0.735ยตs (SLO: <10.000ยตs ๐ -92.6%) vs baseline: +0.4%
Memory: โ 40.364MB (SLO: <41.500MB -2.7%) vs baseline: +5.3%
โ capitalize_noaspect
Time: โ 0.434ยตs (SLO: <10.000ยตs ๐ -95.7%) vs baseline: ~same
Memory: โ 40.167MB (SLO: <41.500MB -3.2%) vs baseline: +4.3%
โ casefold_aspect
Time: โ 0.738ยตs (SLO: <10.000ยตs ๐ -92.6%) vs baseline: -0.1%
Memory: โ 40.344MB (SLO: <41.500MB -2.8%) vs baseline: +4.9%
โ casefold_noaspect
Time: โ 0.366ยตs (SLO: <10.000ยตs ๐ -96.3%) vs baseline: -0.2%
Memory: โ 40.501MB (SLO: <41.500MB -2.4%) vs baseline: +5.8%
โ decode_aspect
Time: โ 0.729ยตs (SLO: <10.000ยตs ๐ -92.7%) vs baseline: +0.3%
Memory: โ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.7%
โ decode_noaspect
Time: โ 0.422ยตs (SLO: <10.000ยตs ๐ -95.8%) vs baseline: +0.2%
Memory: โ 40.501MB (SLO: <41.500MB -2.4%) vs baseline: +5.6%
โ encode_aspect
Time: โ 0.713ยตs (SLO: <10.000ยตs ๐ -92.9%) vs baseline: +0.2%
Memory: โ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +4.6%
โ encode_noaspect
Time: โ 0.403ยตs (SLO: <10.000ยตs ๐ -96.0%) vs baseline: +0.9%
Memory: โ 40.423MB (SLO: <41.500MB -2.6%) vs baseline: +5.3%
โ format_aspect
Time: โ 3.442ยตs (SLO: <10.000ยตs ๐ -65.6%) vs baseline: ~same
Memory: โ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.6%
โ format_map_aspect
Time: โ 3.581ยตs (SLO: <10.000ยตs ๐ -64.2%) vs baseline: -0.5%
Memory: โ 40.324MB (SLO: <41.500MB -2.8%) vs baseline: +4.9%
โ format_map_noaspect
Time: โ 0.771ยตs (SLO: <10.000ยตs ๐ -92.3%) vs baseline: -0.4%
Memory: โ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.8%
โ format_noaspect
Time: โ 0.603ยตs (SLO: <10.000ยตs ๐ -94.0%) vs baseline: +2.0%
Memory: โ 40.383MB (SLO: <41.500MB -2.7%) vs baseline: +5.4%
โ index_aspect
Time: โ 0.357ยตs (SLO: <10.000ยตs ๐ -96.4%) vs baseline: +0.6%
Memory: โ 40.147MB (SLO: <41.500MB -3.3%) vs baseline: +4.2%
โ index_noaspect
Time: โ 0.278ยตs (SLO: <10.000ยตs ๐ -97.2%) vs baseline: -1.8%
Memory: โ 40.541MB (SLO: <41.500MB -2.3%) vs baseline: +5.6%
โ join_aspect
Time: โ 1.334ยตs (SLO: <10.000ยตs ๐ -86.7%) vs baseline: +0.4%
Memory: โ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +5.1%
โ join_noaspect
Time: โ 0.494ยตs (SLO: <10.000ยตs ๐ -95.1%) vs baseline: -0.1%
Memory: โ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +4.5%
โ ljust_aspect
Time: โ 2.606ยตs (SLO: <20.000ยตs ๐ -87.0%) vs baseline: -0.5%
Memory: โ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +5.1%
โ ljust_noaspect
Time: โ 0.405ยตs (SLO: <10.000ยตs ๐ -96.0%) vs baseline: -0.2%
Memory: โ 40.403MB (SLO: <41.500MB -2.6%) vs baseline: +5.4%
โ lower_aspect
Time: โ 2.300ยตs (SLO: <10.000ยตs ๐ -77.0%) vs baseline: +2.5%
Memory: โ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +5.1%
โ lower_noaspect
Time: โ 0.371ยตs (SLO: <10.000ยตs ๐ -96.3%) vs baseline: +1.1%
Memory: โ 40.344MB (SLO: <41.500MB -2.8%) vs baseline: +5.2%
โ lstrip_aspect
Time: โ 2.256ยตs (SLO: <20.000ยตs ๐ -88.7%) vs baseline: +0.6%
Memory: โ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +4.9%
โ lstrip_noaspect
Time: โ 0.383ยตs (SLO: <10.000ยตs ๐ -96.2%) vs baseline: ~same
Memory: โ 40.324MB (SLO: <41.500MB -2.8%) vs baseline: +4.9%
โ modulo_aspect
Time: โ 1.043ยตs (SLO: <10.000ยตs ๐ -89.6%) vs baseline: +4.2%
Memory: โ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.6%
โ modulo_aspect_for_bytearray_bytearray
Time: โ 1.542ยตs (SLO: <10.000ยตs ๐ -84.6%) vs baseline: -1.3%
Memory: โ 40.108MB (SLO: <41.500MB -3.4%) vs baseline: +4.2%
โ modulo_aspect_for_bytes
Time: โ 0.979ยตs (SLO: <10.000ยตs ๐ -90.2%) vs baseline: +0.6%
Memory: โ 40.147MB (SLO: <41.500MB -3.3%) vs baseline: +4.6%
โ modulo_aspect_for_bytes_bytearray
Time: โ 1.240ยตs (SLO: <10.000ยตs ๐ -87.6%) vs baseline: +0.7%
Memory: โ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.6%
โ modulo_noaspect
Time: โ 0.632ยตs (SLO: <10.000ยตs ๐ -93.7%) vs baseline: +0.8%
Memory: โ 40.600MB (SLO: <41.500MB -2.2%) vs baseline: +5.5%
โ replace_aspect
Time: โ 4.870ยตs (SLO: <10.000ยตs ๐ -51.3%) vs baseline: -0.9%
Memory: โ 40.285MB (SLO: <41.500MB -2.9%) vs baseline: +5.2%
โ replace_noaspect
Time: โ 0.461ยตs (SLO: <10.000ยตs ๐ -95.4%) vs baseline: +0.2%
Memory: โ 40.600MB (SLO: <41.500MB -2.2%) vs baseline: +5.9%
โ repr_aspect
Time: โ 0.911ยตs (SLO: <10.000ยตs ๐ -90.9%) vs baseline: +0.6%
Memory: โ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.5%
โ repr_noaspect
Time: โ 0.414ยตs (SLO: <10.000ยตs ๐ -95.9%) vs baseline: -1.1%
Memory: โ 40.285MB (SLO: <41.500MB -2.9%) vs baseline: +4.9%
โ rstrip_aspect
Time: โ 1.952ยตs (SLO: <20.000ยตs ๐ -90.2%) vs baseline: +1.3%
Memory: โ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.7%
โ rstrip_noaspect
Time: โ 0.379ยตs (SLO: <10.000ยตs ๐ -96.2%) vs baseline: -1.9%
Memory: โ 40.442MB (SLO: <41.500MB -2.5%) vs baseline: +5.0%
โ slice_aspect
Time: โ 0.492ยตs (SLO: <10.000ยตs ๐ -95.1%) vs baseline: -0.3%
Memory: โ 40.364MB (SLO: <41.500MB -2.7%) vs baseline: +5.3%
โ slice_noaspect
Time: โ 0.446ยตs (SLO: <10.000ยตs ๐ -95.5%) vs baseline: -1.0%
Memory: โ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +4.9%
โ stringio_aspect
Time: โ 1.561ยตs (SLO: <10.000ยตs ๐ -84.4%) vs baseline: +1.4%
Memory: โ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +4.9%
โ stringio_noaspect
Time: โ 0.721ยตs (SLO: <10.000ยตs ๐ -92.8%) vs baseline: +1.2%
Memory: โ 40.423MB (SLO: <41.500MB -2.6%) vs baseline: +5.4%
โ strip_aspect
Time: โ 2.243ยตs (SLO: <20.000ยตs ๐ -88.8%) vs baseline: +0.2%
Memory: โ 40.285MB (SLO: <41.500MB -2.9%) vs baseline: +4.9%
โ strip_noaspect
Time: โ 0.386ยตs (SLO: <10.000ยตs ๐ -96.1%) vs baseline: +0.5%
Memory: โ 40.501MB (SLO: <41.500MB -2.4%) vs baseline: +5.4%
โ swapcase_aspect
Time: โ 2.504ยตs (SLO: <10.000ยตs ๐ -75.0%) vs baseline: +2.6%
Memory: โ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +5.0%
โ swapcase_noaspect
Time: โ 0.538ยตs (SLO: <10.000ยตs ๐ -94.6%) vs baseline: -0.3%
Memory: โ 40.521MB (SLO: <41.500MB -2.4%) vs baseline: +5.1%
โ title_aspect
Time: โ 2.433ยตs (SLO: <10.000ยตs ๐ -75.7%) vs baseline: +2.7%
Memory: โ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.6%
โ title_noaspect
Time: โ 0.502ยตs (SLO: <10.000ยตs ๐ -95.0%) vs baseline: -0.5%
Memory: โ 40.364MB (SLO: <41.500MB -2.7%) vs baseline: +5.0%
โ translate_aspect
Time: โ 3.323ยตs (SLO: <10.000ยตs ๐ -66.8%) vs baseline: +1.2%
Memory: โ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.7%
โ translate_noaspect
Time: โ 1.045ยตs (SLO: <10.000ยตs ๐ -89.6%) vs baseline: +0.6%
Memory: โ 40.167MB (SLO: <41.500MB -3.2%) vs baseline: +4.8%
โ upper_aspect
Time: โ 2.325ยตs (SLO: <10.000ยตs ๐ -76.8%) vs baseline: +2.8%
Memory: โ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +5.1%
โ upper_noaspect
Time: โ 0.374ยตs (SLO: <10.000ยตs ๐ -96.3%) vs baseline: +1.4%
Memory: โ 40.344MB (SLO: <41.500MB -2.8%)
๐ก otelspan - 22/22
โ add-event
Time: โ 40.250ms (SLO: <47.150ms ๐ -14.6%) vs baseline: +0.1%
Memory: โ 39.581MB (SLO: <47.000MB ๐ -15.8%) vs baseline: +5.4%
โ add-metrics
Time: โ 260.605ms (SLO: <344.800ms ๐ -24.4%) vs baseline: -0.4%
Memory: โ 43.674MB (SLO: <47.500MB -8.1%) vs baseline: +4.6%
โ add-tags
Time: โ 318.254ms (SLO: <321.000ms ๐ก -0.9%) vs baseline: -0.4%
Memory: โ 43.791MB (SLO: <47.500MB -7.8%) vs baseline: +5.1%
โ get-context
Time: โ 80.388ms (SLO: <92.350ms ๐ -13.0%) vs baseline: +0.2%
Memory: โ 39.909MB (SLO: <46.500MB ๐ -14.2%) vs baseline: +4.7%
โ is-recording
Time: โ 38.008ms (SLO: <44.500ms ๐ -14.6%) vs baseline: ~same
Memory: โ 39.459MB (SLO: <47.500MB ๐ -16.9%) vs baseline: +4.7%
โ record-exception
Time: โ 58.896ms (SLO: <67.650ms ๐ -12.9%) vs baseline: +0.3%
Memory: โ 39.988MB (SLO: <47.000MB ๐ -14.9%) vs baseline: +4.5%
โ set-status
Time: โ 44.088ms (SLO: <50.400ms ๐ -12.5%) vs baseline: -0.5%
Memory: โ 39.451MB (SLO: <47.000MB ๐ -16.1%) vs baseline: +4.5%
โ start
Time: โ 37.964ms (SLO: <43.450ms ๐ -12.6%) vs baseline: +2.0%
Memory: โ 39.556MB (SLO: <47.000MB ๐ -15.8%) vs baseline: +5.1%
โ start-finish
Time: โ 82.794ms (SLO: <88.000ms -5.9%) vs baseline: +0.2%
Memory: โ 37.238MB (SLO: <46.500MB ๐ -19.9%) vs baseline: +4.7%
โ start-finish-telemetry
Time: โ 84.148ms (SLO: <89.000ms -5.5%) vs baseline: ~same
Memory: โ 37.336MB (SLO: <46.500MB ๐ -19.7%) vs baseline: +4.9%
โ update-name
Time: โ 38.614ms (SLO: <45.150ms ๐ -14.5%) vs baseline: -0.5%
Memory: โ 39.674MB (SLO: <47.000MB ๐ -15.6%) vs baseline: +5.0%
๐ก ratelimiter - 12/12
โ defaults
Time: โ 2.354ยตs (SLO: <10.000ยตs ๐ -76.5%) vs baseline: +0.6%
Memory: โ 35.134MB (SLO: <35.500MB ๐ก -1.0%) vs baseline: +5.2%
โ high_rate_limit
Time: โ 2.427ยตs (SLO: <10.000ยตs ๐ -75.7%) vs baseline: -0.2%
Memory: โ 35.075MB (SLO: <35.500MB ๐ก -1.2%) vs baseline: +4.9%
โ long_window
Time: โ 2.359ยตs (SLO: <10.000ยตs ๐ -76.4%) vs baseline: -0.4%
Memory: โ 35.095MB (SLO: <35.500MB ๐ก -1.1%) vs baseline: +4.7%
โ low_rate_limit
Time: โ 2.364ยตs (SLO: <10.000ยตs ๐ -76.4%) vs baseline: ~same
Memory: โ 35.212MB (SLO: <35.500MB ๐ก -0.8%) vs baseline: +5.0%
โ no_rate_limit
Time: โ 0.827ยตs (SLO: <10.000ยตs ๐ -91.7%) vs baseline: -0.3%
Memory: โ 35.134MB (SLO: <35.500MB ๐ก -1.0%) vs baseline: +5.1%
โ short_window
Time: โ 2.494ยตs (SLO: <10.000ยตs ๐ -75.1%) vs baseline: ~same
Memory: โ 35.075MB (SLO: <35.500MB ๐ก -1.2%) vs baseline: +4.7%
๐ก recursivecomputation - 8/8
โ deep
Time: โ 308.924ms (SLO: <320.950ms -3.7%) vs baseline: +0.2%
Memory: โ 35.881MB (SLO: <36.500MB ๐ก -1.7%) vs baseline: +4.7%
โ deep-profiled
Time: โ 327.928ms (SLO: <359.150ms -8.7%) vs baseline: -0.6%
Memory: โ 39.833MB (SLO: <40.500MB ๐ก -1.6%) vs baseline: +4.9%
โ medium
Time: โ 6.996ms (SLO: <7.400ms -5.5%) vs baseline: -0.2%
Memory: โ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +4.6%
โ shallow
Time: โ 0.949ms (SLO: <1.050ms -9.7%) vs baseline: +0.9%
Memory: โ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.9%
๐ก sethttpmeta - 32/32
โ all-disabled
Time: โ 10.589ยตs (SLO: <20.000ยตs ๐ -47.1%) vs baseline: +1.0%
Memory: โ 35.586MB (SLO: <36.000MB ๐ก -1.1%) vs baseline: +4.6%
โ all-enabled
Time: โ 40.742ยตs (SLO: <50.000ยตs ๐ -18.5%) vs baseline: +1.5%
Memory: โ 35.507MB (SLO: <36.000MB ๐ก -1.4%) vs baseline: +4.3%
โ collectipvariant_exists
Time: โ 41.048ยตs (SLO: <50.000ยตs ๐ -17.9%) vs baseline: +0.4%
Memory: โ 35.350MB (SLO: <36.000MB ๐ก -1.8%) vs baseline: +4.2%
โ no-collectipvariant
Time: โ 40.008ยตs (SLO: <50.000ยตs ๐ -20.0%) vs baseline: +0.5%
Memory: โ 35.370MB (SLO: <36.000MB ๐ก -1.8%) vs baseline: +4.2%
โ no-useragentvariant
Time: โ 38.914ยตs (SLO: <50.000ยตs ๐ -22.2%) vs baseline: +0.6%
Memory: โ 35.193MB (SLO: <36.000MB -2.2%) vs baseline: +3.6%
โ obfuscation-no-query
Time: โ 40.564ยตs (SLO: <50.000ยตs ๐ -18.9%) vs baseline: +0.1%
Memory: โ 35.370MB (SLO: <36.000MB ๐ก -1.8%) vs baseline: +4.1%
โ obfuscation-regular-case-explicit-query
Time: โ 76.038ยตs (SLO: <90.000ยตs ๐ -15.5%) vs baseline: -0.1%
Memory: โ 35.665MB (SLO: <36.500MB -2.3%) vs baseline: +4.6%
โ obfuscation-regular-case-implicit-query
Time: โ 76.346ยตs (SLO: <90.000ยตs ๐ -15.2%) vs baseline: -0.1%
Memory: โ 35.684MB (SLO: <36.500MB -2.2%) vs baseline: +5.1%
โ obfuscation-send-querystring-disabled
Time: โ 154.650ยตs (SLO: <170.000ยตs -9.0%) vs baseline: ~same
Memory: โ 35.665MB (SLO: <36.500MB -2.3%) vs baseline: +4.8%
โ obfuscation-worst-case-explicit-query
Time: โ 149.035ยตs (SLO: <160.000ยตs -6.9%) vs baseline: ~same
Memory: โ 35.684MB (SLO: <36.500MB -2.2%) vs baseline: +5.1%
โ obfuscation-worst-case-implicit-query
Time: โ 154.936ยตs (SLO: <170.000ยตs -8.9%) vs baseline: ~same
Memory: โ 35.704MB (SLO: <36.500MB -2.2%) vs baseline: +4.9%
โ useragentvariant_exists_1
Time: โ 39.531ยตs (SLO: <50.000ยตs ๐ -20.9%) vs baseline: +0.3%
Memory: โ 35.448MB (SLO: <36.000MB ๐ก -1.5%) vs baseline: +4.1%
โ useragentvariant_exists_2
Time: โ 40.572ยตs (SLO: <50.000ยตs ๐ -18.9%) vs baseline: +0.2%
Memory: โ 35.429MB (SLO: <36.000MB ๐ก -1.6%) vs baseline: +4.3%
โ useragentvariant_exists_3
Time: โ 39.970ยตs (SLO: <50.000ยตs ๐ -20.1%) vs baseline: -0.3%
Memory: โ 35.212MB (SLO: <36.000MB -2.2%) vs baseline: +4.3%
โ useragentvariant_not_exists_1
Time: โ 39.509ยตs (SLO: <50.000ยตs ๐ -21.0%) vs baseline: +0.2%
Memory: โ 35.330MB (SLO: <36.000MB ๐ก -1.9%) vs baseline: +3.9%
โ useragentvariant_not_exists_2
Time: โ 39.464ยตs (SLO: <50.000ยตs ๐ -21.1%) vs baseline: ~same
Memory: โ 35.291MB (SLO: <36.000MB ๐ก -2.0%) vs baseline: +3.5%
๐ก span - 26/26
โ add-event
Time: โ 18.171ms (SLO: <22.500ms ๐ -19.2%) vs baseline: -0.2%
Memory: โ 36.933MB (SLO: <53.000MB ๐ -30.3%) vs baseline: +4.9%
โ add-metrics
Time: โ 88.329ms (SLO: <93.500ms -5.5%) vs baseline: +0.3%
Memory: โ 41.032MB (SLO: <53.000MB ๐ -22.6%) vs baseline: +4.8%
โ add-tags
Time: โ 141.966ms (SLO: <155.000ms -8.4%) vs baseline: -0.8%
Memory: โ 41.145MB (SLO: <53.000MB ๐ -22.4%) vs baseline: +4.9%
โ get-context
Time: โ 17.008ms (SLO: <20.500ms ๐ -17.0%) vs baseline: +0.3%
Memory: โ 36.724MB (SLO: <53.000MB ๐ -30.7%) vs baseline: +4.6%
โ is-recording
Time: โ 17.319ms (SLO: <20.500ms ๐ -15.5%) vs baseline: ~same
Memory: โ 36.783MB (SLO: <53.000MB ๐ -30.6%) vs baseline: +4.8%
โ record-exception
Time: โ 36.743ms (SLO: <40.000ms -8.1%) vs baseline: +0.8%
Memory: โ 37.227MB (SLO: <53.000MB ๐ -29.8%) vs baseline: +4.6%
โ set-status
Time: โ 18.711ms (SLO: <22.000ms ๐ -14.9%) vs baseline: -0.2%
Memory: โ 36.723MB (SLO: <53.000MB ๐ -30.7%) vs baseline: +5.0%
โ start
Time: โ 17.488ms (SLO: <20.500ms ๐ -14.7%) vs baseline: +3.6%
Memory: โ 36.667MB (SLO: <53.000MB ๐ -30.8%) vs baseline: +4.5%
โ start-finish
Time: โ 50.862ms (SLO: <52.500ms -3.1%) vs baseline: ~same
Memory: โ 34.682MB (SLO: <35.500MB -2.3%) vs baseline: +4.7%
โ start-finish-telemetry
Time: โ 52.247ms (SLO: <54.500ms -4.1%) vs baseline: -0.2%
Memory: โ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +5.0%
โ start-finish-traceid128
Time: โ 54.185ms (SLO: <57.000ms -4.9%) vs baseline: -0.3%
Memory: โ 34.800MB (SLO: <35.500MB ๐ก -2.0%) vs baseline: +5.2%
โ start-traceid128
Time: โ 17.334ms (SLO: <22.500ms ๐ -23.0%) vs baseline: +0.8%
Memory: โ 36.647MB (SLO: <53.000MB ๐ -30.9%) vs baseline: +4.9%
โ update-name
Time: โ 17.246ms (SLO: <22.000ms ๐ -21.6%) vs baseline: -0.8%
Memory: โ 36.792MB (SLO: <53.000MB ๐ -30.6%) vs baseline: +4.8%
๐ก tracer - 6/6
โ large
Time: โ 29.416ms (SLO: <32.950ms ๐ -10.7%) vs baseline: +0.7%
Memory: โ 35.901MB (SLO: <36.500MB ๐ก -1.6%) vs baseline: +4.6%
โ medium
Time: โ 2.893ms (SLO: <3.200ms -9.6%) vs baseline: +0.2%
Memory: โ 34.682MB (SLO: <35.500MB -2.3%) vs baseline: +4.9%
โ small
Time: โ 330.875ยตs (SLO: <370.000ยตs ๐ -10.6%) vs baseline: +1.5%
Memory: โ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.7%
โ ๏ธ Unstable Tests (1 suite)
โ ๏ธ packagesupdateimporteddependencies - 24/24 (1 unstable)
โ import_many
Time: โ 154.642ยตs (SLO: <170.000ยตs -9.0%) vs baseline: +0.2%
Memory: โ 39.779MB (SLO: <41.000MB -3.0%) vs baseline: +4.8%
โ import_many_cached
Time: โ 121.602ยตs (SLO: <130.000ยตs -6.5%) vs baseline: +0.1%
Memory: โ 39.683MB (SLO: <41.000MB -3.2%) vs baseline: +4.9%
โ import_many_stdlib
Time: โ 0.753ms (SLO: <1.750ms ๐ -56.9%) vs baseline: -0.3%
Memory: โ 39.648MB (SLO: <41.000MB -3.3%) vs baseline: +5.1%
โ ๏ธ import_many_stdlib_cached
Time: โ ๏ธ 0.173ms (SLO: <1.100ms ๐ -84.3%) vs baseline: +0.3%
Memory: โ 39.699MB (SLO: <41.000MB -3.2%) vs baseline: +5.0%
โ import_many_unknown
Time: โ 828.694ยตs (SLO: <890.000ยตs -6.9%) vs baseline: ~same
Memory: โ 39.876MB (SLO: <41.000MB -2.7%) vs baseline: +4.7%
โ import_many_unknown_cached
Time: โ 795.024ยตs (SLO: <870.000ยตs -8.6%) vs baseline: -0.6%
Memory: โ 39.794MB (SLO: <41.000MB -2.9%) vs baseline: +4.6%
โ import_one
Time: โ 19.798ยตs (SLO: <30.000ยตs ๐ -34.0%) vs baseline: +0.3%
Memory: โ 39.754MB (SLO: <41.000MB -3.0%) vs baseline: +5.2%
โ import_one_cache
Time: โ 6.262ยตs (SLO: <10.000ยตs ๐ -37.4%) vs baseline: ~same
Memory: โ 39.713MB (SLO: <41.000MB -3.1%) vs baseline: +4.7%
โ import_one_stdlib
Time: โ 18.661ยตs (SLO: <20.000ยตs -6.7%) vs baseline: ~same
Memory: โ 39.597MB (SLO: <41.000MB -3.4%) vs baseline: +4.3%
โ import_one_stdlib_cache
Time: โ 6.281ยตs (SLO: <10.000ยตs ๐ -37.2%) vs baseline: -0.4%
Memory: โ 39.642MB (SLO: <41.000MB -3.3%) vs baseline: +4.5%
โ import_one_unknown
Time: โ 45.780ยตs (SLO: <50.000ยตs -8.4%) vs baseline: +1.2%
Memory: โ 39.746MB (SLO: <41.000MB -3.1%) vs baseline: +5.4%
โ import_one_unknown_cache
Time: โ 6.251ยตs (SLO: <10.000ยตs ๐ -37.5%) vs baseline: -0.2%
Memory: โ 39.648MB (SLO: <41.000MB -3.3%) vs baseline: +4.4%
โ All Tests Passing (5 suites)
โ flasksqli - 5/5
โ appsec-enabled
Time: โ 2.065ms (SLO: <4.200ms ๐ -50.8%) vs baseline: +0.3%
Memory: โ 55.699MB (SLO: <66.000MB ๐ -15.6%) vs baseline: +4.7%
โ iast-enabled
Time: โ 2.062ms (SLO: <2.800ms ๐ -26.4%) vs baseline: ~same
Memory: โ 55.719MB (SLO: <62.500MB ๐ -10.9%) vs baseline: +4.7%
โ tracer-enabled
Time: โ 2.055ms (SLO: <2.250ms -8.7%) vs baseline: -0.3%
โ iastpropagation - 8/8
โ no-propagation
Time: โ 48.691ยตs (SLO: <60.000ยตs ๐ -18.8%) vs baseline: +0.1%
Memory: โ 40.108MB (SLO: <42.000MB -4.5%) vs baseline: +4.8%
โ propagation_enabled
Time: โ 173.697ยตs (SLO: <190.000ยตs -8.6%) vs baseline: -1.1%
Memory: โ 40.010MB (SLO: <42.000MB -4.7%) vs baseline: +4.6%
โ propagation_enabled_100
Time: โ 1.937ms (SLO: <2.300ms ๐ -15.8%) vs baseline: +0.5%
Memory: โ 40.108MB (SLO: <42.000MB -4.5%) vs baseline: +4.7%
โ propagation_enabled_1000
Time: โ 32.453ms (SLO: <34.550ms -6.1%) vs baseline: -0.4%
Memory: โ 40.147MB (SLO: <42.000MB -4.4%) vs baseline: +5.1%
โ otelsdkspan - 24/24
โ add-event
Time: โ 40.440ms (SLO: <42.000ms -3.7%) vs baseline: +0.2%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +5.0%
โ add-link
Time: โ 36.101ms (SLO: <38.550ms -6.4%) vs baseline: ~same
Memory: โ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.6%
โ add-metrics
Time: โ 220.199ms (SLO: <232.000ms -5.1%) vs baseline: +0.7%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +5.1%
โ add-tags
Time: โ 213.538ms (SLO: <221.600ms -3.6%) vs baseline: -0.7%
Memory: โ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +4.5%
โ get-context
Time: โ 29.266ms (SLO: <31.300ms -6.5%) vs baseline: +0.8%
Memory: โ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +4.6%
โ is-recording
Time: โ 29.307ms (SLO: <31.000ms -5.5%) vs baseline: +0.2%
Memory: โ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%
โ record-exception
Time: โ 63.191ms (SLO: <65.850ms -4.0%) vs baseline: +0.2%
Memory: โ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.8%
โ set-status
Time: โ 32.280ms (SLO: <34.150ms -5.5%) vs baseline: +0.3%
Memory: โ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.5%
โ start
Time: โ 29.335ms (SLO: <30.150ms -2.7%) vs baseline: +1.6%
Memory: โ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%
โ start-finish
Time: โ 34.149ms (SLO: <35.350ms -3.4%) vs baseline: +0.2%
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.2%
โ start-finish-telemetry
Time: โ 34.146ms (SLO: <35.450ms -3.7%) vs baseline: +0.5%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%
โ update-name
Time: โ 31.144ms (SLO: <33.400ms -6.8%) vs baseline: ~same
Memory: โ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.5%
โ packagespackageforrootmodulemapping - 4/4
โ cache_off
Time: โ 341.795ms (SLO: <354.300ms -3.5%) vs baseline: -1.1%
Memory: โ 40.618MB (SLO: <41.500MB -2.1%) vs baseline: +4.9%
โ cache_on
Time: โ 0.381ยตs (SLO: <10.000ยตs ๐ -96.2%) vs baseline: +0.2%
Memory: โ 39.223MB (SLO: <41.000MB -4.3%) vs baseline: +5.0%
โ samplingrules - 8/8
โ average_match
Time: โ 138.172ยตs (SLO: <290.000ยตs ๐ -52.4%) vs baseline: +0.2%
Memory: โ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +5.2%
โ high_match
Time: โ 174.625ยตs (SLO: <480.000ยตs ๐ -63.6%) vs baseline: +0.4%
Memory: โ 34.682MB (SLO: <35.500MB -2.3%) vs baseline: +4.7%
โ low_match
Time: โ 99.164ยตs (SLO: <120.000ยตs ๐ -17.4%) vs baseline: +0.8%
Memory: โ 603.597MB (SLO: <700.000MB ๐ -13.8%) vs baseline: +4.9%
โ very_low_match
Time: โ 2.654ms (SLO: <8.500ms ๐ -68.8%) vs baseline: +0.2%
Memory: โ 70.956MB (SLO: <75.000MB -5.4%) vs baseline: +4.8%
โน๏ธ Scenarios Missing SLO Configuration (10 scenarios)
The following scenarios exist in candidate data but have no SLO thresholds configured:
coreapiscenario-core_dispatch_listenerscoreapiscenario-core_dispatch_no_listenerscoreapiscenario-core_dispatch_with_results_listenerscoreapiscenario-core_dispatch_with_results_no_listenersdjangosimple-baselineerrortrackingdjangosimple-baselineerrortrackingflasksqli-baselineflasksimple-baselineflasksqli-baselinesethttpmeta-obfuscation-disabled