dd-trace-py
dd-trace-py copied to clipboard
feat(LLMObs): update the prompt annotation
This PR updates the prompt typed dict extending it with a couple fields :
- name : name of the prompt
- chat_template : list of role,content pairs where content is a string template of a prompt It adds new ways to annotate the prompt both using :
- @llm(prompt={...})
- prompt_context(id, name, template, ...) It also adds the strict validation mode enabled in the @llm and prompt_context usages. Strict validation adds the following checks :
- id is mandatory
- either a template or a chat_template should be provided
- version must be semver compatible
Checklist
- [ ] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the library release note guidelines
- The change includes or references documentation updates if necessary
- Backport labels are set (if applicable)
Reviewer Checklist
- [ ] Reviewer has checked that all the criteria below are met
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking API changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the release branch maintenance policy
CODEOWNERS have been resolved as:
releasenotes/notes/update-prompt-annotation-0fa90edf6829fe1d.yaml @DataDog/apm-python
ddtrace/llmobs/_constants.py @DataDog/ml-observability
ddtrace/llmobs/_integrations/langchain.py @DataDog/ml-observability
ddtrace/llmobs/_llmobs.py @DataDog/ml-observability
ddtrace/llmobs/_utils.py @DataDog/ml-observability
ddtrace/llmobs/utils.py @DataDog/ml-observability
tests/llmobs/test_llmobs.py @DataDog/ml-observability
tests/llmobs/test_llmobs_service.py @DataDog/ml-observability
Benchmarks
Benchmark execution time: 2025-05-06 14:49:14
Comparing candidate commit f6c24466a6491ebdac8cb01f413d55ce34a8b03d in PR branch yahya/update-prompt-annotation with baseline commit 6fdbeb53155c9f6ecc5db77c7f180143a762344f in branch main.
Found 14 performance improvements and 7 performance regressions! Performance is the same for 479 metrics, 8 unstable metrics.
scenario:iast_aspects-modulo_aspect_for_bytes_bytearray
- ๐ฅ
execution_time[+125.615ns; +150.281ns] or [+12.331%; +14.752%]
scenario:iast_aspects-ospathbasename_aspect
- ๐ฅ
execution_time[+670.180ns; +826.476ns] or [+16.317%; +20.123%]
scenario:iast_aspects-ospathdirname_aspect
- ๐ฅ
execution_time[+819.660ns; +987.342ns] or [+18.290%; +22.031%]
scenario:iast_aspects-ospathjoin_aspect
- ๐ฅ
execution_time[+889.492ns; +955.990ns] or [+14.672%; +15.769%]
scenario:iast_aspects-ospathsplit_aspect
- ๐ฅ
execution_time[+815.233ns; +1019.160ns] or [+17.356%; +21.697%]
scenario:iast_aspects-ospathsplitext_aspect
- ๐ฅ
execution_time[+722.874ns; +856.940ns] or [+16.143%; +19.137%]
scenario:otelspan-start
- ๐ฅ
execution_time[+3.317ms; +5.438ms] or [+7.999%; +13.110%]
scenario:packagesupdateimporteddependencies-import_many
- ๐ฉ
execution_time[-27.035ms; -26.904ms] or [-99.670%; -99.186%]
scenario:packagesupdateimporteddependencies-import_many_cached
- ๐ฉ
execution_time[-27.520ยตs; -26.034ยตs] or [-18.652%; -17.645%]
scenario:packagesupdateimporteddependencies-import_many_stdlib
- ๐ฉ
execution_time[-727.892ms; -723.898ms] or [-100.174%; -99.624%]
scenario:packagesupdateimporteddependencies-import_many_stdlib_cached
- ๐ฉ
execution_time[-719.475ms; -715.970ms] or [-100.220%; -99.732%]
scenario:packagesupdateimporteddependencies-import_many_unknown
- ๐ฉ
execution_time[-29.911ms; -29.730ms] or [-97.598%; -97.005%]
scenario:packagesupdateimporteddependencies-import_many_unknown_cached
- ๐ฉ
execution_time[-236.099ยตs; -224.473ยตs] or [-23.063%; -21.928%]
scenario:packagesupdateimporteddependencies-import_one
- ๐ฉ
execution_time[-11.284ms; -11.233ms] or [-100.053%; -99.597%]
scenario:packagesupdateimporteddependencies-import_one_cache
- ๐ฉ
execution_time[-781.774ns; -682.389ns] or [-11.127%; -9.713%]
scenario:packagesupdateimporteddependencies-import_one_stdlib
- ๐ฉ
execution_time[-10.314ms; -10.268ms] or [-100.042%; -99.595%]
scenario:packagesupdateimporteddependencies-import_one_stdlib_cache
- ๐ฉ
execution_time[-674.695ns; -604.094ns] or [-9.774%; -8.751%]
scenario:packagesupdateimporteddependencies-import_one_unknown
- ๐ฉ
execution_time[-19.752ms; -19.644ms] or [-100.042%; -99.496%]
scenario:packagesupdateimporteddependencies-import_one_unknown_cache
- ๐ฉ
execution_time[-730.984ns; -632.508ns] or [-10.438%; -9.032%]
scenario:samplingrules-average_match
- ๐ฉ
execution_time[-188.597ยตs; -184.602ยตs] or [-36.357%; -35.587%]
scenario:samplingrules-low_match
- ๐ฉ
execution_time[-351.625ยตs; -347.101ยตs] or [-68.060%; -67.184%]
Bootstrap import analysis
Comparison of import times between this PR and base.
Summary
The average import time from this PR is: 273 ยฑ 5 ms.
The average import time from base is: 274 ยฑ 4 ms.
The import time difference between this PR and base is: -0.9 ยฑ 0.2 ms.
Import time breakdown
The following import paths have shrunk:
ddtrace.auto
1.911 ms
(0.70%)
ddtrace.bootstrap.sitecustomize
1.237 ms
(0.45%)
ddtrace.bootstrap.preload
1.237 ms
(0.45%)
ddtrace.internal.remoteconfig.client
0.626 ms
(0.23%)
ddtrace
0.674 ms
(0.25%)
ddtrace.internal._unpatched
0.030 ms
(0.01%)
json
0.030 ms
(0.01%)
json.decoder
0.030 ms
(0.01%)
re
0.030 ms
(0.01%)
enum
0.030 ms
(0.01%)
types
0.030 ms
(0.01%)
CODEOWNERS have been resolved as:
releasenotes/notes/update-prompt-annotation-0fa90edf6829fe1d.yaml @DataDog/apm-python
ddtrace/llmobs/_constants.py @DataDog/ml-observability
ddtrace/llmobs/_llmobs.py @DataDog/ml-observability
ddtrace/llmobs/_utils.py @DataDog/ml-observability
ddtrace/llmobs/utils.py @DataDog/ml-observability
tests/llmobs/test_llmobs.py @DataDog/ml-observability
tests/llmobs/test_llmobs_service.py @DataDog/ml-observability
No data reported at this time.
This comment will be updated automatically if new data arrives.
๐ Commit SHA: 871f28f | Docs | Was this helpful? Give us feedback!
This pull request has been automatically closed after a period of inactivity. After this much time, it will likely be easier to open a new pull request with the same changes than to update this one from the base branch. Please comment or reopen if you think this pull request was closed in error.
Performance SLOs
Comparing candidate yahya/update-prompt-annotation (d9d6fc91f9d44edfbfd82ef589a873fa68c49579) with baseline main (fcacd83532e1275aee523650a45a0f25b44bae15)
๐ Performance Regressions (1 suite)
๐ iastaspectsospath - 24/24
โ ospathbasename_aspect
Time: โ 5.318ยตs (SLO: <10.000ยตs ๐ -46.8%) vs baseline: ๐ +21.9%
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%
โ ospathbasename_noaspect
Time: โ 1.088ยตs (SLO: <10.000ยตs ๐ -89.1%) vs baseline: +0.7%
Memory: โ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%
โ ospathjoin_aspect
Time: โ 6.666ยตs (SLO: <10.000ยตs ๐ -33.3%) vs baseline: +10.0%
Memory: โ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%
โ ospathjoin_noaspect
Time: โ 2.296ยตs (SLO: <10.000ยตs ๐ -77.0%) vs baseline: +0.4%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%
โ ospathnormcase_aspect
Time: โ 3.473ยตs (SLO: <10.000ยตs ๐ -65.3%) vs baseline: ~same
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%
โ ospathnormcase_noaspect
Time: โ 0.574ยตs (SLO: <10.000ยตs ๐ -94.3%) vs baseline: +0.9%
Memory: โ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%
โ ospathsplit_aspect
Time: โ 4.920ยตs (SLO: <10.000ยตs ๐ -50.8%) vs baseline: -0.2%
Memory: โ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%
โ ospathsplit_noaspect
Time: โ 1.612ยตs (SLO: <10.000ยตs ๐ -83.9%) vs baseline: +2.2%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%
โ ospathsplitdrive_aspect
Time: โ 4.233ยตs (SLO: <10.000ยตs ๐ -57.7%) vs baseline: ๐ +13.4%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%
โ ospathsplitdrive_noaspect
Time: โ 0.699ยตs (SLO: <10.000ยตs ๐ -93.0%) vs baseline: +0.4%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%
โ ospathsplitext_aspect
Time: โ 4.636ยตs (SLO: <10.000ยตs ๐ -53.6%) vs baseline: +0.7%
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%
โ ospathsplitext_noaspect
Time: โ 1.381ยตs (SLO: <10.000ยตs ๐ -86.2%) vs baseline: -0.4%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%
๐ก Near SLO Breach (2 suites)
๐ก djangosimple - 28/28
โ appsec
Time: โ 20.521ms (SLO: <22.300ms -8.0%) vs baseline: -0.2%
Memory: โ 65.209MB (SLO: <67.000MB -2.7%) vs baseline: +4.8%
โ exception-replay-enabled
Time: โ 1.346ms (SLO: <1.450ms -7.1%) vs baseline: +0.5%
Memory: โ 64.105MB (SLO: <67.000MB -4.3%) vs baseline: +4.8%
โ iast
Time: โ 20.495ms (SLO: <22.250ms -7.9%) vs baseline: -0.3%
Memory: โ 65.196MB (SLO: <67.000MB -2.7%) vs baseline: +4.7%
โ profiler
Time: โ 15.249ms (SLO: <16.550ms -7.9%) vs baseline: -0.4%
Memory: โ 53.302MB (SLO: <54.500MB -2.2%) vs baseline: +4.7%
โ span-code-origin
Time: โ 26.125ms (SLO: <28.200ms -7.4%) vs baseline: ~same
Memory: โ 67.421MB (SLO: <69.500MB -3.0%) vs baseline: +4.9%
โ tracer
Time: โ 20.498ms (SLO: <21.750ms -5.8%) vs baseline: ~same
Memory: โ 65.278MB (SLO: <67.000MB -2.6%) vs baseline: +4.9%
โ tracer-and-profiler
Time: โ 22.084ms (SLO: <23.500ms -6.0%) vs baseline: -0.7%
Memory: โ 66.414MB (SLO: <67.500MB ๐ก -1.6%) vs baseline: +5.0%
โ tracer-dont-create-db-spans
Time: โ 19.415ms (SLO: <21.500ms -9.7%) vs baseline: +0.2%
Memory: โ 65.243MB (SLO: <66.000MB ๐ก -1.1%) vs baseline: +4.7%
โ tracer-minimal
Time: โ 16.661ms (SLO: <17.500ms -4.8%) vs baseline: ~same
Memory: โ 65.047MB (SLO: <66.000MB ๐ก -1.4%) vs baseline: +5.1%
โ tracer-native
Time: โ 20.511ms (SLO: <21.750ms -5.7%) vs baseline: -0.2%
Memory: โ 71.054MB (SLO: <72.500MB ๐ก -2.0%) vs baseline: +4.8%
โ tracer-no-caches
Time: โ 18.422ms (SLO: <19.650ms -6.2%) vs baseline: -0.1%
Memory: โ 65.248MB (SLO: <67.000MB -2.6%) vs baseline: +4.9%
โ tracer-no-databases
Time: โ 18.778ms (SLO: <20.100ms -6.6%) vs baseline: -0.3%
Memory: โ 64.863MB (SLO: <67.000MB -3.2%) vs baseline: +4.8%
โ tracer-no-middleware
Time: โ 20.166ms (SLO: <21.500ms -6.2%) vs baseline: -0.3%
Memory: โ 65.254MB (SLO: <67.000MB -2.6%) vs baseline: +4.9%
โ tracer-no-templates
Time: โ 20.360ms (SLO: <22.000ms -7.5%) vs baseline: ~same
Memory: โ 65.220MB (SLO: <67.000MB -2.7%) vs baseline: +4.8%
๐ก otelspan - 22/22
โ add-event
Time: โ 45.274ms (SLO: <47.150ms -4.0%) vs baseline: +0.2%
Memory: โ 45.063MB (SLO: <47.000MB -4.1%) vs baseline: +4.9%
โ add-metrics
Time: โ 321.492ms (SLO: <344.800ms -6.8%) vs baseline: ~same
Memory: โ 553.509MB (SLO: <562.000MB ๐ก -1.5%) vs baseline: +5.1%
โ add-tags
Time: โ 292.543ms (SLO: <314.000ms -6.8%) vs baseline: ~same
Memory: โ 554.131MB (SLO: <563.500MB ๐ก -1.7%) vs baseline: +4.8%
โ get-context
Time: โ 82.651ms (SLO: <92.350ms ๐ -10.5%) vs baseline: ~same
Memory: โ 40.124MB (SLO: <46.500MB ๐ -13.7%) vs baseline: +4.6%
โ is-recording
Time: โ 42.726ms (SLO: <44.500ms -4.0%) vs baseline: -0.7%
Memory: โ 44.399MB (SLO: <47.500MB -6.5%) vs baseline: +4.6%
โ record-exception
Time: โ 61.656ms (SLO: <67.650ms -8.9%) vs baseline: +0.3%
Memory: โ 40.412MB (SLO: <47.000MB ๐ -14.0%) vs baseline: +4.7%
โ set-status
Time: โ 48.863ms (SLO: <50.400ms -3.1%) vs baseline: +0.6%
Memory: โ 44.347MB (SLO: <47.000MB -5.6%) vs baseline: +4.6%
โ start
Time: โ 42.065ms (SLO: <43.450ms -3.2%) vs baseline: +0.3%
Memory: โ 44.358MB (SLO: <47.000MB -5.6%) vs baseline: +4.7%
โ start-finish
Time: โ 84.306ms (SLO: <88.000ms -4.2%) vs baseline: +2.0%
Memory: โ 34.544MB (SLO: <46.500MB ๐ -25.7%) vs baseline: +4.9%
โ start-finish-telemetry
Time: โ 84.203ms (SLO: <89.000ms -5.4%) vs baseline: ~same
Memory: โ 34.544MB (SLO: <46.500MB ๐ -25.7%) vs baseline: +4.8%
โ update-name
Time: โ 44.116ms (SLO: <45.150ms -2.3%) vs baseline: ~same
Memory: โ 44.654MB (SLO: <47.000MB -5.0%) vs baseline: +4.8%
โ ๏ธ Unstable Tests (1 suite)
โ ๏ธ coreapiscenario - 12/12 (2 unstable)
โ ๏ธ context_with_data_listeners
Time: โ ๏ธ 13.411ยตs (SLO: <20.000ยตs ๐ -32.9%) vs baseline: +0.1%
Memory: โ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%
โ context_with_data_no_listeners
Time: โ 3.402ยตs (SLO: <10.000ยตs ๐ -66.0%) vs baseline: +0.2%
Memory: โ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.2%
โ ๏ธ context_with_data_only_all_listeners
Time: โ ๏ธ 13.467ยตs (SLO: <20.000ยตs ๐ -32.7%) vs baseline: +1.1%
Memory: โ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +5.0%
โ get_item_exists
Time: โ 0.576ยตs (SLO: <10.000ยตs ๐ -94.2%) vs baseline: -3.2%
Memory: โ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.9%
โ get_item_missing
Time: โ 0.634ยตs (SLO: <10.000ยตs ๐ -93.7%) vs baseline: -0.9%
Memory: โ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +4.9%
โ set_item
Time: โ 24.094ยตs (SLO: <30.000ยตs ๐ -19.7%) vs baseline: -0.2%
Memory: โ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%
โ All Tests Passing (20 suites)
โ errortrackingdjangosimple - 6/6
โ errortracking-enabled-all
Time: โ 18.056ms (SLO: <19.850ms -9.0%) vs baseline: ~same
Memory: โ 65.024MB (SLO: <66.500MB -2.2%) vs baseline: +4.8%
โ errortracking-enabled-user
Time: โ 18.040ms (SLO: <19.400ms -7.0%) vs baseline: ~same
Memory: โ 64.938MB (SLO: <66.500MB -2.3%) vs baseline: +4.8%
โ tracer-enabled
Time: โ 18.054ms (SLO: <19.450ms -7.2%) vs baseline: +0.6%
Memory: โ 64.920MB (SLO: <66.500MB -2.4%) vs baseline: +4.9%
โ errortrackingflasksqli - 6/6
โ errortracking-enabled-all
Time: โ 2.092ms (SLO: <2.300ms -9.0%) vs baseline: +0.2%
Memory: โ 51.767MB (SLO: <53.500MB -3.2%) vs baseline: +4.7%
โ errortracking-enabled-user
Time: โ 2.086ms (SLO: <2.250ms -7.3%) vs baseline: -0.3%
Memory: โ 51.826MB (SLO: <53.500MB -3.1%) vs baseline: +4.8%
โ tracer-enabled
Time: โ 2.089ms (SLO: <2.300ms -9.2%) vs baseline: -0.2%
Memory: โ 51.885MB (SLO: <53.500MB -3.0%) vs baseline: +5.1%
โ flasksimple - 16/16
โ appsec-get
Time: โ 4.575ms (SLO: <4.750ms -3.7%) vs baseline: -0.2%
Memory: โ 62.872MB (SLO: <65.000MB -3.3%) vs baseline: +5.0%
โ appsec-post
Time: โ 6.579ms (SLO: <6.750ms -2.5%) vs baseline: -0.3%
Memory: โ 63.088MB (SLO: <65.000MB -2.9%) vs baseline: +4.7%
โ appsec-telemetry
Time: โ 4.577ms (SLO: <4.750ms -3.6%) vs baseline: -0.5%
Memory: โ 62.839MB (SLO: <65.000MB -3.3%) vs baseline: +4.9%
โ debugger
Time: โ 1.855ms (SLO: <2.000ms -7.2%) vs baseline: -0.5%
Memory: โ 45.334MB (SLO: <47.000MB -3.5%) vs baseline: +4.6%
โ iast-get
Time: โ 1.865ms (SLO: <2.000ms -6.7%) vs baseline: -0.1%
Memory: โ 41.913MB (SLO: <49.000MB ๐ -14.5%) vs baseline: +4.7%
โ profiler
Time: โ 1.913ms (SLO: <2.100ms -8.9%) vs baseline: -0.5%
Memory: โ 45.124MB (SLO: <47.000MB -4.0%) vs baseline: +4.8%
โ tracer
Time: โ 3.374ms (SLO: <3.650ms -7.6%) vs baseline: -0.1%
Memory: โ 52.236MB (SLO: <53.500MB -2.4%) vs baseline: +4.9%
โ tracer-native
Time: โ 3.378ms (SLO: <3.650ms -7.4%) vs baseline: ~same
Memory: โ 58.019MB (SLO: <60.000MB -3.3%) vs baseline: +4.9%
โ flasksqli - 6/6
โ appsec-enabled
Time: โ 3.956ms (SLO: <4.200ms -5.8%) vs baseline: +0.4%
Memory: โ 63.131MB (SLO: <66.000MB -4.3%) vs baseline: +4.9%
โ iast-enabled
Time: โ 2.452ms (SLO: <2.800ms ๐ -12.4%) vs baseline: -0.3%
Memory: โ 58.629MB (SLO: <60.000MB -2.3%) vs baseline: +4.9%
โ tracer-enabled
Time: โ 2.084ms (SLO: <2.250ms -7.4%) vs baseline: +0.3%
Memory: โ 51.806MB (SLO: <54.500MB -4.9%) vs baseline: +4.9%
โ httppropagationextract - 60/60
โ all_styles_all_headers
Time: โ 80.488ยตs (SLO: <100.000ยตs ๐ -19.5%) vs baseline: -0.4%
Memory: โ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%
โ b3_headers
Time: โ 14.326ยตs (SLO: <20.000ยตs ๐ -28.4%) vs baseline: +0.5%
Memory: โ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.8%
โ b3_single_headers
Time: โ 13.431ยตs (SLO: <20.000ยตs ๐ -32.8%) vs baseline: +0.7%
Memory: โ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%
โ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match
Time: โ 63.809ยตs (SLO: <80.000ยตs ๐ -20.2%) vs baseline: +1.0%
Memory: โ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%
โ datadog_tracecontext_tracestate_propagated_on_trace_id_match
Time: โ 65.689ยตs (SLO: <80.000ยตs ๐ -17.9%) vs baseline: ~same
Memory: โ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%
โ empty_headers
Time: โ 1.593ยตs (SLO: <10.000ยตs ๐ -84.1%) vs baseline: -1.2%
Memory: โ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%
โ full_t_id_datadog_headers
Time: โ 24.172ยตs (SLO: <30.000ยตs ๐ -19.4%) vs baseline: +6.5%
Memory: โ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%
โ invalid_priority_header
Time: โ 6.562ยตs (SLO: <10.000ยตs ๐ -34.4%) vs baseline: +0.7%
Memory: โ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%
โ invalid_span_id_header
Time: โ 6.493ยตs (SLO: <10.000ยตs ๐ -35.1%) vs baseline: -0.3%
Memory: โ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%
โ invalid_tags_header
Time: โ 6.534ยตs (SLO: <10.000ยตs ๐ -34.7%) vs baseline: -0.3%
Memory: โ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%
โ invalid_trace_id_header
Time: โ 6.532ยตs (SLO: <10.000ยตs ๐ -34.7%) vs baseline: -0.2%
Memory: โ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%
โ large_header_no_matches
Time: โ 27.512ยตs (SLO: <30.000ยตs -8.3%) vs baseline: -0.2%
Memory: โ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%
โ large_valid_headers_all
Time: โ 28.735ยตs (SLO: <40.000ยตs ๐ -28.2%) vs baseline: ~same
Memory: โ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%
โ medium_header_no_matches
Time: โ 9.773ยตs (SLO: <20.000ยตs ๐ -51.1%) vs baseline: ~same
Memory: โ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%
โ medium_valid_headers_all
Time: โ 11.244ยตs (SLO: <20.000ยตs ๐ -43.8%) vs baseline: +0.5%
Memory: โ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%
โ none_propagation_style
Time: โ 1.688ยตs (SLO: <10.000ยตs ๐ -83.1%) vs baseline: -0.2%
Memory: โ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%
โ tracecontext_headers
Time: โ 34.500ยตs (SLO: <40.000ยตs ๐ -13.7%) vs baseline: +0.4%
Memory: โ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%
โ valid_headers_all
Time: โ 6.532ยตs (SLO: <10.000ยตs ๐ -34.7%) vs baseline: +0.5%
Memory: โ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%
โ valid_headers_basic
Time: โ 6.096ยตs (SLO: <10.000ยตs ๐ -39.0%) vs baseline: ~same
Memory: โ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%
โ wsgi_empty_headers
Time: โ 1.581ยตs (SLO: <10.000ยตs ๐ -84.2%) vs baseline: -0.7%
Memory: โ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%
โ wsgi_invalid_priority_header
Time: โ 6.638ยตs (SLO: <10.000ยตs ๐ -33.6%) vs baseline: +1.0%
Memory: โ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%
โ wsgi_invalid_span_id_header
Time: โ 1.587ยตs (SLO: <10.000ยตs ๐ -84.1%) vs baseline: +0.3%
Memory: โ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%
โ wsgi_invalid_tags_header
Time: โ 6.586ยตs (SLO: <10.000ยตs ๐ -34.1%) vs baseline: +0.2%
Memory: โ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%
โ wsgi_invalid_trace_id_header
Time: โ 6.605ยตs (SLO: <10.000ยตs ๐ -34.0%) vs baseline: +0.6%
Memory: โ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%
โ wsgi_large_header_no_matches
Time: โ 28.671ยตs (SLO: <40.000ยตs ๐ -28.3%) vs baseline: +0.4%
Memory: โ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%
โ wsgi_large_valid_headers_all
Time: โ 29.861ยตs (SLO: <40.000ยตs ๐ -25.3%) vs baseline: ~same
Memory: โ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%
โ wsgi_medium_header_no_matches
Time: โ 10.031ยตs (SLO: <20.000ยตs ๐ -49.8%) vs baseline: -0.5%
Memory: โ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%
โ wsgi_medium_valid_headers_all
Time: โ 11.435ยตs (SLO: <20.000ยตs ๐ -42.8%) vs baseline: +0.2%
Memory: โ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%
โ wsgi_valid_headers_all
Time: โ 6.559ยตs (SLO: <10.000ยตs ๐ -34.4%) vs baseline: -0.5%
Memory: โ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%
โ wsgi_valid_headers_basic
Time: โ 6.205ยตs (SLO: <10.000ยตs ๐ -37.9%) vs baseline: +1.6%
Memory: โ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%
โ httppropagationinject - 16/16
โ ids_only
Time: โ 21.964ยตs (SLO: <30.000ยตs ๐ -26.8%) vs baseline: +0.7%
Memory: โ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%
โ with_all
Time: โ 29.416ยตs (SLO: <40.000ยตs ๐ -26.5%) vs baseline: +0.7%
Memory: โ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%
โ with_dd_origin
Time: โ 25.674ยตs (SLO: <30.000ยตs ๐ -14.4%) vs baseline: +0.5%
Memory: โ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%
โ with_priority_and_origin
Time: โ 25.654ยตs (SLO: <40.000ยตs ๐ -35.9%) vs baseline: +2.3%
Memory: โ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%
โ with_sampling_priority
Time: โ 21.846ยตs (SLO: <30.000ยตs ๐ -27.2%) vs baseline: ~same
Memory: โ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%
โ with_tags
Time: โ 28.365ยตs (SLO: <40.000ยตs ๐ -29.1%) vs baseline: +4.0%
Memory: โ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%
โ with_tags_invalid
Time: โ 28.775ยตs (SLO: <40.000ยตs ๐ -28.1%) vs baseline: -0.2%
Memory: โ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.1%
โ with_tags_max_size
Time: โ 27.905ยตs (SLO: <40.000ยตs ๐ -30.2%) vs baseline: +0.7%
Memory: โ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%
โ iast_aspects - 40/40
โ re_expand_aspect
Time: โ 33.853ยตs (SLO: <40.000ยตs ๐ -15.4%) vs baseline: +5.5%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%
โ re_expand_noaspect
Time: โ 29.828ยตs (SLO: <40.000ยตs ๐ -25.4%) vs baseline: +4.2%
Memory: โ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.5%
โ re_findall_aspect
Time: โ 2.886ยตs (SLO: <10.000ยตs ๐ -71.1%) vs baseline: -1.3%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%
โ re_findall_noaspect
Time: โ 1.406ยตs (SLO: <10.000ยตs ๐ -85.9%) vs baseline: -0.8%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%
โ re_finditer_aspect
Time: โ 4.540ยตs (SLO: <10.000ยตs ๐ -54.6%) vs baseline: +0.2%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%
โ re_finditer_noaspect
Time: โ 1.408ยตs (SLO: <10.000ยตs ๐ -85.9%) vs baseline: +0.5%
Memory: โ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%
โ re_fullmatch_aspect
Time: โ 3.042ยตs (SLO: <10.000ยตs ๐ -69.6%) vs baseline: +9.1%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%
โ re_fullmatch_noaspect
Time: โ 1.302ยตs (SLO: <10.000ยตs ๐ -87.0%) vs baseline: +0.5%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%
โ re_group_aspect
Time: โ 3.218ยตs (SLO: <10.000ยตs ๐ -67.8%) vs baseline: +7.0%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%
โ re_group_noaspect
Time: โ 1.585ยตs (SLO: <10.000ยตs ๐ -84.2%) vs baseline: -2.6%
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%
โ re_groups_aspect
Time: โ 3.363ยตs (SLO: <10.000ยตs ๐ -66.4%) vs baseline: +6.3%
Memory: โ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%
โ re_groups_noaspect
Time: โ 1.698ยตs (SLO: <10.000ยตs ๐ -83.0%) vs baseline: +0.3%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%
โ re_match_aspect
Time: โ 3.093ยตs (SLO: <10.000ยตs ๐ -69.1%) vs baseline: +8.1%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%
โ re_match_noaspect
Time: โ 1.296ยตs (SLO: <10.000ยตs ๐ -87.0%) vs baseline: -0.3%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%
โ re_search_aspect
Time: โ 2.619ยตs (SLO: <10.000ยตs ๐ -73.8%) vs baseline: -0.7%
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%
โ re_search_noaspect
Time: โ 1.202ยตs (SLO: <10.000ยตs ๐ -88.0%) vs baseline: -0.2%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%
โ re_sub_aspect
Time: โ 3.464ยตs (SLO: <10.000ยตs ๐ -65.4%) vs baseline: -0.1%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%
โ re_sub_noaspect
Time: โ 1.534ยตs (SLO: <10.000ยตs ๐ -84.7%) vs baseline: +0.7%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%
โ re_subn_aspect
Time: โ 3.706ยตs (SLO: <10.000ยตs ๐ -62.9%) vs baseline: ~same
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%
โ re_subn_noaspect
Time: โ 1.598ยตs (SLO: <10.000ยตs ๐ -84.0%) vs baseline: -0.3%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%
โ iastaspects - 118/118
โ add_aspect
Time: โ 0.408ยตs (SLO: <10.000ยตs ๐ -95.9%) vs baseline: -0.8%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.1%
โ add_inplace_aspect
Time: โ 0.410ยตs (SLO: <10.000ยตs ๐ -95.9%) vs baseline: +0.2%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%
โ add_inplace_noaspect
Time: โ 0.319ยตs (SLO: <10.000ยตs ๐ -96.8%) vs baseline: +1.1%
Memory: โ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%
โ add_noaspect
Time: โ 0.278ยตs (SLO: <10.000ยตs ๐ -97.2%) vs baseline: +0.7%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%
โ bytearray_aspect
Time: โ 1.318ยตs (SLO: <10.000ยตs ๐ -86.8%) vs baseline: -1.6%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%
โ bytearray_extend_aspect
Time: โ 1.483ยตs (SLO: <10.000ยตs ๐ -85.2%) vs baseline: +1.1%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%
โ bytearray_extend_noaspect
Time: โ 0.612ยตs (SLO: <10.000ยตs ๐ -93.9%) vs baseline: +0.4%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%
โ bytearray_noaspect
Time: โ 0.483ยตs (SLO: <10.000ยตs ๐ -95.2%) vs baseline: -0.5%
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%
โ bytes_aspect
Time: โ 1.293ยตs (SLO: <10.000ยตs ๐ -87.1%) vs baseline: -0.8%
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%
โ bytes_noaspect
Time: โ 0.492ยตs (SLO: <10.000ยตs ๐ -95.1%) vs baseline: +0.2%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%
โ bytesio_aspect
Time: โ 1.347ยตs (SLO: <10.000ยตs ๐ -86.5%) vs baseline: +0.4%
Memory: โ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.6%
โ bytesio_noaspect
Time: โ 0.499ยตs (SLO: <10.000ยตs ๐ -95.0%) vs baseline: +1.3%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%
โ capitalize_aspect
Time: โ 0.731ยตs (SLO: <10.000ยตs ๐ -92.7%) vs baseline: -0.4%
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%
โ capitalize_noaspect
Time: โ 0.434ยตs (SLO: <10.000ยตs ๐ -95.7%) vs baseline: +0.1%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%
โ casefold_aspect
Time: โ 0.745ยตs (SLO: <10.000ยตs ๐ -92.6%) vs baseline: +0.7%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%
โ casefold_noaspect
Time: โ 0.372ยตs (SLO: <10.000ยตs ๐ -96.3%) vs baseline: +1.1%
Memory: โ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%
โ decode_aspect
Time: โ 0.730ยตs (SLO: <10.000ยตs ๐ -92.7%) vs baseline: ~same
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%
โ decode_noaspect
Time: โ 0.419ยตs (SLO: <10.000ยตs ๐ -95.8%) vs baseline: -1.2%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%
โ encode_aspect
Time: โ 0.712ยตs (SLO: <10.000ยตs ๐ -92.9%) vs baseline: +1.2%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%
โ encode_noaspect
Time: โ 0.400ยตs (SLO: <10.000ยตs ๐ -96.0%) vs baseline: +0.4%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%
โ format_aspect
Time: โ 3.424ยตs (SLO: <10.000ยตs ๐ -65.8%) vs baseline: -0.4%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%
โ format_map_aspect
Time: โ 3.672ยตs (SLO: <10.000ยตs ๐ -63.3%) vs baseline: +0.6%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%
โ format_map_noaspect
Time: โ 0.776ยตs (SLO: <10.000ยตs ๐ -92.2%) vs baseline: -0.5%
Memory: โ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%
โ format_noaspect
Time: โ 0.597ยตs (SLO: <10.000ยตs ๐ -94.0%) vs baseline: +0.2%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%
โ index_aspect
Time: โ 0.357ยตs (SLO: <10.000ยตs ๐ -96.4%) vs baseline: -1.0%
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%
โ index_noaspect
Time: โ 0.279ยตs (SLO: <10.000ยตs ๐ -97.2%) vs baseline: +1.3%
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%
โ join_aspect
Time: โ 1.366ยตs (SLO: <10.000ยตs ๐ -86.3%) vs baseline: ~same
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%
โ join_noaspect
Time: โ 0.492ยตs (SLO: <10.000ยตs ๐ -95.1%) vs baseline: +1.1%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%
โ ljust_aspect
Time: โ 2.600ยตs (SLO: <20.000ยตs ๐ -87.0%) vs baseline: -0.5%
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%
โ ljust_noaspect
Time: โ 0.404ยตs (SLO: <10.000ยตs ๐ -96.0%) vs baseline: -1.6%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%
โ lower_aspect
Time: โ 2.213ยตs (SLO: <10.000ยตs ๐ -77.9%) vs baseline: -0.8%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%
โ lower_noaspect
Time: โ 0.370ยตs (SLO: <10.000ยตs ๐ -96.3%) vs baseline: +0.6%
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%
โ lstrip_aspect
Time: โ 2.267ยตs (SLO: <20.000ยตs ๐ -88.7%) vs baseline: +0.1%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%
โ lstrip_noaspect
Time: โ 0.384ยตs (SLO: <10.000ยตs ๐ -96.2%) vs baseline: -0.3%
Memory: โ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%
โ modulo_aspect
Time: โ 1.000ยตs (SLO: <10.000ยตs ๐ -90.0%) vs baseline: -0.5%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%
โ modulo_aspect_for_bytearray_bytearray
Time: โ 1.553ยตs (SLO: <10.000ยตs ๐ -84.5%) vs baseline: +0.6%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%
โ modulo_aspect_for_bytes
Time: โ 0.981ยตs (SLO: <10.000ยตs ๐ -90.2%) vs baseline: -0.4%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.2%
โ modulo_aspect_for_bytes_bytearray
Time: โ 1.258ยตs (SLO: <10.000ยตs ๐ -87.4%) vs baseline: +0.9%
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%
โ modulo_noaspect
Time: โ 0.630ยตs (SLO: <10.000ยตs ๐ -93.7%) vs baseline: +0.8%
Memory: โ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%
โ replace_aspect
Time: โ 4.926ยตs (SLO: <10.000ยตs ๐ -50.7%) vs baseline: ~same
Memory: โ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.6%
โ replace_noaspect
Time: โ 0.461ยตs (SLO: <10.000ยตs ๐ -95.4%) vs baseline: ~same
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.7%
โ repr_aspect
Time: โ 0.903ยตs (SLO: <10.000ยตs ๐ -91.0%) vs baseline: ~same
Memory: โ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%
โ repr_noaspect
Time: โ 0.422ยตs (SLO: <10.000ยตs ๐ -95.8%) vs baseline: +1.4%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.1%
โ rstrip_aspect
Time: โ 1.973ยตs (SLO: <20.000ยตs ๐ -90.1%) vs baseline: +1.3%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%
โ rstrip_noaspect
Time: โ 0.382ยตs (SLO: <10.000ยตs ๐ -96.2%) vs baseline: +0.5%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%
โ slice_aspect
Time: โ 0.491ยตs (SLO: <10.000ยตs ๐ -95.1%) vs baseline: -0.9%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%
โ slice_noaspect
Time: โ 0.450ยตs (SLO: <10.000ยตs ๐ -95.5%) vs baseline: +0.6%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%
โ stringio_aspect
Time: โ 1.563ยตs (SLO: <10.000ยตs ๐ -84.4%) vs baseline: -0.7%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%
โ stringio_noaspect
Time: โ 0.728ยตs (SLO: <10.000ยตs ๐ -92.7%) vs baseline: +1.7%
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%
โ strip_aspect
Time: โ 2.244ยตs (SLO: <20.000ยตs ๐ -88.8%) vs baseline: -0.5%
Memory: โ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%
โ strip_noaspect
Time: โ 0.391ยตs (SLO: <10.000ยตs ๐ -96.1%) vs baseline: +1.5%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.6%
โ swapcase_aspect
Time: โ 2.444ยตs (SLO: <10.000ยตs ๐ -75.6%) vs baseline: -0.8%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%
โ swapcase_noaspect
Time: โ 0.538ยตs (SLO: <10.000ยตs ๐ -94.6%) vs baseline: +0.6%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%
โ title_aspect
Time: โ 2.318ยตs (SLO: <10.000ยตs ๐ -76.8%) vs baseline: -0.8%
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%
โ title_noaspect
Time: โ 0.499ยตs (SLO: <10.000ยตs ๐ -95.0%) vs baseline: -0.5%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%
โ translate_aspect
Time: โ 3.261ยตs (SLO: <10.000ยตs ๐ -67.4%) vs baseline: -0.7%
Memory: โ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +5.1%
โ translate_noaspect
Time: โ 1.045ยตs (SLO: <10.000ยตs ๐ -89.6%) vs baseline: +0.5%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%
โ upper_aspect
Time: โ 2.240ยตs (SLO: <10.000ยตs ๐ -77.6%) vs baseline: +0.7%
Memory: โ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%
โ upper_noaspect
Time: โ 0.369ยตs (SLO: <10.000ยตs ๐ -96.3%) vs baseline: -1.3%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%
โ iastaspectssplit - 12/12
โ rsplit_aspect
Time: โ 1.596ยตs (SLO: <10.000ยตs ๐ -84.0%) vs baseline: +8.3%
Memory: โ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%
โ rsplit_noaspect
Time: โ 0.578ยตs (SLO: <10.000ยตs ๐ -94.2%) vs baseline: -1.0%
Memory: โ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%
โ split_aspect
Time: โ 1.478ยตs (SLO: <10.000ยตs ๐ -85.2%) vs baseline: +2.3%
Memory: โ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%
โ split_noaspect
Time: โ 0.572ยตs (SLO: <10.000ยตs ๐ -94.3%) vs baseline: +0.6%
Memory: โ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%
โ splitlines_aspect
Time: โ 1.449ยตs (SLO: <10.000ยตs ๐ -85.5%) vs baseline: +0.7%
Memory: โ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%
โ splitlines_noaspect
Time: โ 0.585ยตs (SLO: <10.000ยตs ๐ -94.1%) vs baseline: +0.7%
Memory: โ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%
โ iastpropagation - 8/8
โ no-propagation
Time: โ 48.798ยตs (SLO: <60.000ยตs ๐ -18.7%) vs baseline: -0.5%
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.8%
โ propagation_enabled
Time: โ 171.382ยตs (SLO: <190.000ยตs -9.8%) vs baseline: -0.7%
Memory: โ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.8%
โ propagation_enabled_100
Time: โ 1.968ms (SLO: <2.300ms ๐ -14.4%) vs baseline: +2.5%
Memory: โ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.8%
โ propagation_enabled_1000
Time: โ 32.530ms (SLO: <34.550ms -5.8%) vs baseline: -0.5%
Memory: โ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%
โ otelsdkspan - 24/24
โ add-event
Time: โ 40.827ms (SLO: <42.000ms -2.8%) vs baseline: +0.5%
Memory: โ 34.544MB (SLO: <39.000MB ๐ -11.4%) vs baseline: +5.0%
โ add-link
Time: โ 36.260ms (SLO: <38.550ms -5.9%) vs baseline: -0.4%
Memory: โ 34.524MB (SLO: <39.000MB ๐ -11.5%) vs baseline: +4.7%
โ add-metrics
Time: โ 222.904ms (SLO: <232.000ms -3.9%) vs baseline: +1.1%
Memory: โ 34.524MB (SLO: <39.000MB ๐ -11.5%) vs baseline: +4.9%
โ add-tags
Time: โ 212.709ms (SLO: <221.600ms -4.0%) vs baseline: ~same
Memory: โ 34.524MB (SLO: <39.000MB ๐ -11.5%) vs baseline: +4.7%
โ get-context
Time: โ 29.851ms (SLO: <31.300ms -4.6%) vs baseline: +2.0%
Memory: โ 34.485MB (SLO: <39.000MB ๐ -11.6%) vs baseline: +4.6%
โ is-recording
Time: โ 29.530ms (SLO: <31.000ms -4.7%) vs baseline: +0.9%
Memory: โ 34.505MB (SLO: <39.000MB ๐ -11.5%) vs baseline: +4.7%
โ record-exception
Time: โ 63.251ms (SLO: <65.850ms -3.9%) vs baseline: +0.5%
Memory: โ 34.544MB (SLO: <39.000MB ๐ -11.4%) vs baseline: +4.8%
โ set-status
Time: โ 32.150ms (SLO: <34.150ms -5.9%) vs baseline: +0.9%
Memory: โ 34.544MB (SLO: <39.000MB ๐ -11.4%) vs baseline: +4.9%
โ start
Time: โ 29.284ms (SLO: <30.150ms -2.9%) vs baseline: +1.9%
Memory: โ 34.524MB (SLO: <39.000MB ๐ -11.5%) vs baseline: +4.9%
โ start-finish
Time: โ 34.160ms (SLO: <35.350ms -3.4%) vs baseline: +0.5%
Memory: โ 34.564MB (SLO: <39.000MB ๐ -11.4%) vs baseline: +5.2%
โ start-finish-telemetry
Time: โ 33.817ms (SLO: <35.450ms -4.6%) vs baseline: -0.5%
Memory: โ 34.505MB (SLO: <39.000MB ๐ -11.5%) vs baseline: +4.9%
โ update-name
Time: โ 31.282ms (SLO: <33.400ms -6.3%) vs baseline: +0.6%
Memory: โ 34.544MB (SLO: <39.000MB ๐ -11.4%) vs baseline: +4.9%
โ packagespackageforrootmodulemapping - 4/4
โ cache_off
Time: โ 341.744ms (SLO: <354.300ms -3.5%) vs baseline: ~same
Memory: โ 38.037MB (SLO: <40.000MB -4.9%) vs baseline: +4.4%
โ cache_on
Time: โ 0.386ยตs (SLO: <10.000ยตs ๐ -96.1%) vs baseline: +1.0%
Memory: โ 36.646MB (SLO: <39.000MB -6.0%) vs baseline: +5.0%
โ packagesupdateimporteddependencies - 24/24
โ import_many
Time: โ 154.698ยตs (SLO: <170.000ยตs -9.0%) vs baseline: -0.5%
Memory: โ 36.632MB (SLO: <38.500MB -4.9%) vs baseline: +5.6%
โ import_many_cached
Time: โ 120.896ยตs (SLO: <130.000ยตs -7.0%) vs baseline: -0.1%
Memory: โ 36.302MB (SLO: <38.500MB -5.7%) vs baseline: +5.0%
โ import_many_stdlib
Time: โ 1.599ms (SLO: <1.750ms -8.6%) vs baseline: -0.2%
Memory: โ 36.663MB (SLO: <38.500MB -4.8%) vs baseline: +4.7%
โ import_many_stdlib_cached
Time: โ 0.964ms (SLO: <1.100ms ๐ -12.3%) vs baseline: -0.4%
Memory: โ 36.311MB (SLO: <38.500MB -5.7%) vs baseline: +4.8%
โ import_many_unknown
Time: โ 831.360ยตs (SLO: <890.000ยตs -6.6%) vs baseline: -0.9%
Memory: โ 36.595MB (SLO: <38.500MB -4.9%) vs baseline: +4.4%
โ import_many_unknown_cached
Time: โ 791.954ยตs (SLO: <870.000ยตs -9.0%) vs baseline: +0.3%
Memory: โ 36.308MB (SLO: <38.500MB -5.7%) vs baseline: +3.8%
โ import_one
Time: โ 19.681ยตs (SLO: <30.000ยตs ๐ -34.4%) vs baseline: -0.6%
Memory: โ 36.311MB (SLO: <39.000MB -6.9%) vs baseline: +5.1%
โ import_one_cache
Time: โ 6.233ยตs (SLO: <10.000ยตs ๐ -37.7%) vs baseline: -0.8%
Memory: โ 36.518MB (SLO: <38.500MB -5.1%) vs baseline: +5.3%
โ import_one_stdlib
Time: โ 18.660ยตs (SLO: <20.000ยตs -6.7%) vs baseline: -0.4%
Memory: โ 36.505MB (SLO: <38.500MB -5.2%) vs baseline: +5.1%
โ import_one_stdlib_cache
Time: โ 6.275ยตs (SLO: <10.000ยตs ๐ -37.3%) vs baseline: ~same
Memory: โ 36.291MB (SLO: <38.500MB -5.7%) vs baseline: +4.6%
โ import_one_unknown
Time: โ 45.113ยตs (SLO: <50.000ยตs -9.8%) vs baseline: -0.6%
Memory: โ 36.497MB (SLO: <38.500MB -5.2%) vs baseline: +4.9%
โ import_one_unknown_cache
Time: โ 6.330ยตs (SLO: <10.000ยตs ๐ -36.7%) vs baseline: +1.3%
Memory: โ 36.313MB (SLO: <38.500MB -5.7%) vs baseline: +4.2%
โ ratelimiter - 12/12
โ defaults
Time: โ 2.350ยตs (SLO: <10.000ยตs ๐ -76.5%) vs baseline: ~same
Memory: โ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +3.7%
โ high_rate_limit
Time: โ 2.418ยตs (SLO: <10.000ยตs ๐ -75.8%) vs baseline: +0.2%
Memory: โ 31.320MB (SLO: <34.000MB -7.9%) vs baseline: +3.4%
โ long_window
Time: โ 2.356ยตs (SLO: <10.000ยตs ๐ -76.4%) vs baseline: -1.0%
Memory: โ 31.654MB (SLO: <34.000MB -6.9%) vs baseline: +4.5%
โ low_rate_limit
Time: โ 2.356ยตs (SLO: <10.000ยตs ๐ -76.4%) vs baseline: -1.1%
Memory: โ 31.398MB (SLO: <34.000MB -7.7%) vs baseline: +3.6%
โ no_rate_limit
Time: โ 0.829ยตs (SLO: <10.000ยตs ๐ -91.7%) vs baseline: -0.6%
Memory: โ 31.438MB (SLO: <34.000MB -7.5%) vs baseline: +3.6%
โ short_window
Time: โ 2.471ยตs (SLO: <10.000ยตs ๐ -75.3%) vs baseline: -1.4%
Memory: โ 31.339MB (SLO: <34.000MB -7.8%) vs baseline: +3.6%
โ recursivecomputation - 8/8
โ deep
Time: โ 308.698ms (SLO: <320.950ms -3.8%) vs baseline: ~same
Memory: โ 32.932MB (SLO: <34.500MB -4.5%) vs baseline: +4.7%
โ deep-profiled
Time: โ 326.513ms (SLO: <359.150ms -9.1%) vs baseline: +0.1%
Memory: โ 35.960MB (SLO: <39.000MB -7.8%) vs baseline: +4.6%
โ medium
Time: โ 7.093ms (SLO: <7.400ms -4.1%) vs baseline: +0.1%
Memory: โ 32.204MB (SLO: <34.000MB -5.3%) vs baseline: +5.0%
โ shallow
Time: โ 0.954ms (SLO: <1.050ms -9.2%) vs baseline: ~same
Memory: โ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.7%
โ samplingrules - 8/8
โ average_match
Time: โ 148.751ยตs (SLO: <290.000ยตs ๐ -48.7%) vs baseline: ~same
Memory: โ 31.733MB (SLO: <34.000MB -6.7%) vs baseline: +4.8%
โ high_match
Time: โ 195.626ยตs (SLO: <480.000ยตs ๐ -59.2%) vs baseline: ~same
Memory: โ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.7%
โ low_match
Time: โ 100.588ยตs (SLO: <120.000ยตs ๐ -16.2%) vs baseline: +1.3%
Memory: โ 632.416MB (SLO: <700.000MB -9.7%) vs baseline: +4.9%
โ very_low_match
Time: โ 2.900ms (SLO: <8.500ms ๐ -65.9%) vs baseline: ~same
Memory: โ 70.112MB (SLO: <75.000MB -6.5%) vs baseline: +4.7%
โ sethttpmeta - 32/32
โ all-disabled
Time: โ 10.689ยตs (SLO: <20.000ยตs ๐ -46.6%) vs baseline: +0.4%
Memory: โ 32.519MB (SLO: <34.000MB -4.4%) vs baseline: +4.7%
โ all-enabled
Time: โ 40.138ยตs (SLO: <50.000ยตs ๐ -19.7%) vs baseline: +0.4%
Memory: โ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%
โ collectipvariant_exists
Time: โ 40.752ยตs (SLO: <50.000ยตs ๐ -18.5%) vs baseline: -0.2%
Memory: โ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.7%
โ no-collectipvariant
Time: โ 39.932ยตs (SLO: <50.000ยตs ๐ -20.1%) vs baseline: ~same
Memory: โ 32.539MB (SLO: <34.000MB -4.3%) vs baseline: +4.8%
โ no-useragentvariant
Time: โ 38.878ยตs (SLO: <50.000ยตs ๐ -22.2%) vs baseline: +0.2%
Memory: โ 32.617MB (SLO: <34.000MB -4.1%) vs baseline: +5.0%
โ obfuscation-no-query
Time: โ 41.136ยตs (SLO: <50.000ยตs ๐ -17.7%) vs baseline: +1.9%
Memory: โ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%
โ obfuscation-regular-case-explicit-query
Time: โ 75.675ยตs (SLO: <90.000ยตs ๐ -15.9%) vs baseline: +0.2%
Memory: โ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%
โ obfuscation-regular-case-implicit-query
Time: โ 76.333ยตs (SLO: <90.000ยตs ๐ -15.2%) vs baseline: +0.3%
Memory: โ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%
โ obfuscation-send-querystring-disabled
Time: โ 153.885ยตs (SLO: <170.000ยตs -9.5%) vs baseline: +0.3%
Memory: โ 32.598MB (SLO: <34.500MB -5.5%) vs baseline: +5.2%
โ obfuscation-worst-case-explicit-query
Time: โ 147.794ยตs (SLO: <160.000ยตs -7.6%) vs baseline: -0.1%
Memory: โ 32.617MB (SLO: <34.500MB -5.5%) vs baseline: +5.0%
โ obfuscation-worst-case-implicit-query
Time: โ 155.317ยตs (SLO: <170.000ยตs -8.6%) vs baseline: +0.9%
Memory: โ 32.519MB (SLO: <34.500MB -5.7%) vs baseline: +4.9%
โ useragentvariant_exists_1
Time: โ 39.445ยตs (SLO: <50.000ยตs ๐ -21.1%) vs baseline: ~same
Memory: โ 32.539MB (SLO: <34.000MB -4.3%) vs baseline: +4.9%
โ useragentvariant_exists_2
Time: โ 40.751ยตs (SLO: <50.000ยตs ๐ -18.5%) vs baseline: +0.7%
Memory: โ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +5.0%
โ useragentvariant_exists_3
Time: โ 40.014ยตs (SLO: <50.000ยตs ๐ -20.0%) vs baseline: +0.2%
Memory: โ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%
โ useragentvariant_not_exists_1
Time: โ 39.260ยตs (SLO: <50.000ยตs ๐ -21.5%) vs baseline: ~same
Memory: โ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +5.0%
โ useragentvariant_not_exists_2
Time: โ 40.071ยตs (SLO: <50.000ยตs ๐ -19.9%) vs baseline: +1.8%
Memory: โ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%
โ span - 26/26
โ add-event
Time: โ 24.301ms (SLO: <26.200ms -7.2%) vs baseline: +0.4%
Memory: โ 51.619MB (SLO: <53.000MB -2.6%) vs baseline: +4.9%
โ add-metrics
Time: โ 91.989ms (SLO: <98.350ms -6.5%) vs baseline: -0.4%
Memory: โ 606.908MB (SLO: <961.000MB ๐ -36.8%) vs baseline: +4.9%
โ add-tags
Time: โ 151.607ms (SLO: <168.550ms ๐ -10.1%) vs baseline: +0.6%
Memory: โ 608.253MB (SLO: <962.500MB ๐ -36.8%) vs baseline: +4.9%
โ get-context
Time: โ 22.449ms (SLO: <23.700ms -5.3%) vs baseline: +0.3%
Memory: โ 50.319MB (SLO: <53.000MB -5.1%) vs baseline: +4.7%
โ is-recording
Time: โ 22.785ms (SLO: <23.900ms -4.7%) vs baseline: +0.9%
Memory: โ 50.402MB (SLO: <53.000MB -4.9%) vs baseline: +4.9%
โ record-exception
Time: โ 42.538ms (SLO: <44.500ms -4.4%) vs baseline: +0.4%
Memory: โ 43.215MB (SLO: <53.000MB ๐ -18.5%) vs baseline: +4.4%
โ set-status
Time: โ 24.247ms (SLO: <26.000ms -6.7%) vs baseline: -0.2%
Memory: โ 50.330MB (SLO: <53.000MB -5.0%) vs baseline: +4.7%
โ start
Time: โ 22.057ms (SLO: <23.500ms -6.1%) vs baseline: -0.4%
Memory: โ 50.350MB (SLO: <53.000MB -5.0%) vs baseline: +4.9%
โ start-finish
Time: โ 51.902ms (SLO: <55.500ms -6.5%) vs baseline: ~same
Memory: โ 32.204MB (SLO: <34.000MB -5.3%) vs baseline: +4.8%
โ start-finish-telemetry
Time: โ 53.575ms (SLO: <58.300ms -8.1%) vs baseline: +0.6%
Memory: โ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +4.8%
โ start-finish-traceid128
Time: โ 55.460ms (SLO: <60.050ms -7.6%) vs baseline: -0.4%
Memory: โ 32.204MB (SLO: <34.000MB -5.3%) vs baseline: +5.0%
โ start-traceid128
Time: โ 22.607ms (SLO: <24.600ms -8.1%) vs baseline: -0.2%
Memory: โ 50.248MB (SLO: <53.000MB -5.2%) vs baseline: +4.5%
โ update-name
Time: โ 23.320ms (SLO: <24.100ms -3.2%) vs baseline: +0.8%
Memory: โ 50.975MB (SLO: <53.000MB -3.8%) vs baseline: +4.6%
โ telemetryaddmetric - 30/30
โ 1-count-metric-1-times
Time: โ 3.169ยตs (SLO: <20.000ยตs ๐ -84.2%) vs baseline: +1.6%
Memory: โ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.8%
โ 1-count-metrics-100-times
Time: โ 213.320ยตs (SLO: <250.000ยตs ๐ -14.7%) vs baseline: -0.4%
Memory: โ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.7%
โ 1-distribution-metric-1-times
Time: โ 2.991ยตs (SLO: <20.000ยตs ๐ -85.0%) vs baseline: +2.3%
Memory: โ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +4.9%
โ 1-distribution-metrics-100-times
Time: โ 194.151ยตs (SLO: <220.000ยตs ๐ -11.7%) vs baseline: +1.8%
Memory: โ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +4.9%
โ 1-gauge-metric-1-times
Time: โ 2.107ยตs (SLO: <20.000ยตs ๐ -89.5%) vs baseline: +1.1%
Memory: โ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.1%
โ 1-gauge-metrics-100-times
Time: โ 124.585ยตs (SLO: <150.000ยตs ๐ -16.9%) vs baseline: -0.9%
Memory: โ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.3%
โ 1-rate-metric-1-times
Time: โ 3.202ยตs (SLO: <20.000ยตs ๐ -84.0%) vs baseline: +2.3%
Memory: โ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.7%
โ 1-rate-metrics-100-times
Time: โ 213.546ยตs (SLO: <250.000ยตs ๐ -14.6%) vs baseline: +0.7%
Memory: โ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%
โ 100-count-metrics-100-times
Time: โ 21.381ms (SLO: <23.500ms -9.0%) vs baseline: -0.8%
Memory: โ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.9%
โ 100-distribution-metrics-100-times
Time: โ 1.994ms (SLO: <2.250ms ๐ -11.4%) vs baseline: +0.3%
Memory: โ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.1%
โ 100-gauge-metrics-100-times
Time: โ 1.286ms (SLO: <1.550ms ๐ -17.0%) vs baseline: -0.2%
Memory: โ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +4.9%
โ 100-rate-metrics-100-times
Time: โ 2.187ms (SLO: <2.550ms ๐ -14.2%) vs baseline: +0.2%
Memory: โ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +5.1%
โ flush-1-metric
Time: โ 4.193ยตs (SLO: <20.000ยตs ๐ -79.0%) vs baseline: +1.9%
Memory: โ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +5.0%
โ flush-100-metrics
Time: โ 181.899ยตs (SLO: <250.000ยตs ๐ -27.2%) vs baseline: +0.6%
Memory: โ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%
โ flush-1000-metrics
Time: โ 2.187ms (SLO: <2.500ms ๐ -12.5%) vs baseline: ~same
Memory: โ 32.991MB (SLO: <34.500MB -4.4%) vs baseline: +5.0%
โ tracer - 6/6
โ large
Time: โ 30.646ms (SLO: <32.950ms -7.0%) vs baseline: +0.4%
Memory: โ 33.227MB (SLO: <34.500MB -3.7%) vs baseline: +4.6%
โ medium
Time: โ 2.992ms (SLO: <3.200ms -6.5%) vs baseline: +0.2%
Memory: โ 31.654MB (SLO: <34.000MB -6.9%) vs baseline: +4.4%
โ small
Time: โ 338.997ยตs (SLO: <370.000ยตs -8.4%) vs baseline: +0.2%
Memory: โ 31.752MB (SLO: <34.000MB -6.6%) vs baseline: +4.9%
โน๏ธ Scenarios Missing SLO Configuration (14 scenarios)
The following scenarios exist in candidate data but have no SLO thresholds configured:
coreapiscenario-context_with_data_listeners_and_all_listenerscoreapiscenario-core_dispatch_listenerscoreapiscenario-core_dispatch_listeners_and_all_listenerscoreapiscenario-core_dispatch_no_listenerscoreapiscenario-core_dispatch_only_all_listenerscoreapiscenario-core_dispatch_with_results_listenerscoreapiscenario-core_dispatch_with_results_listeners_and_all_listenerscoreapiscenario-core_dispatch_with_results_no_listenerscoreapiscenario-core_dispatch_with_results_only_all_listenersdjangosimple-baselineerrortrackingdjangosimple-baselineerrortrackingflasksqli-baselineflasksimple-baselineflasksqli-baseline