execute all sirun benchmarks in a docker container

Open tlhunter opened this issue 3 years ago • 7 comments

What does this PR do?

This PR allows all of the sirun-based benchmarks to be run in a docker container using the latest three even versions of Node.js.

To build the container, run the following from the root of the repository:

docker build -t dd-trace-benchmark -f benchmark/sirun/Dockerfile .

Executing the benchmarks are done by running runall.sh within a container. Output is written to /app/benchmark/sirun/results.ndjson.

docker run -it --platform=linux/amd64 dd-trace-benchmark bash -c 'cd /app/benchmark/sirun && ./runall.sh'

Motivation

This will allow us to check PRs for performance regressions.

TODO

[ ] wire up CI so that these benchmarks run against PRs that have a certain GitHub label attached
[x] clean up the interface for running tests
[x] fix all of the tests - several of them fail to run (missing modules)
[x] add a README to the benchmarks directory

Sep 19 '22 23:09 tlhunter

Overall package size

Self size: 2.83 MB Deduped: 31.9 MB No deduping: 32.11 MB

Dependency sizes

name	version	self size	total size
@datadog/pprof	1.0.2	8.74 MB	16.25 MB
@datadog/native-metrics	1.4.3	6.57 MB	6.58 MB
@datadog/native-appsec	1.2.1	5.1 MB	5.43 MB
opentracing	0.14.7	194.81 kB	194.81 kB
@datadog/sketches-js	2.1.0	109.9 kB	109.9 kB
lodash.sortby	4.7.0	75.76 kB	75.76 kB
lru-cache	7.14.0	74.95 kB	74.95 kB
semver	5.7.1	61.58 kB	61.58 kB
ipaddr.js	2.0.1	59.52 kB	59.52 kB
ignore	5.2.0	48.87 kB	48.87 kB
import-in-the-middle	1.3.4	32.7 kB	37.17 kB
istanbul-lib-coverage	3.2.0	29.34 kB	29.34 kB
retry	0.10.1	27.44 kB	27.44 kB
lodash.uniq	4.5.0	25.01 kB	25.01 kB
limiter	1.1.5	23.17 kB	23.17 kB
lodash.kebabcase	4.1.1	17.75 kB	17.75 kB
lodash.pick	4.4.0	16.33 kB	16.33 kB
crypto-randomuuid	1.0.0	11.18 kB	11.18 kB
diagnostics_channel	1.1.0	7.07 kB	7.07 kB
path-to-regexp	0.1.7	6.78 kB	6.78 kB
koalas	1.0.2	6.47 kB	6.47 kB
methods	1.1.2	5.29 kB	5.29 kB
module-details-from-path	1.0.3	4.47 kB	4.47 kB

_{🤖 This report was automatically generated by heaviest-objects-in-the-universe}

Sep 19 '22 23:09 github-actions[bot]

Codecov Report

Merging #2394 (8065e1e) into master (3f7f243) will increase coverage by 0.00%. The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #2394   +/-   ##
=======================================
  Coverage   92.97%   92.98%           
=======================================
  Files         279      279           
  Lines        9500     9504    +4     
=======================================
+ Hits         8833     8837    +4     
  Misses        667      667

Impacted Files	Coverage Δ
packages/dd-trace/src/tracer.js	`100.00% <0.00%> (ø)`
packages/dd-trace/src/profiling/profiler.js	`97.10% <0.00%> (+0.08%)`	:arrow_up:

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

Sep 19 '22 23:09 codecov[bot]

Here are the currently failing tests:

appsec

Error: 'run' must be provided

plugin-http

Error: 'run' must be provided

plugin-net

Error: 'run' must be provided

plugin-bluebird

node:internal/modules/cjs/loader:958
  throw err;
  ^

Error: Cannot find module '../../../versions/bluebird/node_modules/bluebird/js/release/bluebird'
Require stack:
- /Users/thomas.hunter/Projects/dd-trace-js/benchmark/sirun/plugin-bluebird/index.js
    at Module._resolveFilename (node:internal/modules/cjs/loader:955:15)
    at Module._load (node:internal/modules/cjs/loader:803:27)
    at Module.require (node:internal/modules/cjs/loader:1021:19)
    at require (node:internal/modules/cjs/helpers:103:18)
    at Object.<anonymous> (/Users/thomas.hunter/Projects/dd-trace-js/benchmark/sirun/plugin-bluebird/index.js:7:17)
    at Module._compile (node:internal/modules/cjs/loader:1119:14)
    at Module._extensions..js (node:internal/modules/cjs/loader:1173:10)
    at Module.load (node:internal/modules/cjs/loader:997:32)
    at Module._load (node:internal/modules/cjs/loader:838:12)
    at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:81:12) {
  code: 'MODULE_NOT_FOUND',
  requireStack: [
    '/Users/thomas.hunter/Projects/dd-trace-js/benchmark/sirun/plugin-bluebird/index.js'
  ]
}

Node.js v18.9.0
Test exited with code 1, so aborting test.

Test Config:
---
name: plugin-bluebird
variant: control
setup: ~
teardown: ~
run:
  - node
  - index.js
timeout: ~
env:
  USE_TRACER: "0"
  COUNT: "50000"
cachegrind: true
iterations: 10
variants: ~

For this one, it looks like ../../../versions/bluebird/ does not have a node_modules/ directory. Perhaps there's a missing yarn execution somewhere?

profiler

Error: No profiles to submit
    at Profiler._submit (/Users/thomas.hunter/Projects/dd-trace-js/packages/dd-trace/src/profiling/profiler.js:113:29)
    at Profiler._collect (/Users/thomas.hunter/Projects/dd-trace-js/packages/dd-trace/src/profiling/profiler.js:103:18)
    at Timeout._onTimeout (/Users/thomas.hunter/Projects/dd-trace-js/packages/dd-trace/src/profiling/profiler.js:76:43)
    at listOnTimeout (node:internal/timers:564:17)
    at process.processTimers (node:internal/timers:507:7)

startup

node:internal/modules/cjs/loader:958
  throw err;
  ^

Error: Cannot find module '../vendor/darwin-arm64-unknown/appsec.node'
Require stack:
- /Users/thomas.hunter/Projects/dd-trace-js/node_modules/@datadog/native-appsec/lib/loader.js
- /Users/thomas.hunter/Projects/dd-trace-js/node_modules/@datadog/native-appsec/index.js
- /Users/thomas.hunter/Projects/dd-trace-js/benchmark/sirun/startup/startup-test.js
    at Module._resolveFilename (node:internal/modules/cjs/loader:955:15)
    at Module._load (node:internal/modules/cjs/loader:803:27)
    at Module.require (node:internal/modules/cjs/loader:1021:19)
    at require (node:internal/modules/cjs/helpers:103:18)
    at module.exports.load (/Users/thomas.hunter/Projects/dd-trace-js/node_modules/@datadog/native-appsec/lib/loader.js:13:10)
    at Object.<anonymous> (/Users/thomas.hunter/Projects/dd-trace-js/node_modules/@datadog/native-appsec/index.js:6:43)
    at Module._compile (node:internal/modules/cjs/loader:1119:14)
    at Module._extensions..js (node:internal/modules/cjs/loader:1173:10)
    at Module.load (node:internal/modules/cjs/loader:997:32)
    at Module._load (node:internal/modules/cjs/loader:838:12) {
  code: 'MODULE_NOT_FOUND',
  requireStack: [
    '/Users/thomas.hunter/Projects/dd-trace-js/node_modules/@datadog/native-appsec/lib/loader.js',
    '/Users/thomas.hunter/Projects/dd-trace-js/node_modules/@datadog/native-appsec/index.js',
    '/Users/thomas.hunter/Projects/dd-trace-js/benchmark/sirun/startup/startup-test.js'
  ]
}

Node.js v18.9.0
Test exited with code 1, so aborting test.
	
Test Config:
---
name: startup
variant: control-everything
setup: ~
teardown: ~
run:
  - node
  - startup-test.js
timeout: ~
env:
  USE_TRACER: "0"
  EVERYTHING: "1"
cachegrind: true
iterations: 10
variants: ~

Sep 20 '22 17:09 tlhunter

At this point profiler still fails in the same way, and cachegrind never works (which is probably due to me running on macOS).

Sep 22 '22 21:09 tlhunter

After looking up CI results for other jobs I can see that they all have the same profiler errors:

Seems like more of a warning since the jobs are passing.

Sep 22 '22 22:09 tlhunter

We're now having an error with the graphql tests, one which doesn't happen while building docker containers locally:

benchmarking plugin-graphql...
internal/modules/cjs/loader.js:905
  throw err;
  ^
Error: Cannot find module '../../../versions/graphql/node_modules/graphql'
Require stack:
- /app/benchmark/sirun/plugin-graphql/index.js
    at Function.Module._resolveFilename (internal/modules/cjs/loader.js:902:15)
    at Function.Module._load (internal/modules/cjs/loader.js:746:27)
    at Module.require (internal/modules/cjs/loader.js:974:19)
    at require (internal/modules/cjs/helpers.js:101:18)
    at Object.<anonymous> (/app/benchmark/sirun/plugin-graphql/index.js:26:17)
    at Module._compile (internal/modules/cjs/loader.js:1085:14)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:1114:10)
    at Module.load (internal/modules/cjs/loader.js:950:32)
    at Function.Module._load (internal/modules/cjs/loader.js:790:12)
    at Function.executeUserEntryPoint [as runMain] (internal/modules/run_main.js:75:12) {
  code: 'MODULE_NOT_FOUND',
  requireStack: [ '/app/benchmark/sirun/plugin-graphql/index.js' ]
}
Test exited with code 1, so aborting test.
Test Config:
---
name: plugin-graphql
variant: control
setup: ~
teardown: ~
run:
  - node
  - index.js
timeout: ~
env: {}
cachegrind: false
iterations: 3
variants: ~
/app/benchmark/sirun/run-all-variants.js:62
      throw e // Older Node versions don't fail on uncaught promise rejections.
      ^
Error: Process exited with non-zero code.
    at ChildProcess.<anonymous> (/app/benchmark/sirun/run-all-variants.js:20:16)
    at ChildProcess.emit (events.js:400:28)
    at Process.ChildProcess._handle.onexit (internal/child_process.js:285:12)
done with plugin-graphql.

Sep 23 '22 18:09 tlhunter

Parameters

	Baseline	Candidate
config	baseline	candidate

See matching parameters

	Baseline	Candidate
name	startup	startup
nodeVersion	14.20.1	14.20.1
variant	control	control

Summary

See unchanged results

Group	Metric	Mean	Median
scenario:startup-control-14.20.1	cpu_usage_percentage	no difference _{[-0.163%; +0.163%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.042KB; +0.042KB] or [-0.128%; +0.128%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-3.741ms; +3.741ms] or [-46.953%; +46.953%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-3.824ms; +3.824ms] or [-9.508%; +9.508%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.394ms; +0.394ms] or [-0.813%; +0.813%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:profiler-control-14.20.1	cpu_usage_percentage	no difference _{[-0.393%; +0.393%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-1.932ms; +1.932ms] or [-38.489%; +38.489%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-0.018ms; +0.018ms] or [-1.229%; +1.229%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-0.075KB; +0.075KB] or [-0.175%; +0.175%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-5.852ms; +5.852ms] or [-30.206%; +30.206%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-5.695ms; +5.695ms] or [-5.245%; +5.245%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.534ms; +0.534ms] or [-0.413%; +0.413%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-bluebird-control-14.20.1	cpu_usage_percentage	no difference _{[-0.616%; +0.616%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.031KB; +0.031KB] or [-0.063%; +0.063%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-7.020ms; +7.020ms] or [-40.057%; +40.057%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-7.089ms; +7.089ms] or [-5.668%; +5.668%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.834ms; +0.834ms] or [-0.582%; +0.582%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:log-without-log-14.20.1	cpu_usage_percentage	no difference _{[-0.190%; +0.190%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.094KB; +0.094KB] or [-0.216%; +0.216%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-8.456ms; +8.456ms] or [-45.112%; +45.112%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-8.347ms; +8.347ms] or [-6.500%; +6.500%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.570ms; +0.570ms] or [-0.386%; +0.386%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:startup-with-tracer-14.20.1	cpu_usage_percentage	no difference _{[-0.065%; +0.065%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.077KB; +0.077KB] or [-0.178%; +0.178%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-5.122ms; +5.122ms] or [-31.314%; +31.314%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-4.901ms; +4.901ms] or [-3.744%; +3.744%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.366ms; +0.366ms] or [-0.248%; +0.248%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-control-14.20.1	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:profiler-with-cpu-profiler-14.20.1	cpu_usage_percentage	no difference _{[-0.519%; +0.519%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-0.247ms; +0.247ms] or [-1.258%; +1.258%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-0.018ms; +0.018ms] or [-1.227%; +1.227%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-0.081KB; +0.081KB] or [-0.180%; +0.180%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-5.738ms; +5.738ms] or [-34.745%; +34.745%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-5.660ms; +5.660ms] or [-3.920%; +3.920%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-1.082ms; +1.082ms] or [-0.668%; +0.668%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:log-skip-log-14.20.1	cpu_usage_percentage	no difference _{[-0.893%; +0.893%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.146KB; +0.146KB] or [-0.336%; +0.336%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-7.350ms; +7.350ms] or [-52.607%; +52.607%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-7.529ms; +7.529ms] or [-5.631%; +5.631%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-1.549ms; +1.549ms] or [-1.043%; +1.043%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-bluebird-with-tracer-14.20.1	cpu_usage_percentage	no difference _{[-0.054%; +0.054%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.132KB; +0.132KB] or [-0.245%; +0.245%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-5.777ms; +5.777ms] or [-19.802%; +19.802%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-6.899ms; +6.899ms] or [-2.870%; +2.870%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-2.046ms; +2.046ms] or [-0.758%; +0.758%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:async_hooks-no-hooks-14.20.1	cpu_usage_percentage	no difference _{[-0.330%; +0.330%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-1.038ms; +1.038ms] or [-1.790%; +1.790%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-0.157ms; +0.157ms] or [-0.831%; +0.831%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-0.429KB; +0.429KB] or [-0.362%; +0.362%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-18.591ms; +18.591ms] or [-29.951%; +29.951%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-16.815ms; +16.815ms] or [-5.570%; +5.570%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-7.427ms; +7.427ms] or [-0.877%; +0.877%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:spans-finish-immediately-14.20.1	cpu_usage_percentage	no difference _{[-0.108%; +0.108%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.078KB; +0.078KB] or [-0.160%; +0.160%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-7.384ms; +7.384ms] or [-31.243%; +31.243%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-7.821ms; +7.821ms] or [-1.917%; +1.917%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-1.363ms; +1.363ms] or [-0.315%; +0.315%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:profiler-with-space-profiler-14.20.1	cpu_usage_percentage	no difference _{[-0.472%; +0.472%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-0.480ms; +0.480ms] or [-8.424%; +8.424%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-0.017ms; +0.017ms] or [-1.149%; +1.149%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-0.085KB; +0.085KB] or [-0.197%; +0.197%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-4.818ms; +4.818ms] or [-28.894%; +28.894%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-4.735ms; +4.735ms] or [-4.166%; +4.166%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.915ms; +0.915ms] or [-0.695%; +0.695%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:log-with-debug-14.20.1	cpu_usage_percentage	no difference _{[-1.095%; +1.095%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.078KB; +0.078KB] or [-0.179%; +0.179%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-5.541ms; +5.541ms] or [-29.577%; +29.577%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-5.606ms; +5.606ms] or [-4.360%; +4.360%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-1.758ms; +1.758ms] or [-1.186%; +1.186%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-with-async-hooks-14.20.1	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:profiler-with-all-profilers-14.20.1	cpu_usage_percentage	no difference _{[-0.245%; +0.245%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-0.370ms; +0.370ms] or [-1.863%; +1.863%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-0.024ms; +0.024ms] or [-1.654%; +1.654%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-0.062KB; +0.062KB] or [-0.138%; +0.138%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-5.089ms; +5.089ms] or [-31.591%; +31.591%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-5.052ms; +5.052ms] or [-3.459%; +3.459%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.751ms; +0.751ms] or [-0.460%; +0.460%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:log-with-error-14.20.1	cpu_usage_percentage	no difference _{[-0.855%; +0.855%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.056KB; +0.056KB] or [-0.128%; +0.128%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-7.739ms; +7.739ms] or [-37.260%; +37.260%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-7.966ms; +7.966ms] or [-6.286%; +6.286%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-1.603ms; +1.603ms] or [-1.081%; +1.081%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-q-control-14.20.1	cpu_usage_percentage	no difference _{[-0.041%; +0.041%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.778KB; +0.778KB] or [-0.650%; +0.650%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-12.452ms; +12.452ms] or [-21.796%; +21.796%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-13.326ms; +13.326ms] or [-2.241%; +2.241%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-4.187ms; +4.187ms] or [-0.642%; +0.642%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:net-control-14.20.1	cpu_usage_percentage	no difference _{[-3.395%; +3.395%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.062KB; +0.062KB] or [-0.148%; +0.148%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-12.173ms; +12.173ms] or [-8.008%; +8.008%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-12.467ms; +12.467ms] or [-3.893%; +3.893%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-39.080ms; +39.080ms] or [-5.369%; +5.369%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:appsec-control-14.20.1	cpu_usage_percentage	no difference _{[-3.265%; +3.265%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.280KB; +0.280KB] or [-0.453%; +0.453%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-14.168ms; +14.168ms] or [-12.137%; +12.137%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-16.704ms; +16.704ms] or [-1.923%; +1.923%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.037s; +0.037s] or [-3.548%; +3.548%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:async_hooks-init-only-14.20.1	cpu_usage_percentage	no difference _{[-0.349%; +0.349%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-6.054ms; +6.054ms] or [-2.760%; +2.760%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-16.582ms; +16.582ms] or [-33.638%; +33.638%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-3.275KB; +3.275KB] or [-2.149%; +2.149%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-35.161ms; +35.161ms] or [-36.704%; +36.704%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-42.142ms; +42.142ms] or [-4.905%; +4.905%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.019s; +0.019s] or [-1.334%; +1.334%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-http-client-control-14.20.1	cpu_usage_percentage	no difference _{[-1.741%; +1.741%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.165KB; +0.165KB] or [-0.372%; +0.372%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-24.961ms; +24.961ms] or [-11.638%; +11.638%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-25.411ms; +25.411ms] or [-4.919%; +4.919%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.035s; +0.035s] or [-2.950%; +2.950%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:startup-control-everything-14.20.1	cpu_usage_percentage	no difference _{[-0.044%; +0.044%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.717KB; +0.717KB] or [-0.630%; +0.630%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-31.378ms; +31.378ms] or [-24.487%; +24.487%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-24.060ms; +24.060ms] or [-2.411%; +2.411%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.010s; +0.010s] or [-0.862%; +0.862%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:exporting-pipeline-0.4-14.20.1	cpu_usage_percentage	no difference _{[-0.050%; +0.050%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.673KB; +0.673KB] or [-0.760%; +0.760%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-15.883ms; +15.883ms] or [-24.523%; +24.523%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.022s; +0.022s] or [-1.640%; +1.640%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.009s; +0.009s] or [-0.630%; +0.630%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:spans-finish-later-14.20.1	cpu_usage_percentage	no difference _{[-0.049%; +0.049%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-3.128KB; +3.128KB] or [-1.557%; +1.557%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-13.795ms; +13.795ms] or [-11.734%; +11.734%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-17.909ms; +17.909ms] or [-2.119%; +2.119%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-5.258ms; +5.258ms] or [-0.546%; +0.546%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-with-depth-off-14.20.1	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-q-with-tracer-14.20.1	cpu_usage_percentage	no difference _{[-0.050%; +0.050%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.834KB; +0.834KB] or [-0.626%; +0.626%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-11.485ms; +11.485ms] or [-17.622%; +17.622%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-13.611ms; +13.611ms] or [-1.592%; +1.592%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-9.020ms; +9.020ms] or [-0.980%; +0.980%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:scope-manager-base-14.20.1	cpu_usage_percentage	no difference _{[-0.201%; +0.201%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.109KB; +0.109KB] or [-0.265%; +0.265%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-26.839ms; +26.839ms] or [-84.017%; +84.017%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-18.652ms; +18.652ms] or [-13.254%; +13.254%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.033s; +0.033s] or [-0.599%; +0.599%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:net-with-tracer-14.20.1	cpu_usage_percentage	no difference _{[-3.558%; +3.558%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.412KB; +0.412KB] or [-0.757%; +0.757%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-26.444ms; +26.444ms] or [-12.621%; +12.621%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-26.138ms; +26.138ms] or [-2.903%; +2.903%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.070s; +0.070s] or [-4.967%; +4.967%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:appsec-appsec-enabled-14.20.1	cpu_usage_percentage	no difference _{[-0.183%; +0.183%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.441KB; +0.441KB] or [-0.646%; +0.646%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-21.380ms; +21.380ms] or [-15.414%; +15.414%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.021s; +0.021s] or [-1.829%; +1.829%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.003s; +0.003s] or [-0.239%; +0.239%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:async_hooks-all-hooks-14.20.1	cpu_usage_percentage	no difference _{[-0.182%; +0.182%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-3.552ms; +3.552ms] or [-0.728%; +0.728%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-8.137ms; +8.137ms] or [-4.921%; +4.921%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-1.120KB; +1.120KB] or [-0.508%; +0.508%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-36.575ms; +36.575ms] or [-17.909%; +17.909%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.054s; +0.054s] or [-2.756%; +2.756%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.019s; +0.019s] or [-0.765%; +0.765%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-with-depth-on-max-14.20.1	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:exporting-pipeline-0.5-14.20.1	cpu_usage_percentage	no difference _{[-0.062%; +0.062%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.496KB; +0.496KB] or [-0.657%; +0.657%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-16.127ms; +16.127ms] or [-37.326%; +37.326%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.016s; +0.016s] or [-1.438%; +1.438%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.006s; +0.006s] or [-0.528%; +0.528%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:startup-with-tracer-everything-14.20.1	cpu_usage_percentage	no difference _{[-0.031%; +0.031%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.366KB; +0.366KB] or [-0.321%; +0.321%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-10.494ms; +10.494ms] or [-7.265%; +7.265%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.014s; +0.014s] or [-1.166%; +1.166%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.004s; +0.004s] or [-0.338%; +0.338%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:scope-manager-async_hooks-14.20.1	cpu_usage_percentage	no difference _{[-0.176%; +0.176%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.055KB; +0.055KB] or [-0.133%; +0.133%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-36.985ms; +36.985ms] or [-133.741%; +133.741%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-27.089ms; +27.089ms] or [-19.871%; +19.871%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.017s; +0.017s] or [-0.324%; +0.324%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-http-client-with-tracer-14.20.1	cpu_usage_percentage	no difference _{[-0.088%; +0.088%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.226KB; +0.226KB] or [-0.326%; +0.326%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-30.420ms; +30.420ms] or [-12.001%; +12.001%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.030s; +0.030s] or [-2.227%; +2.227%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.010s; +0.010s] or [-0.495%; +0.495%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:appsec-control-with-attacks-14.20.1	cpu_usage_percentage	no difference _{[-0.252%; +0.252%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.230KB; +0.230KB] or [-0.372%; +0.372%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-18.192ms; +18.192ms] or [-15.494%; +15.494%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-17.139ms; +17.139ms] or [-1.950%; +1.950%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.005s; +0.005s] or [-0.484%; +0.484%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-dns-control-14.20.1	cpu_usage_percentage	no difference _{[-0.226%; +0.226%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.282KB; +0.282KB] or [-0.738%; +0.738%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-100.820ms; +100.820ms] or [-18.283%; +18.283%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-100.693ms; +100.693ms] or [-29.367%; +29.367%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.939s; +0.939s] or [-8.012%; +8.012%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:exporting-pipeline-0.4_with_stats-14.20.1	cpu_usage_percentage	no difference _{[-0.073%; +0.073%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.805KB; +0.805KB] or [-0.908%; +0.908%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-8.297ms; +8.297ms] or [-13.933%; +13.933%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.017s; +0.017s] or [-1.303%; +1.303%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.012s; +0.012s] or [-0.891%; +0.891%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-with-depth-and-collapse-off-14.20.1	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-http-server-control-14.20.1	cpu_usage_percentage	no difference _{[-0.069%; +0.069%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.059KB; +0.059KB] or [-0.138%; +0.138%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-13.526ms; +13.526ms] or [-19.826%; +19.826%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-13.483ms; +13.483ms] or [-3.689%; +3.689%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.002s; +0.002s] or [-0.204%; +0.204%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:appsec-appsec-enabled-with-attacks-14.20.1	cpu_usage_percentage	no difference _{[-0.158%; +0.158%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.331KB; +0.331KB] or [-0.470%; +0.470%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-27.409ms; +27.409ms] or [-22.259%; +22.259%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.028s; +0.028s] or [-2.255%; +2.255%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.003s; +0.003s] or [-0.240%; +0.240%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-with-depth-and-collapse-on-14.20.1	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:scope-manager-async_local_storage-14.20.1	cpu_usage_percentage	no difference _{[-0.004%; +0.004%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.082KB; +0.082KB] or [-0.200%; +0.200%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-14.095ms; +14.095ms] or [-60.705%; +60.705%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-13.807ms; +13.807ms] or [-9.949%; +9.949%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.017s; +0.017s] or [-0.323%; +0.323%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:exporting-pipeline-0.5_with_stats-14.20.1	cpu_usage_percentage	no difference _{[-0.059%; +0.059%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.669KB; +0.669KB] or [-0.877%; +0.877%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-9.972ms; +9.972ms] or [-24.447%; +24.447%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.011s; +0.011s] or [-1.022%; +1.022%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.002s; +0.002s] or [-0.197%; +0.197%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-http-server-with-tracer-14.20.1	cpu_usage_percentage	no difference _{[-0.153%; +0.153%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.155KB; +0.155KB] or [-0.250%; +0.250%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-20.214ms; +20.214ms] or [-17.827%; +17.827%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-19.798ms; +19.798ms] or [-2.357%; +2.357%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.008s; +0.008s] or [-0.457%; +0.457%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:scope-manager-async_resource-14.20.1	cpu_usage_percentage	no difference _{[-0.258%; +0.258%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.066KB; +0.066KB] or [-0.160%; +0.160%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-33.195ms; +33.195ms] or [-169.599%; +169.599%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-40.395ms; +40.395ms] or [-28.291%; +28.291%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.012s; +0.012s] or [-0.223%; +0.223%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:encoders-0.4-14.20.1	cpu_usage_percentage	no difference _{[-0.015%; +0.015%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.344KB; +0.344KB] or [-0.137%; +0.137%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-0.039s; +0.039s] or [-2.511%; +2.511%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.062s; +0.062s] or [-1.134%; +1.134%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.052s; +0.052s] or [-0.745%; +0.745%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-dns-with-tracer-14.20.1	cpu_usage_percentage	no difference _{[-0.223%; +0.223%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.491KB; +0.491KB] or [-0.878%; +0.878%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-53.781ms; +53.781ms] or [-8.184%; +8.184%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.032s; +0.032s] or [-1.943%; +1.943%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.113s; +0.113s] or [-0.892%; +0.892%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-http-server-querystring-obfuscation-14.20.1	cpu_usage_percentage	no difference _{[-0.196%; +0.196%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.407KB; +0.407KB] or [-0.601%; +0.601%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-14.680ms; +14.680ms] or [-11.885%; +11.885%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-15.493ms; +15.493ms] or [-1.672%; +1.672%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.004s; +0.004s] or [-0.232%; +0.232%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:encoders-0.5-14.20.1	cpu_usage_percentage	no difference _{[-0.014%; +0.014%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.204KB; +0.204KB] or [-0.125%; +0.125%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-18.235ms; +18.235ms] or [-5.395%; +5.395%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.040s; +0.040s] or [-0.963%; +0.963%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.027s; +0.027s] or [-0.605%; +0.605%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:startup-control-16.17.1	cpu_usage_percentage	no difference _{[-0.130%; +0.130%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.224KB; +0.224KB] or [-0.683%; +0.683%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-3.379ms; +3.379ms] or [-44.538%; +44.538%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-3.412ms; +3.412ms] or [-8.255%; +8.255%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.330ms; +0.330ms] or [-0.670%; +0.670%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:profiler-control-16.17.1	cpu_usage_percentage	no difference _{[-0.661%; +0.661%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-1.950ms; +1.950ms] or [-36.692%; +36.692%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-0.020ms; +0.020ms] or [-1.600%; +1.600%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-0.104KB; +0.104KB] or [-0.229%; +0.229%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-5.386ms; +5.386ms] or [-33.801%; +33.801%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-5.327ms; +5.327ms] or [-4.669%; +4.669%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.800ms; +0.800ms] or [-0.608%; +0.608%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:log-without-log-16.17.1	cpu_usage_percentage	no difference _{[-1.217%; +1.217%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.061KB; +0.061KB] or [-0.134%; +0.134%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-6.870ms; +6.870ms] or [-66.838%; +66.838%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-7.039ms; +7.039ms] or [-5.137%; +5.137%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-2.076ms; +2.076ms] or [-1.400%; +1.400%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-bluebird-control-16.17.1	cpu_usage_percentage	no difference _{[-0.053%; +0.053%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.235KB; +0.235KB] or [-0.458%; +0.458%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-8.056ms; +8.056ms] or [-41.972%; +41.972%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-8.369ms; +8.369ms] or [-5.941%; +5.941%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.616ms; +0.616ms] or [-0.384%; +0.384%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:startup-with-tracer-16.17.1	cpu_usage_percentage	no difference _{[-0.308%; +0.308%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.037KB; +0.037KB] or [-0.082%; +0.082%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-8.605ms; +8.605ms] or [-46.604%; +46.604%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-8.596ms; +8.596ms] or [-6.664%; +6.664%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.624ms; +0.624ms] or [-0.422%; +0.422%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-control-16.17.1	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:profiler-with-cpu-profiler-16.17.1	cpu_usage_percentage	no difference _{[-0.302%; +0.302%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-0.259ms; +0.259ms] or [-1.469%; +1.469%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-0.017ms; +0.017ms] or [-1.330%; +1.330%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-0.069KB; +0.069KB] or [-0.145%; +0.145%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-7.059ms; +7.059ms] or [-39.398%; +39.398%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-7.170ms; +7.170ms] or [-5.335%; +5.335%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.685ms; +0.685ms] or [-0.446%; +0.446%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:log-skip-log-16.17.1	cpu_usage_percentage	no difference _{[-0.029%; +0.029%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.043KB; +0.043KB] or [-0.093%; +0.093%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-6.192ms; +6.192ms] or [-35.103%; +35.103%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-6.058ms; +6.058ms] or [-4.667%; +4.667%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.320ms; +0.320ms] or [-0.217%; +0.217%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:spans-finish-immediately-16.17.1	cpu_usage_percentage	no difference _{[-0.279%; +0.279%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.074KB; +0.074KB] or [-0.153%; +0.153%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-7.486ms; +7.486ms] or [-39.000%; +39.000%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-9.875ms; +9.875ms] or [-2.565%; +2.565%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-4.383ms; +4.383ms] or [-1.082%; +1.082%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:async_hooks-no-hooks-16.17.1	cpu_usage_percentage	no difference _{[-0.235%; +0.235%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-0.712ms; +0.712ms] or [-1.030%; +1.030%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-0.209ms; +0.209ms] or [-1.092%; +1.092%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-0.324KB; +0.324KB] or [-0.274%; +0.274%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-22.545ms; +22.545ms] or [-39.021%; +39.021%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-22.024ms; +22.024ms] or [-7.234%; +7.234%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-2.369ms; +2.369ms] or [-0.277%; +0.277%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:profiler-with-space-profiler-16.17.1	cpu_usage_percentage	no difference _{[-1.874%; +1.874%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-0.452ms; +0.452ms] or [-7.519%; +7.519%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-0.019ms; +0.019ms] or [-1.461%; +1.461%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-0.097KB; +0.097KB] or [-0.213%; +0.213%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-7.071ms; +7.071ms] or [-39.286%; +39.286%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-6.862ms; +6.862ms] or [-5.966%; +5.966%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-2.671ms; +2.671ms] or [-1.977%; +1.977%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-bluebird-with-tracer-16.17.1	cpu_usage_percentage	no difference _{[-0.064%; +0.064%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.142KB; +0.142KB] or [-0.248%; +0.248%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-11.338ms; +11.338ms] or [-37.313%; +37.313%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-11.554ms; +11.554ms] or [-4.901%; +4.901%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.407ms; +0.407ms] or [-0.153%; +0.153%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:log-with-debug-16.17.1	cpu_usage_percentage	no difference _{[-0.040%; +0.040%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.083KB; +0.083KB] or [-0.182%; +0.182%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-8.593ms; +8.593ms] or [-44.872%; +44.872%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-8.483ms; +8.483ms] or [-6.615%; +6.615%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.421ms; +0.421ms] or [-0.285%; +0.285%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:profiler-with-all-profilers-16.17.1	cpu_usage_percentage	no difference _{[-0.339%; +0.339%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-0.260ms; +0.260ms] or [-1.469%; +1.469%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-0.017ms; +0.017ms] or [-1.309%; +1.309%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-0.122KB; +0.122KB] or [-0.253%; +0.253%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-5.043ms; +5.043ms] or [-34.964%; +34.964%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-4.924ms; +4.924ms] or [-3.525%; +3.525%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-1.024ms; +1.024ms] or [-0.660%; +0.660%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-q-control-16.17.1	cpu_usage_percentage	no difference _{[-0.026%; +0.026%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.281KB; +0.281KB] or [-0.221%; +0.221%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-8.122ms; +8.122ms] or [-15.637%; +15.637%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-8.060ms; +8.060ms] or [-1.488%; +1.488%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-3.591ms; +3.591ms] or [-0.604%; +0.604%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-with-async-hooks-16.17.1	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:log-with-error-16.17.1	cpu_usage_percentage	no difference _{[-0.200%; +0.200%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.077KB; +0.077KB] or [-0.168%; +0.168%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-5.544ms; +5.544ms] or [-26.197%; +26.197%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-5.648ms; +5.648ms] or [-4.472%; +4.472%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.526ms; +0.526ms] or [-0.356%; +0.356%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:net-control-16.17.1	cpu_usage_percentage	no difference _{[-3.192%; +3.192%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.061KB; +0.061KB] or [-0.141%; +0.141%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-22.210ms; +22.210ms] or [-12.920%; +12.920%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-21.540ms; +21.540ms] or [-7.701%; +7.701%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-42.773ms; +42.773ms] or [-6.058%; +6.058%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:appsec-control-16.17.1	cpu_usage_percentage	no difference _{[-1.311%; +1.311%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.746KB; +0.746KB] or [-1.115%; +1.115%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-13.592ms; +13.592ms] or [-11.502%; +11.502%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-14.841ms; +14.841ms] or [-1.654%; +1.654%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.017s; +0.017s] or [-1.633%; +1.633%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:exporting-pipeline-0.4-16.17.1	cpu_usage_percentage	no difference _{[-0.050%; +0.050%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.843KB; +0.843KB] or [-0.949%; +0.949%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-16.806ms; +16.806ms] or [-27.487%; +27.487%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.019s; +0.019s] or [-1.915%; +1.915%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.006s; +0.006s] or [-0.525%; +0.525%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:async_hooks-init-only-16.17.1	cpu_usage_percentage	no difference _{[-0.894%; +0.894%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-22.296ms; +22.296ms] or [-11.184%; +11.184%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-4.060ms; +4.060ms] or [-10.680%; +10.680%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-0.559KB; +0.559KB] or [-0.368%; +0.368%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-13.150ms; +13.150ms] or [-13.800%; +13.800%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-14.510ms; +14.510ms] or [-1.743%; +1.743%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.022s; +0.022s] or [-1.557%; +1.557%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-http-client-control-16.17.1	cpu_usage_percentage	no difference _{[-0.249%; +0.249%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.085KB; +0.085KB] or [-0.191%; +0.191%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-24.083ms; +24.083ms] or [-12.108%; +12.108%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-22.865ms; +22.865ms] or [-4.480%; +4.480%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.004s; +0.004s] or [-0.348%; +0.348%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:startup-control-everything-16.17.1	cpu_usage_percentage	no difference _{[-0.051%; +0.051%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.136KB; +0.136KB] or [-0.113%; +0.113%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-19.019ms; +19.019ms] or [-15.812%; +15.812%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-18.642ms; +18.642ms] or [-1.885%; +1.885%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.001s; +0.001s] or [-0.108%; +0.108%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:spans-finish-later-16.17.1	cpu_usage_percentage	no difference _{[-0.056%; +0.056%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.524KB; +0.524KB] or [-0.253%; +0.253%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-17.758ms; +17.758ms] or [-16.875%; +16.875%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-18.428ms; +18.428ms] or [-2.143%; +2.143%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-4.450ms; +4.450ms] or [-0.461%; +0.461%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-q-with-tracer-16.17.1	cpu_usage_percentage	no difference _{[-0.053%; +0.053%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.468KB; +0.468KB] or [-0.365%; +0.365%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-6.851ms; +6.851ms] or [-10.259%; +10.259%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-8.243ms; +8.243ms] or [-1.011%; +1.011%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-2.837ms; +2.837ms] or [-0.322%; +0.322%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-with-depth-off-16.17.1	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:scope-manager-base-16.17.1	cpu_usage_percentage	no difference _{[-0.225%; +0.225%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-1.232KB; +1.232KB] or [-2.840%; +2.840%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-17.837ms; +17.837ms] or [-77.007%; +77.007%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-27.645ms; +27.645ms] or [-18.968%; +18.968%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.040s; +0.040s] or [-0.746%; +0.746%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:exporting-pipeline-0.5-16.17.1	cpu_usage_percentage	no difference _{[-0.076%; +0.076%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.061KB; +0.061KB] or [-0.075%; +0.075%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-10.799ms; +10.799ms] or [-22.732%; +22.732%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-12.291ms; +12.291ms] or [-1.690%; +1.690%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-2.615ms; +2.615ms] or [-0.337%; +0.337%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:net-with-tracer-16.17.1	cpu_usage_percentage	no difference _{[-2.381%; +2.381%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.195KB; +0.195KB] or [-0.323%; +0.323%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-25.347ms; +25.347ms] or [-11.626%; +11.626%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-24.617ms; +24.617ms] or [-3.097%; +3.097%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.045s; +0.045s] or [-3.462%; +3.462%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:async_hooks-all-hooks-16.17.1	cpu_usage_percentage	no difference _{[-0.524%; +0.524%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-7.000ms; +7.000ms] or [-1.315%; +1.315%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-4.673ms; +4.673ms] or [-2.882%; +2.882%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-1.444KB; +1.444KB] or [-0.580%; +0.580%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-24.533ms; +24.533ms] or [-14.956%; +14.956%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.015s; +0.015s] or [-0.911%; +0.911%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.020s; +0.020s] or [-0.872%; +0.872%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:appsec-appsec-enabled-16.17.1	cpu_usage_percentage	no difference _{[-0.213%; +0.213%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.163KB; +0.163KB] or [-0.221%; +0.221%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-16.255ms; +16.255ms] or [-11.050%; +11.050%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.016s; +0.016s] or [-1.495%; +1.495%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.005s; +0.005s] or [-0.372%; +0.372%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-with-depth-on-max-16.17.1	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:startup-with-tracer-everything-16.17.1	cpu_usage_percentage	no difference _{[-0.055%; +0.055%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.323KB; +0.323KB] or [-0.260%; +0.260%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-24.841ms; +24.841ms] or [-15.285%; +15.285%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.025s; +0.025s] or [-2.123%; +2.123%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.005s; +0.005s] or [-0.371%; +0.371%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:exporting-pipeline-0.4_with_stats-16.17.1	cpu_usage_percentage	no difference _{[-0.066%; +0.066%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.747KB; +0.747KB] or [-0.843%; +0.843%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-10.185ms; +10.185ms] or [-16.876%; +16.876%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.016s; +0.016s] or [-1.629%; +1.629%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.010s; +0.010s] or [-0.938%; +0.938%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-http-client-with-tracer-16.17.1	cpu_usage_percentage	no difference _{[-0.088%; +0.088%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.188KB; +0.188KB] or [-0.247%; +0.247%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-40.232ms; +40.232ms] or [-16.708%; +16.708%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.036s; +0.036s] or [-2.822%; +2.822%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.008s; +0.008s] or [-0.388%; +0.388%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:scope-manager-async_hooks-16.17.1	cpu_usage_percentage	no difference _{[-0.096%; +0.096%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.137KB; +0.137KB] or [-0.314%; +0.314%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-23.071ms; +23.071ms] or [-112.944%; +112.944%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-17.507ms; +17.507ms] or [-12.363%; +12.363%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.018s; +0.018s] or [-0.328%; +0.328%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:appsec-control-with-attacks-16.17.1	cpu_usage_percentage	no difference _{[-0.265%; +0.265%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.463KB; +0.463KB] or [-0.688%; +0.688%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-19.821ms; +19.821ms] or [-16.004%; +16.004%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-17.274ms; +17.274ms] or [-1.927%; +1.927%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.006s; +0.006s] or [-0.562%; +0.562%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-dns-control-16.17.1	cpu_usage_percentage	no difference _{[-0.214%; +0.214%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.655KB; +0.655KB] or [-1.699%; +1.699%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-21.440ms; +21.440ms] or [-3.729%; +3.729%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-68.383ms; +68.383ms] or [-22.315%; +22.315%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.684s; +0.684s] or [-5.868%; +5.868%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:exporting-pipeline-0.5_with_stats-16.17.1	cpu_usage_percentage	no difference _{[-0.089%; +0.089%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.073KB; +0.073KB] or [-0.090%; +0.090%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-11.084ms; +11.084ms] or [-25.461%; +25.461%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-11.990ms; +11.990ms] or [-1.652%; +1.652%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-5.252ms; +5.252ms] or [-0.682%; +0.682%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-with-depth-and-collapse-off-16.17.1	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-http-server-control-16.17.1	cpu_usage_percentage	no difference _{[-0.066%; +0.066%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.051KB; +0.051KB] or [-0.108%; +0.108%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-16.430ms; +16.430ms] or [-21.963%; +21.963%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-15.831ms; +15.831ms] or [-4.471%; +4.471%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.003s; +0.003s] or [-0.276%; +0.276%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:appsec-appsec-enabled-with-attacks-16.17.1	cpu_usage_percentage	no difference _{[-0.202%; +0.202%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.457KB; +0.457KB] or [-0.587%; +0.587%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-23.929ms; +23.929ms] or [-17.780%; +17.780%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.023s; +0.023s] or [-1.997%; +1.997%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.007s; +0.007s] or [-0.550%; +0.550%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-with-depth-and-collapse-on-16.17.1	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:scope-manager-async_local_storage-16.17.1	cpu_usage_percentage	no difference _{[-0.141%; +0.141%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-1.196KB; +1.196KB] or [-2.759%; +2.759%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-21.524ms; +21.524ms] or [-85.215%; +85.215%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-13.663ms; +13.663ms] or [-10.252%; +10.252%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.024s; +0.024s] or [-0.447%; +0.447%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:encoders-0.4-16.17.1	cpu_usage_percentage	no difference _{[-0.017%; +0.017%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.153KB; +0.153KB] or [-0.060%; +0.060%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-0.056s; +0.056s] or [-3.717%; +3.717%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.067s; +0.067s] or [-1.731%; +1.731%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.045s; +0.045s] or [-0.845%; +0.845%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-http-server-with-tracer-16.17.1	cpu_usage_percentage	no difference _{[-0.142%; +0.142%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.520KB; +0.520KB] or [-0.774%; +0.774%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-14.076ms; +14.076ms] or [-11.676%; +11.676%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-15.475ms; +15.475ms] or [-1.806%; +1.806%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.007s; +0.007s] or [-0.442%; +0.442%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:scope-manager-async_resource-16.17.1	cpu_usage_percentage	no difference _{[-0.031%; +0.031%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.189KB; +0.189KB] or [-0.432%; +0.432%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-24.889ms; +24.889ms] or [-111.399%; +111.399%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-23.418ms; +23.418ms] or [-17.703%; +17.703%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.002s; +0.002s] or [-0.039%; +0.039%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-dns-with-tracer-16.17.1	cpu_usage_percentage	no difference _{[-0.062%; +0.062%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.626KB; +0.626KB] or [-1.009%; +1.009%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-155.851ms; +155.851ms] or [-20.903%; +20.903%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.132s; +0.132s] or [-8.956%; +8.956%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.104s; +0.104s] or [-0.826%; +0.826%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-http-server-querystring-obfuscation-16.17.1	cpu_usage_percentage	no difference _{[-0.127%; +0.127%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.317KB; +0.317KB] or [-0.419%; +0.419%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-15.892ms; +15.892ms] or [-12.764%; +12.764%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-15.852ms; +15.852ms] or [-1.818%; +1.818%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.005s; +0.005s] or [-0.278%; +0.278%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:encoders-0.5-16.17.1	cpu_usage_percentage	no difference _{[-0.021%; +0.021%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.108KB; +0.108KB] or [-0.065%; +0.065%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-17.132ms; +17.132ms] or [-5.395%; +5.395%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.044s; +0.044s] or [-1.771%; +1.771%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.032s; +0.032s] or [-1.125%; +1.125%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:startup-control-18.10.0	cpu_usage_percentage	no difference _{[-0.080%; +0.080%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.059KB; +0.059KB] or [-0.147%; +0.147%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-3.815ms; +3.815ms] or [-33.806%; +33.806%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-3.833ms; +3.833ms] or [-8.194%; +8.194%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.240ms; +0.240ms] or [-0.411%; +0.411%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:profiler-control-18.10.0	cpu_usage_percentage	no difference _{[-0.375%; +0.375%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-2.152ms; +2.152ms] or [-39.510%; +39.510%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-0.009ms; +0.009ms] or [-0.725%; +0.725%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-0.089KB; +0.089KB] or [-0.172%; +0.172%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-6.898ms; +6.898ms] or [-34.661%; +34.661%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-7.039ms; +7.039ms] or [-6.018%; +6.018%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.796ms; +0.796ms] or [-0.577%; +0.577%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:log-without-log-18.10.0	cpu_usage_percentage	no difference _{[-0.793%; +0.793%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.047KB; +0.047KB] or [-0.091%; +0.091%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-10.093ms; +10.093ms] or [-39.451%; +39.451%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-10.134ms; +10.134ms] or [-7.798%; +7.798%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.947ms; +0.947ms] or [-0.606%; +0.606%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-bluebird-control-18.10.0	cpu_usage_percentage	no difference _{[-0.139%; +0.139%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.063KB; +0.063KB] or [-0.106%; +0.106%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-6.755ms; +6.755ms] or [-32.918%; +32.918%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-6.804ms; +6.804ms] or [-4.672%; +4.672%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.630ms; +0.630ms] or [-0.378%; +0.378%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-control-18.10.0	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:startup-with-tracer-18.10.0	cpu_usage_percentage	no difference _{[-0.127%; +0.127%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.065KB; +0.065KB] or [-0.125%; +0.125%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-6.931ms; +6.931ms] or [-25.910%; +25.910%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-6.828ms; +6.828ms] or [-5.316%; +5.316%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.484ms; +0.484ms] or [-0.311%; +0.311%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:profiler-with-cpu-profiler-18.10.0	cpu_usage_percentage	no difference _{[-0.307%; +0.307%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-0.289ms; +0.289ms] or [-1.545%; +1.545%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-0.013ms; +0.013ms] or [-1.013%; +1.013%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-0.101KB; +0.101KB] or [-0.185%; +0.185%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-4.330ms; +4.330ms] or [-18.541%; +18.541%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-4.087ms; +4.087ms] or [-2.990%; +2.990%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-1.081ms; +1.081ms] or [-0.671%; +0.671%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:log-skip-log-18.10.0	cpu_usage_percentage	no difference _{[-0.160%; +0.160%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.054KB; +0.054KB] or [-0.105%; +0.105%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-7.476ms; +7.476ms] or [-32.705%; +32.705%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-7.493ms; +7.493ms] or [-5.637%; +5.637%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.639ms; +0.639ms] or [-0.408%; +0.408%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:spans-finish-immediately-18.10.0	cpu_usage_percentage	no difference _{[-0.048%; +0.048%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.092KB; +0.092KB] or [-0.167%; +0.167%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-10.000ms; +10.000ms] or [-49.990%; +49.990%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-9.782ms; +9.782ms] or [-2.586%; +2.586%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-3.443ms; +3.443ms] or [-0.863%; +0.863%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:async_hooks-no-hooks-18.10.0	cpu_usage_percentage	no difference _{[-0.156%; +0.156%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-0.946ms; +0.946ms] or [-1.447%; +1.447%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-0.091ms; +0.091ms] or [-0.529%; +0.529%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-0.282KB; +0.282KB] or [-0.226%; +0.226%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-7.716ms; +7.716ms] or [-11.924%; +11.924%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-6.378ms; +6.378ms] or [-2.167%; +2.167%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-2.506ms; +2.506ms] or [-0.298%; +0.298%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-bluebird-with-tracer-18.10.0	cpu_usage_percentage	no difference _{[-0.034%; +0.034%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.011KB; +0.011KB] or [-0.017%; +0.017%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-11.840ms; +11.840ms] or [-39.953%; +39.953%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-12.013ms; +12.013ms] or [-5.399%; +5.399%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.817ms; +0.817ms] or [-0.324%; +0.324%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:profiler-with-space-profiler-18.10.0	cpu_usage_percentage	no difference _{[-0.366%; +0.366%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-0.528ms; +0.528ms] or [-8.645%; +8.645%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-0.014ms; +0.014ms] or [-1.055%; +1.055%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-0.078KB; +0.078KB] or [-0.150%; +0.150%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-7.296ms; +7.296ms] or [-37.836%; +37.836%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-7.284ms; +7.284ms] or [-6.057%; +6.057%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.594ms; +0.594ms] or [-0.422%; +0.422%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:log-with-debug-18.10.0	cpu_usage_percentage	no difference _{[-0.086%; +0.086%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.070KB; +0.070KB] or [-0.136%; +0.136%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-5.369ms; +5.369ms] or [-29.910%; +29.910%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-5.456ms; +5.456ms] or [-3.963%; +3.963%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.370ms; +0.370ms] or [-0.237%; +0.237%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-q-control-18.10.0	cpu_usage_percentage	no difference _{[-0.070%; +0.070%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.591KB; +0.591KB] or [-0.440%; +0.440%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-11.072ms; +11.072ms] or [-17.091%; +17.091%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-11.076ms; +11.076ms] or [-2.062%; +2.062%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-2.720ms; +2.720ms] or [-0.451%; +0.451%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-with-async-hooks-18.10.0	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:profiler-with-all-profilers-18.10.0	cpu_usage_percentage	no difference _{[-0.281%; +0.281%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-0.309ms; +0.309ms] or [-1.654%; +1.654%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-0.017ms; +0.017ms] or [-1.288%; +1.288%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-0.098KB; +0.098KB] or [-0.179%; +0.179%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-8.196ms; +8.196ms] or [-51.063%; +51.063%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-8.418ms; +8.418ms] or [-5.759%; +5.759%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.720ms; +0.720ms] or [-0.441%; +0.441%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:log-with-error-18.10.0	cpu_usage_percentage	no difference _{[-0.051%; +0.051%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.071KB; +0.071KB] or [-0.138%; +0.138%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-4.924ms; +4.924ms] or [-23.719%; +23.719%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-5.045ms; +5.045ms] or [-3.738%; +3.738%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.466ms; +0.466ms] or [-0.299%; +0.299%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:net-control-18.10.0	cpu_usage_percentage	no difference _{[-3.256%; +3.256%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.061KB; +0.061KB] or [-0.118%; +0.118%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-11.642ms; +11.642ms] or [-6.665%; +6.665%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-10.150ms; +10.150ms] or [-3.693%; +3.693%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-42.506ms; +42.506ms] or [-6.003%; +6.003%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:appsec-control-18.10.0	cpu_usage_percentage	no difference _{[-1.558%; +1.558%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.647KB; +0.647KB] or [-0.854%; +0.854%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-24.349ms; +24.349ms] or [-21.520%; +21.520%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-25.657ms; +25.657ms] or [-3.134%; +3.134%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-18.342ms; +18.342ms] or [-1.887%; +1.887%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-http-client-control-18.10.0	cpu_usage_percentage	no difference _{[-0.076%; +0.076%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.038KB; +0.038KB] or [-0.071%; +0.071%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-31.097ms; +31.097ms] or [-15.464%; +15.464%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-30.910ms; +30.910ms] or [-6.270%; +6.270%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.003s; +0.003s] or [-0.224%; +0.224%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:async_hooks-init-only-18.10.0	cpu_usage_percentage	no difference _{[-0.132%; +0.132%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-3.272ms; +3.272ms] or [-1.509%; +1.509%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-12.880ms; +12.880ms] or [-31.450%; +31.450%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-1.234KB; +1.234KB] or [-0.742%; +0.742%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-25.147ms; +25.147ms] or [-25.783%; +25.783%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-22.312ms; +22.312ms] or [-2.462%; +2.462%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.005s; +0.005s] or [-0.326%; +0.326%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:spans-finish-later-18.10.0	cpu_usage_percentage	no difference _{[-0.062%; +0.062%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.783KB; +0.783KB] or [-0.378%; +0.378%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-10.486ms; +10.486ms] or [-9.716%; +9.716%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-10.743ms; +10.743ms] or [-1.345%; +1.345%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-5.540ms; +5.540ms] or [-0.611%; +0.611%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:startup-control-everything-18.10.0	cpu_usage_percentage	no difference _{[-0.054%; +0.054%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.469KB; +0.469KB] or [-0.358%; +0.358%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-22.626ms; +22.626ms] or [-16.616%; +16.616%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.023s; +0.023s] or [-2.255%; +2.255%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.001s; +0.001s] or [-0.127%; +0.127%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-q-with-tracer-18.10.0	cpu_usage_percentage	no difference _{[-0.073%; +0.073%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.471KB; +0.471KB] or [-0.327%; +0.327%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-9.672ms; +9.672ms] or [-12.348%; +12.348%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-15.178ms; +15.178ms] or [-1.906%; +1.906%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-8.900ms; +8.900ms] or [-1.017%; +1.017%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:exporting-pipeline-0.4-18.10.0	cpu_usage_percentage	no difference _{[-0.048%; +0.048%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-3.416KB; +3.416KB] or [-3.457%; +3.457%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-7.081ms; +7.081ms] or [-10.009%; +10.009%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.017s; +0.017s] or [-1.148%; +1.148%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.014s; +0.014s] or [-0.937%; +0.937%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-with-depth-off-18.10.0	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:scope-manager-base-18.10.0	cpu_usage_percentage	no difference _{[-0.253%; +0.253%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.127KB; +0.127KB] or [-0.247%; +0.247%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-17.939ms; +17.939ms] or [-64.990%; +64.990%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-31.349ms; +31.349ms] or [-21.493%; +21.493%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.008s; +0.008s] or [-0.144%; +0.144%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:net-with-tracer-18.10.0	cpu_usage_percentage	no difference _{[-2.255%; +2.255%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.213KB; +0.213KB] or [-0.311%; +0.311%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-20.457ms; +20.457ms] or [-9.232%; +9.232%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-18.577ms; +18.577ms] or [-2.294%; +2.294%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.045s; +0.045s] or [-3.400%; +3.400%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:appsec-appsec-enabled-18.10.0	cpu_usage_percentage	no difference _{[-0.168%; +0.168%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.335KB; +0.335KB] or [-0.404%; +0.404%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-17.123ms; +17.123ms] or [-10.976%; +10.976%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.018s; +0.018s] or [-1.659%; +1.659%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.003s; +0.003s] or [-0.277%; +0.277%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:async_hooks-all-hooks-18.10.0	cpu_usage_percentage	no difference _{[-0.300%; +0.300%]}	no difference _{[nan; nan]}
	max_event_loop_delay	no difference _{[-6.535ms; +6.535ms] or [-1.240%; +1.240%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_gc_pause	no difference _{[-3.324ms; +3.324ms] or [-2.064%; +2.064%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	max_rss_usage	no difference _{[-0.908KB; +0.908KB] or [-0.352%; +0.352%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-19.247ms; +19.247ms] or [-9.366%; +9.366%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.025s; +0.025s] or [-1.556%; +1.556%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.030s; +0.030s] or [-1.313%; +1.313%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-with-depth-on-max-18.10.0	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:exporting-pipeline-0.5-18.10.0	cpu_usage_percentage	no difference _{[-0.104%; +0.104%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.224KB; +0.224KB] or [-0.262%; +0.262%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-8.701ms; +8.701ms] or [-18.925%; +18.925%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.009s; +0.009s] or [-0.816%; +0.816%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.006s; +0.006s] or [-0.505%; +0.505%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:startup-with-tracer-everything-18.10.0	cpu_usage_percentage	no difference _{[-0.041%; +0.041%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.257KB; +0.257KB] or [-0.193%; +0.193%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-22.519ms; +22.519ms] or [-14.029%; +14.029%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.021s; +0.021s] or [-1.797%; +1.797%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.005s; +0.005s] or [-0.353%; +0.353%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-http-client-with-tracer-18.10.0	cpu_usage_percentage	no difference _{[-0.144%; +0.144%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.354KB; +0.354KB] or [-0.411%; +0.411%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-21.677ms; +21.677ms] or [-8.188%; +8.188%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.025s; +0.025s] or [-1.979%; +1.979%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.008s; +0.008s] or [-0.394%; +0.394%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:appsec-control-with-attacks-18.10.0	cpu_usage_percentage	no difference _{[-0.285%; +0.285%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.343KB; +0.343KB] or [-0.450%; +0.450%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-17.883ms; +17.883ms] or [-14.105%; +14.105%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-18.882ms; +18.882ms] or [-2.349%; +2.349%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-4.699ms; +4.699ms] or [-0.496%; +0.496%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:scope-manager-async_hooks-18.10.0	cpu_usage_percentage	no difference _{[-0.070%; +0.070%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.066KB; +0.066KB] or [-0.127%; +0.127%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-18.484ms; +18.484ms] or [-75.753%; +75.753%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-22.016ms; +22.016ms] or [-15.426%; +15.426%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.068s; +0.068s] or [-1.249%; +1.249%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-dns-control-18.10.0	cpu_usage_percentage	no difference _{[-0.084%; +0.084%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.387KB; +0.387KB] or [-0.832%; +0.832%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-61.327ms; +61.327ms] or [-10.310%; +10.310%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-83.427ms; +83.427ms] or [-25.945%; +25.945%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.771s; +0.771s] or [-6.582%; +6.582%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-with-depth-and-collapse-off-18.10.0	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:exporting-pipeline-0.4_with_stats-18.10.0	cpu_usage_percentage	no difference _{[-0.110%; +0.110%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-3.126KB; +3.126KB] or [-3.046%; +3.046%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-7.818ms; +7.818ms] or [-12.373%; +12.373%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.014s; +0.014s] or [-0.969%; +0.969%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.015s; +0.015s] or [-1.021%; +1.021%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-http-server-control-18.10.0	cpu_usage_percentage	no difference _{[-0.073%; +0.073%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.285KB; +0.285KB] or [-0.512%; +0.512%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-13.436ms; +13.436ms] or [-16.828%; +16.828%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-13.446ms; +13.446ms] or [-3.907%; +3.907%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.003s; +0.003s] or [-0.295%; +0.295%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:appsec-appsec-enabled-with-attacks-18.10.0	cpu_usage_percentage	no difference _{[-0.147%; +0.147%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.159KB; +0.159KB] or [-0.184%; +0.184%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-17.671ms; +17.671ms] or [-12.336%; +12.336%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.017s; +0.017s] or [-1.481%; +1.481%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.003s; +0.003s] or [-0.251%; +0.251%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:scope-manager-async_local_storage-18.10.0	cpu_usage_percentage	no difference _{[-0.053%; +0.053%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.094KB; +0.094KB] or [-0.183%; +0.183%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-11.248ms; +11.248ms] or [-50.011%; +50.011%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-12.818ms; +12.818ms] or [-9.211%; +9.211%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.016s; +0.016s] or [-0.305%; +0.305%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-graphql-with-depth-and-collapse-on-18.10.0	cpu_usage_percentage	no difference _{[nan; nan]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[nan; nan] or [+nan%; +nan%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:exporting-pipeline-0.5_with_stats-18.10.0	cpu_usage_percentage	no difference _{[-0.069%; +0.069%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.321KB; +0.321KB] or [-0.375%; +0.375%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-11.934ms; +11.934ms] or [-30.480%; +30.480%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.015s; +0.015s] or [-1.366%; +1.366%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.006s; +0.006s] or [-0.535%; +0.535%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-http-server-with-tracer-18.10.0	cpu_usage_percentage	no difference _{[-0.142%; +0.142%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.345KB; +0.345KB] or [-0.455%; +0.455%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-18.609ms; +18.609ms] or [-13.565%; +13.565%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-17.829ms; +17.829ms] or [-2.356%; +2.356%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.009s; +0.009s] or [-0.582%; +0.582%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:scope-manager-async_resource-18.10.0	cpu_usage_percentage	no difference _{[-0.023%; +0.023%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.378KB; +0.378KB] or [-0.734%; +0.734%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-27.295ms; +27.295ms] or [-91.887%; +91.887%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-27.955ms; +27.955ms] or [-21.587%; +21.587%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.006s; +0.006s] or [-0.120%; +0.120%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-dns-with-tracer-18.10.0	cpu_usage_percentage	no difference _{[-0.106%; +0.106%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.551KB; +0.551KB] or [-0.822%; +0.822%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-5.140ms; +5.140ms] or [-0.670%; +0.670%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.029s; +0.029s] or [-1.868%; +1.868%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.105s; +0.105s] or [-0.822%; +0.822%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:plugin-http-server-querystring-obfuscation-18.10.0	cpu_usage_percentage	no difference _{[-0.127%; +0.127%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.360KB; +0.360KB] or [-0.425%; +0.425%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-21.599ms; +21.599ms] or [-14.973%; +14.973%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-21.978ms; +21.978ms] or [-2.618%; +2.618%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.004s; +0.004s] or [-0.227%; +0.227%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:encoders-0.4-18.10.0	cpu_usage_percentage	no difference _{[-0.012%; +0.012%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.123KB; +0.123KB] or [-0.046%; +0.046%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-0.033s; +0.033s] or [-2.191%; +2.191%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.045s; +0.045s] or [-0.723%; +0.723%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.043s; +0.043s] or [-0.555%; +0.555%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
scenario:encoders-0.5-18.10.0	cpu_usage_percentage	no difference _{[-0.014%; +0.014%]}	no difference _{[nan; nan]}
	max_rss_usage	no difference _{[-0.092KB; +0.092KB] or [-0.053%; +0.053%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_system_time	no difference _{[-19.113ms; +19.113ms] or [-5.819%; +5.819%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	cpu_user_time	no difference _{[-0.023s; +0.023s] or [-0.557%; +0.557%]}	no difference _{[nan; nan] or [+nan%; +nan%]}
	execution_time	no difference _{[-0.019s; +0.019s] or [-0.424%; +0.424%]}	no difference _{[nan; nan] or [+nan%; +nan%]}

Sep 30 '22 17:09 tlhunter

With this latest few commits I modified the appsec test, however I'm seeing that the scope, spans, and startup tests are also failing. Those are hard coded to have the highest CPU affinities (36, 37, 38). I wonder if the machine these tests are running on have changed? Like, did we go from having access to cores 24+ to only 24-35?

Actually... I think tests like ci/circleci: node-bench-sirun-spans-16 are running on the old machines, not the new benchmarking platform, and they probably have less resources. There's no reason to continue running benchmarks on those machines so I'll disable them.

Oct 07 '22 19:10 tlhunter

dd-gitlab/benchmarks currently fails because the baseline branch (master in this case) has no runall.sh script. Which makes sense as it's introduced in this PR.

+ cd /app/baseline//benchmark/sirun
+ ./runall.sh
./steps/run-benchmarks.sh: line 14: ./runall.sh: No such file or directory
Cleaning up project directory and file based variables 00:00
ERROR: Job failed: command terminated with exit code 1

CircleCI Pipeline fails as I've deleted the circle CI config file entirely. While looking over the 119 jobs for this repo, 49 of them are circle CI jobs and they're just for benchmarks.

Oct 07 '22 22:10 tlhunter

Getting a benchmark error:

Found errors in your .gitlab-ci.yml:

    Local file `.gitlab-ci.yml` does not exist!

You can also test your .gitlab-ci.yml in CI Lint

Their GUI linter tool finds and validates the file just fine. Might be a temporary fluke?

Oct 12 '22 21:10 tlhunter

dd-trace-js dd-trace-js copied to clipboard

execute all sirun benchmarks in a docker container

What does this PR do?

Motivation

TODO

Overall package size

Dependency sizes

Codecov Report

appsec

plugin-http

plugin-net

plugin-bluebird

profiler

startup

Parameters

Summary

dd-trace-js
dd-trace-js copied to clipboard