Live debugger parsing, expression evaluation, sender, redaction and FFI

[bwoebi]

trafficstars

Parsing goes through an intermediate step, which serde can simply deserialize to, handling which isn't possible by serde is then translated to working structures.

The Evaluator (feel free to clean up lifetime handling if possible. Spent far too much time fighting the borrow checker. Maybe my code is already perfect and I don't know it.) handles all evaluation of the expression language, iteration, error handling etc. and defers to some callbacks for actual evaluation of the values.

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 50.94062% with 1669 lines in your changes missing coverage. Please review.

Project coverage is 71.87%. Comparing base (43c5a39) to head (27146ae).

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #497      +/-   ##
==========================================
- Coverage   73.83%   71.87%   -1.97%     
==========================================
  Files         257      271      +14     
  Lines       37329    40654    +3325     
==========================================
+ Hits        27563    29221    +1658     
- Misses       9766    11433    +1667     

Components	Coverage Δ
crashtracker	20.36% <ø> (-0.06%)	:arrow_down:
crashtracker-ffi	9.07% <ø> (ø)
datadog-alloc	98.73% <ø> (ø)
data-pipeline	92.71% <ø> (-0.63%)	:arrow_down:
data-pipeline-ffi	0.00% <ø> (ø)
ddcommon	82.73% <55.55%> (-0.35%)	:arrow_down:
ddcommon-ffi	69.12% <52.94%> (-0.40%)	:arrow_down:
ddtelemetry	59.10% <ø> (ø)
ddtelemetry-ffi	22.13% <ø> (ø)
dogstatsd	90.42% <ø> (ø)
dogstatsd-client	79.77% <ø> (ø)
ipc	82.69% <39.44%> (-0.90%)	:arrow_down:
profiling	84.26% <ø> (ø)
profiling-ffi	77.42% <ø> (ø)
serverless	0.00% <ø> (ø)
sidecar	36.35% <21.62%> (-1.85%)	:arrow_down:
sidecar-ffi	0.00% <0.00%> (ø)
spawn-worker	50.36% <ø> (ø)
tinybytes	94.77% <ø> (ø)
trace-mini-agent	72.47% <ø> (ø)
trace-normalization	98.25% <ø> (ø)
trace-obfuscation	95.73% <ø> (ø)
trace-protobuf	77.67% <ø> (ø)
trace-utils	93.46% <ø> (ø)

[pr-commenter[bot]]

Benchmarks

Comparison

Benchmark execution time: 2024-10-02 12:52:17

Comparing candidate commit 27146ae in PR branch bob/live-debugger with baseline commit 43c5a39 in branch main.

Found 9 performance improvements and 26 performance regressions! Performance is the same for 16 metrics, 2 unstable metrics.

scenario:benching deserializing traces from msgpack to their internal representation

• 🟩 execution_time [-38.065ns; -29.438ns] or [-3.111%; -2.406%]

scenario:credit_card/is_card_number/ 3782-8224-6310-005

• 🟥 execution_time [+7.585µs; +7.852µs] or [+6.724%; +6.961%]
• 🟥 throughput [-578424.361op/s; -557936.218op/s] or [-6.525%; -6.294%]

scenario:credit_card/is_card_number/ 378282246310005

• 🟥 execution_time [+7.225µs; +7.436µs] or [+6.918%; +7.119%]
• 🟥 throughput [-637172.301op/s; -618896.325op/s] or [-6.655%; -6.464%]

scenario:credit_card/is_card_number/378282246310005

• 🟥 execution_time [+6.490µs; +6.725µs] or [+6.416%; +6.648%]
• 🟥 throughput [-617438.102op/s; -595453.450op/s] or [-6.245%; -6.023%]

scenario:credit_card/is_card_number/37828224631000521389798

• 🟥 execution_time [+12.896µs; +13.055µs] or [+12.772%; +12.930%]
• 🟥 throughput [-1135162.336op/s; -1120753.869op/s] or [-11.462%; -11.316%]

scenario:credit_card/is_card_number/x371413321323331

• 🟥 execution_time [+2.844µs; +2.934µs] or [+13.578%; +14.004%]
• 🟥 throughput [-5860851.677op/s; -5699219.774op/s] or [-12.277%; -11.938%]

scenario:credit_card/is_card_number_no_luhn/ 3782-8224-6310-005

• 🟥 execution_time [+8.397µs; +8.615µs] or [+9.367%; +9.610%]
• 🟥 throughput [-980642.622op/s; -954159.331op/s] or [-8.790%; -8.553%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

• 🟥 execution_time [+8.054µs; +8.156µs] or [+9.887%; +10.013%]
• 🟥 throughput [-1118556.446op/s; -1103637.035op/s] or [-9.112%; -8.990%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

• 🟥 execution_time [+7.723µs; +7.793µs] or [+9.926%; +10.017%]
• 🟥 throughput [-1170966.190op/s; -1159987.167op/s] or [-9.110%; -9.025%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

• 🟥 execution_time [+12.989µs; +13.155µs] or [+12.864%; +13.028%]
• 🟥 throughput [-1142485.492op/s; -1127880.197op/s] or [-11.536%; -11.389%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

• 🟥 execution_time [+2.769µs; +2.863µs] or [+13.200%; +13.650%]
• 🟥 throughput [-5724441.320op/s; -5551142.085op/s] or [-12.007%; -11.643%]

scenario:normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...

• 🟩 execution_time [-138.822µs; -138.640µs] or [-43.587%; -43.530%]
• 🟩 throughput [+2420463.361op/s; +2425936.515op/s] or [+77.090%; +77.264%]

scenario:normalization/normalize_name/normalize_name/bad-name

• 🟩 execution_time [-9.500µs; -9.464µs] or [-32.027%; -31.906%]
• 🟩 throughput [+15815906.862op/s; +15865193.442op/s] or [+46.912%; +47.058%]

scenario:normalization/normalize_name/normalize_name/good

• 🟩 execution_time [-4.232µs; -4.198µs] or [-24.393%; -24.202%]
• 🟩 throughput [+18442034.853op/s; +18557577.906op/s] or [+31.991%; +32.192%]

scenario:normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters

• 🟥 execution_time [+32.354µs; +32.602µs] or [+17.906%; +18.043%]
• 🟥 throughput [-847118.018op/s; -839498.355op/s] or [-15.307%; -15.169%]

scenario:normalization/normalize_service/normalize_service/[empty string]

• 🟥 execution_time [+1.408µs; +1.439µs] or [+3.137%; +3.206%]
• 🟥 throughput [-692630.390op/s; -677508.179op/s] or [-3.108%; -3.040%]

scenario:normalization/normalize_service/normalize_service/test_ASCII

• 🟥 execution_time [+3.708µs; +3.794µs] or [+7.328%; +7.498%]
• 🟥 throughput [-1379030.598op/s; -1348379.207op/s] or [-6.978%; -6.823%]

scenario:normalization/normalize_trace/test_trace

• 🟩 execution_time [-45.474ns; -40.079ns] or [-14.443%; -12.729%]

scenario:sql/obfuscate_sql_string

• 🟩 execution_time [-1.611µs; -1.548µs] or [-2.103%; -2.021%]

Candidate

Candidate benchmark details

Group 1

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	27146ae	1727872917	bob/live-debugger

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
concentrator/add_spans_to_concentrator	execution_time	9.219ms	9.255ms ± 0.018ms	9.254ms ± 0.009ms	9.263ms	9.275ms	9.289ms	9.411ms	1.71%	3.957	29.536	0.20%	0.001ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
concentrator/add_spans_to_concentrator	execution_time	[9.252ms; 9.257ms] or [-0.028%; +0.028%]	None	None	None

Group 2

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	27146ae	1727872917	bob/live-debugger

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
credit_card/is_card_number/	execution_time	2.013µs	2.014µs ± 0.001µs	2.014µs ± 0.001µs	2.015µs	2.016µs	2.016µs	2.019µs	0.23%	1.706	5.380	0.04%	0.000µs	1	200
credit_card/is_card_number/	throughput	495330228.133op/s	496448673.967op/s ± 208481.755op/s	496471676.291op/s ± 136472.848op/s	496610620.016op/s	496678103.802op/s	496711101.232op/s	496735899.879op/s	0.05%	-1.700	5.344	0.04%	14741.886op/s	1	200
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	119.964µs	120.527µs ± 0.363µs	120.423µs ± 0.229µs	120.786µs	121.234µs	121.421µs	121.869µs	1.20%	0.817	0.243	0.30%	0.026µs	1	200
credit_card/is_card_number/ 3782-8224-6310-005	throughput	8205507.833op/s	8296999.280op/s ± 24907.890op/s	8304040.747op/s ± 15787.033op/s	8316328.074op/s	8327606.193op/s	8334506.583op/s	8335863.385op/s	0.38%	-0.803	0.203	0.30%	1761.254op/s	1	200
credit_card/is_card_number/ 378282246310005	execution_time	109.759µs	111.774µs ± 0.496µs	111.926µs ± 0.123µs	112.017µs	112.175µs	112.272µs	112.860µs	0.83%	-2.350	5.988	0.44%	0.035µs	1	200
credit_card/is_card_number/ 378282246310005	throughput	8860563.091op/s	8946774.625op/s ± 40122.790op/s	8934474.120op/s ± 9829.702op/s	8947212.788op/s	9034813.883op/s	9106063.142op/s	9110847.122op/s	1.97%	2.383	6.141	0.45%	2837.110op/s	1	200
credit_card/is_card_number/37828224631	execution_time	2.013µs	2.014µs ± 0.002µs	2.014µs ± 0.001µs	2.015µs	2.016µs	2.016µs	2.034µs	0.99%	9.567	115.281	0.08%	0.000µs	1	200
credit_card/is_card_number/37828224631	throughput	491609371.649op/s	496428774.642op/s ± 390536.521op/s	496466091.366op/s ± 146515.542op/s	496613699.707op/s	496658091.247op/s	496721431.464op/s	496747280.796op/s	0.06%	-9.506	114.258	0.08%	27615.102op/s	1	200
credit_card/is_card_number/378282246310005	execution_time	105.829µs	107.762µs ± 0.474µs	107.927µs ± 0.129µs	108.017µs	108.134µs	108.210µs	108.243µs	0.29%	-2.248	4.789	0.44%	0.034µs	1	200
credit_card/is_card_number/378282246310005	throughput	9238514.912op/s	9279921.434op/s ± 41221.354op/s	9265506.373op/s ± 11093.404op/s	9281817.260op/s	9374173.243op/s	9439892.957op/s	9449240.357op/s	1.98%	2.271	4.907	0.44%	2914.790op/s	1	200
credit_card/is_card_number/37828224631000521389798	execution_time	113.344µs	113.946µs ± 0.345µs	113.913µs ± 0.277µs	114.209µs	114.552µs	114.679µs	114.953µs	0.91%	0.326	-0.627	0.30%	0.024µs	1	200
credit_card/is_card_number/37828224631000521389798	throughput	8699208.362op/s	8776173.608op/s ± 26525.101op/s	8778617.925op/s ± 21381.876op/s	8797031.883op/s	8815591.653op/s	8819253.010op/s	8822729.115op/s	0.50%	-0.314	-0.641	0.30%	1875.608op/s	1	200
credit_card/is_card_number/x371413321323331	execution_time	23.297µs	23.837µs ± 0.303µs	23.779µs ± 0.237µs	24.047µs	24.390µs	24.560µs	24.856µs	4.53%	0.530	-0.193	1.27%	0.021µs	1	200
credit_card/is_card_number/x371413321323331	throughput	40231004.701op/s	41958125.191op/s ± 529722.139op/s	42054534.062op/s ± 414335.568op/s	42319256.972op/s	42687030.584op/s	42862938.772op/s	42923590.273op/s	2.07%	-0.473	-0.302	1.26%	37457.012op/s	1	200
credit_card/is_card_number_no_luhn/	execution_time	2.013µs	2.014µs ± 0.001µs	2.014µs ± 0.000µs	2.015µs	2.015µs	2.016µs	2.018µs	0.17%	1.164	3.272	0.03%	0.000µs	1	200
credit_card/is_card_number_no_luhn/	throughput	495659807.061op/s	496490392.629op/s ± 159657.696op/s	496504716.800op/s ± 116406.748op/s	496621957.937op/s	496698480.713op/s	496740498.900op/s	496760749.718op/s	0.05%	-1.160	3.252	0.03%	11289.504op/s	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	97.656µs	98.151µs ± 0.258µs	98.110µs ± 0.191µs	98.336µs	98.585µs	98.673µs	98.992µs	0.90%	0.394	-0.501	0.26%	0.018µs	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	10101874.433op/s	10188467.329op/s ± 26735.512op/s	10192608.882op/s ± 19823.625op/s	10208956.062op/s	10226309.585op/s	10236242.387op/s	10240003.598op/s	0.46%	-0.383	-0.517	0.26%	1890.486op/s	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	89.147µs	89.565µs ± 0.133µs	89.563µs ± 0.080µs	89.634µs	89.768µs	89.834µs	90.224µs	0.74%	0.422	2.492	0.15%	0.009µs	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	11083548.481op/s	11165148.482op/s ± 16590.535op/s	11165284.340op/s ± 10024.375op/s	11175446.985op/s	11190144.616op/s	11204115.015op/s	11217415.037op/s	0.47%	-0.403	2.433	0.15%	1173.128op/s	1	200
credit_card/is_card_number_no_luhn/37828224631	execution_time	2.013µs	2.014µs ± 0.001µs	2.014µs ± 0.000µs	2.015µs	2.015µs	2.016µs	2.017µs	0.12%	0.561	1.062	0.03%	0.000µs	1	200
credit_card/is_card_number_no_luhn/37828224631	throughput	495840345.003op/s	496464489.987op/s ± 138990.707op/s	496435619.256op/s ± 102500.143op/s	496602191.582op/s	496653961.520op/s	496684686.252op/s	496704330.743op/s	0.05%	-0.559	1.052	0.03%	9828.127op/s	1	200
credit_card/is_card_number_no_luhn/378282246310005	execution_time	85.257µs	85.560µs ± 0.155µs	85.552µs ± 0.102µs	85.677µs	85.797µs	85.913µs	86.362µs	0.95%	0.777	2.520	0.18%	0.011µs	1	200
credit_card/is_card_number_no_luhn/378282246310005	throughput	11579208.018op/s	11687689.977op/s ± 21081.608op/s	11688808.550op/s ± 13905.503op/s	11701327.516op/s	11722030.267op/s	11727069.656op/s	11729256.284op/s	0.35%	-0.756	2.418	0.18%	1490.695op/s	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	113.334µs	114.047µs ± 0.407µs	114.039µs ± 0.348µs	114.359µs	114.732µs	114.941µs	115.008µs	0.85%	0.225	-0.865	0.36%	0.029µs	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	8695080.807op/s	8768391.111op/s ± 31233.722op/s	8768925.573op/s ± 26729.843op/s	8796063.762op/s	8814675.203op/s	8819976.867op/s	8823447.429op/s	0.62%	-0.213	-0.875	0.36%	2208.558op/s	1	200
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	23.246µs	23.791µs ± 0.312µs	23.693µs ± 0.201µs	23.981µs	24.385µs	24.584µs	24.857µs	4.92%	0.812	0.258	1.31%	0.022µs	1	200
credit_card/is_card_number_no_luhn/x371413321323331	throughput	40229438.064op/s	42039627.013op/s ± 545389.062op/s	42207218.519op/s ± 360955.964op/s	42478510.868op/s	42719889.393op/s	42924398.819op/s	43017510.380op/s	1.92%	-0.751	0.114	1.29%	38564.830op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
credit_card/is_card_number/	execution_time	[2.014µs; 2.014µs] or [-0.006%; +0.006%]	None	None	None
credit_card/is_card_number/	throughput	[496419780.401op/s; 496477567.533op/s] or [-0.006%; +0.006%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	[120.476µs; 120.577µs] or [-0.042%; +0.042%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	throughput	[8293547.286op/s; 8300451.274op/s] or [-0.042%; +0.042%]	None	None	None
credit_card/is_card_number/ 378282246310005	execution_time	[111.706µs; 111.843µs] or [-0.062%; +0.062%]	None	None	None
credit_card/is_card_number/ 378282246310005	throughput	[8941213.992op/s; 8952335.258op/s] or [-0.062%; +0.062%]	None	None	None
credit_card/is_card_number/37828224631	execution_time	[2.014µs; 2.015µs] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number/37828224631	throughput	[496374650.036op/s; 496482899.248op/s] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number/378282246310005	execution_time	[107.696µs; 107.827µs] or [-0.061%; +0.061%]	None	None	None
credit_card/is_card_number/378282246310005	throughput	[9274208.551op/s; 9285634.318op/s] or [-0.062%; +0.062%]	None	None	None
credit_card/is_card_number/37828224631000521389798	execution_time	[113.898µs; 113.994µs] or [-0.042%; +0.042%]	None	None	None
credit_card/is_card_number/37828224631000521389798	throughput	[8772497.484op/s; 8779849.732op/s] or [-0.042%; +0.042%]	None	None	None
credit_card/is_card_number/x371413321323331	execution_time	[23.795µs; 23.879µs] or [-0.176%; +0.176%]	None	None	None
credit_card/is_card_number/x371413321323331	throughput	[41884710.797op/s; 42031539.584op/s] or [-0.175%; +0.175%]	None	None	None
credit_card/is_card_number_no_luhn/	execution_time	[2.014µs; 2.014µs] or [-0.004%; +0.004%]	None	None	None
credit_card/is_card_number_no_luhn/	throughput	[496468265.608op/s; 496512519.650op/s] or [-0.004%; +0.004%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	[98.115µs; 98.187µs] or [-0.036%; +0.036%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	[10184762.045op/s; 10192172.614op/s] or [-0.036%; +0.036%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	[89.546µs; 89.583µs] or [-0.021%; +0.021%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	[11162849.193op/s; 11167447.770op/s] or [-0.021%; +0.021%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	execution_time	[2.014µs; 2.014µs] or [-0.004%; +0.004%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	throughput	[496445227.212op/s; 496483752.762op/s] or [-0.004%; +0.004%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	execution_time	[85.539µs; 85.582µs] or [-0.025%; +0.025%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	throughput	[11684768.269op/s; 11690611.685op/s] or [-0.025%; +0.025%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	[113.991µs; 114.104µs] or [-0.049%; +0.049%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	[8764062.418op/s; 8772719.805op/s] or [-0.049%; +0.049%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	[23.748µs; 23.834µs] or [-0.182%; +0.182%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	throughput	[41964041.334op/s; 42115212.691op/s] or [-0.180%; +0.180%]	None	None	None

Group 3

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	27146ae	1727872917	bob/live-debugger

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
redis/obfuscate_redis_string	execution_time	38.596µs	39.154µs ± 0.969µs	38.708µs ± 0.029µs	38.756µs	41.243µs	41.268µs	42.140µs	8.87%	1.721	1.038	2.47%	0.069µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
redis/obfuscate_redis_string	execution_time	[39.020µs; 39.289µs] or [-0.343%; +0.343%]	None	None	None

Group 4

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	27146ae	1727872917	bob/live-debugger

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching string interning on wordpress profile	execution_time	141.213µs	142.121µs ± 0.499µs	142.097µs ± 0.179µs	142.278µs	142.602µs	143.242µs	147.341µs	3.69%	5.871	58.422	0.35%	0.035µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching string interning on wordpress profile	execution_time	[142.052µs; 142.190µs] or [-0.049%; +0.049%]	None	None	None

Group 5

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	27146ae	1727872917	bob/live-debugger

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching deserializing traces from msgpack to their internal representation	execution_time	1.130µs	1.190µs ± 0.023µs	1.193µs ± 0.015µs	1.209µs	1.212µs	1.214µs	1.214µs	1.81%	-1.109	0.482	1.93%	0.002µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching deserializing traces from msgpack to their internal representation	execution_time	[1.187µs; 1.193µs] or [-0.268%; +0.268%]	None	None	None

Group 6

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	27146ae	1727872917	bob/live-debugger

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_trace/test_trace	execution_time	260.305ns	272.077ns ± 15.012ns	264.857ns ± 3.507ns	283.936ns	305.787ns	312.861ns	316.863ns	19.64%	1.363	0.605	5.50%	1.062ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_trace/test_trace	execution_time	[269.996ns; 274.157ns] or [-0.765%; +0.765%]	None	None	None

Group 7

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	27146ae	1727872917	bob/live-debugger

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sql/obfuscate_sql_string	execution_time	74.606µs	75.029µs ± 0.137µs	75.018µs ± 0.051µs	75.072µs	75.165µs	75.384µs	76.360µs	1.79%	4.552	43.639	0.18%	0.010µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sql/obfuscate_sql_string	execution_time	[75.010µs; 75.048µs] or [-0.025%; +0.025%]	None	None	None

Group 8

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	27146ae	1727872917	bob/live-debugger

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
two way interface	execution_time	19.001µs	25.172µs ± 11.754µs	19.843µs ± 0.394µs	20.688µs	45.872µs	49.293µs	107.977µs	444.17%	3.345	16.567	46.58%	0.831µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
two way interface	execution_time	[23.543µs; 26.801µs] or [-6.471%; +6.471%]	None	None	None

Group 9

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	27146ae	1727872917	bob/live-debugger

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
write only interface	execution_time	1.364µs	3.161µs ± 1.551µs	3.005µs ± 0.022µs	3.026µs	3.059µs	13.689µs	17.989µs	498.56%	8.028	65.331	48.96%	0.110µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
write only interface	execution_time	[2.946µs; 3.376µs] or [-6.802%; +6.802%]	None	None	None

Group 10

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	27146ae	1727872917	bob/live-debugger

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
tags/replace_trace_tags	execution_time	2.689µs	2.741µs ± 0.019µs	2.739µs ± 0.006µs	2.747µs	2.786µs	2.788µs	2.792µs	1.93%	0.177	1.760	0.68%	0.001µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
tags/replace_trace_tags	execution_time	[2.739µs; 2.744µs] or [-0.095%; +0.095%]	None	None	None

Group 11

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	27146ae	1727872917	bob/live-debugger

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	178.774µs	179.762µs ± 0.641µs	179.663µs ± 0.294µs	179.949µs	181.010µs	182.258µs	183.155µs	1.94%	2.110	6.473	0.36%	0.045µs	1	200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	5459860.041op/s	5562991.104op/s ± 19692.557op/s	5565973.282op/s ± 9134.812op/s	5575696.628op/s	5585288.247op/s	5587526.160op/s	5593657.611op/s	0.50%	-2.067	6.231	0.35%	1392.474op/s	1	200
normalization/normalize_name/normalize_name/bad-name	execution_time	20.055µs	20.180µs ± 0.045µs	20.176µs ± 0.030µs	20.209µs	20.249µs	20.300µs	20.359µs	0.91%	0.469	0.922	0.22%	0.003µs	1	200
normalization/normalize_name/normalize_name/bad-name	throughput	49118032.340op/s	49554525.915op/s ± 110961.693op/s	49563646.034op/s ± 73587.295op/s	49631946.754op/s	49712517.916op/s	49771361.474op/s	49861839.347op/s	0.60%	-0.451	0.887	0.22%	7846.177op/s	1	200
normalization/normalize_name/normalize_name/good	execution_time	13.094µs	13.133µs ± 0.030µs	13.123µs ± 0.015µs	13.149µs	13.166µs	13.192µs	13.428µs	2.32%	5.059	46.750	0.23%	0.002µs	1	200
normalization/normalize_name/normalize_name/good	throughput	74470270.147op/s	76147249.354op/s ± 170663.537op/s	76199184.685op/s ± 88602.379op/s	76254677.725op/s	76308807.591op/s	76335944.627op/s	76373726.206op/s	0.23%	-4.905	44.686	0.22%	12067.734op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	[179.673µs; 179.851µs] or [-0.049%; +0.049%]	None	None	None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	[5560261.905op/s; 5565720.303op/s] or [-0.049%; +0.049%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	execution_time	[20.174µs; 20.186µs] or [-0.031%; +0.031%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	throughput	[49539147.691op/s; 49569904.138op/s] or [-0.031%; +0.031%]	None	None	None
normalization/normalize_name/normalize_name/good	execution_time	[13.128µs; 13.137µs] or [-0.031%; +0.031%]	None	None	None
normalization/normalize_name/normalize_name/good	throughput	[76123597.030op/s; 76170901.679op/s] or [-0.031%; +0.031%]	None	None	None

Group 12

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	27146ae	1727872917	bob/live-debugger

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	504.575µs	505.652µs ± 0.459µs	505.658µs ± 0.342µs	506.006µs	506.399µs	506.561µs	506.995µs	0.26%	-0.009	-0.405	0.09%	0.032µs	1	200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	1972404.209op/s	1977645.669op/s ± 1795.365op/s	1977620.548op/s ± 1336.175op/s	1978866.060op/s	1980542.602op/s	1981404.670op/s	1981864.078op/s	0.21%	0.013	-0.407	0.09%	126.951op/s	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	468.145µs	468.941µs ± 0.305µs	468.948µs ± 0.208µs	469.131µs	469.426µs	469.602µs	469.776µs	0.18%	-0.044	-0.117	0.06%	0.022µs	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	2128672.422op/s	2132465.884op/s ± 1385.814op/s	2132432.833op/s ± 947.751op/s	2133425.078op/s	2134792.867op/s	2135711.523op/s	2136088.633op/s	0.17%	0.048	-0.116	0.06%	97.992op/s	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	212.850µs	213.172µs ± 0.116µs	213.170µs ± 0.066µs	213.223µs	213.393µs	213.459µs	213.610µs	0.21%	0.598	1.216	0.05%	0.008µs	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	4681420.858op/s	4691049.376op/s ± 2561.645op/s	4691082.754op/s ± 1459.285op/s	4692962.290op/s	4694426.174op/s	4696893.016op/s	4698149.138op/s	0.15%	-0.594	1.206	0.05%	181.136op/s	1	200
normalization/normalize_service/normalize_service/[empty string]	execution_time	46.146µs	46.298µs ± 0.062µs	46.300µs ± 0.042µs	46.340µs	46.392µs	46.433µs	46.456µs	0.34%	-0.038	-0.250	0.13%	0.004µs	1	200
normalization/normalize_service/normalize_service/[empty string]	throughput	21525606.770op/s	21599209.905op/s ± 28961.325op/s	21598255.596op/s ± 19548.179op/s	21618186.421op/s	21647455.168op/s	21662877.590op/s	21670313.991op/s	0.33%	0.045	-0.250	0.13%	2047.875op/s	1	200
normalization/normalize_service/normalize_service/test_ASCII	execution_time	54.062µs	54.351µs ± 0.249µs	54.253µs ± 0.183µs	54.576µs	54.642µs	54.694µs	55.800µs	2.85%	1.032	3.680	0.46%	0.018µs	1	200
normalization/normalize_service/normalize_service/test_ASCII	throughput	17921274.647op/s	18399206.370op/s ± 84032.564op/s	18432250.498op/s ± 62380.154op/s	18475262.212op/s	18494586.144op/s	18496566.783op/s	18497441.670op/s	0.35%	-0.972	3.232	0.46%	5942.000op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	[505.589µs; 505.716µs] or [-0.013%; +0.013%]	None	None	None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	[1977396.849op/s; 1977894.489op/s] or [-0.013%; +0.013%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	[468.899µs; 468.983µs] or [-0.009%; +0.009%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	[2132273.823op/s; 2132657.944op/s] or [-0.009%; +0.009%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	[213.156µs; 213.188µs] or [-0.008%; +0.008%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	[4690694.357op/s; 4691404.395op/s] or [-0.008%; +0.008%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	execution_time	[46.289µs; 46.307µs] or [-0.019%; +0.019%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	throughput	[21595196.144op/s; 21603223.666op/s] or [-0.019%; +0.019%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	execution_time	[54.317µs; 54.386µs] or [-0.064%; +0.064%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	throughput	[18387560.265op/s; 18410852.476op/s] or [-0.063%; +0.063%]	None	None	None

Baseline

Omitted due to size.