[crashtracker] Emit structured log message as per RFC

[danielsn]

trafficstars

What does this PR do?

Implements the structured output format from #554. Note I'm leaving this as a draft until that RFC is approved.

Motivation

What inspired you to submit this pull request?

Additional Notes

Thanks to the magic of the schemars crate, the schema can be regenerated by running the included test.

How to test the change?

#566 shows a way to validate output against the schema from the RFC.

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 3.02115% with 321 lines in your changes missing coverage. Please review.

Project coverage is 71.53%. Comparing base (a76c5ad) to head (0701431). Report is 1 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #583      +/-   ##
==========================================
- Coverage   71.77%   71.53%   -0.24%     
==========================================
  Files         271      278       +7     
  Lines       40992    41142     +150     
==========================================
+ Hits        29422    29432      +10     
- Misses      11570    11710     +140     

Components	Coverage Δ
crashtracker	19.34% <3.02%> (-0.99%)	:arrow_down:
crashtracker-ffi	9.09% <0.00%> (+0.01%)	:arrow_up:
datadog-alloc	98.73% <ø> (ø)
data-pipeline	91.92% <ø> (ø)
data-pipeline-ffi	0.00% <ø> (ø)
ddcommon	82.73% <ø> (ø)
ddcommon-ffi	69.12% <ø> (ø)
ddtelemetry	59.10% <ø> (ø)
ddtelemetry-ffi	22.13% <ø> (ø)
dogstatsd	88.86% <ø> (ø)
dogstatsd-client	79.77% <ø> (ø)
ipc	82.65% <ø> (ø)
profiling	84.30% <ø> (ø)
profiling-ffi	77.46% <ø> (ø)
serverless	0.00% <ø> (ø)
sidecar	36.09% <ø> (ø)
sidecar-ffi	0.00% <ø> (ø)
spawn-worker	50.36% <ø> (ø)
tinybytes	94.77% <ø> (ø)
trace-mini-agent	72.45% <ø> (ø)
trace-normalization	98.25% <ø> (ø)
trace-obfuscation	95.73% <ø> (ø)
trace-protobuf	77.67% <ø> (ø)
trace-utils	93.08% <ø> (ø)

[pr-commenter[bot]]

Benchmarks

Comparison

Benchmark execution time: 2024-10-21 18:19:30

Comparing candidate commit 0701431 in PR branch dsn/crashtracker-structured-output with baseline commit 6e2d784 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	0701431	1729534124	dsn/crashtracker-structured-output

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
credit_card/is_card_number/	execution_time	4.611µs	4.617µs ± 0.003µs	4.616µs ± 0.002µs	4.618µs	4.621µs	4.622µs	4.643µs	0.58%	3.490	27.934	0.07%	0.000µs	1	200
credit_card/is_card_number/	throughput	215369768.624op/s	216610398.906op/s ± 142299.522op/s	216625599.957op/s ± 70779.677op/s	216689328.051op/s	216803750.353op/s	216838169.065op/s	216874301.876op/s	0.11%	-3.455	27.545	0.07%	10062.096op/s	1	200
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	118.804µs	120.690µs ± 0.805µs	120.575µs ± 0.543µs	121.201µs	121.954µs	123.110µs	123.630µs	2.53%	0.676	1.245	0.67%	0.057µs	1	200
credit_card/is_card_number/ 3782-8224-6310-005	throughput	8088652.410op/s	8286070.449op/s ± 55008.559op/s	8293623.035op/s ± 37449.481op/s	8321387.309op/s	8367999.640op/s	8396825.782op/s	8417219.034op/s	1.49%	-0.621	1.116	0.66%	3889.693op/s	1	200
credit_card/is_card_number/ 378282246310005	execution_time	111.346µs	112.782µs ± 0.701µs	112.696µs ± 0.458µs	113.174µs	114.012µs	114.650µs	115.179µs	2.20%	0.691	0.353	0.62%	0.050µs	1	200
credit_card/is_card_number/ 378282246310005	throughput	8682150.941op/s	8867019.623op/s ± 54901.000op/s	8873426.347op/s ± 36217.014op/s	8908015.443op/s	8944265.279op/s	8959820.338op/s	8980974.260op/s	1.21%	-0.657	0.280	0.62%	3882.087op/s	1	200
credit_card/is_card_number/37828224631	execution_time	4.604µs	4.617µs ± 0.004µs	4.616µs ± 0.001µs	4.618µs	4.621µs	4.624µs	4.663µs	1.02%	6.709	72.392	0.09%	0.000µs	1	200
credit_card/is_card_number/37828224631	throughput	214432292.731op/s	216604225.135op/s ± 197925.369op/s	216618085.880op/s ± 67450.365op/s	216687475.464op/s	216791157.431op/s	216873851.958op/s	217218457.013op/s	0.28%	-6.628	71.268	0.09%	13995.437op/s	1	200
credit_card/is_card_number/378282246310005	execution_time	107.706µs	109.044µs ± 0.703µs	109.010µs ± 0.482µs	109.520µs	110.209µs	110.899µs	111.185µs	2.00%	0.365	-0.147	0.64%	0.050µs	1	200
credit_card/is_card_number/378282246310005	throughput	8993989.962op/s	9170948.260op/s ± 59033.011op/s	9173437.402op/s ± 40733.075op/s	9211939.366op/s	9265111.241op/s	9274906.231op/s	9284499.155op/s	1.21%	-0.332	-0.195	0.64%	4174.264op/s	1	200
credit_card/is_card_number/37828224631000521389798	execution_time	117.754µs	118.901µs ± 0.422µs	118.970µs ± 0.257µs	119.198µs	119.520µs	119.742µs	120.041µs	0.90%	-0.319	-0.178	0.35%	0.030µs	1	200
credit_card/is_card_number/37828224631000521389798	throughput	8330459.325op/s	8410488.726op/s ± 29907.211op/s	8405482.868op/s ± 18120.117op/s	8428793.363op/s	8464903.920op/s	8474894.903op/s	8492258.457op/s	1.03%	0.338	-0.175	0.35%	2114.759op/s	1	200
credit_card/is_card_number/x371413321323331	execution_time	26.495µs	27.062µs ± 0.375µs	26.993µs ± 0.246µs	27.279µs	27.814µs	28.105µs	28.339µs	4.99%	0.890	0.371	1.38%	0.027µs	1	200
credit_card/is_card_number/x371413321323331	throughput	35286621.560op/s	36958897.979op/s ± 506703.259op/s	37047027.106op/s ± 339067.854op/s	37369353.479op/s	37568320.924op/s	37681670.401op/s	37742341.118op/s	1.88%	-0.826	0.208	1.37%	35829.331op/s	1	200
credit_card/is_card_number_no_luhn/	execution_time	4.604µs	4.616µs ± 0.003µs	4.616µs ± 0.002µs	4.618µs	4.620µs	4.622µs	4.622µs	0.13%	-0.416	1.830	0.06%	0.000µs	1	200
credit_card/is_card_number_no_luhn/	throughput	216355885.963op/s	216637239.083op/s ± 120209.660op/s	216637272.681op/s ± 72576.783op/s	216710521.297op/s	216813051.803op/s	216907835.135op/s	217212295.198op/s	0.27%	0.422	1.852	0.06%	8500.107op/s	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	103.333µs	104.344µs ± 0.466µs	104.324µs ± 0.308µs	104.636µs	105.171µs	105.613µs	105.794µs	1.41%	0.296	0.068	0.45%	0.033µs	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	9452336.544op/s	9583833.630op/s ± 42773.488op/s	9585512.498op/s ± 28302.935op/s	9613240.559op/s	9651677.739op/s	9668904.158op/s	9677459.352op/s	0.96%	-0.269	0.036	0.45%	3024.542op/s	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	94.570µs	96.181µs ± 0.719µs	96.192µs ± 0.480µs	96.652µs	97.288µs	97.817µs	98.832µs	2.74%	0.282	0.547	0.75%	0.051µs	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	10118158.896op/s	10397588.978op/s ± 77586.102op/s	10395849.744op/s ± 51666.950op/s	10451655.347op/s	10522306.345op/s	10569800.110op/s	10574190.636op/s	1.72%	-0.228	0.458	0.74%	5486.166op/s	1	200
credit_card/is_card_number_no_luhn/37828224631	execution_time	4.601µs	4.617µs ± 0.005µs	4.616µs ± 0.001µs	4.618µs	4.620µs	4.622µs	4.679µs	1.35%	9.012	108.259	0.11%	0.000µs	1	200
credit_card/is_card_number_no_luhn/37828224631	throughput	213735720.664op/s	216605641.617op/s ± 236864.087op/s	216623250.405op/s ± 63256.441op/s	216687719.224op/s	216783053.925op/s	216821159.035op/s	217354781.279op/s	0.34%	-8.916	106.798	0.11%	16748.820op/s	1	200
credit_card/is_card_number_no_luhn/378282246310005	execution_time	90.634µs	92.765µs ± 0.935µs	92.755µs ± 0.597µs	93.339µs	94.522µs	94.819µs	95.208µs	2.64%	0.260	-0.284	1.00%	0.066µs	1	200
credit_card/is_card_number_no_luhn/378282246310005	throughput	10503368.080op/s	10781041.856op/s ± 108361.250op/s	10781053.096op/s ± 69370.179op/s	10853958.513op/s	10954244.374op/s	10987303.620op/s	11033336.306op/s	2.34%	-0.210	-0.312	1.00%	7662.297op/s	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	117.860µs	118.941µs ± 0.457µs	118.943µs ± 0.342µs	119.264µs	119.619µs	119.848µs	121.170µs	1.87%	0.438	1.771	0.38%	0.032µs	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	8252875.083op/s	8407633.591op/s ± 32262.391op/s	8407364.301op/s ± 24240.210op/s	8432369.864op/s	8457763.770op/s	8476261.065op/s	8484641.103op/s	0.92%	-0.397	1.613	0.38%	2281.296op/s	1	200
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	26.424µs	27.191µs ± 0.421µs	27.168µs ± 0.312µs	27.483µs	27.917µs	28.193µs	28.320µs	4.24%	0.313	-0.478	1.54%	0.030µs	1	200
credit_card/is_card_number_no_luhn/x371413321323331	throughput	35310457.388op/s	36785475.415op/s ± 567233.658op/s	36808044.304op/s ± 422270.004op/s	37230236.973op/s	37600701.142op/s	37819749.145op/s	37843956.956op/s	2.81%	-0.248	-0.556	1.54%	40109.477op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
credit_card/is_card_number/	execution_time	[4.616µs; 4.617µs] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number/	throughput	[216590677.561op/s; 216630120.251op/s] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	[120.578µs; 120.801µs] or [-0.092%; +0.092%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	throughput	[8278446.791op/s; 8293694.106op/s] or [-0.092%; +0.092%]	None	None	None
credit_card/is_card_number/ 378282246310005	execution_time	[112.685µs; 112.879µs] or [-0.086%; +0.086%]	None	None	None
credit_card/is_card_number/ 378282246310005	throughput	[8859410.873op/s; 8874628.374op/s] or [-0.086%; +0.086%]	None	None	None
credit_card/is_card_number/37828224631	execution_time	[4.616µs; 4.617µs] or [-0.013%; +0.013%]	None	None	None
credit_card/is_card_number/37828224631	throughput	[216576794.582op/s; 216631655.687op/s] or [-0.013%; +0.013%]	None	None	None
credit_card/is_card_number/378282246310005	execution_time	[108.947µs; 109.142µs] or [-0.089%; +0.089%]	None	None	None
credit_card/is_card_number/378282246310005	throughput	[9162766.853op/s; 9179129.668op/s] or [-0.089%; +0.089%]	None	None	None
credit_card/is_card_number/37828224631000521389798	execution_time	[118.842µs; 118.959µs] or [-0.049%; +0.049%]	None	None	None
credit_card/is_card_number/37828224631000521389798	throughput	[8406343.874op/s; 8414633.577op/s] or [-0.049%; +0.049%]	None	None	None
credit_card/is_card_number/x371413321323331	execution_time	[27.010µs; 27.114µs] or [-0.192%; +0.192%]	None	None	None
credit_card/is_card_number/x371413321323331	throughput	[36888673.780op/s; 37029122.177op/s] or [-0.190%; +0.190%]	None	None	None
credit_card/is_card_number_no_luhn/	execution_time	[4.616µs; 4.616µs] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number_no_luhn/	throughput	[216620579.180op/s; 216653898.985op/s] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	[104.280µs; 104.409µs] or [-0.062%; +0.062%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	[9577905.636op/s; 9589761.624op/s] or [-0.062%; +0.062%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	[96.082µs; 96.281µs] or [-0.104%; +0.104%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	[10386836.291op/s; 10408341.666op/s] or [-0.103%; +0.103%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	execution_time	[4.616µs; 4.617µs] or [-0.015%; +0.015%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	throughput	[216572814.532op/s; 216638468.701op/s] or [-0.015%; +0.015%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	execution_time	[92.635µs; 92.894µs] or [-0.140%; +0.140%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	throughput	[10766024.029op/s; 10796059.683op/s] or [-0.139%; +0.139%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	[118.878µs; 119.005µs] or [-0.053%; +0.053%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	[8403162.334op/s; 8412104.848op/s] or [-0.053%; +0.053%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	[27.133µs; 27.249µs] or [-0.215%; +0.215%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	throughput	[36706862.285op/s; 36864088.544op/s] or [-0.214%; +0.214%]	None	None	None

Group 2

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	0701431	1729534124	dsn/crashtracker-structured-output

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
write only interface	execution_time	1.372µs	3.207µs ± 1.389µs	3.061µs ± 0.025µs	3.083µs	3.175µs	13.852µs	14.884µs	386.30%	7.589	57.801	43.20%	0.098µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
write only interface	execution_time	[3.014µs; 3.399µs] or [-6.002%; +6.002%]	None	None	None

Group 3

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	0701431	1729534124	dsn/crashtracker-structured-output

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sql/obfuscate_sql_string	execution_time	72.385µs	72.564µs ± 0.173µs	72.550µs ± 0.030µs	72.580µs	72.632µs	72.737µs	74.891µs	3.23%	12.246	162.060	0.24%	0.012µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sql/obfuscate_sql_string	execution_time	[72.540µs; 72.588µs] or [-0.033%; +0.033%]	None	None	None

Group 4

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	0701431	1729534124	dsn/crashtracker-structured-output

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
concentrator/add_spans_to_concentrator	execution_time	9.081ms	9.122ms ± 0.019ms	9.121ms ± 0.009ms	9.130ms	9.143ms	9.177ms	9.278ms	1.72%	3.158	24.411	0.20%	0.001ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
concentrator/add_spans_to_concentrator	execution_time	[9.119ms; 9.124ms] or [-0.028%; +0.028%]	None	None	None

Group 5

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	0701431	1729534124	dsn/crashtracker-structured-output

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_trace/test_trace	execution_time	257.830ns	269.786ns ± 13.854ns	263.555ns ± 5.034ns	273.695ns	302.176ns	310.668ns	312.107ns	18.42%	1.597	1.666	5.12%	0.980ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_trace/test_trace	execution_time	[267.866ns; 271.706ns] or [-0.712%; +0.712%]	None	None	None

Group 6

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	0701431	1729534124	dsn/crashtracker-structured-output

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
tags/replace_trace_tags	execution_time	2.668µs	2.710µs ± 0.018µs	2.708µs ± 0.007µs	2.713µs	2.761µs	2.765µs	2.765µs	2.12%	1.569	3.133	0.67%	0.001µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
tags/replace_trace_tags	execution_time	[2.708µs; 2.713µs] or [-0.092%; +0.092%]	None	None	None

Group 7

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	0701431	1729534124	dsn/crashtracker-structured-output

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching string interning on wordpress profile	execution_time	142.249µs	143.100µs ± 0.374µs	143.059µs ± 0.210µs	143.283µs	143.624µs	144.391µs	144.651µs	1.11%	0.983	2.595	0.26%	0.026µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching string interning on wordpress profile	execution_time	[143.048µs; 143.152µs] or [-0.036%; +0.036%]	None	None	None

Group 8

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	0701431	1729534124	dsn/crashtracker-structured-output

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
redis/obfuscate_redis_string	execution_time	37.576µs	38.077µs ± 0.888µs	37.671µs ± 0.039µs	37.752µs	39.951µs	40.013µs	41.258µs	9.52%	1.755	1.274	2.33%	0.063µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
redis/obfuscate_redis_string	execution_time	[37.954µs; 38.200µs] or [-0.323%; +0.323%]	None	None	None

Group 9

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	0701431	1729534124	dsn/crashtracker-structured-output

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	623.497µs	624.495µs ± 0.497µs	624.429µs ± 0.263µs	624.731µs	625.415µs	625.835µs	626.985µs	0.41%	1.058	2.654	0.08%	0.035µs	1	200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	1594933.580op/s	1601293.761op/s ± 1272.613op/s	1601463.555op/s ± 674.967op/s	1602014.419op/s	1603099.873op/s	1603431.709op/s	1603856.404op/s	0.15%	-1.049	2.616	0.08%	89.987op/s	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	463.375µs	464.173µs ± 0.458µs	464.099µs ± 0.287µs	464.424µs	465.124µs	465.354µs	465.456µs	0.29%	0.732	0.084	0.10%	0.032µs	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	2148432.730op/s	2154372.870op/s ± 2122.959op/s	2154710.725op/s ± 1335.015op/s	2155883.787op/s	2157165.688op/s	2157938.913op/s	2158080.780op/s	0.16%	-0.727	0.076	0.10%	150.116op/s	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	178.136µs	178.354µs ± 0.094µs	178.362µs ± 0.054µs	178.404µs	178.516µs	178.619µs	178.627µs	0.15%	0.192	0.145	0.05%	0.007µs	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	5598250.178op/s	5606841.996op/s ± 2946.262op/s	5606567.342op/s ± 1704.692op/s	5609041.529op/s	5611459.378op/s	5613072.043op/s	5613693.030op/s	0.13%	-0.189	0.141	0.05%	208.332op/s	1	200
normalization/normalize_service/normalize_service/[empty string]	execution_time	46.668µs	46.853µs ± 0.102µs	46.837µs ± 0.075µs	46.921µs	47.012µs	47.147µs	47.244µs	0.87%	0.731	0.896	0.22%	0.007µs	1	200
normalization/normalize_service/normalize_service/[empty string]	throughput	21166702.690op/s	21343374.586op/s ± 46524.700op/s	21350638.377op/s ± 34100.195op/s	21374961.729op/s	21410606.609op/s	21417604.581op/s	21427894.531op/s	0.36%	-0.716	0.847	0.22%	3289.793op/s	1	200
normalization/normalize_service/normalize_service/test_ASCII	execution_time	48.920µs	49.559µs ± 0.260µs	49.500µs ± 0.145µs	49.697µs	50.022µs	50.229µs	50.598µs	2.22%	0.825	1.164	0.52%	0.018µs	1	200
normalization/normalize_service/normalize_service/test_ASCII	throughput	19763445.348op/s	20178514.942op/s ± 105485.716op/s	20201915.867op/s ± 59489.246op/s	20250250.715op/s	20310881.906op/s	20408191.599op/s	20441556.639op/s	1.19%	-0.786	1.082	0.52%	7458.967op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	[624.427µs; 624.564µs] or [-0.011%; +0.011%]	None	None	None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	[1601117.389op/s; 1601470.133op/s] or [-0.011%; +0.011%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	[464.109µs; 464.236µs] or [-0.014%; +0.014%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	[2154078.648op/s; 2154667.092op/s] or [-0.014%; +0.014%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	[178.341µs; 178.367µs] or [-0.007%; +0.007%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	[5606433.672op/s; 5607250.320op/s] or [-0.007%; +0.007%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	execution_time	[46.839µs; 46.867µs] or [-0.030%; +0.030%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	throughput	[21336926.710op/s; 21349822.462op/s] or [-0.030%; +0.030%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	execution_time	[49.523µs; 49.595µs] or [-0.073%; +0.073%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	throughput	[20163895.637op/s; 20193134.248op/s] or [-0.072%; +0.072%]	None	None	None

Group 10

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	0701431	1729534124	dsn/crashtracker-structured-output

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching deserializing traces from msgpack to their internal representation	execution_time	1.136µs	1.195µs ± 0.024µs	1.197µs ± 0.017µs	1.217µs	1.220µs	1.222µs	1.222µs	2.10%	-0.841	-0.146	1.99%	0.002µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching deserializing traces from msgpack to their internal representation	execution_time	[1.192µs; 1.198µs] or [-0.276%; +0.276%]	None	None	None

Group 11

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	0701431	1729534124	dsn/crashtracker-structured-output

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	189.627µs	192.742µs ± 0.947µs	192.857µs ± 0.566µs	193.319µs	194.227µs	194.734µs	195.878µs	1.57%	-0.411	0.896	0.49%	0.067µs	1	200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	5105212.382op/s	5188405.868op/s ± 25556.375op/s	5185185.504op/s ± 15210.628op/s	5203579.433op/s	5236022.862op/s	5257235.919op/s	5273507.701op/s	1.70%	0.451	0.917	0.49%	1807.109op/s	1	200
normalization/normalize_name/normalize_name/bad-name	execution_time	18.157µs	18.193µs ± 0.025µs	18.201µs ± 0.020µs	18.211µs	18.225µs	18.257µs	18.270µs	0.38%	0.315	-0.503	0.13%	0.002µs	1	200
normalization/normalize_name/normalize_name/bad-name	throughput	54733115.761op/s	54965206.497op/s ± 74170.394op/s	54940859.432op/s ± 59936.950op/s	55038609.818op/s	55059791.901op/s	55071815.514op/s	55074869.151op/s	0.24%	-0.310	-0.518	0.13%	5244.639op/s	1	200
normalization/normalize_name/normalize_name/good	execution_time	11.260µs	11.322µs ± 0.029µs	11.315µs ± 0.012µs	11.333µs	11.359µs	11.392µs	11.581µs	2.35%	3.829	29.782	0.26%	0.002µs	1	200
normalization/normalize_name/normalize_name/good	throughput	86349610.685op/s	88325513.026op/s ± 225832.229op/s	88378747.147op/s ± 91444.274op/s	88452935.723op/s	88528311.346op/s	88764479.339op/s	88806989.110op/s	0.48%	-3.699	28.280	0.26%	15968.750op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	[192.611µs; 192.873µs] or [-0.068%; +0.068%]	None	None	None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	[5184864.000op/s; 5191947.735op/s] or [-0.068%; +0.068%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	execution_time	[18.190µs; 18.197µs] or [-0.019%; +0.019%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	throughput	[54954927.193op/s; 54975485.800op/s] or [-0.019%; +0.019%]	None	None	None
normalization/normalize_name/normalize_name/good	execution_time	[11.318µs; 11.326µs] or [-0.036%; +0.036%]	None	None	None
normalization/normalize_name/normalize_name/good	throughput	[88294214.851op/s; 88356811.201op/s] or [-0.035%; +0.035%]	None	None	None

Group 12

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	0701431	1729534124	dsn/crashtracker-structured-output

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
two way interface	execution_time	18.770µs	25.283µs ± 11.450µs	20.320µs ± 0.847µs	22.489µs	40.516µs	41.799µs	109.560µs	439.17%	3.909	22.978	45.18%	0.810µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
two way interface	execution_time	[23.696µs; 26.870µs] or [-6.277%; +6.277%]	None	None	None

Baseline

Omitted due to size.

[danielsn]

Superceded by #738