verify json schema

[pawelchcki]

trafficstars

Add verification of schema and examples

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 70.45%. Comparing base (eb62a5e) to head (afd6aa6).

Additional details and impacted files

@@                          Coverage Diff                           @@
##           dsn/crashtracker-errortracking-rfc     #566      +/-   ##
======================================================================
- Coverage                               70.50%   70.45%   -0.05%     
======================================================================
  Files                                     213      213              
  Lines                                   28412    28429      +17     
======================================================================
  Hits                                    20031    20031              
- Misses                                   8381     8398      +17     

Components	Coverage Δ
crashtracker	25.21% <ø> (ø)
datadog-alloc	98.73% <ø> (ø)
data-pipeline	50.00% <ø> (ø)
data-pipeline-ffi	0.00% <ø> (ø)
ddcommon	86.23% <ø> (ø)
ddcommon-ffi	74.58% <ø> (ø)
ddtelemetry	58.95% <ø> (ø)
ipc	84.18% <ø> (ø)
profiling	78.09% <ø> (ø)
profiling-ffi	56.76% <ø> (ø)
serverless	0.00% <ø> (ø)
sidecar	35.42% <ø> (ø)
sidecar-ffi	0.00% <ø> (ø)
spawn-worker	54.98% <ø> (ø)
trace-mini-agent	71.14% <ø> (ø)
trace-normalization	98.24% <ø> (ø)
trace-obfuscation	95.73% <ø> (ø)
trace-protobuf	77.16% <ø> (ø)
trace-utils	91.03% <ø> (-0.60%)	:arrow_down:

[pr-commenter[bot]]

Benchmarks

Comparison

Benchmark execution time: 2024-08-01 19:07:58

Comparing candidate commit afd6aa6 in PR branch pawel/dsn/crashtracker-rfc-verification with baseline commit eb62a5e in branch dsn/crashtracker-errortracking-rfc.

Found 1 performance improvements and 0 performance regressions! Performance is the same for 41 metrics, 2 unstable metrics.

scenario:tags/replace_trace_tags

• 🟩 execution_time [-56.920ns; -55.374ns] or [-2.449%; -2.383%]

Candidate

Candidate benchmark details

Group 1

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	afd6aa6	1722538380	pawel/dsn/crashtracker-rfc-verification

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	578.224ns	591.309ns ± 6.148ns	590.287ns ± 3.906ns	594.749ns	603.609ns	609.237ns	611.231ns	3.55%	0.649	0.524	1.04%	0.435ns	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	439.087ns	453.230ns ± 3.534ns	454.084ns ± 0.297ns	454.383ns	454.921ns	456.435ns	456.551ns	0.54%	-3.400	9.983	0.78%	0.250ns	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	192.961ns	202.083ns ± 3.096ns	203.233ns ± 1.911ns	204.145ns	205.824ns	208.218ns	214.813ns	5.70%	-0.254	1.142	1.53%	0.219ns	1	200
normalization/normalize_service/normalize_service/[empty string]	execution_time	37.020ns	43.333ns ± 7.159ns	40.243ns ± 2.603ns	46.727ns	58.828ns	59.117ns	60.920ns	51.38%	1.319	0.400	16.48%	0.506ns	1	200
normalization/normalize_service/normalize_service/test_ASCII	execution_time	62.675ns	69.724ns ± 5.639ns	67.858ns ± 3.115ns	69.413ns	80.001ns	80.758ns	81.403ns	19.96%	0.926	-0.665	8.07%	0.399ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	[590.457ns; 592.162ns] or [-0.144%; +0.144%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	[452.740ns; 453.720ns] or [-0.108%; +0.108%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	[201.654ns; 202.512ns] or [-0.212%; +0.212%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	execution_time	[42.340ns; 44.325ns] or [-2.290%; +2.290%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	execution_time	[68.943ns; 70.506ns] or [-1.121%; +1.121%]	None	None	None

Group 2

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	afd6aa6	1722538380	pawel/dsn/crashtracker-rfc-verification

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	280.510ns	281.912ns ± 0.358ns	281.931ns ± 0.077ns	282.017ns	282.241ns	282.993ns	284.381ns	0.87%	0.890	13.795	0.13%	0.025ns	1	200
normalization/normalize_name/normalize_name/bad-name	execution_time	33.622ns	34.181ns ± 0.343ns	34.114ns ± 0.200ns	34.399ns	34.852ns	35.234ns	35.301ns	3.48%	0.840	0.639	1.00%	0.024ns	1	200
normalization/normalize_name/normalize_name/good	execution_time	21.424ns	21.867ns ± 0.142ns	21.854ns ± 0.091ns	21.954ns	22.106ns	22.299ns	22.431ns	2.64%	0.610	1.160	0.65%	0.010ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	[281.863ns; 281.962ns] or [-0.018%; +0.018%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	execution_time	[34.134ns; 34.229ns] or [-0.139%; +0.139%]	None	None	None
normalization/normalize_name/normalize_name/good	execution_time	[21.847ns; 21.887ns] or [-0.090%; +0.090%]	None	None	None

Group 3

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	afd6aa6	1722538380	pawel/dsn/crashtracker-rfc-verification

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
two way interface	execution_time	17.873µs	41.000µs ± 36.777µs	40.308µs ± 3.075µs	43.205µs	53.936µs	111.862µs	526.451µs	1206.07%	11.635	150.493	89.48%	2.601µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
two way interface	execution_time	[35.903µs; 46.097µs] or [-12.432%; +12.432%]	None	None	None

Group 4

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	afd6aa6	1722538380	pawel/dsn/crashtracker-rfc-verification

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
write only interface	execution_time	1.621µs	2.930µs ± 1.819µs	2.763µs ± 0.023µs	2.783µs	3.006µs	3.718µs	24.030µs	769.63%	10.204	106.709	61.92%	0.129µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
write only interface	execution_time	[2.678µs; 3.182µs] or [-8.603%; +8.603%]	None	None	None

Group 5

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	afd6aa6	1722538380	pawel/dsn/crashtracker-rfc-verification

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sql/obfuscate_sql_string	execution_time	70.709µs	70.838µs ± 0.062µs	70.832µs ± 0.023µs	70.857µs	70.901µs	71.001µs	71.491µs	0.93%	6.140	59.809	0.09%	0.004µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sql/obfuscate_sql_string	execution_time	[70.829µs; 70.847µs] or [-0.012%; +0.012%]	None	None	None

Group 6

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	afd6aa6	1722538380	pawel/dsn/crashtracker-rfc-verification

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching string interning on wordpress profile	execution_time	136.894µs	137.290µs ± 0.214µs	137.260µs ± 0.112µs	137.384µs	137.568µs	138.193µs	138.483µs	0.89%	2.145	8.846	0.16%	0.015µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching string interning on wordpress profile	execution_time	[137.260µs; 137.319µs] or [-0.022%; +0.022%]	None	None	None

Group 7

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	afd6aa6	1722538380	pawel/dsn/crashtracker-rfc-verification

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
redis/obfuscate_redis_string	execution_time	37.461µs	37.578µs ± 0.077µs	37.574µs ± 0.030µs	37.603µs	37.634µs	37.667µs	38.360µs	2.09%	6.570	59.718	0.20%	0.005µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
redis/obfuscate_redis_string	execution_time	[37.567µs; 37.588µs] or [-0.028%; +0.028%]	None	None	None

Group 8

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	afd6aa6	1722538380	pawel/dsn/crashtracker-rfc-verification

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
tags/replace_trace_tags	execution_time	2.258µs	2.268µs ± 0.005µs	2.268µs ± 0.004µs	2.272µs	2.275µs	2.280µs	2.286µs	0.82%	0.342	-0.062	0.21%	0.000µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
tags/replace_trace_tags	execution_time	[2.267µs; 2.269µs] or [-0.029%; +0.029%]	None	None	None

Group 9

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	afd6aa6	1722538380	pawel/dsn/crashtracker-rfc-verification

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching deserializing traces from msgpack to their internal representation	execution_time	1.666µs	1.669µs ± 0.001µs	1.669µs ± 0.000µs	1.669µs	1.670µs	1.671µs	1.676µs	0.43%	3.761	31.932	0.05%	0.000µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching deserializing traces from msgpack to their internal representation	execution_time	[1.669µs; 1.669µs] or [-0.007%; +0.007%]	None	None	None

Group 10

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	afd6aa6	1722538380	pawel/dsn/crashtracker-rfc-verification

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
credit_card/is_card_number/	execution_time	3.260ns	3.427ns ± 0.015ns	3.429ns ± 0.001ns	3.430ns	3.432ns	3.433ns	3.437ns	0.24%	-10.038	102.341	0.43%	0.001ns	1	200
credit_card/is_card_number/	throughput	290967666.472op/s	291772086.558op/s ± 1319102.263op/s	291660661.981op/s ± 83677.236op/s	291734286.999op/s	291858048.208op/s	292064837.101op/s	306790024.271op/s	5.19%	10.086	103.374	0.45%	93274.616op/s	1	200
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	84.850ns	87.373ns ± 0.857ns	87.244ns ± 0.430ns	87.762ns	89.130ns	89.724ns	90.556ns	3.80%	0.737	1.960	0.98%	0.061ns	1	200
credit_card/is_card_number/ 3782-8224-6310-005	throughput	11042837.346op/s	11446259.488op/s ± 111533.469op/s	11462120.323op/s ± 56826.456op/s	11509637.175op/s	11614049.066op/s	11708348.454op/s	11785476.997op/s	2.82%	-0.637	1.817	0.97%	7886.607op/s	1	200
credit_card/is_card_number/ 378282246310005	execution_time	80.948ns	82.766ns ± 0.904ns	82.649ns ± 0.450ns	83.159ns	84.422ns	85.886ns	86.567ns	4.74%	1.306	2.936	1.09%	0.064ns	1	200
credit_card/is_card_number/ 378282246310005	throughput	11551735.223op/s	12083655.395op/s ± 130134.639op/s	12099327.588op/s ± 65838.921op/s	12159271.473op/s	12262392.454op/s	12315295.668op/s	12353552.779op/s	2.10%	-1.203	2.600	1.07%	9201.909op/s	1	200
credit_card/is_card_number/37828224631	execution_time	3.265ns	3.427ns ± 0.016ns	3.429ns ± 0.001ns	3.429ns	3.431ns	3.435ns	3.473ns	1.29%	-9.048	86.354	0.48%	0.001ns	1	200
credit_card/is_card_number/37828224631	throughput	287945181.670op/s	291783707.992op/s ± 1467643.668op/s	291670999.374op/s ± 63781.594op/s	291738186.785op/s	291845187.792op/s	292223368.525op/s	306319354.130op/s	5.02%	9.138	87.242	0.50%	103778.079op/s	1	200
credit_card/is_card_number/378282246310005	execution_time	77.633ns	80.328ns ± 0.818ns	80.327ns ± 0.427ns	80.690ns	81.918ns	82.556ns	82.632ns	2.87%	0.053	1.576	1.02%	0.058ns	1	200
credit_card/is_card_number/378282246310005	throughput	12101857.628op/s	12450186.347op/s ± 126852.083op/s	12449076.456op/s ± 66197.531op/s	12521294.759op/s	12647479.062op/s	12862526.033op/s	12881165.931op/s	3.47%	0.057	1.656	1.02%	8969.797op/s	1	200
credit_card/is_card_number/37828224631000521389798	execution_time	67.390ns	68.283ns ± 0.402ns	68.268ns ± 0.169ns	68.431ns	68.699ns	70.429ns	71.010ns	4.02%	2.965	16.896	0.59%	0.028ns	1	200
credit_card/is_card_number/37828224631000521389798	throughput	14082499.785op/s	14645325.182op/s ± 84745.246op/s	14648164.209op/s ± 36082.065op/s	14686648.721op/s	14765658.257op/s	14791462.779op/s	14839030.851op/s	1.30%	-2.790	15.647	0.58%	5992.394op/s	1	200
credit_card/is_card_number/x371413321323331	execution_time	21.302ns	22.380ns ± 0.521ns	22.325ns ± 0.235ns	22.528ns	23.221ns	24.802ns	24.810ns	11.13%	1.965	6.750	2.32%	0.037ns	1	200
credit_card/is_card_number/x371413321323331	throughput	40306469.592op/s	44705046.421op/s ± 999593.933op/s	44792834.893op/s ± 473357.273op/s	45286181.347op/s	45957701.579op/s	46498599.576op/s	46943301.520op/s	4.80%	-1.642	5.274	2.23%	70681.965op/s	1	200
credit_card/is_card_number_no_luhn/	execution_time	3.263ns	3.429ns ± 0.016ns	3.431ns ± 0.000ns	3.431ns	3.433ns	3.435ns	3.454ns	0.68%	-9.607	92.250	0.48%	0.001ns	1	200
credit_card/is_card_number_no_luhn/	throughput	289503877.248op/s	291605039.044op/s ± 1459636.051op/s	291472476.442op/s ± 36994.879op/s	291508925.668op/s	291610363.370op/s	291977327.235op/s	306419847.006op/s	5.13%	9.634	92.585	0.50%	103211.855op/s	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	66.822ns	68.035ns ± 0.705ns	67.998ns ± 0.258ns	68.228ns	68.800ns	69.963ns	75.151ns	10.52%	5.749	52.573	1.03%	0.050ns	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	13306468.050op/s	14699818.942op/s ± 144300.224op/s	14706262.718op/s ± 55849.594op/s	14766290.432op/s	14844192.344op/s	14955829.072op/s	14965086.113op/s	1.76%	-5.120	44.370	0.98%	10203.567op/s	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	62.152ns	63.152ns ± 0.424ns	63.109ns ± 0.233ns	63.353ns	63.985ns	64.482ns	64.653ns	2.45%	0.724	1.386	0.67%	0.030ns	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	15467259.324op/s	15835578.966op/s ± 105861.645op/s	15845514.445op/s ± 58386.360op/s	15896750.100op/s	15994440.884op/s	16046241.438op/s	16089565.184op/s	1.54%	-0.667	1.275	0.67%	7485.549op/s	1	200
credit_card/is_card_number_no_luhn/37828224631	execution_time	3.267ns	3.429ns ± 0.016ns	3.431ns ± 0.001ns	3.431ns	3.433ns	3.434ns	3.439ns	0.24%	-9.761	93.911	0.47%	0.001ns	1	200
credit_card/is_card_number_no_luhn/37828224631	throughput	290775693.281op/s	291608122.646op/s ± 1446550.225op/s	291475212.341op/s ± 44248.430op/s	291507115.978op/s	291607259.249op/s	292000529.424op/s	306121328.807op/s	5.02%	9.770	94.025	0.49%	102286.547op/s	1	200
credit_card/is_card_number_no_luhn/378282246310005	execution_time	59.602ns	60.725ns ± 0.436ns	60.720ns ± 0.267ns	61.013ns	61.488ns	61.838ns	61.847ns	1.86%	0.107	0.064	0.72%	0.031ns	1	200
credit_card/is_card_number_no_luhn/378282246310005	throughput	16168908.097op/s	16468454.727op/s ± 118204.115op/s	16469050.014op/s ± 72481.301op/s	16539961.880op/s	16668934.429op/s	16742251.100op/s	16777899.203op/s	1.88%	-0.063	0.059	0.72%	8358.293op/s	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	66.406ns	67.428ns ± 0.384ns	67.420ns ± 0.189ns	67.615ns	67.939ns	68.619ns	69.761ns	3.47%	1.670	9.739	0.57%	0.027ns	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	14334688.227op/s	14831187.474op/s ± 83780.950op/s	14832452.595op/s ± 41576.194op/s	14870669.153op/s	14951688.982op/s	15042924.212op/s	15058825.102op/s	1.53%	-1.520	8.933	0.56%	5924.208op/s	1	200
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	20.975ns	21.731ns ± 0.301ns	21.704ns ± 0.190ns	21.903ns	22.193ns	22.417ns	23.628ns	8.86%	1.335	7.067	1.38%	0.021ns	1	200
credit_card/is_card_number_no_luhn/x371413321323331	throughput	42322177.364op/s	46026039.563op/s ± 626651.923op/s	46073932.730op/s ± 403968.006op/s	46450727.803op/s	46893465.856op/s	47382015.535op/s	47676029.313op/s	3.48%	-1.059	5.350	1.36%	44310.982op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
credit_card/is_card_number/	execution_time	[3.425ns; 3.429ns] or [-0.060%; +0.060%]	None	None	None
credit_card/is_card_number/	throughput	[291589271.671op/s; 291954901.445op/s] or [-0.063%; +0.063%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	[87.254ns; 87.492ns] or [-0.136%; +0.136%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	throughput	[11430802.022op/s; 11461716.954op/s] or [-0.135%; +0.135%]	None	None	None
credit_card/is_card_number/ 378282246310005	execution_time	[82.641ns; 82.891ns] or [-0.151%; +0.151%]	None	None	None
credit_card/is_card_number/ 378282246310005	throughput	[12065619.986op/s; 12101690.805op/s] or [-0.149%; +0.149%]	None	None	None
credit_card/is_card_number/37828224631	execution_time	[3.425ns; 3.430ns] or [-0.067%; +0.067%]	None	None	None
credit_card/is_card_number/37828224631	throughput	[291580306.694op/s; 291987109.289op/s] or [-0.070%; +0.070%]	None	None	None
credit_card/is_card_number/378282246310005	execution_time	[80.215ns; 80.442ns] or [-0.141%; +0.141%]	None	None	None
credit_card/is_card_number/378282246310005	throughput	[12432605.868op/s; 12467766.825op/s] or [-0.141%; +0.141%]	None	None	None
credit_card/is_card_number/37828224631000521389798	execution_time	[68.228ns; 68.339ns] or [-0.082%; +0.082%]	None	None	None
credit_card/is_card_number/37828224631000521389798	throughput	[14633580.306op/s; 14657070.058op/s] or [-0.080%; +0.080%]	None	None	None
credit_card/is_card_number/x371413321323331	execution_time	[22.308ns; 22.453ns] or [-0.323%; +0.323%]	None	None	None
credit_card/is_card_number/x371413321323331	throughput	[44566512.316op/s; 44843580.526op/s] or [-0.310%; +0.310%]	None	None	None
credit_card/is_card_number_no_luhn/	execution_time	[3.427ns; 3.432ns] or [-0.066%; +0.066%]	None	None	None
credit_card/is_card_number_no_luhn/	throughput	[291402747.526op/s; 291807330.563op/s] or [-0.069%; +0.069%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	[67.937ns; 68.133ns] or [-0.144%; +0.144%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	[14679820.319op/s; 14719817.565op/s] or [-0.136%; +0.136%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	[63.093ns; 63.211ns] or [-0.093%; +0.093%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	[15820907.560op/s; 15850250.372op/s] or [-0.093%; +0.093%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	execution_time	[3.427ns; 3.432ns] or [-0.066%; +0.066%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	throughput	[291407644.697op/s; 291808600.595op/s] or [-0.069%; +0.069%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	execution_time	[60.665ns; 60.786ns] or [-0.100%; +0.100%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	throughput	[16452072.773op/s; 16484836.680op/s] or [-0.099%; +0.099%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	[67.374ns; 67.481ns] or [-0.079%; +0.079%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	[14819576.240op/s; 14842798.708op/s] or [-0.078%; +0.078%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	[21.689ns; 21.773ns] or [-0.192%; +0.192%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	throughput	[45939191.633op/s; 46112887.492op/s] or [-0.189%; +0.189%]	None	None	None

Group 11

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	afd6aa6	1722538380	pawel/dsn/crashtracker-rfc-verification

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_trace/test_trace	execution_time	321.098ns	331.166ns ± 3.982ns	330.233ns ± 1.539ns	332.832ns	337.194ns	340.648ns	362.695ns	9.83%	2.891	19.004	1.20%	0.282ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_trace/test_trace	execution_time	[330.614ns; 331.718ns] or [-0.167%; +0.167%]	None	None	None

Baseline

Omitted due to size.

[github-actions[bot]]

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. To override this behavior, add the keep-open label or update the PR.

[github-actions[bot]]

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. To override this behavior, add the keep-open label or update the PR.