Add document describing the new build process.

[hoolioh]

trafficstars

What does this PR do?

Describe a new build system to be implemented in libdatadog.

Motivation

Improve current the current one so it's less error prone, more maintainable and cand handle features as well as versioning.

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 71.69%. Comparing base (df81898) to head (c4e05fe). Report is 72 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #579      +/-   ##
==========================================
- Coverage   71.77%   71.69%   -0.08%     
==========================================
  Files         238      238              
  Lines       32924    32941      +17     
==========================================
- Hits        23631    23617      -14     
- Misses       9293     9324      +31     

Components	Coverage Δ
crashtracker	20.66% <ø> (ø)
datadog-alloc	98.73% <ø> (ø)
data-pipeline	50.00% <ø> (ø)
data-pipeline-ffi	0.00% <ø> (ø)
ddcommon	82.11% <ø> (ø)
ddcommon-ffi	68.11% <ø> (ø)
ddtelemetry	59.02% <ø> (ø)
ipc	84.29% <ø> (ø)
profiling	84.26% <ø> (ø)
profiling-ffi	77.42% <ø> (ø)
serverless	0.00% <ø> (ø)
sidecar	40.23% <ø> (ø)
sidecar-ffi	0.00% <ø> (ø)
spawn-worker	54.87% <ø> (ø)
trace-mini-agent	70.88% <ø> (ø)
trace-normalization	98.25% <ø> (ø)
trace-obfuscation	95.73% <ø> (ø)
trace-protobuf	77.67% <ø> (ø)
trace-utils	92.97% <ø> (-0.43%)	:arrow_down:

[pr-commenter[bot]]

Benchmarks

Comparison

Benchmark execution time: 2024-08-22 12:33:17

Comparing candidate commit c4e05fe in PR branch julio/build-process-proposal with baseline commit df81898 in branch main.

Found 1 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 2 unstable metrics.

scenario:tags/replace_trace_tags

• 🟩 execution_time [-68.099ns; -59.746ns] or [-2.490%; -2.184%]

Candidate

Candidate benchmark details

Group 1

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c4e05fe	1724329447	julio/build-process-proposal

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
write only interface	execution_time	1.473µs	2.937µs ± 1.405µs	2.778µs ± 0.022µs	2.793µs	2.998µs	12.845µs	15.802µs	468.83%	7.920	62.720	47.74%	0.099µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
write only interface	execution_time	[2.742µs; 3.131µs] or [-6.633%; +6.633%]	None	None	None

Group 2

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c4e05fe	1724329447	julio/build-process-proposal

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	618.391µs	619.936µs ± 1.036µs	619.832µs ± 0.858µs	620.740µs	621.661µs	622.138µs	624.145µs	0.70%	0.589	-0.037	0.17%	0.073µs	1	200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	1602192.654op/s	1613074.638op/s ± 2691.754op/s	1613339.697op/s ± 2235.656op/s	1615505.145op/s	1616399.298op/s	1616933.406op/s	1617101.081op/s	0.23%	-0.581	-0.067	0.17%	190.336op/s	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	386.628µs	388.480µs ± 0.919µs	388.417µs ± 0.604µs	389.016µs	390.083µs	390.884µs	391.128µs	0.70%	0.380	-0.154	0.24%	0.065µs	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	2556706.887op/s	2574148.721op/s ± 6086.258op/s	2574554.264op/s ± 4008.773op/s	2578563.028op/s	2583335.012op/s	2586189.256op/s	2586463.415op/s	0.46%	-0.368	-0.168	0.24%	430.363op/s	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	190.836µs	191.389µs ± 0.243µs	191.349µs ± 0.166µs	191.569µs	191.849µs	192.003µs	192.050µs	0.37%	0.513	-0.134	0.13%	0.017µs	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	5206964.141op/s	5224965.538op/s ± 6627.367op/s	5226058.873op/s ± 4531.646op/s	5229854.803op/s	5234369.604op/s	5236824.393op/s	5240108.489op/s	0.27%	-0.506	-0.141	0.13%	468.626op/s	1	200
normalization/normalize_service/normalize_service/[empty string]	execution_time	44.977µs	45.135µs ± 0.083µs	45.125µs ± 0.053µs	45.182µs	45.262µs	45.320µs	45.642µs	1.15%	1.527	6.395	0.18%	0.006µs	1	200
normalization/normalize_service/normalize_service/[empty string]	throughput	21909637.768op/s	22155668.987op/s ± 40719.232op/s	22160799.914op/s ± 26000.127op/s	22184058.600op/s	22208506.018op/s	22218487.913op/s	22233515.436op/s	0.33%	-1.494	6.168	0.18%	2879.284op/s	1	200
normalization/normalize_service/normalize_service/test_ASCII	execution_time	48.987µs	49.343µs ± 0.199µs	49.302µs ± 0.119µs	49.472µs	49.666µs	49.768µs	50.640µs	2.71%	1.636	7.764	0.40%	0.014µs	1	200
normalization/normalize_service/normalize_service/test_ASCII	throughput	19747212.715op/s	20266744.157op/s ± 81062.378op/s	20283081.066op/s ± 48720.095op/s	20321032.163op/s	20378571.539op/s	20398314.907op/s	20413724.479op/s	0.64%	-1.554	7.117	0.40%	5731.976op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	[619.792µs; 620.079µs] or [-0.023%; +0.023%]	None	None	None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	[1612701.587op/s; 1613447.690op/s] or [-0.023%; +0.023%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	[388.353µs; 388.608µs] or [-0.033%; +0.033%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	[2573305.224op/s; 2574992.218op/s] or [-0.033%; +0.033%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	[191.355µs; 191.423µs] or [-0.018%; +0.018%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	[5224047.048op/s; 5225884.027op/s] or [-0.018%; +0.018%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	execution_time	[45.124µs; 45.147µs] or [-0.026%; +0.026%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	throughput	[22150025.693op/s; 22161312.281op/s] or [-0.025%; +0.025%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	execution_time	[49.315µs; 49.370µs] or [-0.056%; +0.056%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	throughput	[20255509.691op/s; 20277978.623op/s] or [-0.055%; +0.055%]	None	None	None

Group 3

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c4e05fe	1724329447	julio/build-process-proposal

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	309.959µs	312.705µs ± 1.033µs	312.650µs ± 0.681µs	313.412µs	314.530µs	315.004µs	315.349µs	0.86%	0.049	0.041	0.33%	0.073µs	1	200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	3171090.195op/s	3197935.335op/s ± 10565.396op/s	3198461.794op/s ± 6970.793op/s	3204816.792op/s	3213390.406op/s	3223113.902op/s	3226230.745op/s	0.87%	-0.029	0.048	0.33%	747.086op/s	1	200
normalization/normalize_name/normalize_name/bad-name	execution_time	27.935µs	28.004µs ± 0.053µs	27.987µs ± 0.031µs	28.035µs	28.101µs	28.116µs	28.309µs	1.15%	1.477	4.208	0.19%	0.004µs	1	200
normalization/normalize_name/normalize_name/bad-name	throughput	35324791.074op/s	35708829.894op/s ± 67069.833op/s	35730678.637op/s ± 39670.221op/s	35761203.873op/s	35779297.878op/s	35788695.242op/s	35797399.112op/s	0.19%	-1.455	4.043	0.19%	4742.553op/s	1	200
normalization/normalize_name/normalize_name/good	execution_time	16.733µs	16.762µs ± 0.019µs	16.755µs ± 0.014µs	16.777µs	16.792µs	16.804µs	16.833µs	0.47%	0.671	0.074	0.12%	0.001µs	1	200
normalization/normalize_name/normalize_name/good	throughput	59405830.934op/s	59659374.311op/s ± 68793.875op/s	59685336.884op/s ± 49831.116op/s	59720286.374op/s	59739095.072op/s	59750644.068op/s	59760451.748op/s	0.13%	-0.665	0.052	0.12%	4864.462op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	[312.562µs; 312.848µs] or [-0.046%; +0.046%]	None	None	None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	[3196471.072op/s; 3199399.597op/s] or [-0.046%; +0.046%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	execution_time	[27.997µs; 28.012µs] or [-0.026%; +0.026%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	throughput	[35699534.660op/s; 35718125.128op/s] or [-0.026%; +0.026%]	None	None	None
normalization/normalize_name/normalize_name/good	execution_time	[16.759µs; 16.765µs] or [-0.016%; +0.016%]	None	None	None
normalization/normalize_name/normalize_name/good	throughput	[59649840.142op/s; 59668908.480op/s] or [-0.016%; +0.016%]	None	None	None

Group 4

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c4e05fe	1724329447	julio/build-process-proposal

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
credit_card/is_card_number/	execution_time	1.613µs	1.613µs ± 0.000µs	1.613µs ± 0.000µs	1.614µs	1.614µs	1.614µs	1.615µs	0.10%	0.574	0.102	0.03%	0.000µs	1	200
credit_card/is_card_number/	throughput	619240516.194op/s	619836743.870op/s ± 161335.180op/s	619870541.284op/s ± 123423.828op/s	619972197.280op/s	620050258.485op/s	620109020.175op/s	620145545.098op/s	0.04%	-0.573	0.098	0.03%	11408.120op/s	1	200
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	104.024µs	105.162µs ± 0.719µs	104.951µs ± 0.229µs	105.260µs	106.971µs	107.339µs	108.807µs	3.67%	2.057	4.616	0.68%	0.051µs	1	200
credit_card/is_card_number/ 3782-8224-6310-005	throughput	9190543.811op/s	9509580.787op/s ± 64095.698op/s	9528287.252op/s ± 20873.019op/s	9546113.383op/s	9567750.417op/s	9593367.702op/s	9613134.426op/s	0.89%	-2.009	4.354	0.67%	4532.250op/s	1	200
credit_card/is_card_number/ 378282246310005	execution_time	96.386µs	97.170µs ± 0.635µs	96.991µs ± 0.237µs	97.320µs	98.635µs	99.293µs	101.074µs	4.21%	2.508	8.705	0.65%	0.045µs	1	200
credit_card/is_card_number/ 378282246310005	throughput	9893742.161op/s	10291689.564op/s ± 66226.607op/s	10310267.168op/s ± 25200.830op/s	10330661.889op/s	10354052.598op/s	10371363.911op/s	10374954.859op/s	0.63%	-2.425	8.064	0.64%	4682.928op/s	1	200
credit_card/is_card_number/37828224631	execution_time	1.613µs	1.614µs ± 0.003µs	1.613µs ± 0.000µs	1.614µs	1.614µs	1.615µs	1.658µs	2.77%	13.566	186.233	0.20%	0.000µs	1	200
credit_card/is_card_number/37828224631	throughput	603153385.924op/s	619737888.402op/s ± 1192762.642op/s	619872446.670op/s ± 119350.924op/s	619960849.158op/s	620031031.160op/s	620064064.000op/s	620137388.592op/s	0.04%	-13.541	185.766	0.19%	84341.055op/s	1	200
credit_card/is_card_number/378282246310005	execution_time	93.969µs	95.238µs ± 0.704µs	95.170µs ± 0.442µs	95.609µs	96.503µs	96.971µs	98.729µs	3.74%	1.035	2.318	0.74%	0.050µs	1	200
credit_card/is_card_number/378282246310005	throughput	10128760.664op/s	10500578.780op/s ± 77031.796op/s	10507548.100op/s ± 48622.360op/s	10556622.095op/s	10608096.622op/s	10618416.892op/s	10641753.477op/s	1.28%	-0.966	1.995	0.73%	5446.971op/s	1	200
credit_card/is_card_number/37828224631000521389798	execution_time	94.090µs	94.646µs ± 0.415µs	94.562µs ± 0.232µs	94.843µs	95.281µs	96.004µs	97.426µs	3.03%	2.229	9.971	0.44%	0.029µs	1	200
credit_card/is_card_number/37828224631000521389798	throughput	10264157.784op/s	10565920.190op/s ± 45898.267op/s	10575077.191op/s ± 26021.613op/s	10598920.766op/s	10620827.041op/s	10627442.139op/s	10628117.748op/s	0.50%	-2.140	9.234	0.43%	3245.498op/s	1	200
credit_card/is_card_number/x371413321323331	execution_time	22.436µs	22.799µs ± 0.212µs	22.763µs ± 0.149µs	22.940µs	23.157µs	23.377µs	23.387µs	2.74%	0.639	-0.011	0.93%	0.015µs	1	200
credit_card/is_card_number/x371413321323331	throughput	42758743.481op/s	43865883.807op/s ± 405342.964op/s	43931319.848op/s ± 288385.125op/s	44156814.117op/s	44428433.118op/s	44565477.107op/s	44571948.872op/s	1.46%	-0.596	-0.087	0.92%	28662.076op/s	1	200
credit_card/is_card_number_no_luhn/	execution_time	1.613µs	1.613µs ± 0.000µs	1.613µs ± 0.000µs	1.614µs	1.614µs	1.614µs	1.615µs	0.08%	0.485	-0.538	0.03%	0.000µs	1	200
credit_card/is_card_number_no_luhn/	throughput	619366849.016op/s	619817634.682op/s ± 166276.520op/s	619835908.967op/s ± 119523.300op/s	619948696.971op/s	620044054.840op/s	620084690.989op/s	620103952.190op/s	0.04%	-0.484	-0.539	0.03%	11757.526op/s	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	85.899µs	86.681µs ± 0.390µs	86.621µs ± 0.259µs	86.936µs	87.302µs	87.723µs	88.548µs	2.22%	0.779	1.771	0.45%	0.028µs	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	11293284.555op/s	11536795.941op/s ± 51782.139op/s	11544519.351op/s ± 34468.636op/s	11573586.774op/s	11611275.419op/s	11631326.427op/s	11641540.509op/s	0.84%	-0.737	1.598	0.45%	3661.550op/s	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	79.185µs	80.305µs ± 0.607µs	80.273µs ± 0.355µs	80.602µs	81.307µs	81.734µs	83.414µs	3.91%	1.037	2.913	0.75%	0.043µs	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	11988435.476op/s	12453193.180op/s ± 93362.282op/s	12457483.276op/s ± 54902.446op/s	12516194.079op/s	12587247.883op/s	12618266.696op/s	12628718.210op/s	1.37%	-0.954	2.514	0.75%	6601.710op/s	1	200
credit_card/is_card_number_no_luhn/37828224631	execution_time	1.613µs	1.613µs ± 0.000µs	1.613µs ± 0.000µs	1.614µs	1.614µs	1.615µs	1.615µs	0.09%	0.633	-0.002	0.03%	0.000µs	1	200
credit_card/is_card_number_no_luhn/37828224631	throughput	619274991.573op/s	619812008.126op/s ± 169101.730op/s	619825359.679op/s ± 122354.119op/s	619947188.446op/s	620040696.862op/s	620082942.764op/s	620096427.646op/s	0.04%	-0.631	-0.005	0.03%	11957.298op/s	1	200
credit_card/is_card_number_no_luhn/378282246310005	execution_time	77.076µs	78.577µs ± 0.591µs	78.565µs ± 0.428µs	78.984µs	79.627µs	79.951µs	80.083µs	1.93%	0.123	-0.241	0.75%	0.042µs	1	200
credit_card/is_card_number_no_luhn/378282246310005	throughput	12487066.618op/s	12727105.350op/s ± 95615.265op/s	12728274.606op/s ± 69404.484op/s	12798711.170op/s	12867620.855op/s	12951354.694op/s	12974242.783op/s	1.93%	-0.084	-0.246	0.75%	6761.020op/s	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	94.100µs	94.651µs ± 0.338µs	94.570µs ± 0.215µs	94.864µs	95.297µs	95.427µs	95.679µs	1.17%	0.586	-0.279	0.36%	0.024µs	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	10451658.565op/s	10565284.794op/s ± 37668.298op/s	10574137.246op/s ± 24063.180op/s	10593565.204op/s	10621732.383op/s	10626326.213op/s	10626936.095op/s	0.50%	-0.572	-0.301	0.36%	2663.551op/s	1	200
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	22.432µs	22.791µs ± 0.204µs	22.764µs ± 0.134µs	22.917µs	23.168µs	23.344µs	23.382µs	2.71%	0.642	-0.065	0.89%	0.014µs	1	200
credit_card/is_card_number_no_luhn/x371413321323331	throughput	42768731.003op/s	43880426.867op/s ± 390055.341op/s	43929512.907op/s ± 257999.086op/s	44182938.357op/s	44409324.886op/s	44564844.387op/s	44579818.493op/s	1.48%	-0.602	-0.132	0.89%	27581.078op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
credit_card/is_card_number/	execution_time	[1.613µs; 1.613µs] or [-0.004%; +0.004%]	None	None	None
credit_card/is_card_number/	throughput	[619814384.366op/s; 619859103.375op/s] or [-0.004%; +0.004%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	[105.062µs; 105.262µs] or [-0.095%; +0.095%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	throughput	[9500697.739op/s; 9518463.834op/s] or [-0.093%; +0.093%]	None	None	None
credit_card/is_card_number/ 378282246310005	execution_time	[97.082µs; 97.258µs] or [-0.091%; +0.091%]	None	None	None
credit_card/is_card_number/ 378282246310005	throughput	[10282511.193op/s; 10300867.934op/s] or [-0.089%; +0.089%]	None	None	None
credit_card/is_card_number/37828224631	execution_time	[1.613µs; 1.614µs] or [-0.027%; +0.027%]	None	None	None
credit_card/is_card_number/37828224631	throughput	[619572582.972op/s; 619903193.833op/s] or [-0.027%; +0.027%]	None	None	None
credit_card/is_card_number/378282246310005	execution_time	[95.140µs; 95.336µs] or [-0.102%; +0.102%]	None	None	None
credit_card/is_card_number/378282246310005	throughput	[10489902.914op/s; 10511254.646op/s] or [-0.102%; +0.102%]	None	None	None
credit_card/is_card_number/37828224631000521389798	execution_time	[94.588µs; 94.703µs] or [-0.061%; +0.061%]	None	None	None
credit_card/is_card_number/37828224631000521389798	throughput	[10559559.132op/s; 10572281.248op/s] or [-0.060%; +0.060%]	None	None	None
credit_card/is_card_number/x371413321323331	execution_time	[22.769µs; 22.828µs] or [-0.129%; +0.129%]	None	None	None
credit_card/is_card_number/x371413321323331	throughput	[43809707.171op/s; 43922060.444op/s] or [-0.128%; +0.128%]	None	None	None
credit_card/is_card_number_no_luhn/	execution_time	[1.613µs; 1.613µs] or [-0.004%; +0.004%]	None	None	None
credit_card/is_card_number_no_luhn/	throughput	[619794590.355op/s; 619840679.009op/s] or [-0.004%; +0.004%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	[86.627µs; 86.735µs] or [-0.062%; +0.062%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	[11529619.434op/s; 11543972.447op/s] or [-0.062%; +0.062%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	[80.221µs; 80.389µs] or [-0.105%; +0.105%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	[12440254.065op/s; 12466132.294op/s] or [-0.104%; +0.104%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	execution_time	[1.613µs; 1.613µs] or [-0.004%; +0.004%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	throughput	[619788572.252op/s; 619835443.999op/s] or [-0.004%; +0.004%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	execution_time	[78.495µs; 78.659µs] or [-0.104%; +0.104%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	throughput	[12713853.994op/s; 12740356.706op/s] or [-0.104%; +0.104%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	[94.604µs; 94.698µs] or [-0.050%; +0.050%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	[10560064.330op/s; 10570505.257op/s] or [-0.049%; +0.049%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	[22.763µs; 22.819µs] or [-0.124%; +0.124%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	throughput	[43826368.948op/s; 43934484.786op/s] or [-0.123%; +0.123%]	None	None	None

Group 5

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c4e05fe	1724329447	julio/build-process-proposal

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_trace/test_trace	execution_time	308.731ns	316.785ns ± 11.818ns	311.343ns ± 1.723ns	316.424ns	344.625ns	353.667ns	355.202ns	14.09%	1.987	2.627	3.72%	0.836ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_trace/test_trace	execution_time	[315.147ns; 318.423ns] or [-0.517%; +0.517%]	None	None	None

Group 6

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c4e05fe	1724329447	julio/build-process-proposal

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
tags/replace_trace_tags	execution_time	2.615µs	2.671µs ± 0.018µs	2.674µs ± 0.004µs	2.677µs	2.707µs	2.713µs	2.715µs	1.52%	-0.853	3.055	0.68%	0.001µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
tags/replace_trace_tags	execution_time	[2.669µs; 2.674µs] or [-0.094%; +0.094%]	None	None	None

Group 7

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c4e05fe	1724329447	julio/build-process-proposal

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sql/obfuscate_sql_string	execution_time	74.024µs	74.295µs ± 0.188µs	74.259µs ± 0.106µs	74.408µs	74.459µs	74.698µs	76.048µs	2.41%	4.576	38.079	0.25%	0.013µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sql/obfuscate_sql_string	execution_time	[74.269µs; 74.321µs] or [-0.035%; +0.035%]	None	None	None

Group 8

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c4e05fe	1724329447	julio/build-process-proposal

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
two way interface	execution_time	17.407µs	23.950µs ± 15.706µs	17.547µs ± 0.063µs	17.634µs	55.799µs	62.596µs	138.601µs	689.89%	3.526	17.294	65.42%	1.111µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
two way interface	execution_time	[21.773µs; 26.127µs] or [-9.089%; +9.089%]	None	None	None

Group 9

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c4e05fe	1724329447	julio/build-process-proposal

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching string interning on wordpress profile	execution_time	139.057µs	139.712µs ± 0.202µs	139.707µs ± 0.113µs	139.818µs	139.987µs	140.356µs	140.854µs	0.82%	1.499	7.361	0.14%	0.014µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching string interning on wordpress profile	execution_time	[139.685µs; 139.740µs] or [-0.020%; +0.020%]	None	None	None

Group 10

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c4e05fe	1724329447	julio/build-process-proposal

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching deserializing traces from msgpack to their internal representation	execution_time	1.153µs	1.352µs ± 0.062µs	1.354µs ± 0.047µs	1.399µs	1.441µs	1.450µs	1.451µs	7.18%	-0.636	0.503	4.57%	0.004µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching deserializing traces from msgpack to their internal representation	execution_time	[1.344µs; 1.361µs] or [-0.636%; +0.636%]	None	None	None

Group 11

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c4e05fe	1724329447	julio/build-process-proposal

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
redis/obfuscate_redis_string	execution_time	38.803µs	39.407µs ± 1.064µs	38.934µs ± 0.065µs	39.004µs	41.645µs	41.664µs	43.701µs	12.25%	1.792	1.608	2.69%	0.075µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
redis/obfuscate_redis_string	execution_time	[39.260µs; 39.555µs] or [-0.374%; +0.374%]	None	None	None

Baseline

Omitted due to size.

[pawelchcki]

LGTM!