[crashtracker] Add debug info generation

Open danielsn opened this issue 1 month ago • 2 comments

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

Oct 17 '25 12:10 danielsn

⚠️ Tests

⚠️ Warnings

🧪 39 Tests failed

test_crash_ping_timing_and_content from bin_tests::crashtracker_bin_test (Datadog)

thread 'test_crash_ping_timing_and_content' panicked at bin_tests/tests/crashtracker_bin_test.rs:276:5

thread 'test_crash_ping_timing_and_content' panicked at bin_tests/tests/crashtracker_bin_test.rs:276:5:
stack backtrace:
   0:     0x55ef916b3daa - std::backtrace_rs::backtrace::libunwind::trace::h886f3b0575353f6e
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/../../backtrace/src/backtrace/libunwind.rs:116:5
   1:     0x55ef916b3daa - std::backtrace_rs::backtrace::trace_unsynchronized::h652d1041ec67eb09
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
   2:     0x55ef916b3daa - std::sys::backtrace::_print_fmt::hd0317245a04c3039
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/sys/backtrace.rs:66:9
...

test_crash_ping_timing_and_content from bin_tests::crashtracker_bin_test

test_crash_tracking_bin_chained from bin_tests::crashtracker_bin_test

View all

ℹ️ Info

❄️ No new flaky tests detected

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 80eadd7 | Docs | Was this helpful? Give us feedback!}

Oct 17 '25 12:10 datadog-datadog-prod-us1[bot]

Benchmarks

Comparison

Benchmark execution time: 2025-10-17 14:07:07

Comparing candidate commit 80eadd7e in PR branch dsn/crashtracker-debug-info with baseline commit 0272ba46 in branch main.

Found 2 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.

scenario:ip_address/quantize_peer_ip_address_benchmark

🟩 execution_time [-380.149ns; -350.456ns] or [-7.049%; -6.499%]

scenario:redis/obfuscate_redis_string

🟩 execution_time [-6.740µs; -6.462µs] or [-16.110%; -15.445%]

Candidate

Candidate benchmark details

Group 1

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80eadd7e	1760709234	dsn/crashtracker-debug-info

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
ip_address/quantize_peer_ip_address_benchmark	execution_time	4.944µs	5.027µs ± 0.048µs	5.034µs ± 0.049µs	5.080µs	5.094µs	5.097µs	5.098µs	1.27%	0.106	-1.560	0.95%	0.003µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark	execution_time	[5.021µs; 5.034µs] or [-0.132%; +0.132%]	None	None	None

Group 2

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80eadd7e	1760709234	dsn/crashtracker-debug-info

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	204.984µs	205.427µs ± 0.263µs	205.386µs ± 0.139µs	205.544µs	205.825µs	206.201µs	207.075µs	0.82%	2.343	11.074	0.13%	0.019µs	1	200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	4829169.436op/s	4867920.591op/s ± 6218.742op/s	4868877.830op/s ± 3297.749op/s	4871695.024op/s	4875326.825op/s	4877944.604op/s	4878424.390op/s	0.20%	-2.314	10.859	0.13%	439.731op/s	1	200
normalization/normalize_name/normalize_name/bad-name	execution_time	18.179µs	18.351µs ± 0.160µs	18.259µs ± 0.039µs	18.445µs	18.653µs	18.860µs	18.965µs	3.86%	1.349	1.426	0.87%	0.011µs	1	200
normalization/normalize_name/normalize_name/bad-name	throughput	52728967.788op/s	54496457.977op/s ± 470495.375op/s	54766528.911op/s ± 116871.552op/s	54835077.170op/s	54920851.793op/s	54968955.454op/s	55008602.606op/s	0.44%	-1.308	1.239	0.86%	33269.047op/s	1	200
normalization/normalize_name/normalize_name/good	execution_time	10.518µs	10.721µs ± 0.177µs	10.653µs ± 0.078µs	10.774µs	11.065µs	11.129µs	11.152µs	4.68%	1.006	-0.419	1.65%	0.013µs	1	200
normalization/normalize_name/normalize_name/good	throughput	89673193.346op/s	93301836.511op/s ± 1517214.079op/s	93870580.788op/s ± 682452.359op/s	94454617.181op/s	94826512.122op/s	94937355.936op/s	95073707.919op/s	1.28%	-0.977	-0.468	1.62%	107283.236op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	[205.390µs; 205.463µs] or [-0.018%; +0.018%]	None	None	None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	[4867058.734op/s; 4868782.449op/s] or [-0.018%; +0.018%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	execution_time	[18.329µs; 18.373µs] or [-0.121%; +0.121%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	throughput	[54431251.843op/s; 54561664.111op/s] or [-0.120%; +0.120%]	None	None	None
normalization/normalize_name/normalize_name/good	execution_time	[10.696µs; 10.745µs] or [-0.229%; +0.229%]	None	None	None
normalization/normalize_name/normalize_name/good	throughput	[93091565.232op/s; 93512107.791op/s] or [-0.225%; +0.225%]	None	None	None

Group 3

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80eadd7e	1760709234	dsn/crashtracker-debug-info

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
concentrator/add_spans_to_concentrator	execution_time	10.625ms	10.651ms ± 0.015ms	10.649ms ± 0.008ms	10.658ms	10.674ms	10.700ms	10.732ms	0.78%	1.551	4.640	0.14%	0.001ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
concentrator/add_spans_to_concentrator	execution_time	[10.649ms; 10.653ms] or [-0.020%; +0.020%]	None	None	None

Group 4

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80eadd7e	1760709234	dsn/crashtracker-debug-info

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
redis/obfuscate_redis_string	execution_time	34.607µs	35.238µs ± 0.954µs	34.837µs ± 0.109µs	34.951µs	37.240µs	37.308µs	38.928µs	11.74%	1.756	1.434	2.70%	0.067µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
redis/obfuscate_redis_string	execution_time	[35.106µs; 35.370µs] or [-0.375%; +0.375%]	None	None	None

Group 5

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80eadd7e	1760709234	dsn/crashtracker-debug-info

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching string interning on wordpress profile	execution_time	166.656µs	167.379µs ± 0.382µs	167.315µs ± 0.200µs	167.578µs	168.079µs	168.532µs	168.817µs	0.90%	0.929	1.160	0.23%	0.027µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching string interning on wordpress profile	execution_time	[167.326µs; 167.432µs] or [-0.032%; +0.032%]	None	None	None

Group 6

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80eadd7e	1760709234	dsn/crashtracker-debug-info

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
write only interface	execution_time	1.204µs	3.218µs ± 1.420µs	2.995µs ± 0.030µs	3.025µs	3.682µs	14.064µs	14.654µs	389.35%	7.285	54.395	44.02%	0.100µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
write only interface	execution_time	[3.021µs; 3.415µs] or [-6.116%; +6.116%]	None	None	None

Group 7

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80eadd7e	1760709234	dsn/crashtracker-debug-info

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
two way interface	execution_time	18.138µs	26.585µs ± 9.909µs	18.366µs ± 0.183µs	35.426µs	45.179µs	46.175µs	59.880µs	226.04%	0.673	-0.698	37.18%	0.701µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
two way interface	execution_time	[25.212µs; 27.958µs] or [-5.166%; +5.166%]	None	None	None

Group 8

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80eadd7e	1760709234	dsn/crashtracker-debug-info

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
receiver_entry_point/report/2597	execution_time	6.205ms	6.261ms ± 0.040ms	6.254ms ± 0.018ms	6.269ms	6.334ms	6.409ms	6.465ms	3.39%	2.086	5.885	0.63%	0.003ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
receiver_entry_point/report/2597	execution_time	[6.255ms; 6.266ms] or [-0.088%; +0.088%]	None	None	None

Group 9

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80eadd7e	1760709234	dsn/crashtracker-debug-info

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching serializing traces from their internal representation to msgpack	execution_time	14.729ms	14.782ms ± 0.031ms	14.781ms ± 0.017ms	14.796ms	14.826ms	14.897ms	14.925ms	0.98%	1.710	5.256	0.21%	0.002ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching serializing traces from their internal representation to msgpack	execution_time	[14.778ms; 14.786ms] or [-0.029%; +0.029%]	None	None	None

Group 10

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80eadd7e	1760709234	dsn/crashtracker-debug-info

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	534.282µs	535.065µs ± 0.804µs	534.983µs ± 0.243µs	535.244µs	535.656µs	535.846µs	545.312µs	1.93%	10.419	130.267	0.15%	0.057µs	1	200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	1833813.361op/s	1868935.537op/s ± 2765.612op/s	1869216.630op/s ± 849.447op/s	1869999.299op/s	1870811.528op/s	1871304.768op/s	1871670.972op/s	0.13%	-10.312	128.454	0.15%	195.558op/s	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	383.600µs	384.320µs ± 0.308µs	384.282µs ± 0.182µs	384.472µs	384.867µs	385.246µs	385.468µs	0.31%	0.835	1.294	0.08%	0.022µs	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	2594247.606op/s	2602002.684op/s ± 2081.836op/s	2602255.782op/s ± 1233.947op/s	2603459.352op/s	2604960.941op/s	2605683.756op/s	2606882.760op/s	0.18%	-0.828	1.279	0.08%	147.208op/s	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	195.284µs	195.729µs ± 0.164µs	195.726µs ± 0.113µs	195.843µs	196.003µs	196.101µs	196.151µs	0.22%	0.009	-0.210	0.08%	0.012µs	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	5098109.768op/s	5109098.628op/s ± 4289.969op/s	5109184.963op/s ± 2943.549op/s	5112083.782op/s	5115857.650op/s	5118977.933op/s	5120742.389op/s	0.23%	-0.004	-0.210	0.08%	303.347op/s	1	200
normalization/normalize_service/normalize_service/[empty string]	execution_time	37.836µs	37.912µs ± 0.038µs	37.910µs ± 0.026µs	37.938µs	37.977µs	37.999µs	38.030µs	0.32%	0.274	-0.386	0.10%	0.003µs	1	200
normalization/normalize_service/normalize_service/[empty string]	throughput	26295063.362op/s	26376642.832op/s ± 26623.525op/s	26378328.893op/s ± 18093.314op/s	26394830.470op/s	26417409.291op/s	26427394.033op/s	26429963.919op/s	0.20%	-0.270	-0.390	0.10%	1882.568op/s	1	200
normalization/normalize_service/normalize_service/test_ASCII	execution_time	45.799µs	45.894µs ± 0.055µs	45.884µs ± 0.033µs	45.923µs	45.996µs	46.043µs	46.205µs	0.70%	1.456	4.548	0.12%	0.004µs	1	200
normalization/normalize_service/normalize_service/test_ASCII	throughput	21642845.909op/s	21789232.862op/s ± 25909.978op/s	21794181.801op/s ± 15654.120op/s	21807616.359op/s	21819526.168op/s	21830226.652op/s	21834622.627op/s	0.19%	-1.441	4.448	0.12%	1832.112op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	[534.954µs; 535.177µs] or [-0.021%; +0.021%]	None	None	None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	[1868552.250op/s; 1869318.825op/s] or [-0.021%; +0.021%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	[384.277µs; 384.362µs] or [-0.011%; +0.011%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	[2601714.161op/s; 2602291.206op/s] or [-0.011%; +0.011%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	[195.707µs; 195.752µs] or [-0.012%; +0.012%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	[5108504.080op/s; 5109693.177op/s] or [-0.012%; +0.012%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	execution_time	[37.907µs; 37.918µs] or [-0.014%; +0.014%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	throughput	[26372953.068op/s; 26380332.597op/s] or [-0.014%; +0.014%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	execution_time	[45.887µs; 45.902µs] or [-0.017%; +0.017%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	throughput	[21785641.988op/s; 21792823.735op/s] or [-0.016%; +0.016%]	None	None	None

Group 11

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80eadd7e	1760709234	dsn/crashtracker-debug-info

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sql/obfuscate_sql_string	execution_time	88.186µs	88.436µs ± 0.134µs	88.419µs ± 0.035µs	88.454µs	88.561µs	88.672µs	90.017µs	1.81%	8.426	94.956	0.15%	0.009µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sql/obfuscate_sql_string	execution_time	[88.417µs; 88.455µs] or [-0.021%; +0.021%]	None	None	None

Group 12

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80eadd7e	1760709234	dsn/crashtracker-debug-info

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_trace/test_trace	execution_time	244.379ns	255.624ns ± 13.742ns	248.499ns ± 2.739ns	260.211ns	282.767ns	292.987ns	295.996ns	19.11%	1.353	0.502	5.36%	0.972ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_trace/test_trace	execution_time	[253.719ns; 257.528ns] or [-0.745%; +0.745%]	None	None	None

Group 13

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80eadd7e	1760709234	dsn/crashtracker-debug-info

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
credit_card/is_card_number/	execution_time	3.899µs	3.912µs ± 0.002µs	3.912µs ± 0.001µs	3.914µs	3.917µs	3.918µs	3.924µs	0.30%	0.155	6.554	0.06%	0.000µs	1	200
credit_card/is_card_number/	throughput	254832419.270op/s	255593685.844op/s ± 153971.176op/s	255607987.750op/s ± 83292.425op/s	255683288.914op/s	255779535.499op/s	255829174.589op/s	256452808.168op/s	0.33%	-0.139	6.581	0.06%	10887.406op/s	1	200
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	78.448µs	80.579µs ± 0.974µs	80.488µs ± 0.730µs	81.369µs	82.147µs	82.818µs	83.295µs	3.49%	0.254	-0.473	1.21%	0.069µs	1	200
credit_card/is_card_number/ 3782-8224-6310-005	throughput	12005473.721op/s	12411952.709op/s ± 149667.636op/s	12424246.612op/s ± 112157.941op/s	12522769.615op/s	12630944.509op/s	12709620.727op/s	12747297.573op/s	2.60%	-0.202	-0.506	1.20%	10583.100op/s	1	200
credit_card/is_card_number/ 378282246310005	execution_time	71.448µs	71.992µs ± 0.439µs	71.868µs ± 0.276µs	72.194µs	72.899µs	73.164µs	73.744µs	2.61%	1.175	1.318	0.61%	0.031µs	1	200
credit_card/is_card_number/ 378282246310005	throughput	13560516.537op/s	13891022.701op/s ± 84034.868op/s	13914372.852op/s ± 53281.604op/s	13964510.113op/s	13983641.615op/s	13992434.949op/s	13996259.273op/s	0.59%	-1.140	1.186	0.60%	5942.162op/s	1	200
credit_card/is_card_number/37828224631	execution_time	3.892µs	3.913µs ± 0.003µs	3.913µs ± 0.001µs	3.915µs	3.917µs	3.919µs	3.920µs	0.18%	-2.828	18.426	0.08%	0.000µs	1	200
credit_card/is_card_number/37828224631	throughput	255092722.612op/s	255559266.709op/s ± 199758.310op/s	255545172.786op/s ± 97814.811op/s	255645997.108op/s	255783559.268op/s	255936645.749op/s	256913573.409op/s	0.54%	2.857	18.655	0.08%	14125.046op/s	1	200
credit_card/is_card_number/378282246310005	execution_time	68.249µs	69.004µs ± 0.368µs	68.960µs ± 0.264µs	69.266µs	69.666µs	69.981µs	70.297µs	1.94%	0.642	0.151	0.53%	0.026µs	1	200
credit_card/is_card_number/378282246310005	throughput	14225457.211op/s	14492234.719op/s ± 76996.550op/s	14501231.155op/s ± 55590.675op/s	14552479.153op/s	14595826.868op/s	14625361.435op/s	14652276.716op/s	1.04%	-0.615	0.093	0.53%	5444.478op/s	1	200
credit_card/is_card_number/37828224631000521389798	execution_time	45.463µs	45.737µs ± 0.089µs	45.732µs ± 0.060µs	45.800µs	45.885µs	45.916µs	45.958µs	0.50%	-0.087	-0.173	0.19%	0.006µs	1	200
credit_card/is_card_number/37828224631000521389798	throughput	21758774.673op/s	21864010.052op/s ± 42509.316op/s	21866635.887op/s ± 28882.104op/s	21892464.081op/s	21934248.582op/s	21959767.347op/s	21996036.897op/s	0.59%	0.098	-0.165	0.19%	3005.863op/s	1	200
credit_card/is_card_number/x371413321323331	execution_time	6.428µs	6.436µs ± 0.006µs	6.435µs ± 0.002µs	6.437µs	6.443µs	6.468µs	6.486µs	0.79%	4.718	31.638	0.09%	0.000µs	1	200
credit_card/is_card_number/x371413321323331	throughput	154179273.568op/s	155375233.839op/s ± 146704.766op/s	155390692.735op/s ± 52187.667op/s	155444865.342op/s	155513199.431op/s	155566995.203op/s	155577680.820op/s	0.12%	-4.686	31.309	0.09%	10373.593op/s	1	200
credit_card/is_card_number_no_luhn/	execution_time	3.892µs	3.912µs ± 0.003µs	3.912µs ± 0.001µs	3.913µs	3.915µs	3.917µs	3.918µs	0.15%	-3.762	22.746	0.08%	0.000µs	1	200
credit_card/is_card_number_no_luhn/	throughput	255249000.541op/s	255637453.534op/s ± 195832.371op/s	255627350.707op/s ± 84306.703op/s	255707319.624op/s	255827373.919op/s	256818394.988op/s	256957214.564op/s	0.52%	3.786	22.934	0.08%	13847.440op/s	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	61.509µs	62.702µs ± 0.627µs	62.721µs ± 0.458µs	63.065µs	63.776µs	64.054µs	64.622µs	3.03%	0.291	-0.280	1.00%	0.044µs	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	15474686.991op/s	15949975.693op/s ± 159051.654op/s	15943570.507op/s ± 117127.973op/s	16070768.502op/s	16207339.866op/s	16251889.383op/s	16257794.978op/s	1.97%	-0.243	-0.332	0.99%	11246.650op/s	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	53.861µs	54.280µs ± 0.124µs	54.305µs ± 0.071µs	54.361µs	54.432µs	54.514µs	54.532µs	0.42%	-0.997	1.291	0.23%	0.009µs	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	18337982.094op/s	18423184.818op/s ± 42319.991op/s	18414398.831op/s ± 24181.074op/s	18445654.031op/s	18499733.977op/s	18557570.903op/s	18566233.180op/s	0.82%	1.013	1.331	0.23%	2992.475op/s	1	200
credit_card/is_card_number_no_luhn/37828224631	execution_time	3.896µs	3.915µs ± 0.002µs	3.914µs ± 0.001µs	3.915µs	3.918µs	3.920µs	3.921µs	0.18%	-2.761	29.969	0.05%	0.000µs	1	200
credit_card/is_card_number_no_luhn/37828224631	throughput	255013637.990op/s	255445204.853op/s ± 136096.732op/s	255464209.468op/s ± 54101.056op/s	255511070.017op/s	255558010.391op/s	255588654.787op/s	256653941.788op/s	0.47%	2.800	30.347	0.05%	9623.492op/s	1	200
credit_card/is_card_number_no_luhn/378282246310005	execution_time	50.291µs	50.637µs ± 0.149µs	50.631µs ± 0.068µs	50.696µs	50.863µs	51.179µs	51.263µs	1.25%	1.206	3.853	0.29%	0.011µs	1	200
credit_card/is_card_number_no_luhn/378282246310005	throughput	19507437.210op/s	19748472.559op/s ± 57796.982op/s	19750673.681op/s ± 26663.389op/s	19781665.864op/s	19829195.557op/s	19872926.745op/s	19884401.330op/s	0.68%	-1.167	3.729	0.29%	4086.864op/s	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	45.492µs	45.723µs ± 0.088µs	45.722µs ± 0.058µs	45.783µs	45.864µs	45.911µs	45.935µs	0.47%	-0.083	-0.121	0.19%	0.006µs	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	21770095.662op/s	21870990.896op/s ± 42127.768op/s	21871522.187op/s ± 27892.004op/s	21898168.222op/s	21942467.580op/s	21973599.276op/s	21981732.478op/s	0.50%	0.094	-0.117	0.19%	2978.883op/s	1	200
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	6.427µs	6.436µs ± 0.004µs	6.436µs ± 0.003µs	6.438µs	6.442µs	6.444µs	6.446µs	0.17%	0.195	-0.449	0.06%	0.000µs	1	200
credit_card/is_card_number_no_luhn/x371413321323331	throughput	155129129.028op/s	155381602.507op/s ± 92669.450op/s	155387569.001op/s ± 65731.615op/s	155452842.308op/s	155525885.000op/s	155564102.250op/s	155603326.867op/s	0.14%	-0.192	-0.451	0.06%	6552.720op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
credit_card/is_card_number/	execution_time	[3.912µs; 3.913µs] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number/	throughput	[255572346.920op/s; 255615024.768op/s] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	[80.444µs; 80.714µs] or [-0.168%; +0.168%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	throughput	[12391210.214op/s; 12432695.204op/s] or [-0.167%; +0.167%]	None	None	None
credit_card/is_card_number/ 378282246310005	execution_time	[71.931µs; 72.052µs] or [-0.084%; +0.084%]	None	None	None
credit_card/is_card_number/ 378282246310005	throughput	[13879376.277op/s; 13902669.126op/s] or [-0.084%; +0.084%]	None	None	None
credit_card/is_card_number/37828224631	execution_time	[3.913µs; 3.913µs] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number/37828224631	throughput	[255531582.128op/s; 255586951.289op/s] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number/378282246310005	execution_time	[68.953µs; 69.055µs] or [-0.074%; +0.074%]	None	None	None
credit_card/is_card_number/378282246310005	throughput	[14481563.737op/s; 14502905.700op/s] or [-0.074%; +0.074%]	None	None	None
credit_card/is_card_number/37828224631000521389798	execution_time	[45.725µs; 45.750µs] or [-0.027%; +0.027%]	None	None	None
credit_card/is_card_number/37828224631000521389798	throughput	[21858118.670op/s; 21869901.435op/s] or [-0.027%; +0.027%]	None	None	None
credit_card/is_card_number/x371413321323331	execution_time	[6.435µs; 6.437µs] or [-0.013%; +0.013%]	None	None	None
credit_card/is_card_number/x371413321323331	throughput	[155354901.969op/s; 155395565.709op/s] or [-0.013%; +0.013%]	None	None	None
credit_card/is_card_number_no_luhn/	execution_time	[3.911µs; 3.912µs] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number_no_luhn/	throughput	[255610313.051op/s; 255664594.017op/s] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	[62.615µs; 62.789µs] or [-0.139%; +0.139%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	[15927932.663op/s; 15972018.722op/s] or [-0.138%; +0.138%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	[54.262µs; 54.297µs] or [-0.032%; +0.032%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	[18417319.674op/s; 18429049.962op/s] or [-0.032%; +0.032%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	execution_time	[3.914µs; 3.915µs] or [-0.007%; +0.007%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	throughput	[255426343.155op/s; 255464066.551op/s] or [-0.007%; +0.007%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	execution_time	[50.617µs; 50.658µs] or [-0.041%; +0.041%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	throughput	[19740462.453op/s; 19756482.664op/s] or [-0.041%; +0.041%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	[45.711µs; 45.735µs] or [-0.027%; +0.027%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	[21865152.393op/s; 21876829.399op/s] or [-0.027%; +0.027%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	[6.435µs; 6.436µs] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	throughput	[155368759.412op/s; 155394445.601op/s] or [-0.008%; +0.008%]	None	None	None

Group 14

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80eadd7e	1760709234	dsn/crashtracker-debug-info

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching deserializing traces from msgpack to their internal representation	execution_time	60.688ms	61.244ms ± 1.802ms	60.995ms ± 0.052ms	61.055ms	61.272ms	69.020ms	79.380ms	30.14%	8.706	77.725	2.94%	0.127ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching deserializing traces from msgpack to their internal representation	execution_time	[60.994ms; 61.493ms] or [-0.408%; +0.408%]	None	None	None

Group 15

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	80eadd7e	1760709234	dsn/crashtracker-debug-info

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
tags/replace_trace_tags	execution_time	2.322µs	2.381µs ± 0.017µs	2.380µs ± 0.006µs	2.387µs	2.417µs	2.425µs	2.429µs	2.02%	-0.387	2.634	0.73%	0.001µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
tags/replace_trace_tags	execution_time	[2.379µs; 2.384µs] or [-0.101%; +0.101%]	None	None	None

Baseline

Omitted due to size.

Oct 17 '25 12:10 pr-commenter[bot]

libdatadog libdatadog copied to clipboard

[crashtracker] Add debug info generation

What does this PR do?

Motivation

Additional Notes

How to test the change?

⚠️ Warnings

ℹ️ Info

Benchmarks

Comparison

scenario:ip_address/quantize_peer_ip_address_benchmark

scenario:redis/obfuscate_redis_string

Candidate

Group 1

Group 2

Group 3

Group 4

Group 5

Group 6

Group 7

Group 8

Group 9

Group 10

Group 11

Group 12

Group 13

Group 14

Group 15

Baseline

libdatadog
libdatadog copied to clipboard