dd-trace-dotnet [FFE] Feature Flags SDK

Summary of changes

Add support for Feature Flag configuration frameworks

Reason for change

Spec document can be found here

Implementation details

Retrieved FF config from backend through Remote Config. Enable SDK functions. Supplied OpenFeature provider implementation

Test coverage

Added unit and integration tests

Other details

Dec 03 '25 12:12 daniel-romano-DD

Benchmarks

Benchmark execution time: 2025-12-24 12:41:45

Comparing candidate commit 58f1c811 in PR branch dani/apm/feature_flags with baseline commit 1d8371f0 in branch master.

Found 4 performance improvements and 6 performance regressions! Performance is the same for 160 metrics, 16 unstable metrics.

scenario:Benchmarks.Trace.ActivityBenchmark.StartStopWithChild net6.0

🟩 throughput [+5276.786op/s; +8243.684op/s] or [+5.887%; +9.197%]

scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces netcoreapp3.1

🟥 execution_time [+90.625ms; +90.844ms] or [+82.705%; +82.905%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs netcoreapp3.1

🟩 execution_time [-19.041ms; -18.442ms] or [-9.510%; -9.211%]

scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmark netcoreapp3.1

🟥 throughput [-330.184op/s; -136.971op/s] or [-14.518%; -6.023%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net472

🟥 execution_time [+43.803ms; +48.954ms] or [+22.290%; +24.911%]
🟥 throughput [-97.934op/s; -73.504op/s] or [-8.591%; -6.448%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces netcoreapp3.1

🟩 execution_time [-61.477ms; -56.979ms] or [-30.310%; -28.093%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch netcoreapp3.1

🟩 execution_time [-17.438ms; -13.305ms] or [-8.202%; -6.258%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark netcoreapp3.1

🟥 throughput [-439.319op/s; -222.370op/s] or [-20.194%; -10.222%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishTwoScopes net6.0

🟥 execution_time [+11.663ms; +15.586ms] or [+5.863%; +7.835%]

Dec 03 '25 13:12 pr-commenter[bot]

✅ Tests

🎉 All green!

❄️ No new flaky tests detected
🧪 All tests passed

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 3ea365f | Docs | Datadog PR Page | Was this helpful? Give us feedback!}

Dec 15 '25 13:12 datadog-official[bot]

Execution-Time Benchmarks Report :stopwatch:

Execution-time results for samples comparing This PR (7896) and master.

✅ No regressions detected - check the details below

Full Metrics Comparison

FakeDbCommand

Metric	Master (Mean ± 95% CI)	Current (Mean ± 95% CI)	Change	Status
.NET Framework 4.8 - Baseline
duration	68.23 ± (68.20 - 68.44) ms	68.40 ± (68.38 - 68.56) ms	+0.3%	✅⬆️
.NET Framework 4.8 - Bailout
duration	72.38 ± (72.26 - 72.54) ms	72.18 ± (72.09 - 72.27) ms	-0.3%	✅
.NET Framework 4.8 - CallTarget+Inlining+NGEN
duration	1001.64 ± (1003.93 - 1009.10) ms	1001.42 ± (1002.96 - 1008.60) ms	-0.0%	✅
.NET Core 3.1 - Baseline
process.internal_duration_ms	22.01 ± (21.97 - 22.04) ms	22.08 ± (22.04 - 22.12) ms	+0.3%	✅⬆️
process.time_to_main_ms	78.84 ± (78.70 - 78.97) ms	78.92 ± (78.75 - 79.09) ms	+0.1%	✅⬆️
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	10.93 ± (10.92 - 10.93) MB	10.94 ± (10.94 - 10.95) MB	+0.2%	✅⬆️
runtime.dotnet.threads.count	12 ± (12 - 12)	12 ± (12 - 12)	+0.0%	✅
.NET Core 3.1 - Bailout
process.internal_duration_ms	21.93 ± (21.90 - 21.95) ms	21.82 ± (21.80 - 21.84) ms	-0.5%	✅
process.time_to_main_ms	79.91 ± (79.81 - 80.00) ms	79.80 ± (79.72 - 79.89) ms	-0.1%	✅
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	10.95 ± (10.95 - 10.96) MB	10.96 ± (10.96 - 10.96) MB	+0.1%	✅⬆️
runtime.dotnet.threads.count	13 ± (13 - 13)	13 ± (13 - 13)	+0.0%	✅
.NET Core 3.1 - CallTarget+Inlining+NGEN
process.internal_duration_ms	210.26 ± (208.77 - 211.74) ms	211.83 ± (209.99 - 213.67) ms	+0.7%	✅⬆️
process.time_to_main_ms	472.69 ± (471.84 - 473.54) ms	472.55 ± (472.03 - 473.08) ms	-0.0%	✅
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	48.12 ± (48.10 - 48.14) MB	48.14 ± (48.12 - 48.16) MB	+0.1%	✅⬆️
runtime.dotnet.threads.count	28 ± (28 - 28)	28 ± (28 - 28)	+0.0%	✅
.NET 6 - Baseline
process.internal_duration_ms	20.61 ± (20.59 - 20.63) ms	20.63 ± (20.60 - 20.65) ms	+0.1%	✅⬆️
process.time_to_main_ms	68.15 ± (68.03 - 68.28) ms	68.13 ± (68.03 - 68.23) ms	-0.0%	✅
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	10.60 ± (10.60 - 10.61) MB	10.64 ± (10.64 - 10.65) MB	+0.4%	✅⬆️
runtime.dotnet.threads.count	10 ± (10 - 10)	10 ± (10 - 10)	+0.0%	✅
.NET 6 - Bailout
process.internal_duration_ms	20.54 ± (20.51 - 20.57) ms	20.54 ± (20.51 - 20.56) ms	-0.0%	✅
process.time_to_main_ms	69.03 ± (68.95 - 69.10) ms	69.04 ± (68.98 - 69.10) ms	+0.0%	✅⬆️
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	10.74 ± (10.73 - 10.74) MB	10.69 ± (10.68 - 10.69) MB	-0.4%	✅
runtime.dotnet.threads.count	11 ± (11 - 11)	11 ± (11 - 11)	+0.0%	✅
.NET 6 - CallTarget+Inlining+NGEN
process.internal_duration_ms	200.40 ± (199.26 - 201.55) ms	199.65 ± (198.60 - 200.71) ms	-0.4%	✅
process.time_to_main_ms	441.40 ± (440.82 - 441.98) ms	439.38 ± (438.78 - 439.98) ms	-0.5%	✅
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	48.28 ± (48.21 - 48.35) MB	48.27 ± (48.21 - 48.34) MB	-0.0%	✅
runtime.dotnet.threads.count	28 ± (28 - 28)	28 ± (28 - 28)	+0.0%	✅⬆️
.NET 8 - Baseline
process.internal_duration_ms	18.82 ± (18.79 - 18.84) ms	18.87 ± (18.85 - 18.90) ms	+0.3%	✅⬆️
process.time_to_main_ms	67.26 ± (67.15 - 67.37) ms	67.23 ± (67.13 - 67.32) ms	-0.1%	✅
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	7.66 ± (7.66 - 7.67) MB	7.68 ± (7.68 - 7.69) MB	+0.3%	✅⬆️
runtime.dotnet.threads.count	10 ± (10 - 10)	10 ± (10 - 10)	+0.0%	✅
.NET 8 - Bailout
process.internal_duration_ms	18.84 ± (18.82 - 18.87) ms	18.81 ± (18.78 - 18.83) ms	-0.2%	✅
process.time_to_main_ms	68.39 ± (68.34 - 68.44) ms	68.28 ± (68.22 - 68.33) ms	-0.2%	✅
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	7.71 ± (7.71 - 7.72) MB	7.75 ± (7.74 - 7.76) MB	+0.5%	✅⬆️
runtime.dotnet.threads.count	11 ± (11 - 11)	11 ± (11 - 11)	+0.0%	✅
.NET 8 - CallTarget+Inlining+NGEN
process.internal_duration_ms	178.62 ± (177.79 - 179.46) ms	179.32 ± (178.50 - 180.14) ms	+0.4%	✅⬆️
process.time_to_main_ms	423.38 ± (422.92 - 423.84) ms	426.02 ± (425.48 - 426.56) ms	+0.6%	✅⬆️
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	36.24 ± (36.21 - 36.27) MB	36.38 ± (36.35 - 36.41) MB	+0.4%	✅⬆️
runtime.dotnet.threads.count	27 ± (27 - 27)	27 ± (27 - 27)	+0.4%	✅⬆️

HttpMessageHandler

Metric	Master (Mean ± 95% CI)	Current (Mean ± 95% CI)	Change	Status
.NET Framework 4.8 - Baseline
duration	193.97 ± (193.77 - 194.66) ms	192.80 ± (192.60 - 193.48) ms	-0.6%	✅
.NET Framework 4.8 - Bailout
duration	197.04 ± (196.97 - 197.62) ms	197.30 ± (197.04 - 197.72) ms	+0.1%	✅⬆️
.NET Framework 4.8 - CallTarget+Inlining+NGEN
duration	1106.81 ± (1106.01 - 1111.40) ms	1114.38 ± (1116.91 - 1126.32) ms	+0.7%	✅⬆️
.NET Core 3.1 - Baseline
process.internal_duration_ms	188.04 ± (187.65 - 188.42) ms	187.72 ± (187.36 - 188.09) ms	-0.2%	✅
process.time_to_main_ms	81.11 ± (80.85 - 81.36) ms	80.67 ± (80.42 - 80.92) ms	-0.5%	✅
runtime.dotnet.exceptions.count	3 ± (3 - 3)	3 ± (3 - 3)	+0.0%	✅
runtime.dotnet.mem.committed	16.08 ± (16.05 - 16.11) MB	16.13 ± (16.10 - 16.16) MB	+0.3%	✅⬆️
runtime.dotnet.threads.count	20 ± (20 - 20)	20 ± (20 - 20)	+0.8%	✅⬆️
.NET Core 3.1 - Bailout
process.internal_duration_ms	187.40 ± (187.11 - 187.69) ms	187.66 ± (187.37 - 187.96) ms	+0.1%	✅⬆️
process.time_to_main_ms	82.00 ± (81.86 - 82.13) ms	81.84 ± (81.71 - 81.97) ms	-0.2%	✅
runtime.dotnet.exceptions.count	3 ± (3 - 3)	3 ± (3 - 3)	+0.0%	✅
runtime.dotnet.mem.committed	16.14 ± (16.11 - 16.17) MB	16.21 ± (16.18 - 16.24) MB	+0.4%	✅⬆️
runtime.dotnet.threads.count	21 ± (21 - 21)	21 ± (21 - 21)	-0.2%	✅
.NET Core 3.1 - CallTarget+Inlining+NGEN
process.internal_duration_ms	397.00 ± (394.20 - 399.81) ms	396.53 ± (393.85 - 399.21) ms	-0.1%	✅
process.time_to_main_ms	474.64 ± (473.98 - 475.30) ms	473.73 ± (473.03 - 474.43) ms	-0.2%	✅
runtime.dotnet.exceptions.count	3 ± (3 - 3)	3 ± (3 - 3)	+0.0%	✅
runtime.dotnet.mem.committed	58.42 ± (58.27 - 58.57) MB	58.55 ± (58.41 - 58.70) MB	+0.2%	✅⬆️
runtime.dotnet.threads.count	29 ± (29 - 29)	29 ± (29 - 30)	+0.1%	✅⬆️
.NET 6 - Baseline
process.internal_duration_ms	192.23 ± (191.81 - 192.64) ms	195.40 ± (195.00 - 195.80) ms	+1.7%	✅⬆️
process.time_to_main_ms	70.05 ± (69.89 - 70.21) ms	70.89 ± (70.66 - 71.11) ms	+1.2%	✅⬆️
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	16.28 ± (16.20 - 16.36) MB	16.34 ± (16.31 - 16.36) MB	+0.3%	✅⬆️
runtime.dotnet.threads.count	19 ± (19 - 19)	19 ± (19 - 19)	+2.4%	✅⬆️
.NET 6 - Bailout
process.internal_duration_ms	191.51 ± (191.25 - 191.76) ms	191.96 ± (191.50 - 192.42) ms	+0.2%	✅⬆️
process.time_to_main_ms	70.91 ± (70.81 - 71.01) ms	70.94 ± (70.76 - 71.12) ms	+0.0%	✅⬆️
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	16.29 ± (16.17 - 16.41) MB	16.09 ± (15.95 - 16.23) MB	-1.2%	✅
runtime.dotnet.threads.count	20 ± (20 - 20)	20 ± (20 - 20)	+0.2%	✅⬆️
.NET 6 - CallTarget+Inlining+NGEN
process.internal_duration_ms	410.43 ± (407.86 - 413.01) ms	409.72 ± (407.10 - 412.34) ms	-0.2%	✅
process.time_to_main_ms	445.08 ± (444.50 - 445.66) ms	444.39 ± (443.79 - 444.99) ms	-0.2%	✅
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	58.99 ± (58.85 - 59.13) MB	59.15 ± (59.02 - 59.28) MB	+0.3%	✅⬆️
runtime.dotnet.threads.count	30 ± (29 - 30)	30 ± (30 - 30)	+0.2%	✅⬆️
.NET 8 - Baseline
process.internal_duration_ms	190.55 ± (190.16 - 190.94) ms	189.52 ± (189.15 - 189.90) ms	-0.5%	✅
process.time_to_main_ms	69.40 ± (69.23 - 69.56) ms	69.36 ± (69.17 - 69.56) ms	-0.1%	✅
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	11.74 ± (11.71 - 11.77) MB	11.75 ± (11.70 - 11.80) MB	+0.0%	✅⬆️
runtime.dotnet.threads.count	18 ± (18 - 18)	18 ± (18 - 18)	+0.3%	✅⬆️
.NET 8 - Bailout
process.internal_duration_ms	189.75 ± (189.53 - 189.97) ms	189.00 ± (188.73 - 189.27) ms	-0.4%	✅
process.time_to_main_ms	70.61 ± (70.51 - 70.71) ms	70.22 ± (70.11 - 70.33) ms	-0.6%	✅
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	11.87 ± (11.84 - 11.90) MB	11.82 ± (11.78 - 11.85) MB	-0.4%	✅
runtime.dotnet.threads.count	19 ± (19 - 19)	19 ± (19 - 19)	-0.4%	✅
.NET 8 - CallTarget+Inlining+NGEN
process.internal_duration_ms	364.38 ± (362.76 - 365.99) ms	364.74 ± (363.28 - 366.20) ms	+0.1%	✅⬆️
process.time_to_main_ms	426.95 ± (426.42 - 427.48) ms	427.69 ± (427.06 - 428.32) ms	+0.2%	✅⬆️
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	47.89 ± (47.85 - 47.92) MB	48.00 ± (47.96 - 48.03) MB	+0.2%	✅⬆️
runtime.dotnet.threads.count	29 ± (29 - 29)	29 ± (29 - 29)	+0.2%	✅⬆️

Comparison explanation

Execution-time benchmarks measure the whole time it takes to execute a program, and are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are highlighted in **red**. The following thresholds were used for comparing the execution times:

Welch test with statistical test for significance of 5%
Only results indicating a difference greater than 5% and 5 ms are considered.

Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.

Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).

Duration charts

FakeDbCommand (.NET Framework 4.8)

gantt
    title Execution time (ms) FakeDbCommand (.NET Framework 4.8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (7896) - mean (68ms)  : 67, 70
    master - mean (68ms)  : 67, 70

    section Bailout
    This PR (7896) - mean (72ms)  : 71, 73
    master - mean (72ms)  : 71, 74

    section CallTarget+Inlining+NGEN
    This PR (7896) - mean (1,006ms)  : 966, 1046
    master - mean (1,007ms)  : 970, 1043

FakeDbCommand (.NET Core 3.1)

gantt
    title Execution time (ms) FakeDbCommand (.NET Core 3.1)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (7896) - mean (106ms)  : 104, 109
    master - mean (106ms)  : 104, 108

    section Bailout
    This PR (7896) - mean (107ms)  : 106, 108
    master - mean (107ms)  : 106, 108

    section CallTarget+Inlining+NGEN
    This PR (7896) - mean (714ms)  : 673, 755
    master - mean (720ms)  : 668, 772

FakeDbCommand (.NET 6)

gantt
    title Execution time (ms) FakeDbCommand (.NET 6)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (7896) - mean (94ms)  : 92, 95
    master - mean (94ms)  : 91, 96

    section Bailout
    This PR (7896) - mean (94ms)  : 93, 95
    master - mean (94ms)  : 93, 96

    section CallTarget+Inlining+NGEN
    This PR (7896) - mean (666ms)  : 640, 691
    master - mean (668ms)  : 647, 690

FakeDbCommand (.NET 8)

gantt
    title Execution time (ms) FakeDbCommand (.NET 8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (7896) - mean (92ms)  : 90, 94
    master - mean (92ms)  : 90, 95

    section Bailout
    This PR (7896) - mean (93ms)  : 92, 94
    master - mean (93ms)  : 92, 95

    section CallTarget+Inlining+NGEN
    This PR (7896) - mean (634ms)  : 615, 652
    master - mean (631ms)  : 614, 647

HttpMessageHandler (.NET Framework 4.8)

gantt
    title Execution time (ms) HttpMessageHandler (.NET Framework 4.8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (7896) - mean (193ms)  : 189, 197
    master - mean (194ms)  : 190, 199

    section Bailout
    This PR (7896) - mean (197ms)  : 194, 201
    master - mean (197ms)  : 194, 200

    section CallTarget+Inlining+NGEN
    This PR (7896) - mean (1,122ms)  : 1053, 1190
    master - mean (1,109ms)  : 1070, 1147

HttpMessageHandler (.NET Core 3.1)

gantt
    title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (7896) - mean (277ms)  : 272, 282
    master - mean (278ms)  : 272, 284

    section Bailout
    This PR (7896) - mean (278ms)  : 273, 282
    master - mean (278ms)  : 274, 281

    section CallTarget+Inlining+NGEN
    This PR (7896) - mean (901ms)  : 856, 947
    master - mean (912ms)  : 869, 956

HttpMessageHandler (.NET 6)

gantt
    title Execution time (ms) HttpMessageHandler (.NET 6)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (7896) - mean (274ms)  : 268, 281
    master - mean (271ms)  : 266, 276

    section Bailout
    This PR (7896) - mean (271ms)  : 265, 277
    master - mean (270ms)  : 267, 273

    section CallTarget+Inlining+NGEN
    This PR (7896) - mean (884ms)  : 843, 925
    master - mean (891ms)  : 844, 938

HttpMessageHandler (.NET 8)

gantt
    title Execution time (ms) HttpMessageHandler (.NET 8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (7896) - mean (269ms)  : 262, 275
    master - mean (270ms)  : 265, 275

    section Bailout
    This PR (7896) - mean (268ms)  : 265, 272
    master - mean (270ms)  : 267, 272

    section CallTarget+Inlining+NGEN
    This PR (7896) - mean (824ms)  : 803, 845
    master - mean (822ms)  : 801, 843

Dec 15 '25 13:12 dd-trace-dotnet-ci-bot[bot]

@codex review

Dec 18 '25 11:12 daniel-romano-DD