Test failure: Microsoft.Extensions.Configuration.EnvironmentVariables.Test.EnvironmentVariablesTest.BindingDoesNotThrowIfReloadedDuringBinding

[v-wenyuxu]

Failed in: runtime-coreclr libraries-pgo 20241117.1

Failed tests:

net10.0-windows-Release-x64-fullpgo_random_gdv_methodprofiling_only-Windows.10.Amd64.Open
    - Microsoft.Extensions.Configuration.EnvironmentVariables.Test.EnvironmentVariablesTest.BindingDoesNotThrowIfReloadedDuringBinding

Error message:

 System.NullReferenceException : Object reference not set to an instance of an object.

Stack trace:

   at Microsoft.Extensions.Configuration.EnvironmentVariables.Test.EnvironmentVariablesTest.BindingDoesNotThrowIfReloadedDuringBinding() in /_/src/libraries/Microsoft.Extensions.Configuration.EnvironmentVariables/tests/EnvironmentVariablesTest.cs:line 319
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args) in /_/src/coreclr/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.CoreCLR.cs:line 36
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr) in /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.cs:line 57

Known Issue Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": [ "Microsoft.Extensions.Configuration.EnvironmentVariables.Test.EnvironmentVariablesTest.BindingDoesNotThrowIfReloadedDuringBinding [FAIL]", "System.NullReferenceException : Object reference not set to an instance of an object."],
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: :mag_right: Result validation: :warning: Provided build not found. Provide a valid build in the "Build: :mag_right:" line. Validation performed at: 3/26/2025 2:50:26 AM UTC

Report

Build	Definition	Test	Pull Request
1066813	dotnet/runtime	Microsoft.Extensions.Configuration.EnvironmentVariables.Test.EnvironmentVariablesTest.BindingDoesNotThrowIfReloadedDuringBinding	dotnet/runtime#116563
1050390	dotnet/runtime	Microsoft.Extensions.Configuration.EnvironmentVariables.Test.EnvironmentVariablesTest.BindingDoesNotThrowIfReloadedDuringBinding	dotnet/runtime#115658

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	1	2

[amanasifkhalid]

cc @dotnet/jit-contrib, might be bad codegen

[dotnet-policy-service[bot]]

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch See info in area-owners.md if you want to be subscribed.

[amanasifkhalid]

This test has been passing in runtime-coreclr libraries-pgo for a few weeks now.

[jkotas]

This failed again in #113872 on net10.0-windows-Debug-x86-coreclr_checked-Windows.10.Amd64.Open (without any jit stress, etc.):

  Starting:    Microsoft.Extensions.Configuration.EnvironmentVariables.Tests (parallel test collections = on [4 threads], stop on fail = off)
    Microsoft.Extensions.Configuration.EnvironmentVariables.Test.EnvironmentVariablesTest.BindingDoesNotThrowIfReloadedDuringBinding [FAIL]
      System.NullReferenceException : Object reference not set to an instance of an object.
      Stack Trace:
        /_/src/libraries/Microsoft.Extensions.Configuration.EnvironmentVariables/tests/EnvironmentVariablesTest.cs(319,0): at Microsoft.Extensions.Configuration.EnvironmentVariables.Test.EnvironmentVariablesTest.BindingDoesNotThrowIfReloadedDuringBinding()
           at System.RuntimeMethodHandle.InvokeMethod(ObjectHandleOnStack target, Void** arguments, ObjectHandleOnStack sig, BOOL isConstructor, ObjectHandleOnStack result)
        /_/src/coreclr/System.Private.CoreLib/src/System/RuntimeHandles.cs(1159,0): at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
        /_/src/coreclr/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.CoreCLR.cs(36,0): at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
        /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.cs(57,0): at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
  Finished:    Microsoft.Extensions.Configuration.EnvironmentVariables.Tests

[kunalspathak]

Failed again on 6/15

https://helixr1107v0xdcypoyl9e7f.blob.core.windows.net/dotnet-runtime-refs-heads-main-2edd797575674d92af/Microsoft.Extensions.Configuration.EnvironmentVariables.Tests/1/console.c6c8c18c.log?helixlogtype=result

[JulieLeeMSFT]

Failed again on 09/21/25. runtime-coreclr libraries-pgo/20250921.1

net10.0-windows-Release-x86-fullpgo_random_gdv_methodprofiling_only-Windows.10.Amd64.Open
- Microsoft.Extensions.Configuration.EnvironmentVariables.Test.EnvironmentVariablesTest.BindingDoesNotThrowIfReloadedDuringBinding

[xtqqczze]

Failed again at 2025-09-29 15:13:17.844Z.

https://helix.dot.net/api/2019-06-17/jobs/d0ce49a2-188d-4e74-a1e8-348a58249f61/workitems/Microsoft.Extensions.Configuration.EnvironmentVariables.Tests/console

Microsoft.Extensions.Configuration.EnvironmentVariables.Test.EnvironmentVariablesTest.BindingDoesNotThrowIfReloadedDuringBinding [FAIL]
System.NullReferenceException : Object reference not set to an instance of an object.