runtime icon indicating copy to clipboard operation
runtime copied to clipboard

Test failure in System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues

Open JulieLeeMSFT opened this issue 1 year ago • 12 comments
trafficstars

Failed in runtime-coreclr libraries-jitstress2-jitstressregs

Stack Trace:
        /_/src/libraries/System.Numerics.Tensors/tests/TensorPrimitives.Generic.cs(444,0): at System.Numerics.Tensors.Tests.GenericFloatingPointNumberTensorPrimitivesTests`1.SpanDestinationFunctions_SpecialValues(SpanDestinationDelegate tensorPrimitivesMethod, Func`2 expectedMethod, Nullable`1 tolerance)
           at InvokeStub_GenericFloatingPointNumberTensorPrimitivesTests`1.SpanDestinationFunctions_SpecialValues(Object, Span`1)
           at System.Reflection.MethodBaseInvoker.InvokeWithFewArgs(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
  Finished:    System.Numerics.Tensors.Net8.Tests

Known Issue Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "GenericFloatingPointNumberTensorPrimitivesTests`1.SpanDestinationFunctions_SpecialValues",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=660140 Error message validated: [GenericFloatingPointNumberTensorPrimitivesTests1.SpanDestinationFunctions_SpecialValues`] Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 5/1/2024 3:48:58 AM UTC

Report

Build Definition Test Pull Request
673269 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102139
673259 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101938
673175 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102139
2449760 dotnet-runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues
673149 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues
673144 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102094
673122 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102103
673116 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102132
673112 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102117
2449738 dotnet-runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues
673059 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102133
673035 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102129
672997 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102132
672936 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101977
672919 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101975
672901 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102126
672831 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues
672823 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102103
672709 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102084
672661 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102115
672788 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102126
672395 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102101
672392 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102101
672246 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102104
672212 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101580
672195 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101938
672189 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101938
672168 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102059
672162 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101652
672137 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102098
672029 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102084
671966 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101994
671945 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102007
671929 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues
671855 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101580
671775 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102089
671766 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101938
671694 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#85694
671685 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101994
671671 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101950
671627 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101683
671606 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102074
671571 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101976
671557 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101295
671510 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102076
671494 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101717
671452 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101975
671428 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102024
671436 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101801
671306 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues
671274 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101938
671231 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102007
671217 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101994
671098 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101701
671020 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102062
670921 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102058
670861 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101938
670824 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101580
670810 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues
670746 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102054
670704 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#100745
670675 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102036
670627 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101938
670590 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101801
665989 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101848
670466 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101796
670463 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101976
670443 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101801
670387 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101620
670311 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#100266
670269 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102041
670263 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues
670214 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101938
670169 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#98127
670074 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101886
670041 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101994
670017 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102036
669967 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102035
669961 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102034
669779 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101886
669929 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#100823
669901 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101580
669854 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102003
669754 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#100380
669616 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#100266
669613 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102025
669596 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102024
669561 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#102021
669534 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101977
669505 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#100828
669466 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101976
669394 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101717
669355 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101977
669332 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101975
669310 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#100176
669301 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101796
669266 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101295
669225 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#100176
669202 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues
668403 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#101681
Displaying 100 of 194 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
16 139 194

JulieLeeMSFT avatar Apr 30 '24 17:04 JulieLeeMSFT

Tagging subscribers to this area: @dotnet/area-system-numerics See info in area-owners.md if you want to be subscribed.

Tagging subscribers to this area: @dotnet/area-system-numerics-tensors See info in area-owners.md if you want to be subscribed.

It looks similar to https://github.com/dotnet/runtime/issues/97297.

JulieLeeMSFT avatar Apr 30 '24 18:04 JulieLeeMSFT

Looks similar in runtime-coreclr libraries-jitstressregs

 Stack Trace:
           at InvokeStub_GenericFloatingPointNumberTensorPrimitivesTests`1.SpanDestinationFunctions_SpecialValues(Object, Span`1)
           at System.Reflection.MethodBaseInvoker.InvokeWithFewArgs(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
  Finished:    System.Numerics.Tensors.Tests

JulieLeeMSFT avatar Apr 30 '24 18:04 JulieLeeMSFT

@tannergooding, PTAL.

JulieLeeMSFT avatar Apr 30 '24 18:04 JulieLeeMSFT

I can take a look and see if I can find an initial root cause, but I expect this is likely a JIT issue and unrelated to the libraries side of things.

CC. @jeffhandley

tannergooding avatar Apr 30 '24 19:04 tannergooding

It is now failing in Runtime pipeline as well. Please see the Known issue report above.

JulieLeeMSFT avatar May 01 '24 18:05 JulieLeeMSFT

This seems to be still failing in https://github.com/dotnet/runtime/pull/101859 which included the fix made in #101800

kunalspathak avatar May 05 '24 03:05 kunalspathak

It is failing on #101767 with the fix.

jkotas avatar May 06 '24 06:05 jkotas

e.g.

    System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues(tensorPrimitivesMethod: SpanDestinationDelegate { Method = Void ReciprocalSqrtEstimate[Single](System.ReadOnlySpan`1[System.Single], System.Span`1[System.Single]), Target = null }, expectedMethod: Func`2 { Method = Single ReciprocalSqrtEstimate(Single), Target = null }, tolerance: 0.01171875) [FAIL]
      Assert.All() Failure: 256 out of 256 items in the collection did not pass.
      [0]:   Item:  1
             Error: Assert.All() Failure: 2 out of 24 items in the collection did not pass.
                    [12]: Item:  -1.40129846E-45
                          Error: Assert.Equal() Failure: Values differ
                                 Expected: -�
                                 Actual:   NaN
                    [14]: Item:  -1.17549421E-38
                          Error: Assert.Equal() Failure: Values differ
                                 Expected: -�
                                 Actual:   NaN
...

stephentoub avatar May 06 '24 13:05 stephentoub

I'm not able to reproduce the failure locally, on a machine with or without AVX512.

My best guess is that in some edge case scenario the code is calling the fallback instead of allowing the intrinsic implementation to kick in.

Changing it to be mustExpand with no managed implementation should avoid any potential for that, so that's what I'll get a fix up to do.

tannergooding avatar May 10 '24 17:05 tannergooding

Should we disable this test for now? it's been blocking clean CI for two weeks now (e.g. I've just hit it in https://github.com/dotnet/runtime/pull/102132)

EgorBo avatar May 12 '24 14:05 EgorBo

The issue is fixed with https://github.com/dotnet/runtime/pull/102098 and so disabling shouldn't be needed, just final sign-off

If, for whatever reason, the test still shows as flaky somewhere after then I think we can disable it then

tannergooding avatar May 13 '24 19:05 tannergooding