machinelearning icon indicating copy to clipboard operation
machinelearning copied to clipboard

SdcaLogisticRegression failing with LogLoss value above 0.5 on Apple M1

Open ericstj opened this issue 1 year ago • 0 comments

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=894906 Build error leg or test failing: Microsoft.ML.Tests.TrainerEstimators.TrainerEstimators.SdcaLogisticRegression Pull request: https://github.com/dotnet/machinelearning/pull/7319

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": [ "Microsoft.ML.Tests.TrainerEstimators.TrainerEstimators.SdcaLogisticRegression", "Assert.InRange() Failure: Value not in range",  "Range:  (0 - 0.5)" ],
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}
Exception Message
Assert.InRange() Failure: Value not in range
Range:  (0 - 0.5)
Actual: 0.52012587333147553
CallStack
   at Microsoft.ML.Tests.TrainerEstimators.TrainerEstimators.SdcaLogisticRegression() in /Users/runner/work/1/s/test/Microsoft.ML.Tests/TrainerEstimators/SdcaTests.cs:line 86
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

Some sample logs from recent builds: https://helixr1107v0xdeko0k025g8.blob.core.windows.net/dotnet-machinelearning-refs-pull-7319-merge-3b48a7c42a8e4e058e/Microsoft.ML.Tests/1/console.d0d11103.log?helixlogtype=result https://helixr1107v0xdeko0k025g8.blob.core.windows.net/dotnet-machinelearning-refs-pull-7266-merge-e87e490f2d114e22b3/Microsoft.ML.Tests/1/console.41404a72.log

I wonder if we have a math problem here worth investigating or if we should just increase the threshold?

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=894906 Error message validated: [Microsoft.ML.Tests.TrainerEstimators.TrainerEstimators.SdcaLogisticRegression Assert.InRange() Failure: Value not in range Range: (0 - 0.5)] Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 12/16/2024 11:26:11 PM UTC

Report

Build Definition Test Pull Request
1028527 dotnet/machinelearning Microsoft.ML.Tests.TrainerEstimators.TrainerEstimators.SdcaLogisticRegression
1028005 dotnet/machinelearning Microsoft.ML.Tests.TrainerEstimators.TrainerEstimators.SdcaLogisticRegression dotnet/machinelearning#7423
1024265 dotnet/machinelearning Microsoft.ML.Tests.TrainerEstimators.TrainerEstimators.SdcaLogisticRegression dotnet/machinelearning#7443
1019418 dotnet/machinelearning Microsoft.ML.Tests.TrainerEstimators.TrainerEstimators.SdcaLogisticRegression dotnet/machinelearning#7423

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 0 4

ericstj avatar Dec 16 '24 23:12 ericstj