Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SdcaLogisticRegression failing with LogLoss value above 0.5 on Apple M1 #7343

Open
ericstj opened this issue Dec 16, 2024 · 0 comments
Open
Assignees
Labels
blocking-clean-ci Blocking PR or rolling builds Known Build Error Use this to report build issues in the .NET Helix tab untriaged New issue has not been triaged

Comments

@ericstj
Copy link
Member

ericstj commented Dec 16, 2024

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=894906
Build error leg or test failing: Microsoft.ML.Tests.TrainerEstimators.TrainerEstimators.SdcaLogisticRegression
Pull request: #7319

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": [ "Microsoft.ML.Tests.TrainerEstimators.TrainerEstimators.SdcaLogisticRegression", "Assert.InRange() Failure: Value not in range",  "Range:  (0 - 0.5)" ],
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}
Exception Message
Assert.InRange() Failure: Value not in range
Range:  (0 - 0.5)
Actual: 0.52012587333147553
CallStack
   at Microsoft.ML.Tests.TrainerEstimators.TrainerEstimators.SdcaLogisticRegression() in /Users/runner/work/1/s/test/Microsoft.ML.Tests/TrainerEstimators/SdcaTests.cs:line 86
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

Some sample logs from recent builds:
https://helixr1107v0xdeko0k025g8.blob.core.windows.net/dotnet-machinelearning-refs-pull-7319-merge-3b48a7c42a8e4e058e/Microsoft.ML.Tests/1/console.d0d11103.log?helixlogtype=result
https://helixr1107v0xdeko0k025g8.blob.core.windows.net/dotnet-machinelearning-refs-pull-7266-merge-e87e490f2d114e22b3/Microsoft.ML.Tests/1/console.41404a72.log

I wonder if we have a math problem here worth investigating or if we should just increase the threshold?

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=894906
Error message validated: [Microsoft.ML.Tests.TrainerEstimators.TrainerEstimators.SdcaLogisticRegression Assert.InRange() Failure: Value not in range Range: (0 - 0.5)]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 12/16/2024 11:26:11 PM UTC

Report

Build Definition Test Pull Request
901744 dotnet/machinelearning Microsoft.ML.Tests.TrainerEstimators.TrainerEstimators.SdcaLogisticRegression #7351
901263 dotnet/machinelearning Microsoft.ML.Tests.TrainerEstimators.TrainerEstimators.SdcaLogisticRegression #7349
898107 dotnet/machinelearning Microsoft.ML.Tests.TrainerEstimators.TrainerEstimators.SdcaLogisticRegression #7340
896796 dotnet/machinelearning Microsoft.ML.Tests.TrainerEstimators.TrainerEstimators.SdcaLogisticRegression #7266
894906 dotnet/machinelearning Microsoft.ML.Tests.TrainerEstimators.TrainerEstimators.SdcaLogisticRegression #7319

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 3 5
@ericstj ericstj added blocking-clean-ci Blocking PR or rolling builds Known Build Error Use this to report build issues in the .NET Helix tab labels Dec 16, 2024
@dotnet-policy-service dotnet-policy-service bot added the untriaged New issue has not been triaged label Dec 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
blocking-clean-ci Blocking PR or rolling builds Known Build Error Use this to report build issues in the .NET Helix tab untriaged New issue has not been triaged
Projects
None yet
Development

No branches or pull requests

2 participants