microsoft-identity-web
microsoft-identity-web copied to clipboard
UI Automation tests are unstable
Microsoft.Identity.Web Library
Microsoft.Identity.Web
Microsoft.Identity.Web version
NA
Web app
Not Applicable
Web API
Not Applicable
Token cache serialization
Not Applicable
Description
UI Automation tests fail occasionally. 2-3 times a week.
Reproduction steps
NA
Error message
Call stacks look like this:
[xUnit.net 00:00:24.99] WebAppUiTests.WebAppIntegrationTests.ChallengeUser_MicrosoftIdentityFlow_RemoteApp_ValidEmailPasswordCreds_SignInSucceedsTestAsync [SKIP] Skipped WebAppUiTests.WebAppIntegrationTests.ChallengeUser_MicrosoftIdentityFlow_RemoteApp_ValidEmailPasswordCreds_SignInSucceedsTestAsync [1 ms] [xUnit.net 00:00:32.98] WebAppUiTests.B2CWebAppCallsWebApiLocally.Susi_B2C_LocalAccount_TodoAppFucntionsCorrectly [FAIL] Failed WebAppUiTests.B2CWebAppCallsWebApiLocally.Susi_B2C_LocalAccount_TodoAppFucntionsCorrectly [7 s] Error Message: Assert.Fail(): the UI automation failed: Xunit.Sdk.FailException: Assert.Fail(): The web app process has exited prematurely. at Xunit.Assert.Fail(String message) in //src/xunit.assert/Asserts/FailAsserts.cs:line 28 at WebAppUiTests.B2CWebAppCallsWebApiLocally.Susi_B2C_LocalAccount_TodoAppFucntionsCorrectly() in //tests/IntegrationTests/WebAppUiTests/B2CWebAppCallsWebApiLocally.cs:line 84 output: Assert.Fail(): The web app process has exited prematurely.. Stack Trace: at WebAppUiTests.B2CWebAppCallsWebApiLocally.Susi_B2C_LocalAccount_TodoAppFucntionsCorrectly() in //tests/IntegrationTests/WebAppUiTests/B2CWebAppCallsWebApiLocally.cs:line 147 at WebAppUiTests.B2CWebAppCallsWebApiLocally.Susi_B2C_LocalAccount_TodoAppFucntionsCorrectly() in //tests/IntegrationTests/WebAppUiTests/B2CWebAppCallsWebApiLocally.cs:line 165
Id Web logs
No response
Relevant code snippets
NA
Regression
No response
Expected behavior
Build pipelines should be stable.
related: #2722