runtime
runtime copied to clipboard
dotnet
[wasm][firefox] crit: OpenQA.Selenium.WebDriverException: Failed to decode response from marionette
Build Information
Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=656594 Build error leg or test failing: WasmTestOnFirefox-ST-System.Runtime.Tests.WorkItemExecution Pull request: https://github.com/dotnet/runtime/pull/101538
Error Message
Fill the error message using step by step known issues guidance.
{
"ErrorMessage": "crit: OpenQA.Selenium.WebDriverException: Failed to decode response from marionette",
"ErrorPattern": "",
"BuildRetry": false,
"ExcludeConsoleLog": false
}
Known issue validation
Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=656594
Error message validated: [crit: OpenQA.Selenium.WebDriverException: Failed to decode response from marionette]
Result validation: :white_check_mark: Known issue matched with the provided build.
Validation performed at: 4/26/2024 5:46:49 PM UTC
Report
Summary
| 24-Hour Hit Count | 7-Day Hit Count | 1-Month Count |
|---|---|---|
| 0 | 0 | 181 |
Tagging subscribers to this area: @dotnet/area-infrastructure-libraries See info in area-owners.md if you want to be subscribed.
![dotnet-policy-service[bot] avatar](https://avatars.githubusercontent.com/in/285228?v=4 "Published by a pub.dev verified publisher"){kind=small}
Tagging subscribers to this area: @directhex See info in area-owners.md if you want to be subscribed.
test is now disabled, failures should stop rolling in soon
| 24-Hour Hit Count | 7-Day Hit Count | 1-Month Count |
|---|---|---|
| 24 | 175 | 175 |
This has some hints https://stackoverflow.com/questions/49734915/failed-to-decode-response-from-marionette-message-in-python-firefox-headless-s
- docker memory need be at least 2gb
- or there are firefox zombies from previous run
note from @akoeplinger
https://github.com/dotnet/aspnetcore/blob/98c6c2917fc7e2c38d18862b31430dc5718d44b7/src/Components/benchmarkapps/Wasm.Performance/Driver/Selenium.cs#L72-L74
https://stackoverflow.com/questions/55656748/running-firefox-in-headless-mode-on-windows-container-with-windows-servercore
Yeah looks like we'd need a way to specify either --shm-size or mount the host's /dev/shm as a volume into the container.
Here's where we run docker in helix: https://dev.azure.com/dnceng/internal/_git/dotnet-helix-machines?path=/resources/helix-scripts/helix/dockerhelper.py&version=GBmain&line=162&lineEnd=177&lineStartColumn=1&lineEndColumn=1&lineStyle=plain&_a=contents
All LibraryTests_HybridGlobalization on firefox fail because of it.
Yeah looks like we'd need a way to specify either --shm-size.
The link you pasted gives the answer, docker's client run function has shm_size parameter. I can make this change if it would be an accepted solution.
https://docker-py.readthedocs.io/en/stable/containers.html?highlight=shm_size#docker.models.containers.ContainerCollection.run
edit: by default it's 64MB.
Yeah I think adding the parameter with e.g. 2g is the best option we have. You'll need to send a PR to the dotnet-helix-machines repo I linked above and wait for dnceng to get it rolled out.
https://dev.azure.com/dnceng/internal/_git/dotnet-helix-machines/pullrequest/40290
It is not caught because runtime-wasm is excluded from Build Analysis step and the failures happen on runtime-wasm (Build browser-wasm windows Release LibraryTests_HybridGlobalization) e.g. log
Console log: 'WasmTestOnFirefox-ST-Common.Tests' from job 1443fe94-33bc-46e6-bbf7-575bc33b2e86 (windows.amd64.server2022.open.rt) using docker image mcr.microsoft.com/dotnet-buildtools/prereqs:windowsservercore-ltsc2022-helix-webassembly on a002B1J
running %HELIX_CORRELATION_PAYLOAD%\scripts\1a81aacd35e2468bb85a763d39aec6a5\execute.cmd in C:\h\w\ABFC097D\w\B776098D\e max 1800 seconds
....
JavaScript error: resource://gre/modules/WindowsLaunchOnLogin.sys.mjs, line 28: NS_ERROR_FAILURE: Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIWindowsRegKey.open]
JavaScript error: resource://gre/modules/WindowsLaunchOnLogin.sys.mjs, line 28: NS_ERROR_FAILURE: Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIWindowsRegKey.open]
[18:52:33] crit: OpenQA.Selenium.WebDriverException: Failed to decode response from marionette
at OpenQA.Selenium.Remote.RemoteWebDriver.UnpackAndThrowOnError(Response errorResponse)
at OpenQA.Selenium.Remote.RemoteWebDriver.Execute(String driverCommandToExecute, Dictionary`2 parameters)
at OpenQA.Selenium.Remote.RemoteWebDriver.StartSession(ICapabilities desiredCapabilities)
at OpenQA.Selenium.Remote.RemoteWebDriver..ctor(ICommandExecutor commandExecutor, ICapabilities desiredCapabilities)
at OpenQA.Selenium.Firefox.FirefoxDriver..ctor(FirefoxDriverService service, FirefoxOptions options, TimeSpan commandTimeout)
at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestBrowserCommand.<>c__DisplayClass13_0.<GetFirefoxDriver>b__1(FirefoxDriverService driverService) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/Browser/WasmTestBrowserCommand.cs:line 146
at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestBrowserCommand.CreateWebDriver[TDriverService](Func`1 getDriverService, Func`2 getDriver) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/Browser/WasmTestBrowserCommand.cs:line 308
at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestBrowserCommand.CreateWebDriver[TDriverService](Func`1 getDriverService, Func`2 getDriver) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/Browser/WasmTestBrowserCommand.cs:line 313
at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestBrowserCommand.GetFirefoxDriver(ILogger logger) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/Browser/WasmTestBrowserCommand.cs:line 144
at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestBrowserCommand.InvokeInternal(ILogger logger) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/Browser/WasmTestBrowserCommand.cs:line 72
at Microsoft.DotNet.XHarness.CLI.Commands.XHarnessCommand`1.Invoke(IEnumerable`1 arguments) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/XHarnessCommand.cs:line 145
XHarness exit code: 71 (GENERAL_FAILURE)
Waiting for the results of tests after the changes get propagated: https://github.com/dotnet/runtime/pull/104017