aria-at-app
aria-at-app copied to clipboard
w3c
NVDA Bot fails to run Media Seek Slider v25.03.14
expand to view run details
Run & .\run-tester.ps1
& .\run-tester.ps1
shell: C:\Windows\System32\WindowsPowerShell\v1.0\powershell.EXE -command ". '{0}'"
env:
ARIA_AT_WORK_DIR: tests/seek-slider
ARIA_AT_TEST_PATTERN: {reference/**,test-*-nvda.*}
ARIA_AT_CALLBACK_URL: https://aria-at.w3.org/api/jobs/91/test/:testRowNumber
ARIA_AT_STATUS_URL: https://aria-at.w3.org/api/jobs/91
ARIA_AT_CALLBACK_HEADER: x-automation-secret:[redacted]
BROWSER: chrome
NVDA_VERSION: 2023.3
NVDA_PORTABLE_ZIP: D:\a\aria-at-gh-actions-helper\aria-at-gh-actions-helper\nvda-portable\2023.3.zip
Log folder D:\a\aria-at-gh-actions-helper\aria-at-gh-actions-helper
Starting NVDA 2023.3 - D:\a\aria-at-gh-actions-helper\aria-at-gh-actions-helper\nvda-portable\2023.3\nvda.exe
Waiting for localhost:8765 to start from NVDA
Success after 2 tries
Starting at-driver
Waiting for localhost:3031 to start from at-driver
Success (404) after 1 tries
Starting chromedriver
Waiting for localhost:4444 to start from chromedriver
Success (404) after 2 tries
Launching automation-harness host
Starting...
Reference server listening on 'http://127.0.0.1:59397/'.
Plan 'unknown' with 9 tests and 27 files read.
Reference available on 'http://127.0.0.1:59397/xdaz8m'.
AT-Driver: connect: ws://127.0.0.1:3031/command
AT-Driver: outbound: {"id":0,"method":"session.new","params":{"capabilities":{}}}
AT-Driver: inbound: {"id":0,"result":{"sessionId":"29cdf976-f69e-45ca-ba49-baa375f57b46","capabilities":{"atName":"NVDA","atVersion":"2023.3","platformName":"windows"}}}
Starting test #navForwardsToSlider 'Navigate forwards to a slider'.
Capabilities: {"atName":"NVDA","atVersion":"2023.3","browserName":"chrome","browserVersion":"134.0.6998.36","platformName":"windows"}
Starting test #navForwardsToSlider 'undefined'.
Open page: 'about:blank'.
Open page: 'http://127.0.0.1:59397/xdaz8m/reference/2021-9-21_14462/slider-seek.setFocusBeforeSlider.html'.
[Server]: Serving '/xdaz8m/reference/2021-9-21_14462/slider-seek.setFocusBeforeSlider.html'.
[Server]: Serving '/xdaz8m/reference/2021-9-21_14462/css/slider-seek.css'.
[Server]: Serving '/xdaz8m/reference/2021-9-21_14462/js/slider-seek.js'.
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"sessionid":"29cdf976-f69e-45ca-ba49-baa375f57b46","data":" Media Seek Slider Example - Google Chrome"}}
Speech event: ' Media Seek Slider Example - Google Chrome'.
[Server]: Serving '/favicon.ico'.
[Server]: Directory 'favicon.ico' not found. Current directories: xdaz8m.
AT-Driver: outbound: {"id":1,"method":"nvda:settings.setSettings","params":{"settings":[{"name":"virtualBuffers.passThroughAudioIndication","value":false}]}}
AT-Driver: inbound: {"id":1,"result":null}
AT-Driver: inbound: {"id":1,"result":null}
Press keys: 'insert + space'.
AT-Driver: outbound: {"id":2,"method":"interaction.pressKeys","params":{"keys":["",""]}}
AT-Driver: inbound: {"id":2,"result":null}
AT-Driver: inbound: {"id":2,"result":null}
AT-Driver: inbound: {"id":2,"result":null}
Press keys: 'insert + space'.
AT-Driver: outbound: {"id":3,"method":"interaction.pressKeys","params":{"keys":["",""]}}
AT-Driver: inbound: {"id":3,"result":null}
AT-Driver: inbound: {"id":3,"result":null}
AT-Driver: inbound: {"id":3,"result":null}
AT-Driver: inbound: {"id":3,"result":null}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"sessionid":"29cdf976-f69e-45ca-ba49-baa375f57b46","data":" Media Seek Slider Example"}}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"sessionid":"29cdf976-f69e-45ca-ba49-baa375f57b46","data":" Media Seek Slider Example"}}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"sessionid":"29cdf976-f69e-45ca-ba49-baa375f57b46","data":" Media Seek Slider Example"}}
Speech event: ' Media Seek Slider Example'.
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"sessionid":"29cdf976-f69e-45ca-ba49-baa375f57b46","data":" document"}}
Speech event: ' document'.
AT-Driver: outbound: {"id":4,"method":"nvda:settings.setSettings","params":{"settings":[{"name":"virtualBuffers.passThroughAudioIndication","value":true}]}}
AT-Driver: inbound: {"id":4,"result":null}
AT-Driver: inbound: {"id":4,"result":null}
Test Error Unable to apply setting. Expected: "Browse mode" Got: "Media Seek Slider Example
document"
host.js run-plan [plan-files..]
Run test plans
Positionals:
plan-files Files in a test plan [array] [default: []]
Options:
--help Show help [boolean]
--version Show version number [boolean]
--quiet Disable all logging
--debug Enable all logging
--verbose Enable a subset of logging messages
--tests-match Files matching pattern in a test plan will be tested
[string] [default: "{,**/}test*.json"]
--reference-hostname [default: "localhost"]
--plan-workingdir Directory "plan-files" are relative to [default: "."]
--web-driver-url [default: "http://localhost:4444/"]
--web-driver-browser
[choices: "chrome", "firefox", "safari"] [default: "firefox"]
--at-driver-url [default: "http://localhost:4382/"]
--callback-url URL to POST test results to as they complete
--callback-header Header to send with callback request
--show-hidden Show hidden options [boolean]
Error: Unable to apply setting. Expected: "Browse mode" Got: "Media Seek Slider Example
document"
at DriverTestRunner.pressKeysToToggleSetting (file:///D:/a/aria-at-gh-actions-helper/aria-at-gh-actions-helper/node_modules/aria-at-automation-harness/src/runner/driver-test-runner.js:85:11)
at async DriverTestRunner.ensureSettings (file:///D:/a/aria-at-gh-actions-helper/aria-at-gh-actions-helper/node_modules/aria-at-automation-harness/src/runner/driver-test-runner.js:112:15)
at async DriverTestRunner.run (file:///D:/a/aria-at-gh-actions-helper/aria-at-gh-actions-helper/node_modules/aria-at-automation-harness/src/runner/driver-test-runner.js:233:11)
at async hostMain (file:///D:/a/aria-at-gh-actions-helper/aria-at-gh-actions-helper/node_modules/aria-at-automation-harness/src/host/main.js:136:24)
Opening notepad for good luck (and screenshot purposes)
Error: Process completed with exit code 1.
Halting error message: Error: Unable to apply setting. Expected: "Browse mode" Got: "Media Seek Slider Example document"
@howard-e Did you mention something about how this is also failing in the VO bot as well? cc @jugglinmike
Did you mention something about how this is also failing in the VO bot as well?
Yep but for a separate issue. That's being discussed in https://github.com/w3c/aria-at/issues/1205.
The log on that run states "Safari Not Responding" so more appropriate being tied to https://github.com/w3c/aria-at-app/issues/1323.
expand to view VO error
Run ./run-tester.sh
./run-tester.sh
shell: /bin/bash -e {0}
env:
ARIA_AT_WORK_DIR: tests/seek-slider
ARIA_AT_CALLBACK_URL: https://aria-at.w3.org/api/jobs/9[2](https://github.com/bocoup/aria-at-gh-actions-helper/actions/runs/13923623517/job/38962443270#step:21:2)/test/:testRowNumber
ARIA_AT_STATUS_URL: https://aria-at.w[3](https://github.com/bocoup/aria-at-gh-actions-helper/actions/runs/13923623517/job/38962443270#step:21:3).org/api/jobs/92
ARIA_AT_CALLBACK_HEADER: x-automation-secret:[redacted]
BROWSER: safari
AT_DRIVER_SERVER_VERSION: ~0.0.[6](https://github.com/bocoup/aria-at-gh-actions-helper/actions/runs/13923623517/job/38962443270#step:21:6)
Starting...
Reference server listening on 'http://12[7](https://github.com/bocoup/aria-at-gh-actions-helper/actions/runs/13923623517/job/38962443270#step:21:7).0.0.1:49218'.
Plan 'unknown' with 9 tests and 27 files read.
Reference available on 'http://127.0.0.1:4921[8](https://github.com/bocoup/aria-at-gh-actions-helper/actions/runs/13923623517/job/38962443270#step:21:8)/rjsxld'.
AT-Driver: connect: ws://127.0.0.1:3031/session
AT-Driver: outbound: {"id":0,"method":"session.new","params":{"capabilities":{}}}
AT-Driver: inbound: {"id":0,"result":{"sessionId":"b6e[9](https://github.com/bocoup/aria-at-gh-actions-helper/actions/runs/13923623517/job/38962443270#step:21:9)2af0-9b09-483e-9247-cd3ca992a658","capabilities":{"atName":"VoiceOver","atVersion":"13.7.4","platformName":"macos"}}}
Starting test #navForwardsToSlider 'Navigate forwards to a slider'.
Capabilities: {"atName":"VoiceOver","atVersion":"13.7.4","browserName":"safari","browserVersion":"18.3","platformName":"macos"}
Starting test #navForwardsToSlider 'undefined'.
Open page: 'about:blank'.
Open page: 'http://127.0.0.1:49218/rjsxld/reference/2021-9-21_14462/slider-seek.setFocusBeforeSlider.html'.
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"Safari Untitled window toolbar"}}
Speech event: 'Safari Untitled window toolbar'.
[Server]: Serving '/rjsxld/reference/2021-9-21_14462/slider-seek.setFocusBeforeSlider.html'.
[Server]: Serving '/rjsxld/reference/2021-9-21_14462/css/slider-seek.css'.
[Server]: Serving '/rjsxld/reference/2021-9-21_14462/js/slider-seek.js'.
[Server]: Serving '/favicon.ico'.
[Server]: Directory 'favicon.ico' not found. Current directories: rjsxld.
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"Run Test Setup"}}
Speech event: 'Run Test Setup'.
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":" button main"}}
Speech event: ' button main'.
Press keys: 'ctrl + opt + right, ctrl + opt + right'.
AT-Driver: outbound: {"id":1,"method":"interaction.pressKeys","params":{"keys":["","",""]}}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"link"}}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"link"}}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"link"}}
Speech event: 'link'.
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":" Navigate forwards from here"}}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":" Navigate forwards from here"}}
Speech event: ' Navigate forwards from here'.
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"You are currently on a link. To click this link, press Control -Option -Space. "}}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"You are currently on a link. To click this link, press Control -Option -Space. "}}
Speech event: 'You are currently on a link. To click this link, press Control -Option -Space. '.
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"Seek"}}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"Seek"}}
Speech event: 'Seek'.
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"You are currently on a text element. "}}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"Safari is not responding"}}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"Safari is not responding"}}
Speech event: 'Safari is not responding'.
Press keys: 'left + right'.
AT-Driver: outbound: {"id":26,"method":"interaction.pressKeys","params":{"keys":["",""]}}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"Safari not responding"}}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"Safari not responding"}}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"Safari not responding"}}
Speech event: 'Safari not responding'.
AT-Driver: inbound: {"id":26,"result":{}}
AT-Driver: inbound: {"id":26,"result":{}}
Press keys: 'left + right'.
AT-Driver: outbound: {"id":27,"method":"interaction.pressKeys","params":{"keys":["",""]}}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"Safari not responding"}}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"Safari not responding"}}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"Safari not responding"}}
Speech event: 'Safari not responding'.
AT-Driver: inbound: {"id":27,"result":{}}
AT-Driver: inbound: {"id":27,"result":{}}
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"1 Minute 30 Seconds of 5 Minutes"}}
Speech event: '1 Minute 30 Seconds of 5 Minutes'.
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":" Seek"}}
Speech event: ' Seek'.
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":" slider main"}}
Speech event: ' slider main'.
AT-Driver: inbound: {"method":"interaction.capturedOutput","params":{"data":"You are currently on a slider. To start interacting with the slider, press Control -Option -Shift -Down Arrow. "}}
Speech event: 'You are currently on a slider. To start interacting with the slider, press Control -Option -Shift -Down Arrow. '.
Test Error Unable to apply setting. Expected: "quick nav off" Got: "Safari not responding
Safari not responding
1 Minute 30 Seconds of 5 Minutes
Seek
slider main
You are currently on a slider. To start interacting with the slider, press Control -Option -Shift -Down Arrow."
aria-at-harness-host run-plan [plan-files..]
Run test plans
Positionals:
plan-files Files in a test plan [array] [default: []]
Options:
--help Show help [boolean]
--version Show version number [boolean]
--quiet Disable all logging
--debug Enable all logging
--verbose Enable a subset of logging messages
--tests-match Files matching pattern in a test plan will be tested
[string] [default: "{,**/}test*.json"]
--reference-hostname [default: "localhost"]
--plan-workingdir Directory "plan-files" are relative to [default: "."]
--web-driver-url [default: "http://localhost:4444"]
--web-driver-browser
[choices: "chrome", "firefox", "safari"] [default: "firefox"]
--at-driver-url [default: "http://localhost:4382"]
--callback-url URL to POST test results to as they complete
--callback-header Header to send with callback request
--show-hidden Show hidden options [boolean]
Error: Unable to apply setting. Expected: "quick nav off" Got: "Safari not responding
Safari not responding
1 Minute 30 Seconds of 5 Minutes
Seek
slider main
You are currently on a slider. To start interacting with the slider, press Control -Option -Shift -Down Arrow."
at DriverTestRunner.pressKeysToToggleSetting (file:///Users/runner/work/aria-at-gh-actions-helper/aria-at-gh-actions-helper/node_modules/aria-at-automation-harness/src/runner/driver-test-runner.js:85:[11](https://github.com/bocoup/aria-at-gh-actions-helper/actions/runs/13923623517/job/38962443270#step:21:12))
at async DriverTestRunner.ensureSettings (file:///Users/runner/work/aria-at-gh-actions-helper/aria-at-gh-actions-helper/node_modules/aria-at-automation-harness/src/runner/driver-test-runner.js:148:[13](https://github.com/bocoup/aria-at-gh-actions-helper/actions/runs/13923623517/job/38962443270#step:21:14))
at async DriverTestRunner.run (file:///Users/runner/work/aria-at-gh-actions-helper/aria-at-gh-actions-helper/node_modules/aria-at-automation-harness/src/runner/driver-test-runner.js:233:11)
at async hostMain (file:///Users/runner/work/aria-at-gh-actions-helper/aria-at-gh-actions-helper/node_modules/aria-at-automation-harness/src/host/main.js:136:24)
Error: Process completed with exit code 1.
Hi @IsaDC , the issue is now solved. NVDA bot is now back working as expected.
