Infrastructure: MacOS Regression Testing

Open howard-e opened this issue 10 months ago • 1 comments

Follow-up from #3115.

Ensuring that #2735 doesn't become an issue in the future, should we also include macOS in the regression testing?

WAI Preview Link (Last built on Tue, 11 Feb 2025 18:57:16 GMT).

Feb 11 '25 18:02 howard-e

The errors reflected here aren't thrown when running npm run regression locally on macOS 15:

list of regression failures running with macOS

not ok 204 - feed_feed › content/patterns/feed/examples/feed.html [data-test-id="feed-aria-busy"]: aria-busy attribute on feed element
not ok 209 - feed_feed › content/patterns/feed/examples/feed.html [data-test-id="article-role"]: role="article" exists
not ok 214 - feed_feed › content/patterns/feed/examples/feed.html [data-test-id="article-tabindex"]: tabindex="-1" on article elements
not ok 217 - feed_feed › content/patterns/feed/examples/feed.html [data-test-id="article-labelledby"]: aria-labelledby set on article elements
not ok 219 - feed_feed › content/patterns/feed/examples/feed.html [data-test-id="article-describedby"]: aria-describedby set on article elements
not ok 225 - feed_feed › content/patterns/feed/examples/feed.html [data-test-id="article-aria-posinset"]: aria-posinset on article element
not ok 229 - feed_feed › content/patterns/feed/examples/feed.html [data-test-id="article-aria-setsize"]: aria-setsize on article element
not ok 230 - feed_feed › content/patterns/feed/examples/feed.html [data-test-id="key-page-down"]: PAGE DOWN moves focus between articles
not ok 231 - feed_feed › content/patterns/feed/examples/feed.html [data-test-id="key-page-up"]: PAGE UP moves focus between articles
not ok 232 - feed_feed › content/patterns/feed/examples/feed.html [data-test-id="key-control-end"]: CONTROL+END moves focus out of feed
not ok 37 - listbox_collapsible › content/patterns/listbox/examples/listbox-collapsible.html [data-test-id="key-character"]: Character keys moves focus
not ok 97 - toolbar_toolbar › content/patterns/toolbar/examples/toolbar.html [data-test-id="toolbar-menuitemradio-aria-checked"]: menuitemradio elements have aria-checked set

Feb 11 '25 18:02 howard-e