playwright icon indicating copy to clipboard operation
playwright copied to clipboard

test(mcp): eval for generator agent

Open dgozman opened this issue 1 month ago • 4 comments

dgozman avatar Nov 26 '25 11:11 dgozman

Test results for "MCP"

4 failed :x: [webkit] › mcp/launch.spec.ts:80 › persistent context @mcp-ubuntu-latest :x: [eval] › mcp/generator.eval.ts:25 › generate order-two-items @mcp-windows-latest :x: [eval] › mcp/generator.eval.ts:25 › generate order-two-items @mcp-windows-latest :x: [eval] › mcp/generator.eval.ts:25 › generate order-two-items @mcp-windows-latest

2615 passed, 116 skipped


Merge workflow run.

github-actions[bot] avatar Nov 26 '25 11:11 github-actions[bot]

Test results for "tests 1"

9 flaky :warning: [chromium-library] › library/popup.spec.ts:258 › should not throw when click closes popup `@chromium-ubuntu-22.04-node20`
:warning: [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-ubuntu-22.04-node18`
:warning: [firefox-page] › page/page-event-request.spec.ts:182 › should return response body when Cross-Origin-Opener-Policy is set `@firefox-ubuntu-22.04-node18`
:warning: [firefox-page] › page/page-goto.spec.ts:83 › should work with Cross-Origin-Opener-Policy `@firefox-ubuntu-22.04-node18`
:warning: [chromium-library] › library/popup.spec.ts:258 › should not throw when click closes popup `@ubuntu-22.04-chromium-tip-of-tree`
:warning: [webkit-library] › library/browsercontext-cookies-third-party.spec.ts:157 › third party non-partitioned cookies `@webkit-ubuntu-22.04-node18`
:warning: [webkit-library] › library/inspector/pause.spec.ts:459 › pause › should highlight on explore (csharp) `@webkit-ubuntu-22.04-node18`
:warning: [webkit-library] › library/video.spec.ts:378 › screencast › should capture navigation `@webkit-ubuntu-22.04-node18`
:warning: [webkit-page] › page/page-set-input-files.spec.ts:130 › should upload a file after popup `@webkit-ubuntu-22.04-node18`

40308 passed, 787 skipped


Merge workflow run.

github-actions[bot] avatar Nov 26 '25 12:11 github-actions[bot]

Test results for "MCP"

5 failed :x: [chrome] › mcp/autowait.spec.ts:19 › racy navigation destroys context @mcp-ubuntu-latest :x: [chrome] › mcp/autowait.spec.ts:19 › racy navigation destroys context @mcp-windows-latest :x: [eval] › mcp/generator.eval.ts:25 › generate order-two-items @mcp-windows-latest :x: [eval] › mcp/generator.eval.ts:25 › generate order-two-items @mcp-windows-latest :x: [eval] › mcp/generator.eval.ts:25 › generate order-two-items @mcp-windows-latest

2614 passed, 116 skipped


Merge workflow run.

github-actions[bot] avatar Nov 26 '25 13:11 github-actions[bot]

Test results for "tests 1"

12 flaky :warning: [firefox-library] › library/inspector/cli-codegen-1.spec.ts:1079 › cli codegen › should not throw csp directive violation errors `@firefox-ubuntu-22.04-node18`
:warning: [playwright-test] › runner.spec.ts:124 › should ignore subprocess creation error because of SIGINT `@macos-latest-node18-2`
:warning: [playwright-test] › ui-mode-trace.spec.ts:154 › should show snapshots for steps `@macos-latest-node18-2`
:warning: [playwright-test] › ui-mode-trace.spec.ts:659 › should indicate current test status `@macos-latest-node18-2`
:warning: [webkit-library] › library/browsercontext-cookies-third-party.spec.ts:161 › save/load third party non-partitioned cookies `@webkit-ubuntu-22.04-node18`
:warning: [webkit-library] › library/browsercontext-har.spec.ts:208 › should goForward to redirected navigation `@webkit-ubuntu-22.04-node18`
:warning: [webkit-library] › library/browsercontext-reuse.spec.ts:334 › reuse launch › should continue issuing events after closing the reused page `@webkit-ubuntu-22.04-node18`
:warning: [webkit-library] › library/browsercontext-reuse.spec.ts:334 › reuse connect › should continue issuing events after closing the reused page `@webkit-ubuntu-22.04-node18`
:warning: [webkit-library] › library/trace-viewer.spec.ts:283 › should render network bars `@webkit-ubuntu-22.04-node18`
:warning: [webkit-page] › page/page-filechooser.spec.ts:24 › should upload multiple large files `@webkit-ubuntu-22.04-node18`
:warning: [webkit-page] › page/page-set-input-files.spec.ts:146 › should upload large file `@webkit-ubuntu-22.04-node18`
:warning: [playwright-test] › ui-mode-test-progress.spec.ts:165 › should update tracing network live `@windows-latest-node18-2`

40305 passed, 787 skipped


Merge workflow run.

github-actions[bot] avatar Nov 26 '25 14:11 github-actions[bot]