gutenberg icon indicating copy to clipboard operation
gutenberg copied to clipboard

Published 20 hours ago • verified publisher icon WordPress

[Flaky Test] should open a preview window for a new post

Open github-actions[bot] opened this issue 3 years ago • 8 comments

Flaky test detected. This is an auto-generated issue by GitHub Actions. Please do NOT edit this manually.

Test title

should open a preview window for a new post

Test path

/test/e2e/specs/editor/various/preview.spec.js

Errors

Test passed after 1 failed attempt on fix/save-focus-loss.
Test passed after 2 failed attempts on trunk.
Test passed after 1 failed attempt on mobile/issue/3055-show-disabled-block-reason.
Test passed after 1 failed attempt on try/link-control-split-url-text.
Test passed after 2 failed attempts on add/detailed-loading-performance-times.
Test passed after 2 failed attempts on fix/inlined-relative-urls.
Test passed after 2 failed attempts on update/theme-block-placeholder-content.
Test passed after 2 failed attempts on add/template-details-for-template-part.
Test passed after 2 failed attempts on update/card-global-styles-root.
Test passed after 2 failed attempts on fix-helphub-link-i18n.
Test passed after 2 failed attempts on fix/block-inserter-gap.
Test passed after 1 failed attempt on bug/help-section-overflow.
Test passed after 2 failed attempts on update/components-navigator-sticky.
Test passed after 1 failed attempt on trunk.
Test passed after 1 failed attempt on remove/use-jump-step.
Test passed after 2 failed attempts on bug/android-bottom-sheet-overlay.
Test passed after 2 failed attempts on trunk.
Test passed after 2 failed attempts on trunk.
Test passed after 2 failed attempts on update/inspector-controls-design-tools-order.
Test passed after 1 failed attempt on trunk.
Test passed after 1 failed attempt on trunk.
Test passed after 1 failed attempt on trunk.
Test passed after 1 failed attempt on fix/toggle-group-control-visual-state-when-value-not-exists-in-options.
Test passed after 1 failed attempt on add/edit-site-list.
Test passed after 1 failed attempt on try/alternate-fixed-appender.
Test passed after 1 failed attempt on trunk.
Test passed after 1 failed attempt on try/partial-multi-selection.
Test passed after 1 failed attempt on trunk.
Test passed after 1 failed attempt on update/re-architect-templates-addition.
Test passed after 1 failed attempt on add/slider-component.
Test passed after 1 failed attempt on trunk.
Test passed after 1 failed attempt on update/add-canRead-to-use-resource-permissions.
Test passed after 1 failed attempt on try/tools-panel-in-global-styles.
Test passed after 1 failed attempt on form-fields.
Test passed after 1 failed attempt on migrate/gallery-caption-tests-playwright.
Test passed after 1 failed attempt on tests/record-cpus-data.
Test passed after 1 failed attempt on fix/color-palette-pattern.
Test passed after 1 failed attempt on fix/text-control-storybook-help-label-type.
Test passed after 1 failed attempt on refactor/url-popover-placement-position.
Test passed after 1 failed attempt on add-test-for-post-title-block-render.
Test passed after 1 failed attempt on upgrade/react-18-pure-with-react-native-upgrade.
Test passed after 1 failed attempt on fix/undo-after-autocorrect.
Test passed after 1 failed attempt on refactor/lodash-filter.
Test passed after 1 failed attempt on perf/refactor-tree.
Test passed after 1 failed attempt on update/hide-context-block-toolbar.
Test passed after 1 failed attempt on add/block-style-editing.
Test passed after 1 failed attempt on use/offsite-menu-component-on-the-navigation-inspector.
Test passed after 1 failed attempt on refactor/lodash-find-core-data.
Test passed after 1 failed attempt on ts-responsive-wrapper.
Test passed after 1 failed attempt on fix/42689.
Test passed after 1 failed attempt on trunk.
Test passed after 2 failed attempts on add/typography-columns-support.
Test passed after 1 failed attempt on try/page-list-submenu.
Test passed after 1 failed attempt on add/query-loop-terms-dynamic-suggestions-fetching.
Test passed after 1 failed attempt on add/query-loop-terms-dynamic-suggestions-fetching.
Test passed after 1 failed attempt on fix/performance-tests.
Test passed after 1 failed attempt on trunk.
Test passed after 1 failed attempt on try/improve-block-context-cache.
Test passed after 1 failed attempt on update/post-featured-image-wrapper-height.
Test passed after 1 failed attempt on trunk.
Test passed after 1 failed attempt on trunk.
Test passed after 1 failed attempt on trunk.
Test passed after 1 failed attempt on trunk.
Test passed after 1 failed attempt on fix/arrow-key-resizing.
Test passed after 1 failed attempt on add/get-set-content-inside-balanced-tags.
Test passed after 1 failed attempt on update/custom-css-move-to-menu.
Test passed after 1 failed attempt on trunk.
Test passed after 1 failed attempt on add/tag-selection-dropdown.
Test passed after 1 failed attempt on refactor/Notice-typescript. 
page.waitForNavigation: Timeout 10000ms exceeded.
=========================== logs ===========================
waiting for navigation until "load"
============================================================
    at PreviewUtils.waitForPreviewNavigation (/home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/various/preview.spec.js:308:22)
    at /home/runner/work/gutenberg/gutenberg/test/e2e/specs/editor/various/preview.spec.js:94:3
    at /home/runner/work/gutenberg/gutenberg/node_modules/@playwright/test/lib/workerRunner.js:426:9
    at TestInfoImpl._runFn (/home/runner/work/gutenberg/gutenberg/node_modules/@playwright/test/lib/testInfo.js:166:7)
    at /home/runner/work/gutenberg/gutenberg/node_modules/@playwright/test/lib/workerRunner.js:376:26
    at TimeoutManager.runWithTimeout (/home/runner/work/gutenberg/gutenberg/node_modules/@playwright/test/lib/timeoutManager.js:73:7)
    at TestInfoImpl._runWithTimeout (/home/runner/work/gutenberg/gutenberg/node_modules/@playwright/test/lib/testInfo.js:154:26)
    at WorkerRunner._runTest (/home/runner/work/gutenberg/gutenberg/node_modules/@playwright/test/lib/workerRunner.js:356:5)
    at WorkerRunner.runTestGroup (/home/runner/work/gutenberg/gutenberg/node_modules/@playwright/test/lib/workerRunner.js:218:11)
    at process.<anonymous> (/home/runner/work/gutenberg/gutenberg/node_modules/@playwright/test/lib/worker.js:88:5)

github-actions[bot] avatar Oct 06 '21 06:10 github-actions[bot]

I run the test 15 times using for i in {1..15}; do npm run test-e2e -- packages/e2e-tests/specs/editor/various/preview.test.js; done and I was not able to reproduce the test fail.

Needs more investigation.

JustinyAhin avatar Oct 12 '21 07:10 JustinyAhin

I run the test 15 times using for i in {1..15}; do npm run test-e2e -- packages/e2e-tests/specs/editor/various/preview.test.js; done and I was not able to reproduce the test fail.

Needs more investigation.

This test just fails in another PR checks (https://github.com/WordPress/gutenberg/pull/35534/checks?check_run_id=3867384922#step:6:66) so, definitely need more digging.

JustinyAhin avatar Oct 12 '21 07:10 JustinyAhin

I can now reproduce

JustinyAhin avatar Oct 12 '21 10:10 JustinyAhin

@JustinyAhin, let me know if you need help with testing or code to fix this issue.

Mamaduka avatar Oct 12 '21 11:10 Mamaduka

I also tried to debug this issue but wasn't able to find the solution. It looks like tests started failing on the trunk after #34731.

Based on artifact Preview dropdown isn't open after the post is published: https://github.com/WordPress/gutenberg/blob/17bdf97b7ecfe579dfac10b415b84cf959865fdf/packages/e2e-tests/specs/editor/various/preview.test.js#L155-L161

cc @ellatrix

Screenshot

should open a preview window for a new post 2021-10-12T15-16-32 .

Mamaduka avatar Oct 12 '21 15:10 Mamaduka

Hm, not sure how the PR affected this test. I guess we can revert it for now.

ellatrix avatar Oct 12 '21 17:10 ellatrix

Let's see if @ntsekouras's PR fixes it :)

ellatrix avatar Oct 12 '21 17:10 ellatrix

This issue has gone 30 days without any activity.

github-actions[bot] avatar Sep 23 '22 02:09 github-actions[bot]