crc icon indicating copy to clipboard operation
crc copied to clipboard

[QE] Compactify e2e tests

Open jsliacan opened this issue 3 years ago • 11 comments
trafficstars

This PR contains the following changes

  • include the relevant clicumber code in this codebase, as suggested in #2538 and #3210
  • update dependencies (cucumber/godog/...)
  • compactify features/scenarios to fit the cucumber paradigms
  • leave out config.feature (should be replaced by an integration test of similar extent #3249)

jsliacan avatar May 09 '22 08:05 jsliacan

Does it make sense keep the clicumber integrated code under e2e? Or may keep e2e only with suites and features and move the clicumber code to extended?

WDYT?

adrianriobo avatar Jul 06 '22 10:07 adrianriobo

@adrianriobo , I moved it directly into testsuite because testsuite was "extending" the clicumber suite. That said, I am happy to put it wherever you think is better, I have no real opinions either way.

EDIT: It's in extended now as you suggested.

jsliacan avatar Jul 06 '22 11:07 jsliacan

/retest

jsliacan avatar Jul 15 '22 11:07 jsliacan

/test

anjannath avatar Aug 01 '22 11:08 anjannath

@anjannath: The /test command needs one or more targets. The following commands are available to trigger required jobs:

  • /test e2e-crc
  • /test images
  • /test integration-crc

Use /test all to run all jobs.

In response to this:

/test

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

openshift-ci[bot] avatar Aug 01 '22 11:08 openshift-ci[bot]

/test all

anjannath avatar Aug 01 '22 11:08 anjannath

/retest

jsliacan avatar Aug 03 '22 09:08 jsliacan

/retest

jsliacan avatar Sep 15 '22 11:09 jsliacan

@jsliacan pr needs rebase

anjannath avatar Sep 28 '22 08:09 anjannath

nice speedup for e2e, integration tests!

test time e2e integration
this pr 1h52m46s 1h12m18s
in main 2h31m8s 1h23m38s

anjannath avatar Sep 28 '22 14:09 anjannath

Include clicumber code, update dependencies, compactify feature files

i guess these three things are tightly coupled and hard to split into individual commits without rewriting the feature files multiple times for each commit.. better to also include the information in the pr description as commit log

anjannath avatar Sep 28 '22 14:09 anjannath

leave out config.feature (should be replaced by an integration test of similar extent https://github.com/code-ready/crc/issues/3249)

@jsliacan maybe keep the config.feature for now (if it works with the current changes) and remove it when we have something similar in the integration tests? i.e when working on fixing #3249

anjannath avatar Sep 29 '22 05:09 anjannath

better to exclude the config.feature changes from the first commit itself than removing it and re-adding

anjannath avatar Sep 30 '22 08:09 anjannath

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: anjannath

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

openshift-ci[bot] avatar Sep 30 '22 11:09 openshift-ci[bot]

New changes are detected. LGTM label has been removed.

openshift-ci[bot] avatar Oct 10 '22 14:10 openshift-ci[bot]