testkube icon indicating copy to clipboard operation
testkube copied to clipboard

Improve sanity tests with other executors based tests

Open exu opened this issue 1 year ago • 1 comments

Is your feature request related to a problem? Please describe.

As a testkube engineer, I want to be sure that changes in executor code doesn't have impact on testkube API

So we would need to implement a bunch of tests for particular executors:

  • [x] postman
  • [x] cypress (#2294)
  • [ ] k6 (#2417, in review)
  • [ ] maven
  • [ ] gradle
  • [ ] soapui
  • [ ] ginkgo
  • [ ] artillery.io

All tests should be run against Testkube itself

  • UI,
  • CLI,
  • API

Design test plan first for all components

Split this task to separate ones after planning what should be done

Extend release workflows/create quality workflows to run the tests during release:

  • [ ] https://github.com/kubeshop/testkube/issues/2306

exu avatar Aug 10 '22 07:08 exu

One more case:

  • Checking parameters and ENVs

tkonieczny avatar Sep 29 '22 12:09 tkonieczny

  • Test sources
  • Different checkout options

tkonieczny avatar Oct 06 '22 11:10 tkonieczny

@tkonieczny, is it done? I see that it's marked as done on Testkube Quality project, but it's not done in Testkube, nor the issue is closed.

rangoo94 avatar May 23 '23 11:05 rangoo94