build icon indicating copy to clipboard operation
build copied to clipboard

Tests fail more frequent after switch to use Github action

Open zhangtbj opened this issue 3 years ago • 2 comments

After we switch to use GitHub Action as CI process, we see more frequent test failures than before.

For this monday as an example, there are about 5 PRs, but most of the PRs failed at integration or e2e test steps, but some of them are just the document change. We faced several failures:

  • Cluster setup fail
  • integration or e2e test fail

such as:

      Expected
          <string>: service account foobar-sa not found
      to equal
          <string>:  \"foobar-sa\" not found

      /home/runner/work/build/build/test/catalog.go:311

Here: https://github.com/shipwright-io/build/pull/641/checks?check_run_id=2070257253

We don't know how to improve it now, but would like to open this issue to record the recent failures then think how to solve the failures better.

So we will continue adding the failure message here then think about how to solve it.

zhangtbj avatar Mar 10 '21 02:03 zhangtbj