ginkgo icon indicating copy to clipboard operation
ginkgo copied to clipboard

Failed test summary is not showing up in ginkgo 2.1.4

Open poojaprasanthi opened this issue 2 years ago • 1 comments

I updated the ginkgo version to 2.1.4.

In my older versions - the test run summary used to look like

Summarizing 4 Failures:

[Panic!] MDCTestsForAuthorizationAndPermission [It] DatasetListAndGetAccessWithOwnerQualifier 
/go/src/cd.splunkdev.com/integration-tests/search/lib/common/common.go:554

[Panic!] MDCTestsForAuthorizationAndPermission [It] DatasetListAndGetAccessWithOwnerQualifier 
/go/src/cd.splunkdev.com/integration-tests/search/lib/common/common.go:554

[Panic!] MDCTestsForAuthorizationAndPermission [It] ModulesListAndGetAccessWithOwnerQualifier 
/go/src/cd.splunkdev.com/integration-tests/search/lib/common/common.go:554

[Panic!] MDCTestsForAuthorizationAndPermission [It] ModulesListAndGetAccessWithOwnerQualifier 
/go/src/cd.splunkdev.com/integration-tests/search/lib/common/common.go:554

Ran 45 of 236 Specs in 694.678 seconds
FAIL! -- 43 Passed | 2 Failed | 0 Flaked | 0 Pending | 191 Skipped
--- FAIL: TestTest (694.70s)
FAIL

but after the upgrade , I could not see the summary about failing tests. it only displays last lines:

Ran 41 of 41 Specs in 276.068 seconds
FAIL! -- 40 Passed | 1 Failed | 0 Pending | 0 Skipped
--- FAIL: TestTest (276.07s)
FAIL

Ginkgo ran 2 suites in 4m38.552614585s

There were failures detected in the following suites:
  e2e ./tests/e2e

Test Suite Failed

what flag should I use to see the failed tests summary?

As of now I am using :

ginkgo -v -progress -no-color -slow-spec-threshold=10s -timeout=60m -flake-attempts=2 -focus ModulesAndKnowledgeObjects  tests/...

Also, how should I silence these outputs like

[SynchronizedAfterSuite] PASSED [115.491 seconds]
[SynchronizedAfterSuite]
/Users/pprasanthi/integration/src/cd.splunkdev.com/integration-tests/search/tests/e2e/suite_setup_test.go:42

  Begin Captured GinkgoWriter Output >>
    [SynchronizedAfterSuite] TOP-LEVEL
      /Users/pprasanthi/integration/src/cd.splunkdev.com/integration-tests/search/tests/e2e/suite_setup_test.go:42
    [SynchronizedAfterSuite] TOP-LEVEL
      /Users/pprasanthi/integration/src/cd.splunkdev.com/integration-tests/search/tests/e2e/suite_setup_test.go:42
  << End Captured GinkgoWriter Output

poojaprasanthi avatar May 03 '22 20:05 poojaprasanthi

+1, I am facing the same issue after updating ginkgo to v2, if there is only one failure in the suit it doesn't show up int the test summary, is there a way we can print the test summary at the end of the test run?

anandrkskd avatar Jul 27 '22 09:07 anandrkskd

hey there - sorry for the delay. I'm pushing out a fix for this now. should cut a release sometime next week or so.

onsi avatar Aug 25 '22 20:08 onsi