checkly-cli icon indicating copy to clipboard operation
checkly-cli copied to clipboard
verified publisher icon checkly

bug: Prolonged test suite exceeding CLI default timeout of 5 minutes displaying false positives

Open Dnhem opened this issue 1 year ago • 2 comments

Node.js version

18.20.2

NPM version

10.5.0

@checkly/cli version

4.9.1

Steps to reproduce

npx checkly test --timeout=1 --reporter=github

What is expected?

  • Test suite exceeding CLI default timeout of 5 minutes should not display failed test result(s) on GitHub MD report
  • Timeout should be flexible/increased to allow test suite to finish executing instead of displaying false positive on GitHub MD report

What is actually happening?

Misalignment - GitHub MD displays false positives while Test Sessions are displaying passed results

image

Any additional comments?

No response

Dnhem avatar Nov 12 '24 09:11 Dnhem

Thanks for the report, I'll look into this as soon as possible.

sorccu avatar Nov 12 '24 16:11 sorccu

@sorccu Hi, any updates?

everzel avatar Nov 26 '24 12:11 everzel