AL-Go icon indicating copy to clipboard operation
AL-Go copied to clipboard

BCPT Test Report

Open freddydk opened this issue 2 years ago • 0 comments

This PR will add a BCPT Test Report to the build summary, looking like this: image

You can also add a bcptBaseLine.json to the project in order to establish a baseline for the performance tests. It looks like this: image

TODOs:

  • [x] Add tests
  • [x] Add thresholds to project settings
  • [x] Determine how thresholds should work? threshold on very small items like (enter account no.) doesn't make much sense. It absolutely makes sense to have threshold on scenarios.
  • [x] Determine sorting of test results? (codeunitID, codeunitName or ???)
  • [x] Issue GitHub warnings and errors when thresholds are exceeded
  • [x] Is durationMin in milliseconds, seconds or what? how many decimal digits should be displayed?
  • [x] Get BCPT Backend Team signoff that BCPT Test Results are correctly understood and compared
  • [x] Add scenario documentation

Example of bcpt tests with failures and warnings: image

freddydk avatar Jul 24 '23 06:07 freddydk