aria-at icon indicating copy to clipboard operation
aria-at copied to clipboard

Add script to count test plans, tests, assertions, and command/assertion pairs

Open s3ththompson opened this issue 4 years ago • 5 comments

Preview Tests

Preview Tests

This PR adds a script to the scripts directory which provides basic metrics for all test plans or a single specified test plan.

The output of this script can be used to track the growth of the ARIA-AT repository over time.

Example output:

$ npm run count
8 test plans, 242 tests, 919 assertions, 1643 command/assertion pairs

s3ththompson avatar Jun 04 '21 16:06 s3ththompson

1643 command/assertions

@s3ththompson What does that mean? What is a "command/assertion"?

jscholes avatar Jun 04 '21 17:06 jscholes

@jscholes was trying to think of a better name for that... it's basically number of commands times number of assertions in order to count the total number of distinct data points that are collected. i'll happy replace the wording if you have any suggestions!

s3ththompson avatar Jun 04 '21 17:06 s3ththompson

@s3ththompson Hmm, tricky one. Reading your response, what comes to mind immediately is "command/assertion pairs". Or just "datapoints", which is so vague that it all but forces users to read the documentation (and would need to be documented accordingly).

jscholes avatar Jun 04 '21 17:06 jscholes

@jscholes I like "command/assertion pairs" better. I updated the script to use that terminology.

s3ththompson avatar Jun 04 '21 17:06 s3ththompson

✅ Deploy Preview for aria-at ready!

🔨 Explore the source changes: f41fa82eb8d499b850516f4eda56e3f7b4d732a5

🔍 Inspect the deploy log: https://app.netlify.com/sites/aria-at/deploys/6238a1180c6695000815bd16

😎 Browse the preview: https://deploy-preview-442--aria-at.netlify.app

netlify[bot] avatar Mar 21 '22 15:03 netlify[bot]

I am going to post a commit here with my suggested changes.

mzgoddard avatar Mar 09 '23 19:03 mzgoddard