cnti-testcatalog
[BUG] Individual tests are not adding total points in the results file, only in the items for the test
Describe the bug Despite just a single test being run and it providing the points awarded in the results file under the test name, the total points are not added to the top of the results file like they are during category or workload runs.
To Reproduce Steps to reproduce the behavior:
- Setup CNF with k8s
- Run a single test
- View the results file generated.
- You'll see no total points at the top of the results file.
Expected behavior
Either the total points should be added or since these are single test results, remove the total points (or do away with producing a results file altogether for individual tests) in the header of the yml log as it's irrelevant to have redundant points: in the results file.
Screenshots
root@cnf-testsuite-test1:~/cnf-testsuite# ./cnf-testsuite single_process_type
✔️ PASSED: Only one process type used 🐜 ⚖️👀
root@cnf-testsuite-test1:~/cnf-testsuite# cat results/cnf-testsuite-results-20220408-125103-544.yml
---
name: cnf testsuite
status:
points:
exit_code: 0
items:
- name: single_process_type
status: passed
points: 5
Should we generate results files for individual tests? Only groups of tests (like workload, microservice, all, platform) is what I would assume require results files.
Should we generate results files for individual tests? Only groups of tests (like workload, microservice, all, platform) is what I would assume require results files.
I updated the behavior to indicate possibly just do away with individual tests results files, seems rather pointless to be honest.
