Test Runs Summary report
Test Runs Summary report
I want to select several test runs the same way I can select the test cases and create a new test plan with them. After selection test runs I want the Chart to change the visual presentation for only selected test runs. The test runs can be grouped by feature name (Epic in Jira) or sprint the same way I group test cases in a test suit. I can save the selection of test runs into the test runs summary report where I would see the chart, test runs in the form of drop-downs with run test cases, summary of passed/failed/skipped and linked issues found during test runs ( overall number of found and linked issues), metrics of the overall test runs time, number of test-cases (maybe even group by Labels)
Additional context
@Tny6918 , to achieve such an outcome you can put your test runs into a group (folder). When you open a group view - the chart will render accordingly with test runs in the given group.
@Tny6918 did you tried RunGroups?
https://docs.testomat.io/getting-started/managing-runs#rungroups
@poliarush Hello!
I was using this functionality during the meeting with stakeholders, and we were kind of puzzled. At first, they thought that we had above 35 issues per the first test run, but actually it was just 5. And passed test cases are placed above 30 point, but actually it was 28. So what kind of logic is behind putting red dot above the level of 35? Can we change it to show the actual result aligned with numbers accordingly?
@Tny6918
if you add more runs in this group you will be timeline,
i think it's not really understandable when you have only 1 run.
what is your suggestion to chart to improve understanding? we are using apex charts, https://apexcharts.com/javascript-chart-demos/ what kind of chart is more suitable here?
or maybe it's better to have such type of chart? will it be more understandable?
Yes, we have some group runs which show the timeline. But as you see it is misleading to show red above the green line. Automatically you look for numbers and see that the number of issues should be 15 like on the screen, but actually, it is just 1. (screenshot)So I propose to show a red line like I've added to the screenshot. So it will be aligned with the value 1 from the left.
It would be good to show clearly aligned numbers(on the left) with graphical lines as in screenshot 2. (Pls disregard created per day and resolved issues per day). The goal here is to demonstrate to stakeholders that we deliver a better product than it was before with each sprint
@Tny6918 ok we need to brainstorm with a team how to improve this
i think you're right we would need to change chart to something like this
Hi @Tny6918! We updated the chart UI on the Run Group detailed view (screenshot below).
So we close the ticket for now. Please feel free to re-open the ticket if needed.
URL: https://docs.testomat.io/getting-started/managing-runs/#rungroup-chart