app icon indicating copy to clipboard operation
app copied to clipboard

Test Runs Summary report

Open Tny6918 opened this issue 1 year ago • 7 comments

Test Runs Summary report

I want to select several test runs the same way I can select the test cases and create a new test plan with them. After selection test runs I want the Chart to change the visual presentation for only selected test runs. The test runs can be grouped by feature name (Epic in Jira) or sprint the same way I group test cases in a test suit. I can save the selection of test runs into the test runs summary report where I would see the chart, test runs in the form of drop-downs with run test cases, summary of passed/failed/skipped and linked issues found during test runs ( overall number of found and linked issues), metrics of the overall test runs time, number of test-cases (maybe even group by Labels)

Additional context Screenshot_276

Tny6918 avatar Apr 22 '24 09:04 Tny6918

@Tny6918 , to achieve such an outcome you can put your test runs into a group (folder). When you open a group view - the chart will render accordingly with test runs in the given group.

tikolakin avatar Apr 28 '24 14:04 tikolakin

@Tny6918 did you tried RunGroups?

https://docs.testomat.io/getting-started/managing-runs#rungroups

2024-05-01_00 53 20@2x

poliarush avatar Apr 30 '24 22:04 poliarush

@poliarush Hello! I was using this functionality during the meeting with stakeholders, and we were kind of puzzled. At first, they thought that we had above 35 issues per the first test run, but actually it was just 5. And passed test cases are placed above 30 point, but actually it was 28. So what kind of logic is behind putting red dot above the level of 35? Can we change it to show the actual result aligned with numbers accordingly? Screenshot_309

Tny6918 avatar May 09 '24 17:05 Tny6918

@Tny6918 if you add more runs in this group you will be timeline, i think it's not really understandable when you have only 1 run. 2024-05-09_19 58 05@2x

what is your suggestion to chart to improve understanding? we are using apex charts, https://apexcharts.com/javascript-chart-demos/ what kind of chart is more suitable here?

poliarush avatar May 09 '24 17:05 poliarush

or maybe it's better to have such type of chart? will it be more understandable?

2024-05-09_20 04 47@2x

poliarush avatar May 09 '24 18:05 poliarush

Yes, we have some group runs which show the timeline. But as you see it is misleading to show red above the green line. Automatically you look for numbers and see that the number of issues should be 15 like on the screen, but actually, it is just 1. (screenshot)So I propose to show a red line like I've added to the screenshot. So it will be aligned with the value 1 from the left. Screenshot_310 It would be good to show clearly aligned numbers(on the left) with graphical lines as in screenshot 2. (Pls disregard created per day and resolved issues per day). The goal here is to demonstrate to stakeholders that we deliver a better product than it was before with each sprint Screenshot_311

Tny6918 avatar May 09 '24 18:05 Tny6918

@Tny6918 ok we need to brainstorm with a team how to improve this

i think you're right we would need to change chart to something like this

2024-05-09_20 27 08@2x

poliarush avatar May 09 '24 18:05 poliarush

Hi @Tny6918! We updated the chart UI on the Run Group detailed view (screenshot below).

Image

So we close the ticket for now. Please feel free to re-open the ticket if needed.

TetianaKhomenko avatar Jul 16 '24 13:07 TetianaKhomenko

URL: https://docs.testomat.io/getting-started/managing-runs/#rungroup-chart

maxkryvoshyya avatar Aug 08 '24 19:08 maxkryvoshyya