rfhub2 icon indicating copy to clipboard operation
rfhub2 copied to clipboard

Gather test runs results

Open MaciejWiczk opened this issue 5 years ago • 3 comments

Gathering data from tests runs would be a nice addition to existing docs. It would require changes in:

  • UI, to display data, in tabular (and graphical? like some progress bar of green and red, that we are all used to ;) ) form, with nested links, ie Suite ROBOT/RFHUB2/UI/TEST_SUITE_1 etc.
  • API, by adding new endpoints
  • CLI, to enable gathering test cases with their status

MaciejWiczk avatar Jan 14 '20 09:01 MaciejWiczk

@MaciejWiczk Could you try to define initial requirements for that? what kind of information would you like to gather and present?

pbylicki avatar Jan 14 '20 21:01 pbylicki

Sure, I will prepare some materials tomorrow.

MaciejWiczk avatar Jan 14 '20 21:01 MaciejWiczk

I think that a good starting point for this one would be log.html from RFWK, but less verbose, image On right side I think that using something similar to Travis branch view could present last 5 test runs and their pass/fail ratio. image I was thinking to use nested expandable panels but I do not know how they would behve when nested as much as robot TC.

Other idea is to use approach similar to Report Portal, and store each run, divided by project/top suite, or any other unique identifier extracted from one output.xml (in our case that would point to acceptance, which does not sound so good at he moment), and present each output,xml: image

MaciejWiczk avatar Jan 15 '20 07:01 MaciejWiczk