Visualization of Test Results

[foxtrott]

Hi all,

I'm wondering whether it is feasible to improve the viewTest.php file in favour of a more modern representation rather than a potentially very very long simple table. I was thinking about something like a calendar view [1] which allows grouping individual tests according to labels, projects or others. In case of many thousand tests, this could be pretty useful.

Kind regards, Florian

[1] https://beta.observablehq.com/@mbostock/d3-calendar-view

[zackgalbreath]

As it currently exists, viewTest.php allows you to filter its results by label, test name, and more. The Summary and History columns on this table also give an indication of how each test is performing outside of this one particular run.

If there's another visualization that we can add to this page to make it more useful, then I'm totally for it. I'm not sure that a calendar heatmap is the right choice though, because there isn't necessarily one build per day. Maybe a line chart with three series (pass, fail, notrun) or a stacked area chart instead?

I'm also a little concerned that the database queries to retrieve all this data might be slow, but we can deal with that problem if/when it arises.

[zackgalbreath]

I should also point out that testOverview.php has a timeline view showing how the number of passing, failing, and not run tests changed over time. From the "Dashboard" drop-down menu click on "Tests" to take a look.

[shahzebsiddiqui]

I think CDASH needs a better way to view historical data for the following

1. Historical Data by buildname
2. Historical Data by test

We need a way to navigate test via calendar form where we can put Start and End date to filter test, i want to know when a particular test has failed so we can diagnose errors.

Currently we have a timeline graph but this doesn't make any sense after trying to click on the graph it doesn't show what test is causing the error and no way to move the date range.

I found a filter that shows build history by particular buildname i think this feature is useful we may need to make this more apparent it was hidden under menu Show Build History for this page https://my.cdash.org/build/2172836

This image below is the build history filter i think the text field needs to be fixed for instance the date field needs to be calendar picker instead of manually writing the date which can pose issues.

[zackgalbreath]

We need a way to navigate test via calendar form where we can put Start and End date to filter test

The Begin and End fields on index.php pop up a calendar widget to make it easier to select a range of dates.

Let us know if this wasn't what you were looking for.

[shahzebsiddiqui]

I was able to use this filter as you suggested it worked i guess it works on buildname but not per test name. Is it possible to make this more clear this filter field is hidden two navigations from the main dashboard. Can't we set this filter field on main dashboard considering you change the text field.

[shahzebsiddiqui]

I am able to see history by buildname how do i see history by test since that is ultimately what we want to see. This feature is still nice

[zackgalbreath]

how do i see history by test

I think the "Tests Query" page is what you're looking for.

Here's an example of using filters on this page to see the history of a specific test:

https://my.cdash.org/queryTests.php?project=buildtest-nersc&begin=2022-04-30&end=2022-06-24&filtercount=1&showfilters=1&field1=testname&compare1=61&value1=cuda_example_nvcc