Add ability to explore metrics from the runs list by selecting multiple runs and metrics

[rubenaprikyan]

🚀 Feature

Add ability to explore metrics from the runs list by selecting multiple runs and metrics

Motivation

It would be a great experience to be possible to explore metrics from the runs list, by selecting one or more runs and metrics.

Pitch

The suggestion is to have explore button on runs table, and by clicking on the button after selecting one or more runs, show the modal or popover to select metrics, then redirect to the metrics explorer with the generated query.

[ashutoshsaboo]

Big +1 on this. In addition to the above request for across metrics/runs, even within a single run when multiple metrics are logged it'd be useful to have a quick 1-click way to batch select metrics and get redirected to the metrics explorer with those metrics pre-selected and superimposed in a single graph.

For example: say if i'm logging loss, accuracy over epochs for both train, val, pred set. Selecting both metrics from the run single page and having a way to go to metrics explorer with both these metrics pre-selected (for either that specific run only or all the runs those metrics should be superimposed should be allowed for) would be very beneficial to have. Otherwise user has to go to metrics explorer manually -> click for specific metrics -> search for specific runs -> then plot them. This is like 4 steps of additional work in comparison, if it can be done with a single 1-click automated way itself that'd be quite useful. @rubenaprikyan @SGevorg @gorarakelyan

[ashutoshsaboo]

Has there been any progress on this? @roubkar @gorarakelyan

[dngfra]

It would be useful to have this feature not only for metrics but also for images and scatters and link them such that I can visualize the results in all the panels (images, metrics, scatters) for the same runs by selecting them once in the beginning. I might want to quickly inspect and compare some runs and then quickly switch between metrics and images to check different things but it is unpractical if every time I switch panels I need to reselect which runs to visualize.

In addition, this might even speed up the visualization of the images. At the moment if I select some images I want to explore they will first be all collected within runs and experiments, which can be very slow and even stuck Aim on "loading..." in case of many different runs. If I could first select the runs it would not need to load all the images first.