[WebUI] Show corresponding metrics, not individual metrics in the project

[H4dr1en]

Following up on Slack thread

I have the following use case:

I need to add two custom columns, each reporting one metric. Currently, this shows me the best (min/max) values reached by the model, but not necessarily for the same epoch. Since at the end, I want to choose a single model, I’d like to show on the first custom column, the min/max value of a metric, and on the second column, the corresponding value of the second metric. Otherwise, I have to go and look up manually on each experiment to find the corresponding value for the metric 2.

Would it be possible to add this feature?

[ainoam]

Definitely an interesting use case @H4dr1en. We'll make sure to look at it when we augment the experiment table.

[andre-bauer]

+1 for this feature , is there any way to get the desired behavior already?

[H4dr1en]

Hi @ainoam , this is still desirable, any chance this can be added in the next releases?

[ainoam]

Thanks for following up @H4dr1en.

This item is still more on the research side of things as a naïve implementation for this functionality would result in too high loads on the ClearML backend due to it's data architecture (read: the way such compound queries would load elasticsearch).

One of the directions being considered is adding direct visualization (e.g. apache superset) outside the experiment table - Your thoughts?

[H4dr1en]

I understand the technical challenge yes - adding superset visualizations sounds super cool! Could it solve this issue in a simple way?

[wxdrizzle]

+1 for this feature. For example, in a paper we usually need to report several metrics for each model. So we need to find a single epoch and then report all metrics.

One solution I came up with is to define a set of new metrics and store the values we want as their last values. To do so, we need to manually find the epoch we want and get the corresponding values. Then, we assign the values to these new metrics. That can achieve the purpose but need a little bit more coding. Hope we can have this feature in WebUI directly.

[H4dr1en]

Hi there (@ainoam), I am still interested by this feature. Right my team converged to using a spreadsheet to report the metric values for the same checkpoint for each experiment, this is a lot of manual work that somehow defeats the purpose of the table view for us