metriq-app icon indicating copy to clipboard operation
metriq-app copied to clipboard

Expand chart type options

Open WrathfulSpatula opened this issue 1 year ago • 4 comments

We have a user request for box-and-whiskers plots on Metriq.

We already have input options that establishes a per-result confidence interval and error bars. However, the request seems to be to allow users to see a box plot on the overall set of results.

WrathfulSpatula avatar Aug 08 '23 20:08 WrathfulSpatula

Thank you for opening this issue and considering expanding the chart options! Our motivation is to be able to visualize data distribution as an option to current single metric charts. In our use case we run our experiments in batches, so being able to display the data using box plots we get to easily see the dispersion of data, the score range and outliers. The extra input data for each metric would be: min, max, q1, median, q3.

Here is a chart example for task 26 (date reflects the package version used in each experiment batch) image image

karlaspuldaro avatar Aug 18 '23 19:08 karlaspuldaro

@WrathfulSpatula Any updates on this issue? I would be happy to help implementing this :)

karlaspuldaro avatar Sep 25 '23 21:09 karlaspuldaro

Sorry, I was away at IEEE Quantum Week, last week! As soon we finish a UI update for platforms, which we plan to have this week, we can start with your plots, here. So, I anticipate to start looking at this again late this week, and I'll post any updates we have here on the issue thread. I appreciate your offer, and I'm sorry we've taken so long to start with this. (The implementation might be based in the standard error intervals we already have, but I made a database migration to capture quartile data, already, and Vincent also has that handy, depending on who gets to it first.)

WrathfulSpatula avatar Sep 26 '23 14:09 WrathfulSpatula

@WrathfulSpatula Thank you for the update, and no worries, September has also been a busy conference month for us :)

karlaspuldaro avatar Sep 26 '23 16:09 karlaspuldaro