seismometer icon indicating copy to clipboard operation
seismometer copied to clipboard

Add Nutrition Card Style Model Performance Rollup

Open firste opened this issue 1 year ago • 0 comments

Is your feature request related to a problem? Please describe

Seismometer has many great analyses that help answer important questions related to a model's performance, fairness, and the performance and fairness of workflows using the model. However identifying which analyses to deep dive and what to do can require data science or operational expertise that under-resourced organizations may not have easy access to.

Describe the solution you'd like

Create a nutrition card style rollup for the key analysis dimensions and allow a model developer or implementor to provide next steps when certain constraints are out of bounds with the rollup data.

Describe alternatives you've considered

There may be existing open-source packages that provide some of these capabilities but I have not investigated any of them.

Additional context

This will need an RFC as there are many existing approaches to this.

@gbowlin - you were interested in following this

firste avatar Jul 30 '24 13:07 firste