seismometer
seismometer copied to clipboard
epic-open-source
AI model evaluation with a focus on healthcare
# Overview Updates CI for test coverage ## Description of changes Coverage should be done on base environment (py3.10 + linux) since there is no dependent branching Test suite should...
## Problem Summary Currently, it appears that variables like age are expected to be cut into ranges prior to processing in seismometer. However, it could very well be a tunable...
## Problem Summary Decision curve analysis is recommended in pretty much every guideline on the evaluation of AI, including TRIPOD AI and also see https://mskcc-epi-bio.github.io/decisioncurveanalysis/literature.html#DCA__Machine_LearningAI. It is not currently in...
# Overview Add merge option "first", "last", "nearest", and "count" on top of "forward". ## Description of changes Add merge option "first", "last", "nearest", and "count" on top of "forward"....
# Overview ## Description of changes We have a ModelOptionsWidget, and a ModelOptionsAndCohortsWidget. This PR is to contribute the difference of the two widgets. ## Author Checklist - [ ]...
## Is your feature request related to a problem? Please describe Seismometer is currently using [aequitas](https://github.com/dssg/aequitas) for its fairness audit since it is a package that some healthcare organizations were...
## Problem Summary Running mypy on the code base produces a number of typing errors. Many of them are benign but given our expectations around typing in the codebase, we...
## Problem Summary With the UX improvements in 0.2.0 release, configuration expectations for events became more strict and the events section in usage config is required. We previously had documentation...
## Is your feature request related to a problem? Please describe Seismometer has many great analyses that help answer important questions related to a model's performance, fairness, and the performance...
## Is your feature request related to a problem? Please describe During validation of a new model, comparing performance between the new model and an existing model or process is...
Metadata
Owner
Metadata
AI model evaluation with a focus on healthcare