ESP icon indicating copy to clipboard operation
ESP copied to clipboard

Ability to indicate ground truth data in test data.

Open damellis opened this issue 8 years ago • 1 comments

So that we can score pipelines based on how it does relative to that ground truth information. This is probably complicated, as the form of ground truth data may change based on the pipeline / classification type as well as the post-processing done. For instance, we may want to have a way to mark ground truth as regions / intervals and score pipelines against the percentage of the intervals that match. But we might also want a way to specify ground truth as events and score the pipeline by distance between its events and the ground truth ones.

damellis avatar Apr 18 '16 22:04 damellis

We'll also need a way to save and load ground truth data. I'm not sure if the GRT currently has a conception of this or not.

damellis avatar Jun 23 '16 18:06 damellis