snorkel icon indicating copy to clipboard operation
snorkel copied to clipboard

Change LF stat "empirical accuracy" to "precision"

Open astarostap opened this issue 5 years ago • 2 comments

I was using Metal's LF analysis function, which gives you the "empirical accuracy" of your LFs. It was pretty confusing, I wasn't sure if it was computing its accuracy or its precision. After some experimentation I realized it's computing rule precisions. So, I thought maybe it would be better to call it "precision" to avoid confusions.

astarostap avatar Aug 27 '19 22:08 astarostap

@astarostap thanks for pointing this out! We need to make sure our naming is clear here. As you pointed out, in all but the simplest label model configurations, 'accuracy' is a misnomer. More precisely, the weights are the estimated conditional probabilities. I think this is clear in the label model now but not necessarily all helper functions throughout the repo... we'll do a cleaning pass here!

ajratner avatar Aug 31 '19 00:08 ajratner

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

github-actions[bot] avatar Sep 30 '19 12:09 github-actions[bot]