NudeNet icon indicating copy to clipboard operation
NudeNet copied to clipboard

The Classifier Performs way better than the Detector

Open nikhilcss97 opened this issue 5 months ago • 3 comments

These are the benchmark accuracy% numbers I ran for different models across versions on a dataset of 10,000 images. The classifier performs way better than the detectors including the latest detector. This dataset consisted of all NSFW images.

@bedapudi6788 Can we please release the updated classifier model as well? Would be very helpful if we can get increased accuracy on it.

Threshold 0 0.2 0.4 0.5 0.6 0.7 0.75 0.8 0.85 0.9 0.95
Nudenet 320m v3.4.2 60.6 60.6 46.58 37.77 26.33 14.3 8 2.76 0.24 0.03 0
NudeNet 640m v3.4.2 59.11 59.11 45.81 36.34 25.4 12.56 6.24 1.94 0.09 0 0
NudeNet Classifier v2.0.9** 100 100 100 100 100 100 100 100 100 78.06 50.75
NudeNet Classifier v2.0.9 with FACE Labels 66.53 66.53 54.24 47.26 38.05 26.68 19.38 10.82 2.65 0.03 0
NudeNet Detector v2.0.9 54.95 54.95 54.95 54.95 40.44 23.62 14.91 7.56 3.05 0.77 0.09
OpenNSFW v0.14.0 100 89.47 74.97 66.66 58.21 48.27 43.06 37.5 31.46 24.73 15.97

** - The NudeNet Classifier v2.0.9 100% accuracy might be a little biased since we got this data from this model itself.

nikhilcss97 avatar Sep 13 '24 13:09 nikhilcss97