NudeNet icon indicating copy to clipboard operation
NudeNet copied to clipboard

The Classifier Performs way better than the Detector

Open nikhilcss97 opened this issue 1 year ago • 4 comments

These are the benchmark accuracy% numbers I ran for different models across versions on a dataset of 10,000 images. The classifier performs way better than the detectors including the latest detector. This dataset consisted of all NSFW images.

@bedapudi6788 Can we please release the updated classifier model as well? Would be very helpful if we can get increased accuracy on it.

Threshold 0 0.2 0.4 0.5 0.6 0.7 0.75 0.8 0.85 0.9 0.95
Nudenet 320m v3.4.2 60.6 60.6 46.58 37.77 26.33 14.3 8 2.76 0.24 0.03 0
NudeNet 640m v3.4.2 59.11 59.11 45.81 36.34 25.4 12.56 6.24 1.94 0.09 0 0
NudeNet Classifier v2.0.9** 100 100 100 100 100 100 100 100 100 78.06 50.75
NudeNet Classifier v2.0.9 with FACE Labels 66.53 66.53 54.24 47.26 38.05 26.68 19.38 10.82 2.65 0.03 0
NudeNet Detector v2.0.9 54.95 54.95 54.95 54.95 40.44 23.62 14.91 7.56 3.05 0.77 0.09
OpenNSFW v0.14.0 100 89.47 74.97 66.66 58.21 48.27 43.06 37.5 31.46 24.73 15.97

** - The NudeNet Classifier v2.0.9 100% accuracy might be a little biased since we got this data from this model itself.

nikhilcss97 avatar Sep 13 '24 13:09 nikhilcss97

@bedapudi6788

Also, if possible can you please share the dataset you used to train the detector or the source from where you got that dataset?

nikhilcss97 avatar Sep 13 '24 13:09 nikhilcss97

Hi, if there are any updates about this issue, please let me know. Thank you both. @nikhilcss97 @bedapudi6788

ryliu68 avatar Sep 30 '24 08:09 ryliu68

Hi, @nikhilcss97; how do you construct your dataset? Have you tried to label the dataset? I need some help to label some datasets collected by myself. Thank you.

ryliu68 avatar Sep 30 '24 08:09 ryliu68

I can recommend this Yolo11 based NSFW detector:

https://huggingface.co/erax-ai/EraX-NSFW-V1.0

Version 1.0 performs better than NudeNet 2 and 3 from what I can tell. Their version 1.1 under performs for some reason.

henryruhs avatar Jan 23 '25 00:01 henryruhs