The Classifier Performs way better than the Detector
These are the benchmark accuracy% numbers I ran for different models across versions on a dataset of 10,000 images. The classifier performs way better than the detectors including the latest detector. This dataset consisted of all NSFW images.
@bedapudi6788 Can we please release the updated classifier model as well? Would be very helpful if we can get increased accuracy on it.
| Threshold | 0 | 0.2 | 0.4 | 0.5 | 0.6 | 0.7 | 0.75 | 0.8 | 0.85 | 0.9 | 0.95 |
|---|---|---|---|---|---|---|---|---|---|---|---|
Nudenet 320m v3.4.2 |
60.6 | 60.6 | 46.58 | 37.77 | 26.33 | 14.3 | 8 | 2.76 | 0.24 | 0.03 | 0 |
NudeNet 640m v3.4.2 |
59.11 | 59.11 | 45.81 | 36.34 | 25.4 | 12.56 | 6.24 | 1.94 | 0.09 | 0 | 0 |
NudeNet Classifier v2.0.9** |
100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 100 | 78.06 | 50.75 |
NudeNet Classifier v2.0.9 with FACE Labels |
66.53 | 66.53 | 54.24 | 47.26 | 38.05 | 26.68 | 19.38 | 10.82 | 2.65 | 0.03 | 0 |
NudeNet Detector v2.0.9 |
54.95 | 54.95 | 54.95 | 54.95 | 40.44 | 23.62 | 14.91 | 7.56 | 3.05 | 0.77 | 0.09 |
OpenNSFW v0.14.0 |
100 | 89.47 | 74.97 | 66.66 | 58.21 | 48.27 | 43.06 | 37.5 | 31.46 | 24.73 | 15.97 |
** - The NudeNet Classifier v2.0.9 100% accuracy might be a little biased since we got this data from this model itself.
@bedapudi6788
Also, if possible can you please share the dataset you used to train the detector or the source from where you got that dataset?
Hi, if there are any updates about this issue, please let me know. Thank you both. @nikhilcss97 @bedapudi6788
Hi, @nikhilcss97; how do you construct your dataset? Have you tried to label the dataset? I need some help to label some datasets collected by myself. Thank you.
I can recommend this Yolo11 based NSFW detector:
https://huggingface.co/erax-ai/EraX-NSFW-V1.0
Version 1.0 performs better than NudeNet 2 and 3 from what I can tell. Their version 1.1 under performs for some reason.