nsfwjs icon indicating copy to clipboard operation
nsfwjs copied to clipboard

False positive drawing

Open linkle69 opened this issue 4 years ago • 13 comments
trafficstars

SPOILER_Matou_shinji-1-67-1.png

linkle69 avatar Jan 07 '21 13:01 linkle69

The ai classify's this as hentai (Latest mobilenet model)

linkle69 avatar Jan 07 '21 13:01 linkle69

Which model did you use? I'm dragging the image to NSFWJS.com and can't reproduce with the 90% mode or the 93% model.

2 1

GantMan avatar Jan 07 '21 15:01 GantMan

I used the 93% one I set the jpg quality of images to 60 before scanning them using nsfwjs

linkle69 avatar Jan 07 '21 19:01 linkle69

Can you provide the image you used?

And yes, false positives will happen.

GantMan avatar Jan 07 '21 20:01 GantMan

SPOILER_Matou_shinji-1-67-2.jpg

linkle69 avatar Jan 07 '21 20:01 linkle69

for whatever reason I don't have this false positive on the website while I do on my code

maybe its because I use tf prod mode

linkle69 avatar Jan 07 '21 20:01 linkle69

From my testings, I have noticed that this issue is with the latest released model from the nsfwjs_model repo when I used a previous release it didn't have this false positive

linkle69 avatar Jan 08 '21 09:01 linkle69

@TechnikEmpire - would know what's up.

https://github.com/TechnikEmpire

GantMan avatar Jan 08 '21 15:01 GantMan

@LINKdiscordd link directly to the model you pulled and I'll check it out to see if I can repro.

TechnikEmpire avatar Jan 08 '21 15:01 TechnikEmpire

Just to be clear this could very well be a false positive. Latest models were trained by me with a vastly different data set than previous models. So imo such "bugs" can be expected, if they're defined simply by comparing against previous models.

There will always be a margin of error. Even whether we get 70% or 99% "accuracy", those numbers only apply to the dataset we trained and tested on, not the billions of images in existence.

I'm still happy to verify this though if you link to it. I'm asking for a link so there's no error in verifying.

TechnikEmpire avatar Jan 08 '21 16:01 TechnikEmpire

https://github.com/GantMan/nsfw_model/releases/download/1.2.0/mobilenet_v2_140_224.1.zip

Its the model from the web model folder which has this false positive

linkle69 avatar Jan 08 '21 17:01 linkle69

I can confirm that this is just a false positive.

TechnikEmpire avatar Jan 12 '21 16:01 TechnikEmpire

With relatively low confidence I might add, but still a false positive. 57% confidence.

TechnikEmpire avatar Jan 12 '21 16:01 TechnikEmpire