subsai icon indicating copy to clipboard operation
subsai copied to clipboard

Censoring

Open MidnightKittenCat opened this issue 1 year ago • 10 comments

Are there any models that don't have any nsfw censoring?

MidnightKittenCat avatar Jan 03 '24 03:01 MidnightKittenCat

I don't know to be honest, but I think the "models" are just different implementations of the Whisper architecture and the model weights are still the same from openAI, so all the implementations will behave in the same way I assume.

absadiki avatar Jan 03 '24 05:01 absadiki

I don't know to be honest, but I think the "models" are just different implementations of the Whisper architecture and the model weights are still the same from openAI, so all the implementations will behave in the same way I assume.

Not quite sure about this so just thought I’d check with you on it.

“ NLLB 200 can translate in 200 languages, which makes it even more attractive! Quality seems to be on par with Opus MT in the languages we've tested. The model does not enforce any sort of filtering on adult content”

Could we have the option to have different translation methods? Such as google translate, NLLB 200

MidnightKittenCat avatar Jan 03 '24 12:01 MidnightKittenCat

I didn't know about NLLB 200 .. it seems interesting. Thanks for letting me know. Yes, I think I can add it to the translation models if you need it!

For google translate, the official API will need keys and stuff .. And I want the project to be free from third party services, just self hosted AI models.

absadiki avatar Jan 04 '24 01:01 absadiki

I didn't know about NLLB 200 .. it seems interesting. Thanks for letting me know. Yes, I think I can add it to the translation models if you need it!

For google translate, the official API will need keys and stuff .. And I want the project to be free from third party services, just self hosted AI models.

Yes please that'd be great!

MidnightKittenCat avatar Jan 04 '24 07:01 MidnightKittenCat

I didn't know about NLLB 200 .. it seems interesting. Thanks for letting me know. Yes, I think I can add it to the translation models if you need it!

For google translate, the official API will need keys and stuff .. And I want the project to be free from third party services, just self hosted AI models.

Could we also add translation models such as opus and perhaps madlad from google? if not all's good! having nllb alone would be a game changer ;P

MidnightKittenCat avatar Jan 04 '24 16:01 MidnightKittenCat

Here you go @MidnightKittenCat, nllb200 has been added to the translation models.

I am really surprised how good it is :) I don't think opus can come even close :D For madlad, It's interesting as well. Thanks for letting me know. Maybe I'll add it later.

For now please update the package and give nllb200 a try. Let me know if you found any issues ?

absadiki avatar Jan 04 '24 23:01 absadiki

Here you go @MidnightKittenCat, nllb200 has been added to the translation models.

I am really surprised how good it is :) I don't think opus can come even close :D For madlad, It's interesting as well. Thanks for letting me know. Maybe I'll add it later.

For now please update the package and give nllb200 a try. Let me know if you found any issues ?

Great! I’m not home as of this moment so I’m a few hours I can give it a try, this should definitely fix the filtering issue I’ve been having ;P thanks a ton!

Definitely looking forward to madlad

MidnightKittenCat avatar Jan 05 '24 00:01 MidnightKittenCat

You are welcome :) Take your time .. just wanted to make sure it's working without a problem on your side.

absadiki avatar Jan 05 '24 01:01 absadiki

You are welcome :) Take your time .. just wanted to make sure it's working without a problem on your side.

Just got back, I do not see the option to choose the translation model anywhere in the webui. If there currently is no way to change the translation model in the webui could we have that added? Thanks! :D

MidnightKittenCat avatar Jan 05 '24 05:01 MidnightKittenCat

It is in the webui as well. Make sure to update the package first, then from post processing tools, choose translation and select the nllb200 from the drop down menu, then check Create the model.

absadiki avatar Jan 05 '24 06:01 absadiki