SillyTavern icon indicating copy to clipboard operation
SillyTavern copied to clipboard

[FEATURE_REQUEST] Jailbreak support for Image prompt templates

Open xalyy opened this issue 10 months ago • 7 comments

Have you searched for similar requests?

No

Is your feature request related to a problem? If so, please describe.

No response

Describe the solution you'd like

I would like to be able to insert jailbreaks in the image prompts templates. If you try to generate a description prompt for the generated images with Claude it doesnt work since Claude has to be jailbroken for it to work. A tickable box would be nice where you can enable jailbreaks for it.

Describe alternatives you've considered

No response

Additional context

No response

Priority

Medium (Would be very useful)

Are you willing to test this on staging/unstable branch if this is implemented?

Yes

xalyy avatar Apr 25 '24 19:04 xalyy

I think the better feature would be to have macros work in image gen prompts. That way you could simply add your jailbreak there via its macro, or even put a specific one into a variable.

Wolfsblvt avatar Apr 27 '24 20:04 Wolfsblvt

Macros should be working in image prompts without any modifications since day 1 of the ImageGen extension.

Cohee1207 avatar Apr 27 '24 20:04 Cohee1207

Yup, you are correct.

So you can either use {{charJailbreak}} at the beginning of your image prompts,
or more specific, create your own jealbreak via

/setglobalvar key=imageGenJailbreak Write your Jailbreak here

and then just add it via {{getglobalvar::imageGenJailbreak}}.

Wolfsblvt avatar Apr 27 '24 20:04 Wolfsblvt

Macros should be working in image prompts without any modifications since day 1 of the ImageGen extension.

Yup, you are correct.

So you can either use {{charJailbreak}} at the beginning of your image prompts, or more specific, create your own jealbreak via

/setglobalvar key=imageGenJailbreak Write your Jailbreak here

and then just add it via {{getglobalvar::imageGenJailbreak}}.

I can try that, thanks for the suggestion guys. Another suggestion I can give is that if there would be an option to choose which language model or API do you want the templates to be handled by, like how it is with image captioning, you can choose multiple APIs.

xalyy avatar Apr 27 '24 20:04 xalyy

Another suggestion I can give is that if there would be an option to choose which language model or API do you want the templates to be handled by, like how it is with image captioning, you can choose multiple APIs.

No, this is impossible due to how complex the handling of different models, their settings, and prompts is. You don't simply say "I want this model!", you need to configure specific instruct formatting, select parameters, configure the system prompt, etc. The list goes on. And with the growing list of supported APIs, this is going to be more and more improbable. STscripts already give control over your currently selected model and its settings - use that instead.

Cohee1207 avatar Apr 27 '24 20:04 Cohee1207

Yup, you are correct.

So you can either use {{charJailbreak}} at the beginning of your image prompts, or more specific, create your own jealbreak via

/setglobalvar key=imageGenJailbreak Write your Jailbreak here

and then just add it via {{getglobalvar::imageGenJailbreak}}.

Just for clarification how will the prefill get added to this? Because as far as I understand Claude still needs the prefill too.

xalyy avatar Apr 27 '24 20:04 xalyy

Macros and extensions are not aware of prefills. You have to monitor the generated prompts to figure it out

Cohee1207 avatar Apr 27 '24 20:04 Cohee1207