StabilityMatrix icon indicating copy to clipboard operation
StabilityMatrix copied to clipboard

[Feature Request] Prompt templating for Inference UI

Open sttollgrin opened this issue 1 year ago • 3 comments

Please consider adding syntax that would add ability to create dynamic prompts that are resolved every time new image is generated. For example (all syntax listed below is just an example based on existing <lora/embeddings> syntax):

a <random:girl|boy> with <random:red|green|purple|yellow|black> hair in style of <random:artist1, <lora:style_artist1:0.8>|artist2, <lora:style_artist2:0.9>>

upon running image generation would resolve to something like:

a girl with purple hair in style of artist1, <lora:style_artist1:0.8>

or

a boy with black hair in style of artist2, <lora:style_artist2:0.9>

and generate image according to that resolved prompt.

Moreover, with multiple batches, each batch would have new prompt generated so running above with 5 batches may generate 5 different prompts:

a girl with purple hair in style of artist1, <lora:style_artist1:0.8>
a boy with black hair in style of artist2, <lora:style_artist2:0.9>
a girl with yellow hair in style of artist2, <lora:style_artist2:0.9>
a girl with red hair in style of artist1, <lora:style_artist1:0.8>
a boy with purple hair in style of artist2, <lora:style_artist2:0.9>

and so on

it should be also possible to select multiple choices at once

a girl with two color hair, <random,2:red|green|purple|yellow|black>

could generate for example

a girl with two color hair, red, green
a girl with two color hair, yellow, purple

other possible enhancements could include combinatorial prompt generation:

a <combinatorial:girl|boy> with <combinatorial:red|green|purple> hair

would generate all combinations of possible prompts

a girl with red hair
a girl with green hair
a girl with purple hair
a boy with red hair
a boy with green hair
a boy with purple hair

and generate image for each possible prompt (so for example here, with batch count=1 it would actually generate 6 different images, with batch count=2 it would be 12 images etc)

sttollgrin avatar Jul 17 '24 15:07 sttollgrin

This issue is stale because it has been open 30 days with no activity. Remove the stale label or comment, else this will be closed in 5 days.

github-actions[bot] avatar Aug 17 '24 01:08 github-actions[bot]

This issue is stale because it has been open 30 days with no activity. Remove the stale label or comment, else this will be closed in 5 days.

github-actions[bot] avatar Sep 17 '24 01:09 github-actions[bot]

This issue was closed because it has been stale for 5 days with no activity.

github-actions[bot] avatar Sep 22 '24 02:09 github-actions[bot]

This issue is stale because it has been open 30 days with no activity. Remove the stale label or comment, else this will be closed in 5 days.

github-actions[bot] avatar Oct 23 '24 02:10 github-actions[bot]

This issue was closed because it has been stale for 5 days with no activity.

github-actions[bot] avatar Oct 28 '24 02:10 github-actions[bot]