CrossAttentionControl icon indicating copy to clipboard operation
CrossAttentionControl copied to clipboard

Add direct target editing to the notebook

Open tugot17 opened this issue 2 years ago • 1 comments

It would be great to have a direct target editing in the notebook examples. Something like: obraz

Code for this:

#https://lexica.art/prompt/2127efd3-e23b-44dc-baac-494993bc9688
image = stablediffusion("A photo of a Corgi dog riding a bike in Times Square wearing sunglasses and beach hat, cinestill, 800t, 35mm, full-HD",
                        seed=2401809524,
                        guidance_scale=7,
                        steps = 150)
image
prompt = "A photo of a teddy bear riding a bike in Times Square wearing sunglasses and beach hat, cinestill, 800t, 35mm, full-HD"

print(prompt_token(prompt, 5), prompt_token(prompt, 6))

stablediffusion(prompt,
                        seed=2401809524,
                        guidance_scale=7,
                        prompt_edit_token_weights = [(5, 5), (6, 5)],
                        init_image=image,
                        steps=150)

tugot17 avatar Oct 09 '22 09:10 tugot17

Thanks for the suggestion, I will try to improve the code and add more examples to the notebook eventually. Right now I am focused on completing the implementation from the paper (a small section at the end is not yet implemented) and making it compatible with diffusers==0.4.0, but feel free to send a pull request if you would like to work on this.

bloc97 avatar Oct 09 '22 16:10 bloc97