Moore-AnimateAnyone icon indicating copy to clipboard operation
Moore-AnimateAnyone copied to clipboard

SDXL support

Open gsrujana opened this issue 2 years ago • 1 comments

Hello, Is it possible to use this with SDXL instead of SD1.5? Also, for training this model with SDXL base model.

gsrujana avatar Feb 01 '24 17:02 gsrujana

From some research, the reason its not supported on SDXL is due to the "sd-image-variations" model was only finetuned on sd 1.5. I believe there's been an SDXL (or SD 2.1) initiative to achieve something similar. Will take a look and check back.

Stability AI themselves released Unclip for SD 2.1 (https://huggingface.co/stabilityai/stable-diffusion-2-1-unclip), this is effectively the same as sd-image-variations

SDXL currently has an open issue requesting Unclip for SDXL (https://github.com/Stability-AI/generative-models/issues/22)

It looks like SDXL-refiner is already an image-to-image variation model, so it may very well work

matbeedotcom avatar May 21 '24 17:05 matbeedotcom