SD-Latent-Interposer icon indicating copy to clipboard operation
SD-Latent-Interposer copied to clipboard

Support for AuraFlow

Open metapea opened this issue 1 year ago • 3 comments

Can you add any support for AuraFlow? (Preferably SD LoRas to AuraFlow checkpoint at least)

metapea avatar Aug 12 '24 04:08 metapea

Doesn't this also just use the SDXL VAE? Selecting XL should make it work.

https://huggingface.co/fal/AuraFlow/blob/main/vae/diffusion_pytorch_model.fp16.safetensors

https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0/blob/main/vae/diffusion_pytorch_model.fp16.safetensors

city96 avatar Aug 22 '24 21:08 city96

Doesn't this also just use the SDXL VAE? Selecting XL should make it work.

That would make the rest easier if that's the case, but is it even possible to add support for XL/PonyXL Loras to a AuraFlow checkpoint? A XL lora most likely wouldn't work on AuraFlow.

metapea avatar Nov 08 '24 18:11 metapea

This repo is only for converting the latents between models for doing img2img on the output of one model with a second model that uses a different latent space.

What you're thinking of is X-Adapter but I have no clue if it exists for AuraFlow.

city96 avatar Nov 08 '24 22:11 city96