diffusers
                                
                                 diffusers copied to clipboard
                                
                                    diffusers copied to clipboard
                            
                            
                            
                        π€ Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
Added v-prediction to FlaxDDIM and FlaxDDPM schedulers as well as the Flax training examples.
No hardcoded names anymore in textual inversion.
Generally speaking, I am not clear on what to do with the output of these LoRA python scripts. I don't think the output can be natively used by the webuis....
[ControlNet](https://github.com/lllyasviel/ControlNet) by @lllyasviel is a neural network structure to control diffusion models by adding extra conditions. Discussed in #2331. Done at PoC level, but there's still work to be done...
Original codebase: https://github.com/haoheliu/AudioLDM Checkpoints: https://huggingface.co/spaces/haoheliu/audioldm-text-to-audio-generation/tree/main/ckpt TODOs **UNet** - [x] Convert UNet weights - [x] Add new modelling code - [x] Verify correctness **VAE** - [x] Convert VAE weights - [x]...
I generated a LoRA with the following command. My `dataset_name` points to a folder with 17 images of my face, and a `metadata.jsonl` with the appropriate format required by π€...
I use U2Dmodel with nn.DataParallel if torch.cuda.device_count() > 1: model = nn.DataParallel(model) Then I try to get the output. model_output = model(noisy_images, timesteps) The model _output is UNet2DOutput(sample=) model _output.sample...
### Describe the bug when train this code with multiple gpu  I got a bug like this  ### Reproduction I just mutify...
Hello, I'm trying to come up with an image variation model, where the input would be an unstained pathology image and the model would output a stained version of the...
This PR edits the ["Controlling generation" doc](https://huggingface.co/docs/diffusers/main/en/using-diffusers/controlling_generation) to include several details on memory, distinct differences between the methods like InstructGPT and Pix2PixZero (that may not be very obvious to the...