Andy

Hi, I'm interested in helping out. Is this task already taken? If not, could I work on this task?

I'm new to contributing and so I'm a little confused about what I should be doing. Should I clone the changes and make a colab to compare with original predictions?

Definitely would love to dive deeper into this but would love some guidance if possible.

Update: VAE training script runs successfully but I'll need to test on a full dataset and evaluate the results. @zhuliyi0 Is there a dataset you would like me to try...

@zhuliyi0 No worries and thanks for responding. Might be a little busy this week but I'll try out with the new dataset and see if the VAE is improving in...

@zhuliyi0 Perhaps but I can't really confirm anything at the moment. I'm basing hardware requirements on the docs (https://huggingface.co/docs/diffusers/training/text2image): > Using gradient_checkpointing and mixed_precision, it should be possible to finetune...

> Hey @zhuliyi0 , thanks for taking the time to test things. The script is definitely not perfect yet but I'll work on the things you mentioned. In terms of...

> here is a training test run: > > https://wandb.ai//zhuliyi0/goa_5e5/reports/VAE-training-test--Vmlldzo0ODYzMzcx Your wandb experiment seems to be private/locked. > I can confirm VAE is adding details, making the image better. Are...

> Hello, This project is really cool, thank you! I noticed a potential mistake in the code: the kl loss is applied on the output, but I think it should...

@zhuliyi0 I updated the PR with @ThibaultCastells 's code. Can you give your training another try and let us know the results? (e,.g, is the white-washing issue improved) Also, I...