zhuliyi0

wow super cool! I was planning to train VAE to re-create certain architecture styles with consistent details, so I found this dataset on HF: https://huggingface.co/datasets/Xpitfire/cmp_facade Not a big dataset though,...

I got the script to run, but looks like my 12G VRAM is far from enough. I assume vram will go down once adam8bit and other optimizations is in place?

I am a total newbie on python and ML. I am still trying to run the script on my local GPU, right now the OOM is gone after I stick...

I got training to run on my local GPU on Windows. The directory error was due to path naming convention in Windows. Again from validation images I can see it...

Totally understand that the script wouldn't be perfect at this point. I am glad to help whenever I can. I will try using pipeline to test inference performance. @Pie31415

here is a training test run: https://wandb.ai//zhuliyi0/goa_5e5/reports/VAE-training-test--Vmlldzo0ODYzMzcx Also did a quick inference test using a finetuned model that was trained on the same dataset, compare results with the default and...

I made the project public. And the weight file: https://drive.google.com/file/d/1gTQqWuVA7m7GYIStVbulYS-tN_CMY-PM/view?usp=sharing Some inference image that shows the white-wash issue, using VAE at step 4k - 40k, gradually getting worse: https://drive.google.com/drive/folders/16ivRLiLgb7dDixfFbNIL7vf_wNe9BaRO?usp=sharing

@Pie31415 I re-run a training with new script, the result was conceivably no different. The white wash issue still exist, the same as previous. Seems like the training gradually makes...

I tried the new scripts with kl and ipips not zero, and white wash isssue seems to be gone, however the test images are blurred and over-saturated. Still tunning more...

About whether to only train the decoder: the validation images during training does not have any issue that the test image had, white-wash or blur. Wonder if this is because...