How to do fp16 finetuning for dreambooth inpainting?

[shileims]

Hi @thedarkzeno and @patil-suraj Thanks for your excellent work on dream booth inpainting. My question is that how to perform fp16 dreambooth inpainting fine-tuning?

[patil-suraj]

Hey @shileims you can configure accelerate to use mixed precision, use accelerate config and it'll ask you bunch of question when it asks about mixed precision, choose fp16. Or you could also just pass --mixed_precision="fp16" as an argument to the script.

[AmericanPresidentJimmyCarter]

As far as I can tell, there is no code in this repo to train an inpainting/outpainting model like the RunwayML model.

[AmericanPresidentJimmyCarter]

Update: there is a training script for inpainting here based off of the ones from diffusers

https://github.com/devilismyfriend/StableTuner/blob/main/scripts/trainer.py

[patil-suraj]

thank you for sharing!

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.