IF icon indicating copy to clipboard operation
IF copied to clipboard

Published 20 hours ago • verified publisher icon deep-floyd

finetune

Open betterftr opened this issue 1 year ago • 6 comments

Finetuning code will be released as well? Awesome project btw! Cant wait to train a custom model

betterftr avatar Apr 28 '23 18:04 betterftr

awesome project! looking forward to the finetuning code

pigtigger avatar May 01 '23 05:05 pigtigger

Just repurpose the imagen trainer script. Until they release their paper, just use random search and figure the best hyperparameters to you. Currently trying to figure out myself, I'm beyond thirsty lol.

https://github.com/lucidrains/imagen-pytorch/blob/main/imagen_pytorch/trainer.py

darkman111a avatar May 03 '23 15:05 darkman111a

@darkman111a Have you made any progress with fine-tuning the IF model? If so could you please share it? I don't have enough knowledge to modify the Imagen code and would be very appreciated for your help!

baleksey avatar May 07 '23 16:05 baleksey

+1

alelordelo avatar May 25 '23 12:05 alelordelo

@darkman111a hi, have you sucessfully fine-tuned the IF model? I would appreciate it if you could share your training configs.

TheSilverBullets avatar Jun 06 '23 04:06 TheSilverBullets

I have just published an Open Source version of Textual Inversion to incorporate your own objects, faces, logos or styles into DeepFloyd IF: https://github.com/oss-roettger/T5-Textual-Inversion The clear and short notebook runs within 24 GB CUDA memory. Feedback welcome! Kind regards Hans

oss-roettger avatar Jun 13 '23 19:06 oss-roettger