DiffusionCLIP
DiffusionCLIP copied to clipboard
tring to reconstrace paper results
Thank you for your great work i am trying to train ( fine tune ) my own model i am running on CelebA-HQ dataset and i try to train my models for changing a face into Neanderthal/pixar but i get bad results
my configuration for Neanderthal fine tuning: mode = "clip_finetune_eff" #"can't run with clip_finetune - gpu memory error" exp = './runs/finetune_Neanderthal' edit_attr = "neanderthal" n_train_img = 50 n_test_img = 10 n_iter = 50 t_0 = 500 n_inv_step = 40 n_train_step = 6 n_test_step = 40 lr_clip_finetune = 8e-6 id_loss_w = 0 l1_loss_w = 1
the results i get :
after 5 epochs (train):
after 8 epochs :
after 10 epochs :
after 12 epochs :
same happen for pixar ( change edit_attr = "pixar" ) after 5 epochs:
after 10 epochs :
after 15 epochs :
what i am doing wrong ? thank you
Thank you for your great work i am trying to train ( fine tune ) my own model i am running on CelebA-HQ dataset and i try to train my models for changing a face into Neanderthal/pixar but i get bad results
my configuration for Neanderthal fine tuning: mode = "clip_finetune_eff" #"can't run with clip_finetune - gpu memory error" exp = './runs/finetune_Neanderthal' edit_attr = "neanderthal" n_train_img = 50 n_test_img = 10 n_iter = 50 t_0 = 500 n_inv_step = 40 n_train_step = 6 n_test_step = 40 lr_clip_finetune = 8e-6 id_loss_w = 0 l1_loss_w = 1
the results i get :
after 5 epochs (train):
after 8 epochs :
after 10 epochs :
after 12 epochs :
same happen for pixar ( change edit_attr = "pixar" ) after 5 epochs:
after 10 epochs :
after 15 epochs :
what i am doing wrong ? thank you
Maybe you should set n_iter=1?
have you obtain good results finally, i also get bad results
have you obtain good results finally, i also get bad results
I use "clip_finetune" instead of "clip_finetune_eff", the results are better.