DiffusionCLIP icon indicating copy to clipboard operation
DiffusionCLIP copied to clipboard

Finetuning bedroom models

Open GaParmar opened this issue 1 year ago • 1 comments

Hi,

This work is amazing! I am trying to reproduce the bedroom editing results you have shown in the paper. I can achieve them when I use the pretrained finetuned model provided in google drive. However when I try to finetune the model myself, I get very poor results. This is the command I used for finetuning the model. Could you tell me if some of the hyperparemeters are set incorrectly here?

python main.py --clip_finetune \
            --config bedroom.yml      \
            --exp ./test_runs/bedrooms_full        \
            --edit_attr "bedroom_princess"  \
            --do_train 1             \
            --do_test 1              \
            --n_train_img 50         \
            --n_test_img 10          \
            --n_iter 5               \
            --t_0 500                \
            --n_inv_step 40          \
            --n_train_step 6         \
            --n_test_step 40         \
            --lr_clip_finetune 8e-6  \
            --id_loss_w 0            \
            --l1_loss_w 1

-Gaurav

GaParmar avatar Aug 26 '22 02:08 GaParmar

have you get good results finally

wzr1201 avatar Feb 22 '24 07:02 wzr1201