T2I-Adapter icon indicating copy to clipboard operation
T2I-Adapter copied to clipboard

The training details about Unet parameters frozen

Open hda-xian opened this issue 8 months ago • 2 comments

Why are the UNet parameters frozen during training for SD1v5, but not for SDXL? the haggingface training sdxl script sets " Unet.train() "

***** huggingface train sdxl ********* vae.requires_grad_(False) text_encoder_one.requires_grad_(False) text_encoder_two.requires_grad_(False) t2iadapter.train() unet.train()

*******Tencent ARC train sd1v5 ************** model.cuda() model.eval() # model is contain all models vae ,cliptext return model

*******Tencent ARC train sdxl ************** vae.requires_grad_(False) text_encoder_one.requires_grad_(False) text_encoder_two.requires_grad_(False) -> the Unet does not set no grad means Unet need grad

hda-xian avatar Jun 09 '24 14:06 hda-xian