ControlNet icon indicating copy to clipboard operation
ControlNet copied to clipboard

loading error on CLIPTExtModel

Open yyua8222 opened this issue 2 years ago • 3 comments

Hi, just trying for the script, but got an error when loading the pre-trained cliptextmodel, it seems that CLIPTextModel can not directly load as "openai/clip-vit-large-patch14", am I wrong and how can I fix this problem, thanks

yyua8222 avatar Feb 21 '23 16:02 yyua8222

I got the same error and it is duplicated issue as #263 and maybe #336. Please help me if there is anybody succeeds in training custom dataset.

dedoogong avatar May 03 '23 12:05 dedoogong

Actually, I have fixed this problem, this should be the issue that the current CLIP version from huggingface has been updated, so just simply forced the CLIP initial model to the correct parameter size of the checkpoint, and it could run.

yyua8222 avatar May 03 '23 12:05 yyua8222

I solved it by update transformers

Yangel-hide avatar Jan 16 '24 12:01 Yangel-hide