diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

Support for load hypernet finetune .pt file

Open CrazyBoyM opened this issue 3 years ago • 4 comments

does the txt2img pipe support load a finetune .pt file to improve the output performance of checkpoint model ?

CrazyBoyM avatar Oct 07 '22 14:10 CrazyBoyM

Hey @CrazyBoyM,

Sorry I don't understand the question here

patrickvonplaten avatar Oct 07 '22 17:10 patrickvonplaten

sorry for my poor english. it is mean hypernetwork and text inversion, just like a option in the webui version of staable diffusion, load a single finetune file to improve the base model.

CrazyBoyM avatar Oct 07 '22 17:10 CrazyBoyM

You can extend the script using the method from this notebook: https://colab.research.google.com/github/huggingface/notebooks/blob/main/diffusers/stable_conceptualizer_inference.ipynb

Have a look at the "Load the newly learned embeddings into CLIP" section. text_encoder and tokenizer are properties of the pipeline object.

allo- avatar Oct 09 '22 18:10 allo-

You can extend the script using the method from this notebook: https://colab.research.google.com/github/huggingface/notebooks/blob/main/diffusers/stable_conceptualizer_inference.ipynb

Have a look at the "Load the newly learned embeddings into CLIP" section. text_encoder and tokenizer are properties of the pipeline object.

Thanks for help.I will take it a try.

CrazyBoyM avatar Oct 10 '22 09:10 CrazyBoyM