axodox-machinelearning icon indicating copy to clipboard operation
axodox-machinelearning copied to clipboard

LoRA support

Open alex-aparin opened this issue 1 year ago • 5 comments

Is there any way to use LoRA models with the library? Should be they converted like main models?

alex-aparin avatar Jun 16 '23 13:06 alex-aparin

This guide from Microsoft suggests that it could work, but I did not try it: https://github.com/microsoft/Olive/tree/main/examples/directml/stable_diffusion

axodox avatar Jun 16 '23 15:06 axodox

Thank you. This experiment will be my next step.

alex-aparin avatar Jun 17 '23 16:06 alex-aparin

Hello Alex, did it work? I would be also interested in using LoRA models

arturodrt avatar Jul 20 '23 00:07 arturodrt

As far as I know there is a limitation that ONNX converted LORA-s weights would be "burned into" the original model, as such it would consume a lot of HDD space to use them. However I have heard that the ONNX converter will eventually provide features which make loading safetensors directly feasible.

axodox avatar Jul 22 '23 14:07 axodox

@Artuurodrt Hello. I am sorry for late response. Unfortunately I stopped my research. Still have no idea whether it's possible or not.

alex-aparin avatar Jul 31 '23 18:07 alex-aparin