Do you support finetuning with LoRA?

[StarCycle]

Hello,

Do you support finetuning with LoRA?

Or I can directly use your training code for finetuning (but I am afraid that the model will forget too much knowledge in the pretraining phase)

Best, StarCycle

[23Rj20]

have you been able to finetune using their own implementation??

[StarCycle]

have you been able to finetune using their own implementation??

Not yet. I have no experience on finetuning diffusion models before...I usually finetune LLM. I am not sure whether share similar tools