AudioLDM-training-finetuning icon indicating copy to clipboard operation
AudioLDM-training-finetuning copied to clipboard

Support LoRA finetuning in the future?

Open ZhengJun-AI opened this issue 1 year ago • 1 comments

Thanks for your great work! I have made a personal dataset for finetuning, but I think my small dataset will make the model worse. And I find that the LoRA finetuning method is generally applied in diffusion models, which is better than directly finetuning the whole UNet model. Will this repo support LoRA finetuning method in the future?

ZhengJun-AI avatar Nov 20 '23 07:11 ZhengJun-AI

Yes that's a great idea. LoRA and other adapter is for sure the good direction to go. I'll implement that when I have time or other guys on GitHub may be interested in contributing to that.

haoheliu avatar Nov 22 '23 19:11 haoheliu