Releasing LoRA Trainer Code

[peteromallet]

Hi Yuwei, do you have any ETA on when you wil release the LoRA trainer code? Many in the community have different ideas on how to use it.

[jiaxiangc]

I try to train lora with peft, the results of training are right. But i can not load lora ckpt rightly.

[alexhe101]

I try to train lora with peft, the results of training are right. But i can not load lora ckpt rightly. @jiaxiangc I am writing code to train it by LORA, can we have chance to discuss this