How to finetune loar model on the other loar model?

Open 2718564960 opened this issue 2 years ago • 1 comments

Hi, master. How to finetune loar model on the other loar model?

hi，大师。如何在一个loar model上再预训练呢？

Apr 27 '23 04:04 2718564960

Hi, you can merge it by referring to ./scripts/run_finetune_with_lora_save_aggregated_weights.sh and then tune a new lora based on it.

Apr 27 '23 13:04 shizhediao