ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

[Question]: Why is the save training model so big using the peft training way?

Open HaixHan opened this issue 2 years ago • 1 comments

🐛 Describe the bug

In stage 1 and stage 3, the size (about 13GB) of the training model is very big using the peft training way. I have set "lora_rank">0 when training sft or prompt method? Why do I get an error when I try to use "actor.save_pretrained(args.save_path):“ "AttributeError: 'BLOOMActor' object has no attribute 'save_pretrained " image image

Environment

No response

HaixHan avatar Apr 13 '23 13:04 HaixHan

Hi, why not using trainer's saving utility?

JThh avatar Apr 17 '23 09:04 JThh