Sparsebit icon indicating copy to clipboard operation
Sparsebit copied to clipboard

Published 20 hours ago • verified publisher icon megvii-research

Support lama65b single a100 finetuning

Open Jiang-Stan opened this issue 1 year ago • 0 comments

修改后4bit LoRA finetune w/ lr 3e-4表现与alpaca-lora原repo 8bit表现一致。见下图：

2023-06-13 10-49-38 的屏幕截图

Jiang-Stan avatar May 25 '23 09:05 Jiang-Stan