LongWriter icon indicating copy to clipboard operation
LongWriter copied to clipboard
verified publisher icon THUDM

Hardware requirements for Training/Finetuning?

Open CHesketh76 opened this issue 1 year ago • 1 comments

I have a 3070Ti and was wondering if running this training pipeline on consumer grade hardware is possible. If not, then what is the recommend hardware requirement and cost of training?

CHesketh76 avatar Oct 16 '24 18:10 CHesketh76

Hi, I'm sorry but I don't think RTX 3070Ti has sufficient memory size for training or running LongWriter model. We train on 8xH800 (80GB) for full fine-tuning (LoRA and quantization may reduce the memory utilization).

bys0318 avatar Oct 19 '24 08:10 bys0318