starcoder icon indicating copy to clipboard operation
starcoder copied to clipboard

Published 20 hours ago • verified publisher icon bigcode-project

hardware requirement for fine tuning.

Open Kushalamummigatti opened this issue 1 year ago • 0 comments

what is the max token size for finetuning? Please provide insight on the hardware requirement for fine tuning the model? Can i finetune with 4 GPU of 16gb each?

Kushalamummigatti avatar Jun 16 '23 14:06 Kushalamummigatti