CodeGen icon indicating copy to clipboard operation
CodeGen copied to clipboard

Published 20 hours ago • verified publisher icon salesforce

memory out of error. Hardware requirements

Open Kushalamummigatti opened this issue 1 year ago • 1 comments

I have tried to finetune Codegen 2B Mono on 40GB GPU (single card) with sequence length set as 256. It gave CUDA memory out of error. What is the GPU memory required to finetune 2B and above models?

Kushalamummigatti avatar Jun 16 '23 17:06 Kushalamummigatti