stanford_alpaca icon indicating copy to clipboard operation
stanford_alpaca copied to clipboard

Published 20 hours ago • verified publisher icon tatsu-lab

OOM issue

Open puyuanliu opened this issue 1 year ago • 8 comments

Can this finetuning script fit into A10, which only has 24GB GPU memory? I am trying to fine-tune the model on 4 A10 GPUs using a batch size of 1, but I still get an OOM error.

puyuanliu avatar Mar 16 '23 06:03 puyuanliu