FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Finetune 13b model on V100 with bs1 in int8 got OOM?

Open luohao123 opened this issue 2 years ago • 0 comments

Finetune 13b model on V100 with bs1 in int8 got OOM?

I already enabled Deepspeed

luohao123 avatar Jun 04 '23 11:06 luohao123