BELLE icon indicating copy to clipboard operation
BELLE copied to clipboard

请问模型运行时的内存和显存需要多少?

Open MingJiaAn opened this issue 1 year ago • 6 comments

我这边60G的内存在AutoModelForCausalLM.from_pretrained过程溢出了

MingJiaAn avatar Mar 22 '23 09:03 MingJiaAn