CPM-Bee icon indicating copy to clipboard operation
CPM-Bee copied to clipboard

Published 20 hours ago • verified publisher icon OpenBMB

微调GPU需求

Open baihuajun24 opened this issue 1 year ago • 5 comments

微调10B模型有推荐的GPU要求么，比如说至少多少内存l? 20G内存和单张3090是推理的需求吧，如果要跑finetune 10B模型，最少要几张3090呀, 支持QLora, ptuning这种节约计算的形式么?

baihuajun24 avatar May 29 '23 06:05 baihuajun24