Yunchen Zhang
Yunchen Zhang
anybody solved?
same question
Yes, it works for BLOOMZ-560m and BLOOMZ-7B1. I got the same problem shown in the @agemagician error message.
> Oh, seeing #15, it seems you have already solved this issue? What was the problem? @agemagician I cannot inference the 176B FP16 model, while I have 1TB RAM. And...
same question, while I have 1000GB RAM