GLM-130B icon indicating copy to clipboard operation
GLM-130B copied to clipboard
verified publisher icon THUDM

Does it support deep speed ZeRO to offload parameters to CPU and NVMe ssd?

Open yt7589 opened this issue 2 years ago • 0 comments

I had used ChatGLM-6B. I could use deep speed tech to offload the parameters to CPU and NVMe ssd. So I could finetune the model on a machine with only one T4 16G card. Dose ChatGLM-130B support deep speed too? Does it support ZeRO stage 3 to offload parameters to CPU memory and NVMe ssd?

yt7589 avatar Apr 24 '23 10:04 yt7589