DeepSpeedExamples icon indicating copy to clipboard operation
DeepSpeedExamples copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

Can I train a opt-6.7B model on 4x4090 gpus?

Open eggqq007 opened this issue 1 year ago • 4 comments

I get 4 4090 gpus, and I want to train the opt-6.7B by using DeepSpeed Chat. Is that possible? I mean I have no idea if I should get a GPU that has enough VRAM or maybe I can use 4 small gpus instead.

eggqq007 avatar Apr 14 '23 05:04 eggqq007