WizardLM icon indicating copy to clipboard operation
WizardLM copied to clipboard

Multi gpu for 30B

Open zachNA2 opened this issue 1 year ago • 0 comments

How can we use the 30B model on multiple gpus? Is there a straight python implementation?

zachNA2 avatar Jun 19 '23 19:06 zachNA2