petals icon indicating copy to clipboard operation
petals copied to clipboard

Published 20 hours ago • verified publisher icon bigscience-workshop

Grok | Mixture-of-Experts | Model Support

Open tibrezus opened this issue 3 months ago • 3 comments

Grok architecture and weights were just released, do Petals support, or is it in plan to support Grok and MOE models? Having a first in class 314B parameter model running on consumer hardware would be great! Thanks in advance.

tibrezus avatar Mar 17 '24 22:03 tibrezus