grok-1

grok-1 copied to clipboard

Torrent files size, estimate excluding the file system. 

GraoMelo

ValueError: Number of devices 1 must equal the product of mesh_shape (1, 8)

9

 I dunno what is going on here. By the way, there's a very big error while I am using the Hugging Face client, but I don't think that will...

CodeBotanist

Add type hints to codebase

2

Is this in scope and worth the effort? If so I can pick it up

alex-96-eng

An open-source third-party training with 8 GPUs

1

Hi everyone interested in Grok-1: We are the ModelScope team, we trained Grok-1 HF version(https://www.modelscope.cn/models/colossalai/grok-1-pytorch/summary) with our training framework SWIFT(https://github.com/modelscope/swift). We use DeepSpeed zero-3 with cpu offload to train Grok-1,...

tastelikefeet

Related to run it locally

2

How can we run the model locally total space of my laptop is 512 GB in which has only max to max of 80 gb but this model also looks...

y3rawat

I have 10 A100 gpu, but 4 in one host, 6 in another host, how to install grok loacally?

u200915986

How much memory is "enough"?

5

pattang56892

Hello, congratulations on the initiative to share the project on GitHub. I would like to suggest that the hardware requirements be explicitly stated in the documentation. When analyzing the dependencies:...

GraoMelo

fixed #328 requiriments por install.

GraoMelo

I want to self host it but theres not buit in api can someone add that

japlic