grok-1
grok-1 copied to clipboard
xai-org
Grok open release
### Rule 69: Make Love, not SPAM! Github issues are meant to point out issues with code such as bugs or other development and running related problems, suggestions etc. Avoid...
What are minimum and recommended hardware requirements to run the model and to do training? 1. How much GPU Memory (VRAM) is required? 2. How much RAM is required? 3....
Reproducing steps: 1. Clone the grok-1 [repo](https://github.com/xai-org/grok-1.git) 2. Install the jax library: ```sh pip install -U "jax[cuda12_pip]" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html ``` 3. Install the requirements: ```sh pip install -r requirements.txt ```...
https://github.com/xai-org/grok-1/blob/d6d9447e2d3c9bd81da571dc8681ea60009e4c03/runners.py#L266 The inference runner loads the tokenizer from `/tmp/` by default. Are users meant to replace the default value in each use? Is there intended to be a function that...
Dataset
What dataset was used to train grok? Will it be open-sourced? How are you going to make model/dataset up to date? Can you provide an example of dataset? This issue...
Hello, when I execute "python run.py", (I use jaxlib-0.4.25 cuda 11.8). it has the error: File "/grok/grok-1/grok-1-main/runners.py", line 597, in sample_from_model next(server) File "/grok/grok-1/grok-1-main/runners.py", line 481, in run rngs, last_output,...
Hi, I am trying to run it （python run.py）, but the process exits by segmentation fault (address not mapped to object at address). I am running it on Linux (1007G...
Original title: > Has the running script evoked container? ERROR is: OCI runtime exec failed: exec failed: container_linux.go:348: starting container process caused "process_linux.go:86: executing setns process caused "exit status 21"":...
Adding some exception handling to LanguageModel and added a comment around the implementation of DenseBlock. Usually the widening -> gelu -> projection is sequential but this implementation isn't, I'm curious...
INFO:rank:Loading checkpoint at ./checkpoints/ckpt-0 Traceback (most recent call last): File "C:\Users\w2983\Desktop\grok-1\checkpoint.py", line 52, in copy_to_shm shutil.copyfile(file, tmp_path) File "C:\Users\w2983\AppData\Local\Programs\Python\Python39\lib\shutil.py", line 264, in copyfile with open(src, 'rb') as fsrc: FileNotFoundError: [Errno...
