OLMo

OLMo copied to clipboard

Added paper references.

ViswanathaReddyGajjala

Set from_tf=True (Problems installing)

9

### ❓ The question I am new to OLMo. I am not a PyTorch person. I am installing OLMo from Git (I would like to try fine tuning). I created...

andrewfr

[Inquire of MMLU Performance]

1

### ❓ The question Hello OLMo team, I have a question regarding the MMLU performance, which is currently at 28, appearing to be quite low. Could there be an issue...

yushengsu-thu

freeze official configs for reproductions

2

Creates official copies of the configs we used to train the released models, with sensible names. Still TODO: - [x] Save 1B config to `configs/official/OLMo-1B.yaml`. @soldni - [ ] Update...

epwalsh

Tokenizer for `prepare_tulu_data.py` not found

2

### 🐛 Describe the bug First of all, thanks a lot for Open Sourcing OLMo! I tried running the `scripts/prepare_tulu_data.py` and faced the following error: ``` 2024-02-02 05:36:05.619 5a0b0b9dc92e:0 olmo.util:152...

tanaymeh

This PR updates the README to include the minimum Python version requirement (>=3.10), addressing confusion and compatibility issues highlighted in issue #422 ### Changes include: - A new section at...

engichang1467

Training code

1

### 📚 The doc issue In the release there is a link to "training code" but it just leads to the github that doesn't document how can one reproduce training...

borgr

ReLoRA - what we've learned

2

epwalsh

dirkgr

step0 optimizer state makes no sense

2

We write out optimizer state for step0, but it doesn't make sense to have it. Thankfully the file we write is small, but it actually crashes when you try to...

dirkgr