Bailey Kuehl comments

Results 42 comments of


                                            Bailey Kuehl

RuntimeError: Triton Error [CUDA]: invalid device context

Hi, thanks again for the inquiry! We’re currently working on closing out old tickets, so we’re closing this out for now, but if you require a follow-up response, please re-open...

Olmo 0724 `-hf` checkpoints don't load the proper config when instantiating with OLMoForCausalLM

Thanks, Sarah! We’re currently working on closing out old tickets, so I'm closing this out for now, but if more action is needed, please re-open and we can discuss it...

Model ladder has no documentation

Hi, thanks again for the inquiry! We’re currently working on closing out old tickets, so we’re closing this out for now, but if you require a follow-up response, please re-open...

Does global_train_batch_size support gradient accumulation?

Hi, thanks again for the inquiry! We’re currently working on closing out old tickets, so we’re closing this out for now, but if you require a follow-up response, please re-open...

Is there explicitly instruction-following data in the version of Dolma used to train v1?

Hi, thanks again for the inquiry! We’re currently working on closing out old tickets, so we’re closing this out for now as it looks like it was resolved, but if...

How the 1B and 7B model are initialized?

Hi! Thanks for the question. We’re currently working on closing out old tickets, and we apologize that we didn’t get to you in a timely fashion. We’re closing this out...

Resuming training on unsharded checkpoint

Hi! Thanks for the feedback. We’re currently working on closing out old tickets, and we apologize that we didn’t get to you in a timely fashion. We’re closing this out...

Cant use LORA

Hi, thanks again for the inquiry! We’re currently working on closing out old tickets, so we’re closing this out for now, but if you require a follow-up response, please re-open...

is_causal=attention_bias is None

Hi, thanks again for the inquiry! We’re currently working on closing out old tickets, so we’re closing this out for now, but if you require a follow-up response, please re-open...

How many tokens were trained for 7B model.

Hi, thanks again for the inquiry! We’re currently working on closing out old tickets, so we’re closing this out for now, but if you require a follow-up response, please re-open...