sudhir2016

Error when trying to run quick start code

3

### Reminder - [X] I have searched the Github Discussion and issues and have not found anything similar to this. ### Environment ```markdown - OS: - Python: - PyTorch: -...

Lamma2 training on dataset downloaded from Huggingface.

13

I am trying to use Ludwig to finetune Llama2 7b in Colab with a Alpaca type dataset downloaded from Huggingface. Using the example notebook provided. Tried various approaches without success....

Tried the quick start code in free tier Google Colab. Got out of memory error. Is this expected ? from vllm import LLM, SamplingParams model = LLM("selfrag/selfrag_llama2_7b", download_dir="/gscratch/h2lab/akari/model_cache", dtype="half") sampling_params...

I trained a model with the Qwen2.5 (3B) - GRPO notebook provided. I got this response on inference with saved lora. To determine the number of r's in the word...