gmonair

Context length for DPO on a 7b model

3

I'm working on using DPO based on the ```DPO Zephyr Unsloth Example.ipynb``` notebook. I'm loading the model like so: ``` max_seq_length = 32768 model, tokenizer = FastLanguageModel.from_pretrained( model_name = "models/DeepSeek-R1-Distill-Qwen-7B",...