Daniel Han

Sorry on the delay - I added `accelerate>=0.34.2` in `pyproject.toml` so future installs won't have this issue - thanks for the fixes everyone!

Just fixed the `weights_only` issue and also ` Failed to create dynamic compiled` issue - apologies on the issue - I changed the logic of how I create modules! For...

Decrease `per_device_train_batch_size` - it's way too large!

Reminder to do `pip install --upgrade unsloth unsloth_zoo` for GRPO evaluation to work! :)

Yep vLLM has some cool docs - would adding it into an Unsloth notebook be helpful?

Ok will try add some vLLM examples!

I'll investigate - thanks for reporting

Will prioritize this!

@kholiavko-roman @kupletist Apologies on the delay - I just tried saving to GGUF again via Colab for Gemma 2 and it functions fine - see https://colab.research.google.com/drive/1oImvTXhxHig-_6G2nq0qz7d7KScw_Lir?usp=sharing

Oh so Gemma-2 Base does not work - weird I'll check