Daniel Han

@erwe324 Oh thanks again for helping - appreciate it!

@af-74413592 No sorry - currently only LoRA and QLoRA

@ch-tseng Sorry on the issue - you'll have to unfortunately manually convert it to GGUF via https://github.com/unslothai/unsloth/wiki#manually-saving-to-gguf.

I'm unsure if the latest release fixes this

@GeneralProtectionFault Apologies on the delay! Yep so `model.save_pretrained_merged` will merge to 16bit, then use `llama.cpp` to first convert it to `F16` format, then use `llama-quantize` to quantize it. I'm trying...

@iskenderulgen @ch-tseng Sorry on the issue and the delay! You need to uninstall Unsloth then reinstall it ```bash pip uninstall unsloth -y pip install --upgrade --force-reinstall --no-cache-dir git+https://github.com/unslothai/unsloth.git ```

@ch-tseng Oh no thats not good :( Did you manage to restart the Python terminal itself? (I'm assuming yes?) That's very weird it didn't work

@tnunamak Yes can reproduce - sorry working on a fix!

@sion42x Yep working on a fix - i think ill push it in today - much apologies on the issue!

@tnunamak @sion42x Fixed!! On a local machine please reinstall ie via: ``` pip uninstall unsloth -y pip install --upgrade --force-reinstall --no-cache-dir git+https://github.com/unslothai/unsloth.git ``` For Colab / Kaggle, restart and run...