Yi 1.5 Model Support

[suptejas]

Yi 1.5 models are some of the most capable < 10B LLMs out there. It would be amazing to get fine-tuning capabilities for the model via Unsloth.

[avcode-exe]

I think it is possible to fine tune Yi-1.5, just replace the model name to be 01-ai/Yi-1.5-9B or unsloth/Yi-1.5-6B-bnb-4bit or other models. I used unsloth to fine tune 01-ai/Yi-1.5-9B, here is the model NotAiLOL/Athena-Yi-1.5-9B-v0.1.

[shimmyshimmer]

You will need to change the model name like @avcode-exe said.

We have more details about Yi in our blog post: https://unsloth.ai/blog/phi3

[danielhanchen]

@suptejas @avcode-exe Yes it should be supported now! Simply change the model name to any model from Yi.

Also update Unsloth for local machines (Colab / Kaggle just refresh and restart the env):

pip uninstall unsloth -y
pip install --upgrade --force-reinstall --no-cache-dir git+https://github.com/unslothai/unsloth.git