unsloth icon indicating copy to clipboard operation
unsloth copied to clipboard

Published 20 hours ago • verified publisher icon unslothai

Can we suport qwen series?

Open zhangfan-algo opened this issue 1 year ago • 5 comments

zhangfan-algo avatar May 08 '24 01:05 zhangfan-algo

Llamafied Qwen models can be directly loaded

ewre324 avatar May 08 '24 01:05 ewre324

Can you provide a script for converting the format?

zhangfan-algo avatar May 08 '24 02:05 zhangfan-algo

Some of the previous issues on the same topic have them. As for the model, you can search hugging face for qwen llamafied keywords.

ewre324 avatar May 08 '24 02:05 ewre324

Oh I think someone made a PR for Qwen

danielhanchen avatar May 09 '24 17:05 danielhanchen

It should be supported everyone! @zhangfan-algo @erwe324! If you're on a local machine, please update Unsloth via

pip uninstall unsloth -y
pip install --upgrade --force-reinstall --no-cache-dir git+https://github.com/unslothai/unsloth.git

Colab and Kaggle is fine (just restart it)

danielhanchen avatar May 16 '24 04:05 danielhanchen