unsloth icon indicating copy to clipboard operation
unsloth copied to clipboard

Published 20 hours ago • verified publisher icon unslothai

I cant finetune with this issue

Open HailamAICT opened this issue 1 year ago • 1 comments

ValueError: You cannot perform fine-tuning on purely quantized models. Please attach trainable adapters on top of the quantized model to correctly perform fine-tuning. Please see: https://huggingface.co/docs/transformers/peft for more details

HailamAICT avatar Mar 13 '24 07:03 HailamAICT

@HailamAICT I think maybe you forgot to call FastLanguage.get_peft_model :)

danielhanchen avatar Mar 13 '24 08:03 danielhanchen