qlora icon indicating copy to clipboard operation
qlora copied to clipboard

Error when loading model

Open m000lie opened this issue 10 months ago • 2 comments

hello, i am constantly getting this error:

TypeError: not a string

This occurs whenever i load a model.

image

m000lie avatar Apr 29 '24 03:04 m000lie

Getting same error while finetuning LlaMa3 8b model

praful-1812 avatar Jul 22 '24 07:07 praful-1812

Any update, did you find a solution ?

Entretoize avatar Aug 11 '24 11:08 Entretoize

thanks in advance,Hi i have a question about the model. So in your script I see u use the FP16 model instead of INT4 model, could qlora use the quantizationed model (like gptq mode?) to finetune?

LiMa-cas avatar Oct 24 '24 03:10 LiMa-cas