llm icon indicating copy to clipboard operation
llm copied to clipboard

Invalid magic number while loading LoRAs

Open clarkmcc opened this issue 2 years ago • 2 comments

I'm getting the following error when trying to load a LoRA.

InvalidMagic { path: "~/.chitchat/loras/alpaca-lora-7b.bin", magic: 4034b50 (PK) }

Is this because the LoRA is out of date, or is our ggml implementation out of date? I get the same error across 3-4 different LoRAs.

clarkmcc avatar Jul 22 '23 21:07 clarkmcc

LoRA files should always start with the ggla magic. (See here) Could you link to the LoRA file you were using? And could it be that you did use a pytorch file without converting it first?

LLukas22 avatar Jul 23 '23 09:07 LLukas22

I agree with Lukas - is it possible that you're using unconverted LoRAs? (Yes, it's rather confusing - we hope the situation will get better soon!)

philpax avatar Jul 23 '23 17:07 philpax