WizardLM icon indicating copy to clipboard operation
WizardLM copied to clipboard

[BUG] Illegal instruction (core dumped)

Open hamroune opened this issue 1 year ago • 0 comments

Hi Everyone, I tried ctransformers to load the GGML of WizardLM, but unfortunely it crashes using from ctransformers import AutoModelForCausalLM and then AutoModelForCausalLM.from_pretrained("TheBloke/WizardLM-30B-GGML", model_file="/home/user/app/wizardlm-30b.ggmlv3.q2_K.bin", model_type="llama") the error says Illegal instruction (core dumped) is there any help for me?

hamroune avatar Jul 03 '23 14:07 hamroune