ctransformers icon indicating copy to clipboard operation
ctransformers copied to clipboard

jupyter notebook crashed when importing llama2 models

Open littlehifive opened this issue 1 year ago • 3 comments

Hi, I tried the following code, but my kernel crashed and restarted, let me know how I should fix this, thanks! :

from ctransformers import AutoModelForCausalLM

llm = AutoModelForCausalLM.from_pretrained("TheBloke/Llama-2-13B-chat-GGML", model_type="llama")

print(llm("AI is going to"))
Screen Shot 2023-07-22 at 10 41 19 AM

littlehifive avatar Jul 22 '23 14:07 littlehifive