ctransformers
ctransformers copied to clipboard
jupyter notebook crashed when importing llama2 models
Hi, I tried the following code, but my kernel crashed and restarted, let me know how I should fix this, thanks! :
from ctransformers import AutoModelForCausalLM
llm = AutoModelForCausalLM.from_pretrained("TheBloke/Llama-2-13B-chat-GGML", model_type="llama")
print(llm("AI is going to"))