ctransformers icon indicating copy to clipboard operation
ctransformers copied to clipboard

`AutoModelForCausalLM` is stuck, no error

Open victoris93 opened this issue 10 months ago • 0 comments

I am trying to run this example code: llm = AutoModelForCausalLM.from_pretrained("marella/gpt-2-ggml") The model is loaded and then the cell just keeps running without outputting anything. Does anyone know what the problem might be?

Additional info:

Model Name: MacBook Air
Chip: Apple M3
Total Number of Cores: 8 (4 performance and 4 efficiency)
Memory: 24 GB

ctransformers version: 0.2.27

victoris93 avatar Mar 10 '25 14:03 victoris93