ctransformers icon indicating copy to clipboard operation
ctransformers copied to clipboard

IBM Granite models support?

Open 0wwafa opened this issue 11 months ago • 0 comments

from ctransformers import AutoModelForCausalLM

llm = AutoModelForCausalLM.from_pretrained("ibm-granite/granite-3.1-2b-instruct", model_type="gpt2")

print(llm("Tell me the difference between thinking in humans and in LLMs."))

the above doesn't work. how can I use it?

0wwafa avatar Jan 10 '25 07:01 0wwafa