ctransformers icon indicating copy to clipboard operation
ctransformers copied to clipboard

Does ctransformers support ollama models?

Open PriyaranjanMarathe opened this issue 1 year ago • 1 comments

Does ctransformers support ollama models?

How do I specify the model in this code below?

llm = CTransformers(model="***where is the model file for a ollama model?", model_type="llama", max_new_tokens=512, temperature=0.1)

PriyaranjanMarathe avatar Feb 21 '24 20:02 PriyaranjanMarathe

https://github.com/ollama/ollama/issues/2652

PriyaranjanMarathe avatar Feb 21 '24 20:02 PriyaranjanMarathe