ctransformers
ctransformers copied to clipboard
Does ctransformers support ollama models?
Does ctransformers support ollama models?
How do I specify the model in this code below?
llm = CTransformers(model="***where is the model file for a ollama model?", model_type="llama", max_new_tokens=512, temperature=0.1)
https://github.com/ollama/ollama/issues/2652