crewAI icon indicating copy to clipboard operation
crewAI copied to clipboard

Published 20 hours ago • verified publisher icon crewAIInc

Ollama Integration doesn't allow setting num_ctx in ollama

Open jcoombes opened this issue 9 months ago • 0 comments

Ollama Integration doesn't allow setting num_ctx in ollama

^ The default value of num_ctx in the API is 2k, and I would like to run llama3:70b with num_ctx 8192.

https://docs.crewai.com/how-to/LLM-Connections/

jcoombes avatar May 18 '24 17:05 jcoombes