n8n
n8n copied to clipboard
"does not support tools"
Bug Description
When I try to chat using the following workflow:
I get back
"[my_model_name] does not support tools."
Log:
ResponseError: llama3.1-8B-Meta:latest does not support tools
at checkOk (/Users/xroot/.nvm/versions/node/v20.17.0/lib/node_modules/n8n/node_modules/ollama/dist/shared/ollama.384eb0a9.cjs:72:9)
at processTicksAndRejections (node:internal/process/task_queues:95:5)
at post (/Users/xroot/.nvm/versions/node/v20.17.0/lib/node_modules/n8n/node_modules/ollama/dist/shared/ollama.384eb0a9.cjs:119:3)
at Ollama.processStreamableRequest (/Users/xroot/.nvm/versions/node/v20.17.0/lib/node_modules/n8n/node_modules/ollama/dist/shared/ollama.384eb0a9.cjs:251:22)
at ChatOllama._streamResponseChunks (/Users/xroot/.nvm/versions/node/v20.17.0/lib/node_modules/n8n/node_modules/@langchain/ollama/dist/chat_models.cjs:455:32)
at ChatOllama._streamIterator (/Users/xroot/.nvm/versions/node/v20.17.0/lib/node_modules/n8n/node_modules/@langchain/core/dist/language_models/chat_models.cjs:93:34)
at ChatOllama.transform (/Users/xroot/.nvm/versions/node/v20.17.0/lib/node_modules/n8n/node_modules/@langchain/core/dist/runnables/base.cjs:394:9)
at RunnableBinding.transform (/Users/xroot/.nvm/versions/node/v20.17.0/lib/node_modules/n8n/node_modules/@langchain/core/dist/runnables/base.cjs:840:9)
at ToolCallingAgentOutputParser.transform (/Users/xroot/.nvm/versions/node/v20.17.0/lib/node_modules/n8n/node_modules/@langchain/core/dist/runnables/base.cjs:383:26)
at RunnableSequence._streamIterator (/Users/xroot/.nvm/versions/node/v20.17.0/lib/node_modules/n8n/node_modules/@langchain/core/dist/runnables/base.cjs:1208:30) {
error: 'llama3.1-8B-Meta:latest does not support tools',
status_code: 400
} undefined
If I replace Ollama with OpenAI, everything works.
To Reproduce
Use a similar workflow: workflow.json Open chat. Type any prompt.
Models that I tried and got the same response: Reasoner-Llama3.1-70b.i1-Q4_K_M.gguf Meta-Llama-3.1-8B-Instruct-Q8_0.gguf Dark-Miqu-70B.i1-Q5_K_M.gguf
Expected behavior
The model should respond
Operating System
macOS Sonoma 14.5 or 14.5.1
n8n Version
1.58.1, reproducable on 1.57.1
Node.js Version
20.17.0, reproducable on 18 and 22
Database
SQLite (default)
Execution mode
main (default)