morphic icon indicating copy to clipboard operation
morphic copied to clipboard
Published 1 month ago • verified publisher icon miurla

Ollama support

Open michaelhadoop opened this issue 1 year ago • 1 comments

As title, when support local LLMs? like ollama.

michaelhadoop avatar Apr 11 '24 15:04 michaelhadoop

I plan to support Local LLM in the future.

Currently, Ollama's OpenAI compatibility doesn't include Tool support. If Ollama adds support for it, I intend to implement it immediately.

  • https://github.com/ollama/ollama/issues/2417
  • https://github.com/ollama/ollama/issues/3137
  • https://github.com/ollama/ollama/pull/3303

miurla avatar Apr 12 '24 02:04 miurla

@miurla Please see https://github.com/rashadphz/farfalle for a great local model implementation. This is exactly like Morphic, so I am sure we can also add Ollama to Morphic. As better function calling becomes available, we can update the feature.

arsaboo avatar May 22 '24 13:05 arsaboo