self-operating-computer icon indicating copy to clipboard operation
self-operating-computer copied to clipboard
verified publisher icon OthersideAI

Add support for LLaVA through Ollama

Open michaelhhogue opened this issue 1 year ago • 0 comments

This PR is a work-in-progress.

The goal of this PR is to add support for LLaVA through Ollama.

Todo:

  • [x] Successfully send prompt + image to LLaVA and get response
  • [ ] Ensure LLaVA responses are in JSON
  • [ ] Add summary support
  • [ ] Add Ollama setup documentation to README
  • [ ] Reduce repeated code across the 3 supported models

michaelhhogue avatar Dec 21 '23 21:12 michaelhhogue