llamacoder icon indicating copy to clipboard operation
llamacoder copied to clipboard

can this only be used with together.ai and not locally?

Open nunbuzor opened this issue 1 year ago • 4 comments

nunbuzor avatar Sep 20 '24 02:09 nunbuzor

you can use this app locally if you run llm locally in your machine; and you can run llms locally using ollama; https://ollama.com/

BishalN avatar Nov 12 '24 09:11 BishalN

this can run any api, just change base URL and API KEY, also change model respectively in dropdown.

akshaynmhc avatar Nov 26 '24 10:11 akshaynmhc

you can use this app locally if you run llm locally in your machine; and you can run llms locally using ollama; https://ollama.com/

I found that the code invokes the together-api package, and it seems that the API is not compatible with Ollama's API.

beuself avatar Dec 11 '24 15:12 beuself

I am forking this repo and trying to working on this,but my device only 16g and can't run local model very well,here is the link ollamacoder

annilq avatar Feb 12 '25 02:02 annilq