enchanted icon indicating copy to clipboard operation
enchanted copied to clipboard

Add support for Anthropic Claude API

Open quinncomendant opened this issue 1 year ago • 5 comments
trafficstars

I'd like to use Enchanted with Anthropic’s chat API. I noticed there is already some discussion of supporting the APIs for ChatGPT (#139) and Mistral (#25). I think it would be simple and very useful to support additional chat APIs for those of us who like to experiment with different models. 🙏

Enchanted looks like the best open-source app for general LLM chat support. Looking forward to seeing it evolve!

quinncomendant avatar Aug 13 '24 20:08 quinncomendant

Same request for another LLM API or openai compatible API

brucevoin avatar Aug 26 '24 08:08 brucevoin

ollama already supports those models. Enchanted enables you to query ollama API, and ollama itself is able to either run a model locally (Llama 8b, ...) or query external parties (Anthropic, OpenAI, ...).

bhenriq avatar Aug 29 '24 16:08 bhenriq

@bhenriq, can you share a link or example of how to use Ollama to query online models? I searched and didn't find any mention of using Ollama as a proxy for remote models. In fact, it's docs say, “Ollama runs locally, and conversation data does not leave your machine.”

quinncomendant avatar Aug 29 '24 19:08 quinncomendant

@quinncomendant i have double checked and it looks like my answer was incorrect. my apologies for that. maybe indeed a capability that enchanted could provide itself.

my confusion came from the fact that i am using another ai client named aichat. that client can invoke both local models (via ollama) and third-party ones. very much what you are asking for. but that ai client is for desktop only.

bhenriq avatar Aug 29 '24 23:08 bhenriq

Duplicates #25

olegshulyakov avatar Mar 12 '25 15:03 olegshulyakov