aider icon indicating copy to clipboard operation
aider copied to clipboard

Add support for "custom" models

Open tonymacx86PRO opened this issue 2 years ago • 1 comments

Can you add please support for custom models with generic prompts? Its will be great combination with a openai proxy.

tonymacx86PRO avatar Jul 05 '23 16:07 tonymacx86PRO

Sorry, I'm not sure I understand what you are requesting. Can you provide more details?

paul-gauthier avatar Jul 06 '23 04:07 paul-gauthier

thank you for creating Aider. It’s been a great help to me and I’m sure to many others as well.

I was wondering if it’s possible to use other open-source LLMs instead of GPT models or along side GPT models. I think this feature would be useful for other users as well.

sriharshaguthikonda avatar Jul 07 '23 01:07 sriharshaguthikonda

like StarCoder with langhcain to replace OpenAI function calling

alifanov avatar Jul 07 '23 10:07 alifanov

I recently published a package llm-client that can be very helpful in enabling the support to run other LLM models, including OpenAI, Google, AI21, HuggingfaceHub, Aleph Alpha, Anthropic, Local models with transformers.

uripeled2 avatar Jul 07 '23 14:07 uripeled2

This FAQ entry provides some information about using aider with other LLMs:

https://aider.chat/docs/faq.html#can-i-use-aider-with-other-llms-local-llms-etc

paul-gauthier avatar Jul 07 '23 16:07 paul-gauthier

I'm going to close this issue, but feel free to re-open if there's more you'd like to discuss about this.

paul-gauthier avatar Jul 08 '23 00:07 paul-gauthier