AgentGPT icon indicating copy to clipboard operation
AgentGPT copied to clipboard

Support for Local LLMs via Ollama

Open zanderlewis opened this issue 1 year ago • 1 comments

⚠️ Please check that this feature request hasn't been suggested before.

  • [X] I searched previous Ideas in Discussions didn't find any similar feature requests.
  • [X] I searched previous Issues didn't find any similar feature requests.

🔖 Feature description

Local LLMs through Ollama would allow for free use of AgentGPT.

✔️ Solution

Support for Local LLMs using Ollama

❓ Alternatives

No response

📝 Additional Context

No response

Acknowledgements

  • [X] My issue title is concise, descriptive, and in title casing.
  • [X] I have searched the existing issues to make sure this feature has not been requested yet.
  • [X] I have provided enough information for the maintainers to understand and evaluate this request.

zanderlewis avatar Jun 23 '24 18:06 zanderlewis

Ig using the Ollama will suit better more specifically the newer version with more capacity but would liked to coined some alternatives such as https://python.langchain.com/v0.1/docs/guides/development/local_llms/ as it is more Flexible

jayzalani avatar Aug 08 '24 18:08 jayzalani