PandoraAI icon indicating copy to clipboard operation
PandoraAI copied to clipboard

Support for Gpt4all REST API

Open anthonyronda opened this issue 1 year ago • 1 comments

Is your feature request related to a problem? Please describe. I am trying to access the local LLM running on my PC from other devices. I am using Gpt4all, which provides a REST API, but doesn't provide a web client that can access it.

Describe the solution you'd like A clear and concise description of what you want to happen. As an alternative to using node-chatgpt-api, modify the code to also allow use of gpt4all-api https://github.com/nomic-ai/gpt4all/tree/main/gpt4all-api

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.

Additional context Add any other context or screenshots about the feature request here. I am willing to write my own implementation and contribute it to the project if I can get a push in the right direction to help me get started.

anthonyronda avatar Nov 29 '23 21:11 anthonyronda

@anthonyronda I've implemented using Local LLMs with node-chatgpt-api and the LM Studio inference server.
You can take a look at my forks:
https://github.com/Richard-Weiss/node-chatgpt-api https://github.com/Richard-Weiss/PandoraAI

But maybe it's enough for you to change the completionsURL in the ChatGPTClient file.

Richard-Weiss avatar Dec 10 '23 17:12 Richard-Weiss