MemGPT-AutoGEN-LLM icon indicating copy to clipboard operation
MemGPT-AutoGEN-LLM copied to clipboard

Published 20 hours ago • verified publisher icon PromptEngineer48

Local host endpoint help

Open JonMike12341234 opened this issue 2 years ago • 1 comments

I followed along and love this project, but I have an issue: I am running text generation webui locally (instead of RunPod), the endpoint is http://127.0.0.1:7860/, I do have openai extension enabled, yet when testing in VSC I get a 404 no response. The solution should be easy, does anyone know how to get app.py to connect to an actual local instance of text gen webui?

JonMike12341234 avatar Nov 02 '23 15:11 JonMike12341234

Try these end points http://127.0.0.1:5001/v1 http://127.0.0.1:5000/v1

PromptEngineer48 avatar Nov 02 '23 15:11 PromptEngineer48