Brian Toner comments

Results 6 comments of


                                            Brian Toner

using local models instead of openAI?

@bartanderson I am attempting the same thing. You'll need to change the server address for the api to your local host: ``` OPENAI_API_BASE: "http://127.0.0.1:8000/v1" #Use the port that your local...

using local models instead of openAI?

However, when I run it locally, I get the following error: ``` > python startup.py "Write a cli snake game based on pygame" --code_review True 2023-08-14 16:24:22.781 | INFO |...

using local models instead of openAI?

@bartanderson You'll need to run your own local, OpenAI-like server running the llm of your choice. For instance, I am testing on llama-cpp-python's sever mode. In my case, my server...

using local models instead of openAI?

@bartanderson I can hit my OpenAI-like server fine. I've been debugging MetaGPT to try and sort out where my issue is coming from. But unfortunately I don't have a lot...

using local models instead of openAI?

Here is an update on my progress. I can validate that MetaGPT does work on a local server. It seems the "stop" field in the request body can take on...

using local models instead of openAI?

@TinaTiel unfortunately the code I used wasn't merged to main. The code I worked from was: https://raw.githubusercontent.com/ggerganov/llama.cpp/d8a8d0e536cfdaca0135f22d43fda80dc5e47cd8/examples/server/api_like_OAI.py I found this linked on stack exchange, I think, explaining that there was...