gpt-pilot icon indicating copy to clipboard operation
gpt-pilot copied to clipboard

[Bug]: GPT-Pilot rewrites entire function for every minor change

Open cranyy opened this issue 1 year ago • 3 comments

Version

VisualStudio Code extension

Operating System

Windows 10

What happened?

More of a minus than a bug, it seems that evne to add a simple thing like "import json" at the top of the file it rewrites the entiiireee function from start to finish, slowing down the process and making it way more expensive. Consider using unified diffs like aider does, this might improve the speed and the need to rewrite everything.

cranyy avatar Feb 26 '24 05:02 cranyy

IKR?!?!?! It absolutely ZAPS your OpenAi credits. I hate to complain but it seems rather unnecessary. I don't think that this is a bug as you say. It is just the way it was written. I am still looking for / meddling with a way to use one of the local LLMs.

Real-Experienes avatar Feb 27 '24 04:02 Real-Experienes

IKR?!?!?! It absolutely ZAPS your OpenAi credits. I hate to complain but it seems rather unnecessary. I don't think that this is a bug as you say. It is just the way it was written. I am still looking for / meddling with a way to use one of the local LLMs.

did you manage to find any other model? its eating credits badly

badboyilprimo avatar Mar 13 '24 21:03 badboyilprimo

Not yet. I'm exploring ways to get Mixtral or one of the larger parameter Dolphin models integrated

Real-Experienes avatar Mar 13 '24 21:03 Real-Experienes