devika icon indicating copy to clipboard operation
devika copied to clipboard

Context limits? Plus no idea what the AI is doing.

Open Ph0rk0z opened this issue 1 year ago • 1 comments

I used the DDG PR, not sure if the search is working. I set the AI to write me a python hello world. It came up with a plan. Now it's doing something.. it keeps generating and it has exhausted my 16k context limit.

The logs are full of repetition and I think you got debug stuck on as the messages cycle. I still can't get into settings on either chrome nor firefox and I can't delete projects. It's pretty cool but I think it still has a long way to go. The plans are really great but it seems to be stuck at executing them.

Ph0rk0z avatar Mar 23 '24 22:03 Ph0rk0z

Hits here too, maybe we should add a sleep or wait function to properly not spam us with useless shit lol

Drlordbasil avatar Mar 24 '24 15:03 Drlordbasil

you have to choose a model with a bigger context length for working devika in full mode. try gemini or gpt-4

ARajgor avatar Apr 03 '24 18:04 ARajgor

Is 32k not enough? Not all models, even API have the same context. It's not infinite.

Ph0rk0z avatar Apr 04 '24 12:04 Ph0rk0z

32k limit isn't big enough yo think of shit properly without rag tbh

On Thu, Apr 4, 2024, 8:23 AM Forkoz @.***> wrote:

Is 32k not enough? Not all models, even API have the same context. It's not infinite.

— Reply to this email directly, view it on GitHub https://github.com/stitionai/devika/issues/96#issuecomment-2037047721, or unsubscribe https://github.com/notifications/unsubscribe-auth/A6G5RBEK4GAGU5IQM7YWSFLY3VA55AVCNFSM6AAAAABFE7SNJCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMZXGA2DONZSGE . You are receiving this because you commented.Message ID: @.***>

Drlordbasil avatar Apr 04 '24 12:04 Drlordbasil

Then lord help the people with ollama using this. Whole thing seems more of a way to sell people on APIs.

Ph0rk0z avatar Apr 05 '24 10:04 Ph0rk0z