Robert Brennan
Robert Brennan
@jabbor what does `git log -n1` show? Does the error persist if you pull latest? Pretty sure we fixed this yesterday
Yeah I see the issue now. For some weird reason the LLM is putting `\` characters into the JSON to escape underscores. repair is double-escaping the `\` instead of removing...
@jabbor which model are you using? GPT? Edit: nvm, I see it's mixtral+ollama now
https://github.com/mangiucugna/json_repair/issues/19
Agree--I'm starting to lean against the json repair and towards just erroring and telling the LLM more about the error
JSON repair has this fix now. We should work on a more robust long-term solution though
This might help: https://github.com/OpenDevin/OpenDevin/pull/444
It's defaulting to using OpenAI for the core model. Can you set `LLM_MODEL="ollama/llama2"` and see if that fixes it?
Oh I bet it's related to this: https://github.com/OpenDevin/OpenDevin/issues/285
Actually according to the docs, you should be fine: https://docs.litellm.ai/docs/providers/ollama So it seems like an ollama issue...