Devin Card

icon location Virtual Student at University of Alaska

Results 3 comments of Devin Card

Invalid JSON error and infinite task solution (with Ollama?)

@rbren Should probably implement Outlines-dev to entirely prevent improper json outputs. works with all models, gpt and local. makes it impossible for improper json to be output, never any need...

Error condensing thoughts

instead of repairing json, a better solution would be to never allow the llm to output improper json. https://github.com/outlines-dev/outlines

Automatic repair of json for langchains agent

https://github.com/outlines-dev/outlines might be the best solution. when implemented, it will never output improper json, or any chosen schema/regex