graphrag icon indicating copy to clipboard operation
graphrag copied to clipboard

[Feature Request]: Possible integration with OutlinesOSS for yielding valid JSON

Open namp opened this issue 1 year ago • 0 comments

Do you need to file an issue?

  • [X] I have searched the existing issues and this feature is not already filed.
  • [ ] My model is hosted on OpenAI or Azure. If not, please look at the "model providers" issue and don't file a new one here.
  • [X] I believe this is a legitimate feature request, not just a question. If this is a question, please use the Discussions area.

Is your feature request related to a problem? Please describe.

Just 2 days ago OpenAI announced structured outputs. However we can already use [@OutlinesOSS (https://x.com/OutlinesOSS) to do the same with open source models since it’s been around for a year.

Most of the issues with graphrag is that many times the less powerful local LLMs do not yield a valid json. The most notable case is with the extraction of community reports giving the notorious "KeyError: 'community'

Describe the solution you'd like

Regardless of the selected LLM the integration of Graphrag with OutlinesOSS will always output valid json when needed

Additional context

No response

namp avatar Aug 08 '24 08:08 namp