graphrag
graphrag copied to clipboard
[Feature Request]: Possible integration with OutlinesOSS for yielding valid JSON
Do you need to file an issue?
- [X] I have searched the existing issues and this feature is not already filed.
- [ ] My model is hosted on OpenAI or Azure. If not, please look at the "model providers" issue and don't file a new one here.
- [X] I believe this is a legitimate feature request, not just a question. If this is a question, please use the Discussions area.
Is your feature request related to a problem? Please describe.
Just 2 days ago OpenAI announced structured outputs. However we can already use [@OutlinesOSS (https://x.com/OutlinesOSS) to do the same with open source models since it’s been around for a year.
Most of the issues with graphrag is that many times the less powerful local LLMs do not yield a valid json. The most notable case is with the extraction of community reports giving the notorious "KeyError: 'community'
Describe the solution you'd like
Regardless of the selected LLM the integration of Graphrag with OutlinesOSS will always output valid json when needed
Additional context
No response