graphrag
graphrag copied to clipboard
[Bug]: <title>graphrag can't index using mistral large 123B with exllamav2
Do you need to file an issue?
- [ ] I have searched the existing issues and this bug is not already filed.
- [ ] My model is hosted on OpenAI or Azure. If not, please look at the "model providers" issue and don't file a new one here.
- [ ] I believe this is a legitimate bug, not just a question. If this is a question, please use the Discussions area.
Describe the bug
graphrag concurrent_requests: 25 , timeout:180 after 180s, only 5 chat complete , there are too many chat timeout like : ERROR: Chat completion 2a725977bfa24ff5ad768d0f0cf563d7 cancelled by user. ERROR: Chat completion b1854e0f70b14a6c906310c3e5a7a7c6 cancelled by user. ERROR: Chat completion 9aa757db07ba407dab480a61dcd1f44a cancelled by user. ERROR: Chat completion faab131c61564578b653c5cda80494fe cancelled by user. ERROR: Chat completion ce1e6fe36f1a4166935bbe211188cbf1 cancelled by user
Steps to reproduce
No response
Expected Behavior
No response
GraphRAG Config Used
# Paste your config here
Logs and screenshots
No response
Additional Information
- GraphRAG Version:
- Operating System:
- Python Version:
- Related Issues: