graphrag icon indicating copy to clipboard operation
graphrag copied to clipboard

[Bug]: <title>graphrag can't index using mistral large 123B with exllamav2

Open xxll88 opened this issue 1 year ago • 0 comments

Do you need to file an issue?

  • [ ] I have searched the existing issues and this bug is not already filed.
  • [ ] My model is hosted on OpenAI or Azure. If not, please look at the "model providers" issue and don't file a new one here.
  • [ ] I believe this is a legitimate bug, not just a question. If this is a question, please use the Discussions area.

Describe the bug

graphrag concurrent_requests: 25 , timeout:180 after 180s, only 5 chat complete , there are too many chat timeout like : ERROR: Chat completion 2a725977bfa24ff5ad768d0f0cf563d7 cancelled by user. ERROR: Chat completion b1854e0f70b14a6c906310c3e5a7a7c6 cancelled by user. ERROR: Chat completion 9aa757db07ba407dab480a61dcd1f44a cancelled by user. ERROR: Chat completion faab131c61564578b653c5cda80494fe cancelled by user. ERROR: Chat completion ce1e6fe36f1a4166935bbe211188cbf1 cancelled by user

Steps to reproduce

No response

Expected Behavior

No response

GraphRAG Config Used

# Paste your config here

Logs and screenshots

No response

Additional Information

  • GraphRAG Version:
  • Operating System:
  • Python Version:
  • Related Issues:

xxll88 avatar Aug 03 '24 03:08 xxll88