graphrag icon indicating copy to clipboard operation
graphrag copied to clipboard

workflow failing

Open riyajatar37003 opened this issue 1 year ago • 0 comments

Describe the bug

i am using vllm based model deployment. i installed it using pip install vllm and its up and running

GraphRAG Indexer ├── Loading Input (csv) - 1 files loaded (1 filtered) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100% 0:00:00 0:00:00 ├── create_base_text_units ├── create_base_extracted_entities └── create_final_covariates ❌ create_final_covariates

ERROR 07-16 12:08:18 api_server.py:247] Error in applying chat template from request: Conversation roles must alternate user/assistant/user/assistant/...

logs.json {"type": "error", "data": "Error Invoking LLM", "stack": "Traceback (most recent call last):\n File "/app/snow.riyaj_atar.home/graphrag/graphrag/llm/base/base_llm.py", line 53, in _invoke\n output = await self._execute_llm(input, **kwargs)\n File "/app/snow.riyaj_atar.home/graphrag/graphrag/llm/openai/openai_chat_llm.py", line 55, in _execute_llm\n completion = await self.client.chat.completions.create(\n File "/tmp/.conda/envs/grag/lib/python3.10/site-packages/openai/resources/chat/completions.py", line 1289, in create\n return await self._post(\n File "/tmp/.conda/envs/grag/lib/python3.10/site-packages/openai/_base_client.py", line 1826, in post\n return await self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)\n File "/tmp/.conda/envs/grag/lib/python3.10/site-packages/openai/_base_client.py", line 1519, in request\n return await self._request(\n File "/tmp/.conda/envs/grag/lib/python3.10/site-packages/openai/_base_client.py", line 1620, in _request\n raise self._make_status_error_from_response(err.response) from None\nopenai.BadRequestError: Error code: 400 - {'object': 'error', 'message': 'Conversation roles must alternate user/assistant/user/assistant/...', 'type': 'invalid_request_error', 'param': None, 'code': None}\n", "source": "Error code: 400 - {'object': 'error', 'message': 'Conversation roles must alternate user/assistant/user/assistant/...', 'type': 'invalid_request_error', 'param': None, 'code': None}", "details": {"input": "MANY entities were missed in the last extraction. Add them below using the same format:\n"}} {"type": "error", "data": "Entity Extraction Error", "stack": "Traceback (most recent call last):\n File "/app/snow.riyaj_atar.home/graphrag/graphrag/index/graph/extractors/graph/graph_extractor.py", line 123, in call\n result = await self._process_document(text, prompt_variables)\n File

Steps to reproduce

No response

Expected Behavior

No response

GraphRAG Config Used

No response

Logs and screenshots

No response

Additional Information

  • GraphRAG Version:
  • Operating System:
  • Python Version:
  • Related Issues:

riyajatar37003 avatar Jul 16 '24 10:07 riyajatar37003