RoadToNowhereX
RoadToNowhereX
### Description After uploading a txt file and trying to index it, this error occured, which has never occured before v0.9.6  kotaemon-v0.9.10, install without Docker in Python 3.10.16, use...
This error occurs when inferencing Qwen/Qwen2.5-VL-32B-Instruct-AWQ on Win11_64 but works properly on WSL Ubuntu-22.04. win11 python environments: accelerate 1.6.0 aiohappyeyeballs 2.6.1 aiohttp 3.11.16 aiosignal 1.3.2 annotated-types 0.7.0 anyio 4.9.0 asttokens...
After extraction and indexing, I would get those KeyErrors whatever I ask the LLM. Frontend: kotaemon Python 3.10 Local LLM: Nemo_saiga Local Embedding Model: gte-qwen2-7B INFO:httpx:HTTP Request: POST http://127.0.0.1:1234/v1/chat/completions "HTTP/1.1...
这项目的管线看起来挺像RAG的,可以在提示词里面也加入GraphRAG一样的示例: https://github.com/microsoft/graphrag/blob/main/graphrag/prompts/index/entity_extraction.py 另外,有啥好用的本地LLM推荐的吗?能同时支持中日双语又足够“聪明”的开源模型可不好找。
### Version Info Python version: 3.10.11 (tags/v3.10.11:7d4cc5a, Apr 5 2023, 00:38:17) [MSC v.1929 64 bit (AMD64)] Python executable: D:\GalTranslation\BallonsTranslator_dev_src_with_gitpython_20241124\ballontrans_pylibs_win\python.exe Version: 1.4.0 Branch: dev Commit hash: a515a420e3334680c17ca7c6f800e9df2bf513c4 ### Type of Request...
According to [utils/call_llm_api.py](https://github.com/TencentCloudADP/youtu-graphrag/blob/main/utils/call_llm_api.py), [Line 16](https://github.com/TencentCloudADP/youtu-graphrag/blob/84157d05fd3b746672ec0c46cd0806942f09acb7/utils/call_llm_api.py#L16) to [Line 18](https://github.com/TencentCloudADP/youtu-graphrag/blob/84157d05fd3b746672ec0c46cd0806942f09acb7/utils/call_llm_api.py#L18), LLM config will be read from [.env](https://github.com/TencentCloudADP/youtu-graphrag/blob/main/.env.example) instead of [base_config.yaml](https://github.com/TencentCloudADP/youtu-graphrag/blob/main/config/base_config.yaml), making configuration files inconsistent. [LLM override in FULLGUIDE](https://github.com/TencentCloudADP/youtu-graphrag/blob/84157d05fd3b746672ec0c46cd0806942f09acb7/FULLGUIDE.md?plain=1#L197) is completely useless because...