DocsGPT
DocsGPT copied to clipboard
arc53
🐛 Bug Report: Error While trying to generate a response Local LLM
📜 Description
This error popped up when DocsGPT trying to response.
👟 Reproduction steps
- execute setup.sh 2. ask question on the web browser. 3. got 500 error and message Something went wrong. Please try again later. 4. check on the logs found the cause (image attached above).
👍 Expected behavior
it should response to the question.
👎 Actual Behavior with Screenshots
💻 Operating system
Linux
What browsers are you seeing the problem on?
Chrome
🤖 What development environment are you experiencing this bug on?
Local dev server
🔒 Did you set the correct environment variables in the right path? List the environment variable names (not values please!)
No response
📃 Provide any additional context for the Bug.
No response
📖 Relevant log output
No response
👀 Have you spent some time to check if this bug has been raised before?
- [X] I checked and didn't find similar issue
🔗 Are you willing to submit PR?
None
🧑⚖️ Code of Conduct
- [X] I agree to follow this project's Code of Conduct
In settings change this line:
EMBEDDINGS_NAME: str = "openai_text-embedding-ada-002"
by this one:
EMBEDDINGS_NAME: str = "huggingface_sentence-transformers/all-mpnet-base-v2"
Also please upload your own docs. as default ones use the openai embeddings
In settings change this line:
EMBEDDINGS_NAME: str = "openai_text-embedding-ada-002"by this one:EMBEDDINGS_NAME: str = "huggingface_sentence-transformers/all-mpnet-base-v2"
Orait thanks for that insight will test it out.
Also please upload your own docs. as default ones use the openai embeddings
owh thanks for the information, but when i upload my custom docs other issue arise where the response take too long to have a feedback and i think Antonio-Vela idea will solved that issue.