private-gpt
private-gpt copied to clipboard
Server fails if it receives 2 prompts simultaneously
I have a problem, when i'm trying to post request twice from 2 devices server get fail and restarts my docker container. in the logs is writen about segmentation fault and not more information. request:
http://localhost:8003/v1/chat/completions
{
"include_sources": true,
"stream": false,
"use_context": true,
"messages": [
...
]
}
my pc parameters: CPU: i9-14gen GPT: nvidia RTX-4090 RAM: 64GB DDR5