RisuAI icon indicating copy to clipboard operation
RisuAI copied to clipboard

In some cases RisuAI is no response

Open KamiaoChan opened this issue 2 years ago • 1 comments

cmd

When utilizing the web UI's API (GGML) and employing a CPU for inferring with large models, it has been observed that generation requests taking around or more than 100 seconds are not received by the RISUAI panel. It appears that content exceeding the 100-second threshold is being treated as timeouts and subsequently discarded. Is there a rule for discarding based on timeouts? How can this issue be resolved?

KamiaoChan avatar Aug 07 '23 03:08 KamiaoChan

Suggest this issue preferred fix

cool-delete avatar Nov 19 '23 02:11 cool-delete