Lissanro Rayen
Lissanro Rayen
No, I have 80K context window but it gets timed out no matter what after reaches long enough processing time, which is around 32K in my case, but I think...
 Here is a screenshot which shows that I can get socket timeout even at much lower context. I tried to decrease max context size from 80K to 32K but...
No, I use ik_llama.cpp (not to be confused with llama.cpp): https://github.com/ikawrakow/ik_llama.cpp - here is a screenshot of my settings (API key and model name are not used by the backend,...
Few months ago I reported this bug, but it was closed after two months of inactivity: https://github.com/oobabooga/text-generation-webui/issues/5837 - the other way it gets triggered, is if the text-generation-webui crashes or...
I quite often encounter this issue when using Roo Code with Kimi K2 0905. When I interrupt the task, often no cancel request gets send, it then faster to kill...