DeepSeek-Coder-V2 icon indicating copy to clipboard operation
DeepSeek-Coder-V2 copied to clipboard

Published 20 hours ago • verified publisher icon deepseek-ai

Error: An unknown error was encountered while running the model

Open vishnunuk opened this issue 1 year ago • 1 comments

When generating a response, deepseek-coder-v2 randomly stops or quits with the following error:

Error: An unknown error was encountered while running the model.

I have tested different versions of deepseek-coder-v2 and the Ollama server, including both the Docker and desktop versions on Windows, macOS, and Linux. On all three platforms, I can reproduce this issue. No other models have shown this behavior.

ss when deepseek-coder-v2 randomly stops or quits when responding... Screenshot 2024-09-17 at 9 17 30 PM

vishnunuk avatar Sep 17 '24 15:09 vishnunuk

https://github.com/ggerganov/llama.cpp/issues/8862

vishnunuk avatar Sep 17 '24 16:09 vishnunuk