aider icon indicating copy to clipboard operation
aider copied to clipboard

APIConnectionError with ollama + deepseek-coder-v2

Open bribroder opened this issue 1 year ago • 0 comments

Issue

I'm running into this "unknown" error using ollama as the model service with deepseek-coder-v2. It works through patching one small area of python code and then on the next area it gets stuck and then can't continue--it appears to be stuck in a loop at this point. The first patch modifies about 4 lines in the first 14 lines of the file, the second patch would start around line 66 of 77 total lines in the (very small, simple) file.

litellm.APIConnectionError: Ollama Error - {'error': 'an unknown error was encountered while running the model '}
Traceback (most recent call last):
  File "~/miniforge3/lib/python3.12/site-packages/litellm/utils.py", line 9548, in chunk_creator
    response_obj = self.handle_ollama_stream(chunk)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "~/miniforge3/lib/python3.12/site-packages/litellm/utils.py", line 8975, in handle_ollama_stream
    raise e

Version and model info

Aider 0.57.2.dev209+g17108c43 Model: deepseek-coder-v2:16b

Similar to #598

bribroder avatar Sep 26 '24 23:09 bribroder