aider
aider copied to clipboard
APIConnectionError with ollama + deepseek-coder-v2
Issue
I'm running into this "unknown" error using ollama as the model service with deepseek-coder-v2. It works through patching one small area of python code and then on the next area it gets stuck and then can't continue--it appears to be stuck in a loop at this point. The first patch modifies about 4 lines in the first 14 lines of the file, the second patch would start around line 66 of 77 total lines in the (very small, simple) file.
litellm.APIConnectionError: Ollama Error - {'error': 'an unknown error was encountered while running the model '}
Traceback (most recent call last):
File "~/miniforge3/lib/python3.12/site-packages/litellm/utils.py", line 9548, in chunk_creator
response_obj = self.handle_ollama_stream(chunk)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "~/miniforge3/lib/python3.12/site-packages/litellm/utils.py", line 8975, in handle_ollama_stream
raise e
Version and model info
Aider 0.57.2.dev209+g17108c43 Model: deepseek-coder-v2:16b
Similar to #598