continue icon indicating copy to clipboard operation
continue copied to clipboard

Cannot connect on Ollama server running in the same network

Open AxelFooley opened this issue 5 months ago • 1 comments

Before submitting your bug report

Relevant environment info

- OS:MacOS Sonoma
- Continue: Pre-release
- IDE: VSCode
- Model: Qwen2.5-Coder-7B-Instruct
- config.json:
  
{
  "models": [
    {
     "title": "Qwen2.5-Coder-7B-Instruct-Q6_K_L",
      "provider": "ollama",
      "model": "Qwen2.5-Coder-7B-Instruct-Q6_K:latest",
      "apiBase": "http://10.0.110.139:11434"
    }
  ],
  "tabAutocompleteModel": {
      "title": "Qwen2.5-Coder-7B-Instruct-Q6_K_L",
      "provider": "ollama",
      "model": "Qwen2.5-Coder-7B-Instruct-Q6_K:latest",
      "apiBase": "http://10.0.110.139:11434"
  },
  "tabAutocompleteOptions": {
    "template": "<|fim_prefix|>{{{ prefix }}}<|fim_suffix|>{{{ suffix }}}<|fim_middle|>"
  }
}

Description

I am running vscode and continue on my Macbook, my models though are being server by a remote server running in my LAN, that you can see defined as apiBase in the config.json above.

The problem is that i am having this error:

Error: request to http://10.0.110.139:11434/api/chat failed, reason: connect EHOSTUNREACH 10.0.110.139:11434 - Local (10.0.110.155:55113)

I believe the issue is with the path, which is giving a 404

~ curl -nL http://10.0.110.139:11434/api/chat 404 page not found

even though the error says Host Unreachable, but the host is very well reachable instead.

To reproduce

No response

Log output

No response

AxelFooley avatar Sep 23 '24 12:09 AxelFooley