ollama-python icon indicating copy to clipboard operation
ollama-python copied to clipboard

Simple Chat gives httpx.ConnectError

Open designcomputer opened this issue 11 months ago • 4 comments

This simple chat example fails:

from ollama import chat

messages = [
  {
    'role': 'user',
    'content': 'Why is the sky blue?',
  },
]

response = chat('llama3.2:3b', messages=messages)
print(response['message']['content'])

httpx.ConnectError: [WinError 10049] The requested address is not valid in its context

But this works fine:

from ollama import Client
client = Client(
  host='http://localhost:11434',
  headers={'x-some-header': 'some-value'}
)
response = client.chat(model='llama3.2:3b', messages=[
  {
    'role': 'user',
    'content': 'Why is the sky blue?',
  },
])

print(response['message']['content'])
# or access fields directly from the response object
print(response.message.content)

The sky appears blue because of a phenomenon called scattering, which occurs when sunlight interacts with the tiny molecules of gases in the Earth's atmosphere.....

designcomputer avatar Dec 29 '24 17:12 designcomputer

Hi @designcomputer! Possible this is some kind of firewall issue - is this on windows?

ParthSareen avatar Dec 29 '24 22:12 ParthSareen

Hi @designcomputer! Possible this is some kind of firewall issue - is this on windows?

Yes, I am using a Windows computer, as indicated by the error message. Assuming the chat function defaults to http://localhost:11434 when the host is not explicitly defined, I’m curious why explicitly defining the host resolves the issue. Could this point to something specific about how the chat function currently handles the default host configuration? The failing example obviously worked in the past.

designcomputer avatar Dec 29 '24 22:12 designcomputer

Did you have a version at which point this was working? Wondering if this is more so windows related or library related. Don't think there have been any client changes in a while

ParthSareen avatar Dec 30 '24 04:12 ParthSareen

Did you have a version at which point this was working? Wondering if this is more so windows related or library related. Don't think there have been any client changes in a while

I believe it used to function properly. The issue might stem from an update made to httpx or related dependencies.

designcomputer avatar Dec 30 '24 11:12 designcomputer