Use litellm.client_session for ollama and ollama_chat

[paul-gauthier]

Fixes https://github.com/BerriAI/litellm/issues/6499.

[vercel[bot]]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Dec 4, 2024 6:17pm

[paul-gauthier]

Checking back on this. Does it look like a reasonable solution?

[spaasis]

Just confirming that this fix works - making these modifications allows me to connect to an ollama instance that would otherwise fail from the self signed certificate

Upd: there's still some path that fails - via Aider:

1. asking for changes works: valid suggestion received
2. when aider starts applying the changes:

litellm.APIConnectionError: Ollama_chatException - HTTPSConnectionPool(host='myollama.org', port=443): Max retries exceeded with url: /ollama/api/chat (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1000)')))
Retry in 0.9 seconds.

[underlines]

hope this gets accepted soon: every enterprise environment who uses self certified TLS for their employees will have this problem.

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[github-actions[bot]]

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.