jupyter-ai icon indicating copy to clipboard operation
jupyter-ai copied to clipboard

Published 20 hours ago • verified publisher icon jupyterlab

ollama embedding with Base API URL ignored

Open sqlreport opened this issue 1 year ago • 2 comments
trafficstars

  • jupyter-ai: 2.23.0
  • ollama3.1 working without issue
  • mxbai-embed-large curl on jupyter terminal working without issue

When running /learn command, I am seeing that jupyter ai chat UI calling using localhost instead of specific base api url configured.

HTTPConnectionPool(host='localhost', port=11434): Max retries exceeded with url: /api/embeddings

sqlreport avatar Sep 19 '24 04:09 sqlreport

This happens when we call /learn command in chat UI. So it seems to be related to embedding model call.

sqlreport avatar Sep 20 '24 06:09 sqlreport

looks like ollama embedding doesn't allow base url to be changed. https://github.com/langchain-ai/langchain/issues/25022

sqlreport avatar Sep 20 '24 06:09 sqlreport

Thank you for reporting this issue. Really sorry you felt the need to close your PRs! Please feel free to ping me in the future if you need my attention. I'll be more responsive from now on.

I'll assign this issue to you + another contributor, and add it to a milestone for tracking.

For contributors: We need a Base API URL optional field for the Ollama embedding provider defined in ollama.py.

dlqqq avatar Nov 27 '24 19:11 dlqqq