open-webui
No endpoints in Docker
Here is the issue: open-webui doesn't detect pipelines. I installed open-webui & pipelines as Docker images and they are accessible through the host.docker.internal address. But: open-webui says Ollama: Network Problem when I click on refresh button in connection setup. Logs from pipelines:
RESET_PIPELINES_DIR is not set to true. No action taken. requirements.txt not found at /app. Skipping installation of requirements. Downloading pipeline files from https://github.com/open-webui/pipelines/blob/main/examples/filters/detoxify_filter_pipeline.py to ./pipelines... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2870 100 2870 0 0 6944 0 --:--:-- --:--:-- --:--:-- 6944 INFO: Started server process [14] INFO: Waiting for application startup. Requirement already satisfied: detoxify in /usr/local/lib/python3.11/site-packages (0.5.2) Requirement already satisfied: transformers in /usr/local/lib/python3.11/site-packages (from detoxify) (4.47.1) Requirement already satisfied: torch>=1.7.0 in /usr/local/lib/python3.11/site-packages (from detoxify) (2.5.1+cpu) Requirement already satisfied: sentencepiece>=0.1.94 in /usr/local/lib/python3.11/site-packages (from detoxify) (0.2.0) Requirement already satisfied: filelock in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (3.13.1) Requirement already satisfied: typing-extensions>=4.8.0 in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (4.9.0) Requirement already satisfied: networkx in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (3.2.1) Requirement already satisfied: jinja2 in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (3.1.3) Requirement already satisfied: fsspec in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (2024.2.0) Requirement already satisfied: sympy==1.13.1 in /usr/local/lib/python3.11/site-packages (from torch>=1.7.0->detoxify) (1.13.1) Requirement already satisfied: mpmath<1.4,>=1.1.0 in /usr/local/lib/python3.11/site-packages (from sympy==1.13.1->torch>=1.7.0->detoxify) (1.3.0) Requirement already satisfied: huggingface-hub<1.0,>=0.24.0 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (0.27.0) Requirement already satisfied: numpy>=1.17 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (1.26.3) Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (24.2) Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (6.0.2) Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (2024.11.6) Requirement already satisfied: requests in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (2.32.2) Requirement already satisfied: tokenizers<0.22,>=0.21 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (0.21.0) Requirement already satisfied: safetensors>=0.4.1 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (0.5.0) Requirement already satisfied: tqdm>=4.27 in /usr/local/lib/python3.11/site-packages (from transformers->detoxify) (4.67.1) Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.11/site-packages (from jinja2->torch>=1.7.0->detoxify) (2.1.5) Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.11/site-packages (from requests->transformers->detoxify) (3.4.1) Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.11/site-packages (from requests->transformers->detoxify) (3.10) Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.11/site-packages (from requests->transformers->detoxify) (2.3.0) Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.11/site-packages (from requests->transformers->detoxify) (2024.12.14) WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:9099 (Press CTRL+C to quit) Installing requirement: detoxify Loaded module: detoxify_filter_pipeline on_startup:detoxify_filter_pipeline INFO: 172.17.0.1:48096 - "GET /api/version HTTP/1.1" 404 Not Found
Logs of open-webui:
ERROR [open_webui.routers.ollama] Unexpected error: HTTP Error: 404 Traceback (most recent call last): File "/app/backend/open_webui/routers/ollama.py", line 204, in verify_connection raise Exception(detail) Exception: HTTP Error: 404 INFO: 192.168.0.94:54262 - "POST /ollama/verify HTTP/1.1" 500 Internal Server Error
I tried /info, /api/version - nothing, Unicorn is completely blank.
My docker command:
docker run -d -p 9099:9099 \
-e PIPELINES_REQUIREMENTS_PATH=/app \
-e PIPELINES_URLS="https://github.com/open-webui/pipelines/blob/main/examples/filters/detoxify_filter_pipeline.py" \
--add-host=host.docker.internal:host-gateway \
-v /opt/ai/pipelines:/app/pipelines \
--name pipelines \
--restart always \
ghcr.io/open-webui/pipelines:main
open-webui v0.5.7
What I missed?
Resolve: put http://host.docker.internal:9099 inside API OpenAI not in Ollama API.
