Unable to run in docker on ARM Mac

[adeffur]

When using the following to run kotaemon in docker, the container exits. (Host is M2 Mac with Rosetta)

docker run --platform linux/amd64 -e GRADIO_SERVER_NAME=0.0.0.0 -e GRADIO_SERVER_PORT=7860 -p 7860:7860 -it taprosoft/kotaemon:v1.0

The following output is printed to the screen:

Warning: Cannot statically find a gradio demo called demo. Reload work may fail. Watching: '/app' '/app' [nltk_data] Downloading package punkt_tab to [nltk_data] /usr/local/lib/python3.10/site- [nltk_data] packages/llama_index/core/_static/nltk_cache... [nltk_data] Unzipping tokenizers/punkt_tab.zip.

Not sure what I'm missing.

[smshapiro85]

Same on my end

[smshapiro85]

I tried to run it on my synology NAS with the same error, so it may not be related to ARM Mac only

[taprosoft]

Should be able to do this on Mac ARM. Let us work on this issue to check if is reproducible.

[sturdan]

same error here windows x64 using docker desktop

[taprosoft]

Can you use docker logs to check out what might be the possible issue.

[kintopp]

I see this too on MacMini M2 Pro, OSX 14.6.1. Docker Desktop v4.33.0. Same error as others in this thread:

Warning: Cannot statically find a gradio demo called demo. Reload work may fail. Watching: '/app' '/app'

docker logs -f <container> shows the same error, no other messages. /Applications/Docker.app/Contents/MacOS/com.docker.diagnose check passes all tests.

[sturdan]

same docker logs message on windows x64 and docker desktop (having an old CPU without AVX, x5650)

Warning: Cannot statically find a gradio demo called demo. Reload work may fail. Watching: '/app' '/app' [nltk_data] Downloading package punkt_tab to [nltk_data] /usr/local/lib/python3.10/site- [nltk_data] packages/llama_index/core/_static/nltk_cache... [nltk_data] Unzipping tokenizers/punkt_tab.zip.

[RobTranquillo]

Same here on M3 Macbook Pro in Docker in Terminal as well as Docker Desktop (freshly installed). Never used Docker on this machine.

[byronbowerman]

Same results; M1 MacBook Pro + Orbstack 1.7.0

[taprosoft]

Noted. Seem this a common issues. Please wait why we investigate this issue.

[sturdan]

would guess it is AVX relatead, all CPU's listed here missing it

[jborbik]

That's my output on a M2 MacBook:

$ docker run -e GRADIO_SERVER_NAME=0.0.0.0 -e GRADIO_SERVER_PORT=7860 -p 7860:7860 -it --rm taprosoft/kotaemon:v1.0

WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested

Warning: Cannot statically find a gradio demo called demo. Reload work may fail.
Watching: '/app' '/app'

[nltk_data] Downloading package punkt_tab to
[nltk_data]     /usr/local/lib/python3.10/site-
[nltk_data]     packages/llama_index/core/_static/nltk_cache...
[nltk_data]   Unzipping tokenizers/punkt_tab.zip.

I managed to resolve the first warning by explicitly specifying the platform but the docker container still closes immediately and the website is not available:

$ docker run --platform linux/amd64  -e GRADIO_SERVER_NAME=0.0.0.0 -e GRADIO_SERVER_PORT=7860 -p 7860:7860 -it --rm taprosoft/kotaemon:v1.0


Warning: Cannot statically find a gradio demo called demo. Reload work may fail.
Watching: '/app' '/app'

[nltk_data] Downloading package punkt_tab to
[nltk_data]     /usr/local/lib/python3.10/site-
[nltk_data]     packages/llama_index/core/_static/nltk_cache...
[nltk_data]   Unzipping tokenizers/punkt_tab.zip.

[pathros]

Same here. On MacOS apple silicon, i get the following error:

WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested

when trying:

docker run -e GRADIO_SERVER_NAME=0.0.0.0 -e GRADIO_SERVER_PORT=7860 -p 7860:7860 -it --rm taprosoft/kotaemon:v1.0

Any ideas to fix it ad make it work?

complete output:

> docker run -e GRADIO_SERVER_NAME=0.0.0.0 -e GRADIO_SERVER_PORT=7860 -p 7860:7860 -it --rm taprosoft/kotaemon:v1.0
WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested

Warning: Cannot statically find a gradio demo called demo. Reload work may fail.
Watching: '/app' '/app'

[nltk_data] Downloading package punkt_tab to
[nltk_data]     /usr/local/lib/python3.10/site-
[nltk_data]     packages/llama_index/core/_static/nltk_cache...
[nltk_data]   Unzipping tokenizers/punkt_tab.zip.

moreover:

docker: image with reference docker.io/taprosoft/kotaemon:v1.0 was found but does not match the specified platform: wanted linux/arm64, actual: linux/amd64.

[slimandslam]

Same issues -- M1 MacBook Pro running MacOS Sonoma 14.6.1

[MarcCG0]

Same issue here on my M2 Max mac, MacOS 13.0 Ventura

[adeffur]

FYI Used the same command on a Ryzen-based system running Win10, started as expected. So probably a CPU compatibility issue. Apparently macOS Sonoma will bring AVX support to Apple Silicon machines.

[bookandlover]

Same issue. Cannot run on Mac M2 Max.

[adeffur]

FYI Used the same command on a Ryzen-based system running Win10, started as expected. So probably a CPU compatibility issue. Apparently macOS Sonoma will bring AVX support to Apple Silicon machines.

Correction: macOS Sequoia is bringing support for AVX2 (source) (currently available in the beta). Not sure which level is required for the kotaemon container to run. Also found no mention of AVX512 support in macOS Sequoia.

[yby2003]

Same issue. Cannot run on Mac M2 Ultra.

[RicardoMonteiroSimoes]

They added the github action to auto build docker images, I have a PR open to add ARM image support https://github.com/Cinnamon/kotaemon/pull/226

[trahloff]

Same for Synology NAS (Intel Celeron J4125, no AVX support)

[cin-niko]

Resolved in the new version. Please check the latest docker full for amd64.