repo2docker icon indicating copy to clipboard operation
repo2docker copied to clipboard

Add ARM64 support to repo2docker

Open yuvipanda opened this issue 3 years ago • 7 comments

I got a M1 Mac, what else does one do to procrastinate?

Fixes #1120

TODO:

  • [ ] Have frozen versions of the conda-lock files be architecture specific
  • [ ] Be platform specific in getting R
  • [ ] Setup arm tests for everything

yuvipanda avatar Aug 26 '22 01:08 yuvipanda

I'm guessing this should be commandline param passed in.

yuvipanda avatar Aug 26 '22 07:08 yuvipanda

I see:

Warning: repo2docker:app.py:814  ---> [Warning] The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64) and no specific platform was requested

everywhere, and am not sure if qemu is actually even being used? We don't use buildx, as we talk to it via the docker API (not buildx). Is it actually not possible to do this via the API? All the docs I can find seem to suggest using buildx

yuvipanda avatar Aug 26 '22 08:08 yuvipanda

Looks like docker-py doesn't support buildx https://github.com/docker/docker-py/issues/2230

manics avatar Aug 26 '22 08:08 manics

everywhere, and am not sure if qemu is actually even being used?

If the build steps don't fail immediately, qemu's involved. You'll get some kind of exec error if there's no qemu. It is weird that it thinks no platform is requested, though.

minrk avatar Aug 26 '22 09:08 minrk

@minrk they currently fail with:

2022-08-26T10:38:55.0109683Z INFO     repo2docker:app.py:814 [91m/tmp/install-base-env.bash: /srv/conda/envs/kernel/bin/ipython: /srv/conda/envs/kernel/bin/python: bad interpreter: No such file or directory

which I'd assume means they aren't using QEMU, and that's the arm binary trying to get started in an amd64 context.

It works on my local machine tho

yuvipanda avatar Aug 26 '22 16:08 yuvipanda

Given how long our tests take, it may make sense to run arm tests on circle. I just did this on pyzmq, and it was ~10x faster than qemu on GHA.

Presumably we only need a pretty basic couple of tests, though.

minrk avatar Sep 02 '22 05:09 minrk

I dunno when I'll be able to work on this again though, would love for someone else to take it over <3

yuvipanda avatar Sep 02 '22 05:09 yuvipanda

This is a PR related to #1055

consideRatio avatar Oct 31 '22 10:10 consideRatio

A tarot card reader on the streets of los angeles told me that completion of this PR is not something she sees in my future given that Saturn is in retrograde, and I will hence close this in favor of the amazing #1228

yuvipanda avatar Jan 02 '23 19:01 yuvipanda