ara-collection icon indicating copy to clipboard operation
ara-collection copied to clipboard

Initial version to make it run on Podman

Open Thulium-Drake opened this issue 1 year ago • 31 comments

Still a work in progress, but it should migrate existing PyPI installation to podman while keeping the data :-)

Thulium-Drake avatar Jul 14 '23 14:07 Thulium-Drake

Build succeeded. https://ansible.softwarefactory-project.io/zuul/buildset/daf1892c5fa246a1902aa7310734fb5c

:heavy_check_mark: ara-role-api-distributed-sqlite SUCCESS in 14m 13s :heavy_check_mark: ara-role-api-mysql SUCCESS in 14m 26s :heavy_check_mark: ara-role-api-postgresql SUCCESS in 15m 46s :heavy_check_mark: ara-role-api-gunicorn-nginx SUCCESS in 11m 41s :heavy_check_mark: ara-role-api-gunicorn-nginx-client-cert SUCCESS in 12m 11s :x: ara-role-api-fedora-packages FAILURE in 5m 12s (non-voting)

Build succeeded. https://ansible.softwarefactory-project.io/zuul/buildset/e9cf5d1476494169b3db0cafc8ef6333

:heavy_check_mark: ara-role-api-distributed-sqlite SUCCESS in 19m 46s :heavy_check_mark: ara-role-api-mysql SUCCESS in 14m 53s :heavy_check_mark: ara-role-api-postgresql SUCCESS in 14m 15s :heavy_check_mark: ara-role-api-gunicorn-nginx SUCCESS in 21m 44s :heavy_check_mark: ara-role-api-gunicorn-nginx-client-cert SUCCESS in 11m 45s :x: ara-role-api-fedora-packages FAILURE in 9m 37s (non-voting)

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/ff0b0a31d0dd4382b49bbff728e2c445

:heavy_check_mark: ara-role-api-distributed-sqlite SUCCESS in 14m 34s :heavy_check_mark: ara-role-api-mysql SUCCESS in 18m 36s :heavy_check_mark: ara-role-api-postgresql SUCCESS in 17m 23s :heavy_check_mark: ara-role-api-gunicorn-nginx SUCCESS in 12m 47s :heavy_check_mark: ara-role-api-gunicorn-nginx-client-cert SUCCESS in 16m 16s :x: ara-role-api-podman ERROR Unable to find playbook /var/lib/zuul/builds/5bbc70ce3d624c28b1281e62cca854c7/untrusted/project_0/github.com/ansible-community/ara-collection/tests/with_podman.yaml in 3s :x: ara-role-api-fedora-packages FAILURE in 6m 10s (non-voting)

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/1aa6eed4a9274266830acf394c4fd000

:heavy_check_mark: ara-role-api-distributed-sqlite SUCCESS in 14m 38s :heavy_check_mark: ara-role-api-mysql SUCCESS in 22m 49s :heavy_check_mark: ara-role-api-postgresql SUCCESS in 23m 40s :heavy_check_mark: ara-role-api-gunicorn-nginx SUCCESS in 18m 20s :heavy_check_mark: ara-role-api-gunicorn-nginx-client-cert SUCCESS in 18m 13s :x: ara-role-api-podman FAILURE in 5m 14s :x: ara-role-api-fedora-packages FAILURE in 5m 16s (non-voting)

Hello and thanks for the PR @Thulium-Drake :heart:

I have some questions and comments in line but this is good work. I'm looking forward to merge it when it's ready :)

dmsimard avatar Jul 18 '23 02:07 dmsimard

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/dfac4700396a48be82a66c458c5da59e

:heavy_check_mark: ara-role-api-distributed-sqlite SUCCESS in 13m 15s :heavy_check_mark: ara-role-api-mysql SUCCESS in 14m 46s :heavy_check_mark: ara-role-api-postgresql SUCCESS in 15m 39s :heavy_check_mark: ara-role-api-gunicorn-nginx SUCCESS in 12m 12s :heavy_check_mark: ara-role-api-gunicorn-nginx-client-cert SUCCESS in 12m 20s :x: ara-role-api-podman FAILURE in 2m 53s :x: ara-role-api-fedora-packages FAILURE in 6m 34s (non-voting)

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/b13a34379f7d42679d8ceb1331d7048b

:heavy_check_mark: ara-role-api-distributed-sqlite SUCCESS in 15m 34s :heavy_check_mark: ara-role-api-mysql SUCCESS in 14m 52s :heavy_check_mark: ara-role-api-postgresql SUCCESS in 19m 52s :heavy_check_mark: ara-role-api-gunicorn-nginx SUCCESS in 13m 59s :heavy_check_mark: ara-role-api-gunicorn-nginx-client-cert SUCCESS in 12m 22s :x: ara-role-api-podman FAILURE in 3m 13s :x: ara-role-api-fedora-packages FAILURE in 6m 02s (non-voting)

So I ran into 2 issues deploying it on a fresh system (I think I forgot to thoroughly clean my dev system the other days :-) and I didn't test RHEL yet):

  • Generating a secret key uses Django tools, I have replaced that with a generic oneliner that should do the same
  • SELinux context for the Podman pod are not correct. I'll try to figure this one out tomorrow, it's definitely something with filecontext, but I need to do some poking and prodding to get it to work.

Thulium-Drake avatar Sep 06 '23 21:09 Thulium-Drake

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/014c6d78d2374eadac433b4eeb7f7152

:x: ara-role-api-distributed-sqlite FAILURE in 12m 22s :x: ara-role-api-mysql FAILURE in 11m 55s :x: ara-role-api-postgresql FAILURE in 7m 20s :x: ara-role-api-gunicorn-nginx FAILURE in 9m 56s :x: ara-role-api-gunicorn-nginx-client-cert FAILURE in 9m 58s :x: ara-role-api-podman FAILURE in 2m 51s :x: ara-role-api-fedora-packages FAILURE in 5m 55s (non-voting)

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/979ee085aaf3439ab1e7197a95efc3f1

:x: ara-role-api-distributed-sqlite FAILURE in 12m 08s :x: ara-role-api-mysql FAILURE in 11m 15s :x: ara-role-api-postgresql FAILURE in 7m 16s :x: ara-role-api-gunicorn-nginx FAILURE in 10m 06s :x: ara-role-api-gunicorn-nginx-client-cert FAILURE in 9m 11s :x: ara-role-api-podman FAILURE in 3m 11s :x: ara-role-api-fedora-packages FAILURE in 6m 59s (non-voting)

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/f319dcf4f1d7411e8ec07b491a67a00b

:x: ara-role-api-distributed-sqlite FAILURE in 11m 32s :x: ara-role-api-mysql FAILURE in 10m 23s :x: ara-role-api-postgresql FAILURE in 7m 02s :x: ara-role-api-gunicorn-nginx FAILURE in 9m 03s :x: ara-role-api-gunicorn-nginx-client-cert FAILURE in 9m 53s :x: ara-role-api-podman FAILURE in 2m 14s :x: ara-role-api-fedora-packages FAILURE in 4m 28s (non-voting)

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/e08565f662eb440a91ed17ebb4b1d38b

:x: ara-role-api-distributed-sqlite FAILURE in 11m 42s :x: ara-role-api-mysql FAILURE in 12m 03s :x: ara-role-api-postgresql FAILURE in 7m 33s :x: ara-role-api-gunicorn-nginx FAILURE in 9m 34s :x: ara-role-api-gunicorn-nginx-client-cert FAILURE in 10m 17s :x: ara-role-api-podman FAILURE in 3m 15s :x: ara-role-api-fedora-packages FAILURE in 5m 10s (non-voting)

recheck

Thulium-Drake avatar Nov 20 '23 10:11 Thulium-Drake

@dmsimard I think CI needs some love, all tests seem to fail, even those this PR didn't touch :sweat_smile:

Do I need to rebase and try again? Or do we need to work on that first (and if so, what needs fixing?)

Thulium-Drake avatar Nov 20 '23 11:11 Thulium-Drake

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/42b1b463b310428a9f9a1a7e576af122

:x: ara-role-api-distributed-sqlite FAILURE in 11m 37s :x: ara-role-api-mysql FAILURE in 12m 12s :x: ara-role-api-postgresql FAILURE in 6m 52s :x: ara-role-api-gunicorn-nginx FAILURE in 10m 02s :x: ara-role-api-gunicorn-nginx-client-cert FAILURE in 9m 26s :x: ara-role-api-podman FAILURE in 3m 14s :x: ara-role-api-fedora-packages FAILURE in 5m 31s (non-voting)

@dmsimard I think CI needs some love, all tests seem to fail, even those this PR didn't touch 😅

Do I need to rebase and try again? Or do we need to work on that first (and if so, what needs fixing?)

I need some time but I will look into it. Sorry about the delay.

dmsimard avatar Dec 20 '23 03:12 dmsimard

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/9c2accc34258420d9ffa289bcddcd655

:x: ara-role-api-distributed-sqlite FAILURE in 11m 57s :x: ara-role-api-mysql FAILURE in 10m 45s :x: ara-role-api-postgresql FAILURE in 6m 12s :x: ara-role-api-gunicorn-nginx FAILURE in 9m 25s :x: ara-role-api-gunicorn-nginx-client-cert FAILURE in 9m 33s :x: ara-role-api-podman FAILURE in 2m 25s :x: ara-role-api-fedora-packages FAILURE in 6m 13s (non-voting)

I am still interested in this. I will circle back to the PR once there is a bugfix release out.

Thanks for your patience.

dmsimard avatar Apr 19 '24 22:04 dmsimard

@dmsimard Rebased! :-)

Thulium-Drake avatar Apr 29 '24 12:04 Thulium-Drake

recheck

Thulium-Drake avatar Apr 29 '24 12:04 Thulium-Drake

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/0b50d7ead1a145958f12848c37c3a5ed

:x: ara-role-api-distributed-sqlite FAILURE in 9m 10s :heavy_check_mark: ara-role-api-mysql SUCCESS in 8m 49s :heavy_check_mark: ara-role-api-postgresql SUCCESS in 10m 14s :heavy_check_mark: ara-role-api-gunicorn-nginx SUCCESS in 6m 49s :heavy_check_mark: ara-role-api-gunicorn-nginx-client-cert SUCCESS in 6m 39s :x: ara-role-api-podman FAILURE in 2m 13s :heavy_check_mark: ara-role-api-fedora-packages SUCCESS in 5m 49s (non-voting)

You can disregard the failure with the distributed-sqlite job, it's the concurrency problem I need to resolve.

For the podman job, the failure was the following:

2024-04-29 12:25:32.788176 | PLAY [Deploy and test ARA API with podman]
2024-04-29 12:25:32.862833 | ERROR! vars file vars/podman_tests.yaml was not found
2024-04-29 12:25:32.862879 | Could not find file on the Ansible Controller.
2024-04-29 12:25:32.862888 | If you are using a module and expect the file to exist on the remote, see the remote_src option
2024-04-29 12:25:32.863596 | RUN END RESULT_NORMAL: [untrusted : github.com/ansible-community/ara-collection/tests/with_podman.yaml@master]
2024-04-29 12:25:32.888422 | POST-RUN START: [untrusted : github.com/ansible-community/ara-collection/tests/zuul_post_logs.yaml@master]

I haven't dug into that yet but I see that the vars file does exist in this PR.

dmsimard avatar Apr 29 '24 16:04 dmsimard

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/3346777a420c435398d03f6203daabc7

:heavy_check_mark: ara-role-api-distributed-sqlite SUCCESS in 8m 35s :heavy_check_mark: ara-role-api-mysql SUCCESS in 8m 34s :heavy_check_mark: ara-role-api-postgresql SUCCESS in 9m 06s :x: ara-role-api-gunicorn-nginx FAILURE in 7m 26s :heavy_check_mark: ara-role-api-gunicorn-nginx-client-cert SUCCESS in 6m 29s :x: ara-role-api-podman FAILURE in 1m 59s :heavy_check_mark: ara-role-api-fedora-packages SUCCESS in 6m 30s (non-voting)

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/759198501b3c4e36b837efb42958fdaf

:x: ara-role-api-distributed-sqlite NODE_FAILURE Node request 200-0007569621 failed in 0s :x: ara-role-api-mysql NODE_FAILURE Node request 200-0007569622 failed in 0s :x: ara-role-api-postgresql NODE_FAILURE Node request 200-0007569623 failed in 0s :x: ara-role-api-gunicorn-nginx NODE_FAILURE Node request 200-0007569624 failed in 0s :x: ara-role-api-gunicorn-nginx-client-cert NODE_FAILURE Node request 200-0007569625 failed in 0s :x: ara-role-api-podman NODE_FAILURE Node request 200-0007569626 failed in 0s :x: ara-role-api-fedora-packages FAILURE in 4m 27s (non-voting)

recheck

dmsimard avatar Sep 09 '24 12:09 dmsimard

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/c5f5406f68724be695dde4c43bd869e2

:x: ara-role-api-distributed-sqlite NODE_FAILURE Node request 200-0007569781 failed in 0s :x: ara-role-api-mysql NODE_FAILURE Node request 200-0007569782 failed in 0s :x: ara-role-api-postgresql NODE_FAILURE Node request 200-0007569783 failed in 0s :x: ara-role-api-gunicorn-nginx NODE_FAILURE Node request 200-0007569784 failed in 0s :x: ara-role-api-gunicorn-nginx-client-cert NODE_FAILURE Node request 200-0007569785 failed in 0s :x: ara-role-api-podman NODE_FAILURE Node request 200-0007569786 failed in 0s :heavy_check_mark: ara-role-api-fedora-packages SUCCESS in 4m 41s (non-voting)

recheck

dmsimard avatar Sep 09 '24 22:09 dmsimard

Build failed. https://ansible.softwarefactory-project.io/zuul/buildset/8dadec6998d243b9a1013ca1cf9b029d

:x: ara-role-api-distributed-sqlite NODE_FAILURE Node request 200-0007570660 failed in 0s :x: ara-role-api-mysql NODE_FAILURE Node request 200-0007570661 failed in 0s :x: ara-role-api-postgresql NODE_FAILURE Node request 200-0007570662 failed in 0s :x: ara-role-api-gunicorn-nginx NODE_FAILURE Node request 200-0007570663 failed in 0s :x: ara-role-api-gunicorn-nginx-client-cert NODE_FAILURE Node request 200-0007570664 failed in 0s :x: ara-role-api-podman NODE_FAILURE Node request 200-0007570665 failed in 0s :heavy_check_mark: ara-role-api-fedora-packages SUCCESS in 5m 31s (non-voting)

recheck

Thulium-Drake avatar Sep 10 '24 19:09 Thulium-Drake

Let's see if Zuul wants to it's thing today :-)

Thulium-Drake avatar Sep 10 '24 19:09 Thulium-Drake