Use uv to test cross-build wheels instead of pip

[zanieb]

In an attempt to avoid the horrible cross-build segfault do to apt install failures... use uv instead of pip to perform the installation.

[zanieb]

Ah we don't have Python for that architecture? Hm.