iceberg-python icon indicating copy to clipboard operation
iceberg-python copied to clipboard

"manylinux_2_34_aarch64" wheel request

Open gabor-one opened this issue 9 months ago • 5 comments

Feature Request / Improvement

Hi Everyone!

Is there any reason why manylinux_2_34_aarch64 wheel has not been built? Can we add it?

Reason: pyiceberg/avro/decoder_fast.pyi is not compiling in slim ARM/Linux container images and the Python native implementation leaks memory. I'll open a separate ticket about this.

gabor-one avatar Mar 18 '25 21:03 gabor-one

It looks like they are still alpha? https://github.com/pypa/manylinux?tab=readme-ov-file#manylinux_2_34-almalinux-9-based---alpha

Fokko avatar Mar 20 '25 10:03 Fokko

Our current version of CI buildwheel seems to support it: https://github.com/pypa/cibuildwheel?tab=readme-ov-file#v2230

Fokko avatar Mar 20 '25 11:03 Fokko

@gabor-one would you like to contribute adding this? heres where to build the wheels https://github.com/apache/iceberg-python/blob/278f7643cd62f9e14496177632cb48d9b52e553d/.github/workflows/pypi-build-artifacts.yml#L64-L77

kevinjqliu avatar Mar 26 '25 17:03 kevinjqliu

I was also playing around with this last week, but it it turns out that it will blow up the tests up to 2h+: https://github.com/Fokko/iceberg-python/actions/runs/14219816306/job/39844845274

This is because most Python packages that have a native extension are not compiled for manylinux_2_34_aarch64, so our testing cycle will build the local extension as part of the tests.

Fokko avatar Apr 07 '25 20:04 Fokko

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

github-actions[bot] avatar Nov 14 '25 00:11 github-actions[bot]