iceberg-python icon indicating copy to clipboard operation
iceberg-python copied to clipboard

NumPy Hardpin 1.26 issue

Open anuraggautam14 opened this issue 1 year ago • 1 comments

Apache Iceberg version

0.7.1 (latest release)

Please describe the bug 🐞

issue : In the latest version (0.7.1) , we notice that NumPy is hard-pinned at 1.26 (pyproject.toml link below) https://github.com/apache/iceberg-python/blob/main/pyproject.toml#L82-L85

This is causing dependency issue in our environment where our other libraries need NumPy > 2

Expected Behaviour:

We expect NumPy to be flex pin to >= 1.26.4 < 3

anuraggautam14 avatar Sep 24 '24 14:09 anuraggautam14

Hi @anuraggautam14 thanks for raising this issue.

This was actually intentionally imposed to solve an issue with pandas and numpy version compatibility. I'll take another pass at this to see if we can be more graceful about our version dependency here

sungwy avatar Sep 24 '24 15:09 sungwy

I think we can remove the numpy dependency completely once we get https://github.com/apache/iceberg-python/issues/1259 fixed. This will give flexibility to the user on which version to use

Fokko avatar Oct 30 '24 06:10 Fokko