Anja Kefala

This is the current challenge for this PR. To migrate the static metadata to the pyproject.toml, we need to set a `version`. In PyArrow, the version is set dynamically using...

> So based on that it seems this should be possible? I found open issues for the behaviour I am noticing: https://github.com/pypa/setuptools_scm/issues/827 https://github.com/pypa/setuptools_scm/issues/1011

Locally, the test seems to be behaving decently: ``` (base) ~/git/arrow/python kef/pyproject $ ls dist pyarrow-16.0.0.dev453+g51a3831e4.d20240416.tar.gz ``` The question is understanding why it is failing in CI.

`setuptools_scm` does have logging. I'm going to see if the logging helps reveal anything. If nothing, I'll explore the alternatives!

From my investigation, it seems like the problem is that `setuptools-scm` is missing from the release VM: ` /opt/hostedtoolcache/Python/3.12.3/x64/bin/python3: No module named setuptools_scm`. It's not being installed. This is confusing,...

Okay, I managed to migrate all of the settings, and it is now working locally and on the CI! This is ready for review. Note: I'm not quite sure what...

@assignUser Yeah, this can happen if we install arrow using `python3 setup.py sdist` without having at least 8.0 of `setuptools-scm`. How do I update these environments?

@github-actions crossbow submit -g python

We are working on figuring out how to best update these environments. I want to research what is the recommend building method, now that Python is moving away from setup.py....

(The force push was just to deal locally with a merge conflict. Any actual update has been committed.)