arrow icon indicating copy to clipboard operation
arrow copied to clipboard

GH-40454: [CI][Debian] Update Debian to 12 from 11

Open kou opened this issue 1 year ago • 23 comments

Rationale for this change

Debian 11 will reach EOL on 2024-07.

What changes are included in this PR?

  • Use Debian 12.
  • Enable build options that can't be enabled with Debian 11.
    • ARROW_AZURE
    • ARROW_FLIGHT_SQL
    • ARROW_WITH_OPENTELEMETRY

Are these changes tested?

Yes.

Are there any user-facing changes?

No.

  • GitHub Issue: #40454

kou avatar Mar 11 '24 07:03 kou

@github-actions crossbow submit test-debian-*

kou avatar Mar 11 '24 07:03 kou

:warning: GitHub issue #40454 has been automatically assigned in GitHub to PR creator.

github-actions[bot] avatar Mar 11 '24 07:03 github-actions[bot]

Revision: 6bf98a6465111ffe99efe26404cd2bf513ded52e

Submitted crossbow builds: ursacomputing/crossbow @ actions-aa275254c8

Task Status
test-debian-12-cpp-amd64 GitHub Actions
test-debian-12-cpp-i386 GitHub Actions
test-debian-12-go-1.19 Azure
test-debian-12-go-1.21 Azure
test-debian-12-python-3-amd64 Azure
test-debian-12-python-3-i386 GitHub Actions
test-debian-c-glib GitHub Actions
test-debian-ruby GitHub Actions

github-actions[bot] avatar Mar 11 '24 07:03 github-actions[bot]

@github-actions crossbow submit test-debian-*

kou avatar Mar 11 '24 07:03 kou

Revision: 53c3ff331b35de169dab7d8d0126100359f130b6

Submitted crossbow builds: ursacomputing/crossbow @ actions-fe10b1609e

Task Status
test-debian-12-cpp-amd64 GitHub Actions
test-debian-12-cpp-i386 GitHub Actions
test-debian-12-go-1.19 Azure
test-debian-12-go-1.21 Azure
test-debian-12-python-3-amd64 Azure
test-debian-12-python-3-i386 GitHub Actions
test-debian-c-glib GitHub Actions
test-debian-ruby GitHub Actions

github-actions[bot] avatar Mar 11 '24 07:03 github-actions[bot]

@github-actions crossbow submit test-debian-*

kou avatar Mar 11 '24 08:03 kou

Revision: 373cdea52cdfdb33bcd771a4820672235b6d393f

Submitted crossbow builds: ursacomputing/crossbow @ actions-89f6cc77e9

Task Status
test-debian-12-cpp-amd64 GitHub Actions
test-debian-12-cpp-i386 GitHub Actions
test-debian-12-go-1.19 Azure
test-debian-12-go-1.21 Azure
test-debian-12-python-3-amd64 Azure
test-debian-12-python-3-i386 GitHub Actions
test-debian-c-glib GitHub Actions
test-debian-ruby GitHub Actions

github-actions[bot] avatar Mar 11 '24 08:03 github-actions[bot]

@github-actions crossbow submit test-debian-*

kou avatar Mar 11 '24 08:03 kou

Revision: 379e5b48611ae2739deb75f3623b8eccd8e4685e

Submitted crossbow builds: ursacomputing/crossbow @ actions-ad8f7b1efa

Task Status
test-debian-12-cpp-amd64 GitHub Actions
test-debian-12-cpp-i386 GitHub Actions
test-debian-12-go-1.19 Azure
test-debian-12-go-1.21 Azure
test-debian-12-python-3-amd64 Azure
test-debian-12-python-3-i386 GitHub Actions
test-debian-c-glib GitHub Actions
test-debian-ruby GitHub Actions

github-actions[bot] avatar Mar 11 '24 08:03 github-actions[bot]

@github-actions crossbow submit test-debian-*

kou avatar Mar 11 '24 09:03 kou

Revision: 281c4379877b41634d9a5fdf8af5a43d563dbb68

Submitted crossbow builds: ursacomputing/crossbow @ actions-36e926db2f

Task Status
test-debian-12-cpp-amd64 GitHub Actions
test-debian-12-cpp-i386 GitHub Actions
test-debian-12-go-1.19 Azure
test-debian-12-go-1.21 Azure
test-debian-12-python-3-amd64 Azure
test-debian-12-python-3-i386 GitHub Actions
test-debian-c-glib GitHub Actions
test-debian-ruby GitHub Actions

github-actions[bot] avatar Mar 11 '24 10:03 github-actions[bot]

@github-actions crossbow submit -g python

raulcd avatar Mar 11 '24 11:03 raulcd

Revision: 281c4379877b41634d9a5fdf8af5a43d563dbb68

Submitted crossbow builds: ursacomputing/crossbow @ actions-dd8ded6b08

Task Status
test-conda-python-3.10 GitHub Actions
test-conda-python-3.10-cython2 GitHub Actions
test-conda-python-3.10-hdfs-2.9.2 GitHub Actions
test-conda-python-3.10-hdfs-3.2.1 GitHub Actions
test-conda-python-3.10-pandas-latest GitHub Actions
test-conda-python-3.10-pandas-nightly GitHub Actions
test-conda-python-3.10-spark-v3.5.0 GitHub Actions
test-conda-python-3.10-substrait GitHub Actions
test-conda-python-3.11 GitHub Actions
test-conda-python-3.11-dask-latest GitHub Actions
test-conda-python-3.11-dask-upstream_devel GitHub Actions
test-conda-python-3.11-hypothesis GitHub Actions
test-conda-python-3.11-pandas-upstream_devel GitHub Actions
test-conda-python-3.11-spark-master GitHub Actions
test-conda-python-3.12 GitHub Actions
test-conda-python-3.8 GitHub Actions
test-conda-python-3.8-pandas-1.0 GitHub Actions
test-conda-python-3.8-spark-v3.5.0 GitHub Actions
test-conda-python-3.9 GitHub Actions
test-conda-python-3.9-pandas-latest GitHub Actions
test-cuda-python GitHub Actions
test-debian-12-python-3-amd64 Azure
test-debian-12-python-3-i386 GitHub Actions
test-fedora-39-python-3 Azure
test-ubuntu-20.04-python-3 Azure
test-ubuntu-22.04-python-3 GitHub Actions

github-actions[bot] avatar Mar 11 '24 11:03 github-actions[bot]

We are doing other things on this PR apart from updating debian version, like enabling AZURE build, etc. I am ok with it but should we reference it on the title/description or do it on a different PR?

You're right. I've update the description. I keep the title for now because these changes are PR details. (Title should describes summary not details.)

kou avatar Mar 11 '24 20:03 kou

@github-actions crossbow submit test-debian-12-python-3-i386

kou avatar Mar 11 '24 20:03 kou

Revision: 3a5b56801dc1d1d87eb88cf1a0409f0cd1c9980a

Submitted crossbow builds: ursacomputing/crossbow @ actions-4107cf027b

Task Status
test-debian-12-python-3-i386 GitHub Actions

github-actions[bot] avatar Mar 11 '24 20:03 github-actions[bot]

@github-actions crossbow submit test-debian-12-python-3-amd64 -g python

kou avatar Mar 11 '24 21:03 kou

Revision: 3a5b56801dc1d1d87eb88cf1a0409f0cd1c9980a

Submitted crossbow builds: ursacomputing/crossbow @ actions-01f19214ef

Task Status
test-conda-python-3.10 GitHub Actions
test-conda-python-3.10-cython2 GitHub Actions
test-conda-python-3.10-hdfs-2.9.2 GitHub Actions
test-conda-python-3.10-hdfs-3.2.1 GitHub Actions
test-conda-python-3.10-pandas-latest GitHub Actions
test-conda-python-3.10-pandas-nightly GitHub Actions
test-conda-python-3.10-spark-v3.5.0 GitHub Actions
test-conda-python-3.10-substrait GitHub Actions
test-conda-python-3.11 GitHub Actions
test-conda-python-3.11-dask-latest GitHub Actions
test-conda-python-3.11-dask-upstream_devel GitHub Actions
test-conda-python-3.11-hypothesis GitHub Actions
test-conda-python-3.11-pandas-upstream_devel GitHub Actions
test-conda-python-3.11-spark-master GitHub Actions
test-conda-python-3.12 GitHub Actions
test-conda-python-3.8 GitHub Actions
test-conda-python-3.8-pandas-1.0 GitHub Actions
test-conda-python-3.8-spark-v3.5.0 GitHub Actions
test-conda-python-3.9 GitHub Actions
test-conda-python-3.9-pandas-latest GitHub Actions
test-cuda-python GitHub Actions
test-debian-12-python-3-amd64 Azure
test-debian-12-python-3-i386 GitHub Actions
test-fedora-39-python-3 Azure
test-ubuntu-20.04-python-3 Azure
test-ubuntu-22.04-python-3 GitHub Actions

github-actions[bot] avatar Mar 11 '24 21:03 github-actions[bot]

@github-actions crossbow submit -g python

kou avatar Mar 12 '24 00:03 kou

Revision: 429fcda9dc0cef01e659d5e9e4735ca1c603f334

Submitted crossbow builds: ursacomputing/crossbow @ actions-81621861bb

Task Status
test-conda-python-3.10 GitHub Actions
test-conda-python-3.10-cython2 GitHub Actions
test-conda-python-3.10-hdfs-2.9.2 GitHub Actions
test-conda-python-3.10-hdfs-3.2.1 GitHub Actions
test-conda-python-3.10-pandas-latest GitHub Actions
test-conda-python-3.10-pandas-nightly GitHub Actions
test-conda-python-3.10-spark-v3.5.0 GitHub Actions
test-conda-python-3.10-substrait GitHub Actions
test-conda-python-3.11 GitHub Actions
test-conda-python-3.11-dask-latest GitHub Actions
test-conda-python-3.11-dask-upstream_devel GitHub Actions
test-conda-python-3.11-hypothesis GitHub Actions
test-conda-python-3.11-pandas-upstream_devel GitHub Actions
test-conda-python-3.11-spark-master GitHub Actions
test-conda-python-3.12 GitHub Actions
test-conda-python-3.8 GitHub Actions
test-conda-python-3.8-pandas-1.0 GitHub Actions
test-conda-python-3.8-spark-v3.5.0 GitHub Actions
test-conda-python-3.9 GitHub Actions
test-conda-python-3.9-pandas-latest GitHub Actions
test-cuda-python GitHub Actions
test-debian-12-python-3-amd64 Azure
test-debian-12-python-3-i386 GitHub Actions
test-fedora-39-python-3 Azure
test-ubuntu-20.04-python-3 Azure
test-ubuntu-22.04-python-3 GitHub Actions

github-actions[bot] avatar Mar 12 '24 00:03 github-actions[bot]

@github-actions crossbow submit test-debian-12*

raulcd avatar Mar 12 '24 16:03 raulcd

Revision: 8039954dd4cdc0e3306548f3052866251ce387c2

Submitted crossbow builds: ursacomputing/crossbow @ actions-fd91db0a83

Task Status
test-debian-12-cpp-amd64 GitHub Actions
test-debian-12-cpp-i386 GitHub Actions
test-debian-12-go-1.19 Azure
test-debian-12-go-1.21 Azure
test-debian-12-python-3-amd64 Azure
test-debian-12-python-3-i386 GitHub Actions

github-actions[bot] avatar Mar 12 '24 16:03 github-actions[bot]

Can we merge this?

kou avatar Mar 12 '24 21:03 kou

After merging your PR, Conbench analyzed the 5 benchmarking runs that have been run so far on merge-commit 93816475f75d751067d4ff427fb9ae64e85acebe.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 3 possible false positives for unstable benchmarks that are known to sometimes produce them.