arrow
arrow copied to clipboard
ARROW-18016: [CI] Add sccache to more jobs
@github-actions crossbow submit -g nightly
Revision: 6ffd9fa38443064e2b6be4d242e03e796639401d
Submitted crossbow builds: ursacomputing/crossbow @ actions-0ae2635d33
By the way, what is the current disk footprint of our sccache?
@github-actions crossbow submit -g nightly
@pitrou ~100G
502 Server Error
The Archery job run can be found at: https://github.com/apache/arrow/actions/runs/3275035030
Revision: 480a82076d89117676ca6afacc7db8cb1bd010e1
Submitted crossbow builds: ursacomputing/crossbow @ actions-dec0e5bfda
@github-actions crossbow submit -g nightly
@raulcd @kou could you review this? There are still a few jobs we can add sccache but I will do those in a follow up to keep this reviewable.
Revision: c9a570c559d408d7f3c6c6712f4c03293ec5afb4
Submitted crossbow builds: ursacomputing/crossbow @ actions-71df0ac8b7
@github-actions crossbow submit verify-rc-source-cpp-linux-conda-latest-amd64 test-alpine-linux-cpp homebrew-r-autobrew test-r-install-local test-r-linux-as-cran test-r-versions
@kou the only way is to manually check in the logs :see_no_evil: but I did that and noted the jobs that are still not using sccache. The builds above had errors (missing curl) I fixed/were still missing envvars so I am now only testing those. all other failures are unrelated.
Revision: 43ebf1d0b4a316a8d60c18f22db6546264e88eae
Submitted crossbow builds: ursacomputing/crossbow @ actions-e42199f957
Task | Status |
---|---|
homebrew-r-autobrew | |
test-alpine-linux-cpp | |
test-r-install-local | |
test-r-linux-as-cran | |
test-r-versions | |
verify-rc-source-cpp-linux-conda-latest-amd64 |
The R failures are unrelated test failure, I had to change the install script to work with alpine's busybox (the ubuntu test is to validate against non busybox)
@github-actions crossbow submit test-alpine-linux-cpp test-ubuntu-20.04-cpp
Revision: f6dbd58db907663213213f83d271440851d7dffc
Submitted crossbow builds: ursacomputing/crossbow @ actions-c33459cfb7
Task | Status |
---|---|
test-alpine-linux-cpp | |
test-ubuntu-20.04-cpp |
rebased to fix go CI issue
@github-actions crossbow submit -g nightly
Revision: 0161e8e4d4bde40265d6ecadc58d939c6a1a85e0
Submitted crossbow builds: ursacomputing/crossbow @ actions-fc4193f39d
- conda-clean
- conda-osx-clang-py*
- conda-win-vs2019-*
- conda-osx-clang-*
- test issue with gandiva and similar issues also happening in nightlies
- python-sdist
- was still missing curl, now fixed
- test-r-versions
- test-r-rstudio-r-base-4.1-opensuse153
- test-r-rhub-ubuntu-gcc-release-latest
- fails due to ARROW-18174
- r-binary-packages
- failed due to false positive busybox detection (the gh ubuntu-latest images have it installed), now fixed
- homebrew-r-{brew|autobrew}
- test-r-dev-duckdb
- test-r-devdocs
- test-r-gcc-11
- test-r-gcc-12
- test-r-linux-as-cran
- test failure also happening in nightlies
- test-conda-cpp-valgrind
- verify-rc-source-js-linux-ubuntu-{18|20|22}.04-amd64
- verify-rc-source-integration-linux-ubuntu-{18|20|22}.04-amd64
- same errors as nightlies, 18.04 jobs seem to have an issue with nodejs/glibc
- verify-rc-source-csharp-macos-arm64
- a flight/grpc error also happening in nightlies
- verify-rc-source-python-linux-conda-latest-amd64
- python test failures
- verify-rc-source-python-macos-conda-amd64
- hash join test failure
- test-conda-python-3.9-spark-master
- test failure same in nightlies
Will update this when more results are available.
@github-actions crossbow submit r-binary-packages python-sdist
Revision: e81aae75e53827b59b5f5a6afcfdcd90b15f68c0
Submitted crossbow builds: ursacomputing/crossbow @ actions-db688f94bb
Task | Status |
---|---|
python-sdist | |
r-binary-packages |
The r binary failure is also caused by ARROW-18174, the problem caused by busybox being installed was solved.
@github-actions crossbow submit test-alpine-linux-cpp test-ubuntu-20.04-cpp
Unable to match any tasks for `ubuntu-cpp`
The Archery job run can be found at: https://github.com/apache/arrow/actions/runs/3347872470
Revision: e81aae75e53827b59b5f5a6afcfdcd90b15f68c0
Submitted crossbow builds: ursacomputing/crossbow @ actions-26453d6d29
Task | Status |
---|---|
test-alpine-linux-cpp | |
test-ubuntu-20.04-cpp |
* python-sdist * was still missing curl, now fixed
Why do we need sscache for this? It seems that we don't compile C/C++ code for this.
BTW, could you list jobs that should be sscache enabled? I'll confirm results of them.
This PR is to widespread to review properly. I am going to open a new PR with reduced scope.