arrow
arrow copied to clipboard
ARROW-17953: [Archery] Add archery docker info command
trafficstars
Some usage examples:
$ archery docker info debian-go-cgo --only command
Service debian-go-cgo docker compose config:
- command: /bin/bash -c "
/arrow/ci/scripts/go_build.sh /arrow &&
/arrow/ci/scripts/go_test.sh /arrow"
or
$ archery docker info debian-go-cgo
Service debian-go-cgo docker compose config:
- image: ${REPO}:${ARCH}-debian-${DEBIAN}-go-${GO}-cgo
- build
- context: .
- dockerfile: ci/docker/debian-go-cgo.dockerfile
- cache_from: ['${REPO}:${ARCH}-debian-${DEBIAN}-go-${GO}-cgo']
- args
- base: ${REPO}:${ARCH}-debian-${DEBIAN}-go-${GO}
- shm_size: 2G
- volumes: ['.:/arrow:delegated', '${DOCKER_VOLUME_PREFIX}debian-ccache:/ccache:delegated']
- environment
- ARROW_GO_TESTCGO: 1
- command: /bin/bash -c "
/arrow/ci/scripts/go_build.sh /arrow &&
/arrow/ci/scripts/go_test.sh /arrow"
or
$ archery docker info ubuntu-cuda-cpp --only environment
Service ubuntu-cuda-cpp docker compose config:
- environment
- ARROW_BUILD_STATIC: OFF
- ARROW_CUDA: ON
- ARROW_GANDIVA: OFF
- ARROW_GCS: OFF
- ARROW_ORC: OFF
- ARROW_S3: OFF
- ARROW_SUBSTRAIT: OFF
- ARROW_WITH_OPENTELEMETRY: OFF
- CCACHE_COMPILERCHECK: content
- CCACHE_COMPRESS: 1
- CCACHE_COMPRESSLEVEL: 6
- CCACHE_MAXSIZE: 1G
- CCACHE_DIR: /ccache
https://issues.apache.org/jira/browse/ARROW-17953
@pitrou @assignUser this should be ready to review again. Thanks for the feedback!
I've noticed something:
$ archery docker info conda-cpp
Service conda-cpp docker-compose config:
image: ${REPO}:${ARCH}-conda-cpp
build
context: .
dockerfile: ci/docker/conda-cpp.dockerfile
cache_from: ['${REPO}:${ARCH}-conda-cpp']
args
repo: ${REPO}
arch: ${ARCH}
shm_size: 2G
ulimits
core: ${ULIMIT_CORE}
environment
ARROW_BUILD_BENCHMARKS: ON
ARROW_BUILD_EXAMPLES: ON
ARROW_ENABLE_TIMING_TESTS: None
ARROW_EXTRA_ERROR_CONTEXT: ON
ARROW_MIMALLOC: ON
ARROW_USE_LD_GOLD: ON
ARROW_USE_PRECOMPILED_HEADERS: ON
BUILD_DOCS_PYTHON: ON
CCACHE_COMPILERCHECK: content
CCACHE_COMPRESS: 1
CCACHE_COMPRESSLEVEL: 6
CCACHE_MAXSIZE: 1G
CCACHE_DIR: /ccache
AWS_ACCESS_KEY_ID: None
AWS_SECRET_ACCESS_KEY: None
SCCACHE_BUCKET: None
SCCACHE_S3_KEY_PREFIX: ${SCCACHE_S3_KEY_PREFIX:-sccache}
volumes: ['.:/arrow:delegated', '${DOCKER_VOLUME_PREFIX}conda-ccache:/ccache:delegated']
command: [' /arrow/ci/scripts/cpp_build.sh /arrow /build && /arrow/ci/scripts/cpp_test.sh /arrow /build']
Printing ARROW_ENABLE_TIMING_TESTS: None is a bit unfortunate. What happens actually is that the value is inherited from the calling shell's environment. So perhaps print out <inherited> or something.
+1
Service conda-cpp docker-compose config:
image: ${REPO}:${ARCH}-conda-cpp
build
context: .
dockerfile: ci/docker/conda-cpp.dockerfile
cache_from: ['${REPO}:${ARCH}-conda-cpp']
args
repo: ${REPO}
arch: ${ARCH}
shm_size: 2G
ulimits
core: ${ULIMIT_CORE}
environment
ARROW_BUILD_BENCHMARKS: ON
ARROW_BUILD_EXAMPLES: ON
ARROW_ENABLE_TIMING_TESTS: <inherited>
ARROW_EXTRA_ERROR_CONTEXT: ON
ARROW_MIMALLOC: ON
ARROW_USE_LD_GOLD: ON
ARROW_USE_PRECOMPILED_HEADERS: ON
BUILD_DOCS_PYTHON: ON
CCACHE_COMPILERCHECK: content
CCACHE_COMPRESS: 1
CCACHE_COMPRESSLEVEL: 6
CCACHE_MAXSIZE: 1G
CCACHE_DIR: /ccache
AWS_ACCESS_KEY_ID: <inherited>
AWS_SECRET_ACCESS_KEY: <inherited>
SCCACHE_BUCKET: <inherited>
SCCACHE_S3_KEY_PREFIX: ${SCCACHE_S3_KEY_PREFIX:-sccache}
volumes: ['.:/arrow:delegated', '${DOCKER_VOLUME_PREFIX}conda-ccache:/ccache:delegated']
command: [' /arrow/ci/scripts/cpp_build.sh /arrow /build && /arrow/ci/scripts/cpp_test.sh /arrow /build']