benchmark-wrapper icon indicating copy to clipboard operation
benchmark-wrapper copied to clipboard

Published 20 hours ago • verified publisher icon cloud-bulldozer

Python 3.9 migration & container build fixes

Open rsevilla87 opened this issue 4 years ago • 12 comments
trafficstars

Signed-off-by: Raul Sevilla [email protected]

Description

Most of builds for arm64 amd amd64 archs have been fixed. Some findings of the failed ones:

  • We're unable to build oslat container since the packages rt-tests and dumb-init are not longer available in the repos. cc: @smalleni
  • Cyclitest build fails due to broken link to the rt-tests RPM, in addition, we should avoid using static links as builds won't work for multiarch builds. cc @smalleni
  • Hammerdb for arm64 fails due to there's no offial odbc driver for arm64. cc @mkarg75

Fixes

rsevilla87 avatar Sep 15 '21 14:09 rsevilla87

Codecov Report

Merging #354 (dcb9e07) into master (47f907c) will not change coverage. The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #354   +/-   ##
=======================================
  Coverage   39.40%   39.40%           
=======================================
  Files          15       15           
  Lines         868      868           
=======================================
  Hits          342      342           
  Misses        526      526
Flag Coverage Δ
gha 39.40% <ø> (ø)
python-3.6 39.40% <ø> (ø)
unit 39.40% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 47f907c...dcb9e07. Read the comment docs.

codecov-commenter avatar Sep 15 '21 14:09 codecov-commenter

Results for SNAFU CI Test

Test Result Runtime
Report\n> FAIL 00:00:00

comet-perf-ci avatar Sep 15 '21 14:09 comet-perf-ci

Results for SNAFU CI Test

Test Result Runtime
snafu/benchmarks/uperf FAIL 00:45:01
snafu/cyclictest_wrapper FAIL 00:00:00
snafu/dns_perf_wrapper FAIL 00:00:00
snafu/fio_wrapper PASS 00:16:22
snafu/flent_wrapper FAIL 00:00:40
snafu/fs_drift_wrapper PASS 00:04:28
snafu/hammerdb PASS 00:08:38
snafu/image_pull_wrapper PASS 00:03:23
snafu/linpack_wrapper FAIL 00:00:00
snafu/log_generator_wrapper PASS 00:03:32
snafu/oslat_wrapper FAIL 00:00:00
snafu/pgbench_wrapper PASS 00:03:21
snafu/scale_openshift_wrapper PASS 00:06:06
snafu/smallfile_wrapper PASS 00:05:40
snafu/stressng_wrapper PASS 00:03:17
snafu/sysbench PASS 00:02:55
snafu/trex_wrapper FAIL 00:00:00
snafu/upgrade_openshift_wrapper PASS 00:00:00
snafu/vegeta_wrapper PASS 00:04:00
snafu/ycsb_wrapper PASS 00:05:28

comet-perf-ci avatar Sep 16 '21 01:09 comet-perf-ci

Results for SNAFU CI Test

Test Result Runtime
snafu/benchmarks/uperf FAIL 00:43:45
snafu/cyclictest_wrapper FAIL 00:00:00
snafu/dns_perf_wrapper FAIL 00:00:00
snafu/fio_wrapper PASS 00:16:52
snafu/flent_wrapper PASS 00:08:18
snafu/fs_drift_wrapper PASS 00:04:38
snafu/hammerdb PASS 00:06:36
snafu/image_pull_wrapper PASS 00:03:13
snafu/linpack_wrapper FAIL 00:00:00
snafu/log_generator_wrapper PASS 00:03:10
snafu/oslat_wrapper FAIL 00:00:00
snafu/pgbench_wrapper PASS 00:03:33
snafu/scale_openshift_wrapper PASS 00:07:39
snafu/smallfile_wrapper PASS 00:08:12
snafu/stressng_wrapper PASS 00:03:24
snafu/sysbench PASS 00:02:54
snafu/trex_wrapper FAIL 00:00:00
snafu/upgrade_openshift_wrapper PASS 00:00:00
snafu/vegeta_wrapper PASS 00:04:04
snafu/ycsb_wrapper PASS 00:05:31

comet-perf-ci avatar Sep 16 '21 12:09 comet-perf-ci

@smalleni @mukrishn Status code: 404 for https://www.rpmfind.net/linux/centos/8-stream/AppStream/x86_64/os/Packages/rt-tests-1.9-2.el8.x86_64.rpm (IP: 195.220.108.108) error building at STEP "RUN dnf -y install https://www.rpmfind.net/linux/centos/8-stream/AppStream/x86_64/os/Packages/rt-tests-1.9-2.el8.x86_64.rpm": error while running runtime: exit status 1

jtaleric avatar Sep 17 '21 18:09 jtaleric

Results for SNAFU CI Test

Test Result Runtime
snafu/benchmarks/uperf FAIL 00:03:13
snafu/cyclictest_wrapper FAIL 00:00:00
snafu/dns_perf_wrapper FAIL 00:00:00
snafu/fio_wrapper FAIL 00:02:06
snafu/flent_wrapper FAIL 00:04:49
snafu/fs_drift_wrapper FAIL 00:01:29
snafu/hammerdb FAIL 00:02:20
snafu/image_pull_wrapper FAIL 00:01:29
snafu/linpack_wrapper FAIL 00:00:00
snafu/log_generator_wrapper FAIL 00:01:38
snafu/oslat_wrapper FAIL 00:00:00
snafu/pgbench_wrapper FAIL 00:01:59
snafu/scale_openshift_wrapper FAIL 00:01:52
snafu/smallfile_wrapper FAIL 00:01:30
snafu/stressng_wrapper FAIL 00:01:50
snafu/sysbench FAIL 00:01:42
snafu/trex_wrapper FAIL 00:00:00
snafu/upgrade_openshift_wrapper PASS 00:00:00
snafu/vegeta_wrapper FAIL 00:01:34
snafu/ycsb_wrapper FAIL 00:03:04

comet-perf-ci avatar Sep 27 '21 12:09 comet-perf-ci

@rsevilla87 since you're at it with upgrading to 3.9, can you also add in an extra line for these Dockerfiles to install dependencies from requirements/py39-reqs/install.txt? Also do we have any idea on what to do with the builds that are still failing? It would be great if we could get all these images fixed in this PR. For a temporary workaround on the 404 errors on cyclictest, I figured we could extract the rpm from our current images and store them under snafu/image_resources, then do the download from GH.

I've updated the images for cyclitest and oslat to fedora, as those RPMs are not available in the official repositories anymore. Not sure if we want to move forward from here.

rsevilla87 avatar Sep 27 '21 12:09 rsevilla87

/rerun all

learnitall avatar Sep 28 '21 15:09 learnitall

Results for SNAFU CI Test

Test Result Runtime
snafu/benchmarks/uperf FAIL 00:02:00
snafu/cyclictest_wrapper FAIL 00:00:00
snafu/dns_perf_wrapper FAIL 00:00:00
snafu/fio_wrapper FAIL 00:02:06
snafu/flent_wrapper FAIL 00:03:15
snafu/fs_drift_wrapper FAIL 00:01:34
snafu/hammerdb FAIL 00:02:27
snafu/image_pull_wrapper FAIL 00:01:30
snafu/linpack_wrapper FAIL 00:00:00
snafu/log_generator_wrapper FAIL 00:01:53
snafu/oslat_wrapper FAIL 00:00:00
snafu/pgbench_wrapper FAIL 00:01:59
snafu/scale_openshift_wrapper FAIL 00:01:51
snafu/smallfile_wrapper FAIL 00:01:34
snafu/stressng_wrapper FAIL 00:01:49
snafu/sysbench FAIL 00:01:43
snafu/trex_wrapper FAIL 00:00:00
snafu/upgrade_openshift_wrapper PASS 00:00:00
snafu/vegeta_wrapper FAIL 00:01:34
snafu/ycsb_wrapper FAIL 00:03:05

comet-perf-ci avatar Sep 28 '21 16:09 comet-perf-ci

/rerun all

learnitall avatar Oct 06 '21 17:10 learnitall

Results for SNAFU CI Test

Test Result Runtime
snafu/benchmarks/uperf FAIL 00:42:45
snafu/cyclictest_wrapper FAIL 00:00:00
snafu/dns_perf_wrapper FAIL 00:00:00
snafu/fio_wrapper PASS 00:17:23
snafu/flent_wrapper PASS 00:07:49
snafu/fs_drift_wrapper PASS 00:04:23
snafu/hammerdb PASS 00:05:58
snafu/image_pull_wrapper PASS 00:03:19
snafu/linpack_wrapper FAIL 00:00:00
snafu/log_generator_wrapper PASS 00:03:18
snafu/oslat_wrapper FAIL 00:00:00
snafu/pgbench_wrapper PASS 00:03:24
snafu/scale_openshift_wrapper PASS 00:05:42
snafu/smallfile_wrapper PASS 00:05:33
snafu/stressng_wrapper PASS 00:03:10
snafu/sysbench PASS 00:02:41
snafu/trex_wrapper FAIL 00:00:00
snafu/upgrade_openshift_wrapper PASS 00:00:00
snafu/vegeta_wrapper PASS 00:04:07
snafu/ycsb_wrapper PASS 00:04:55

comet-perf-ci avatar Oct 06 '21 19:10 comet-perf-ci

Results for SNAFU CI Test

Test Result Runtime
snafu/benchmarks/uperf PASS 00:27:16
snafu/cyclictest_wrapper FAIL 00:00:00
snafu/dns_perf_wrapper FAIL 00:00:00
snafu/fio_wrapper PASS 00:16:00
snafu/flent_wrapper PASS 00:08:05
snafu/fs_drift_wrapper PASS 00:04:10
snafu/hammerdb PASS 00:05:57
snafu/image_pull_wrapper PASS 00:03:08
snafu/linpack_wrapper FAIL 00:00:00
snafu/log_generator_wrapper PASS 00:03:04
snafu/oslat_wrapper FAIL 00:00:00
snafu/pgbench_wrapper PASS 00:03:32
snafu/scale_openshift_wrapper PASS 00:09:38
snafu/smallfile_wrapper PASS 00:05:33
snafu/stressng_wrapper PASS 00:03:31
snafu/sysbench PASS 00:02:42
snafu/trex_wrapper FAIL 00:00:00
snafu/upgrade_openshift_wrapper PASS 00:00:00
snafu/vegeta_wrapper PASS 00:04:28
snafu/ycsb_wrapper PASS 00:05:30

comet-perf-ci avatar Oct 07 '21 17:10 comet-perf-ci