microshift icon indicating copy to clipboard operation
microshift copied to clipboard

Published 20 hours ago • verified publisher icon openshift

USHIFT-2170: support upgrading 2 Y versions at a time

Open dhellmann opened this issue 1 year ago • 12 comments

/assign @pmtk

dhellmann avatar Jan 30 '24 19:01 dhellmann

@dhellmann: This pull request references USHIFT-2170 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the spike to target the "4.16.0" version, but no target version was set.

In response to this:

/assign @pmtk

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jan 30 '24 19:01 openshift-ci-robot

This should be rebased on #2950 before it is merged.

/hold

dhellmann avatar Jan 31 '24 17:01 dhellmann 

repo: downloading from remote: rhocp-4.15-for-rhel-9-x86_64-rpms
error: Status code: 403 for https://cdn.redhat.com/content/dist/layered/rhel9/x86_64/rhocp/4.15/os/repodata/repomd.xml (IP: 23.198.106.83) (https://cdn.redhat.com/content/dist/layered/rhel9/x86_64/rhocp/4.15/os/repodata/repomd.xml).
error: Status code: 403 for https://cdn.redhat.com/content/dist/layered/rhel9/x86_64/rhocp/4.15/os/repodata/repomd.xml (IP: 23.198.106.83) (https://cdn.redhat.com/content/dist/layered/rhel9/x86_64/rhocp/4.15/os/repodata/repomd.xml).
error: Status code: 403 for https://cdn.redhat.com/content/dist/layered/rhel9/x86_64/rhocp/4.15/os/repodata/repomd.xml (IP: 23.198.106.83) (https://cdn.redhat.com/content/dist/layered/rhel9/x86_64/rhocp/4.15/os/repodata/repomd.xml).
error: Status code: 403 for https://cdn.redhat.com/content/dist/layered/rhel9/x86_64/rhocp/4.15/os/repodata/repomd.xml (IP: 23.198.106.83) (https://cdn.redhat.com/content/dist/layered/rhel9/x86_64/rhocp/4.15/os/repodata/repomd.xml).
Red Hat OpenShift Container Platform 4.15 for R 572  B/s | 378  B     00:00    
Errors during downloading metadata for repository 'rhocp-4.15-for-rhel-9-x86_64-rpms':
  - Status code: 403 for https://cdn.redhat.com/content/dist/layered/rhel9/x86_64/rhocp/4.15/os/repodata/repomd.xml (IP: 23.198.106.83)
Error: Failed to download metadata for repo 'rhocp-4.15-for-rhel-9-x86_64-rpms': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried

dhellmann avatar Feb 01 '24 20:02 dhellmann 

./bin/create_local_repo.sh: line 41: YPLUS2_REPO: unbound variable

dhellmann avatar Feb 01 '24 21:02 dhellmann

/hold cancel

rebased after #2950 merged

dhellmann avatar Feb 07 '24 16:02 dhellmann

The issue is a package dependency problem between selinux-policy-targeted and osbuild. https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/openshift_microshift/2952/pull-ci-openshift-microshift-main-microshift-metal-tests/1755264697868750848

Let's see if that's being caused by a RHEL CDN or cache problem.

/retest-required

dhellmann avatar Feb 07 '24 19:02 dhellmann

Same dependency error

19:51:31.930541286 microshift/scripts/image-builder/../dnf_retry.sh:26 	sudo dnf install -y osbuild osbuild-composer git composer-cli ostree rpm-ostree cockpit-composer bash-completion podman runc genisoimage createrepo yum-utils selinux-policy-devel jq wget lorax rpm-build containernetworking-plugins expect
Updating Subscription Management repositories.
Red Hat Enterprise Linux 9 for x86_64 - AppStre  46 MB/s |  29 MB     00:00    
Red Hat Enterprise Linux 9 for x86_64 - BaseOS   28 MB/s |  17 MB     00:00    
Fast Datapath for RHEL 9 x86_64 (RPMs)          408 kB/s | 195 kB     00:00    
Red Hat OpenShift Container Platform 4.14 for R  31 MB/s |  17 MB     00:00    
Red Hat Enterprise Linux 9 for x86_64 - AppStre 100 MB/s |  29 MB     00:00    
Red Hat Enterprise Linux 9 for x86_64 - BaseOS   76 MB/s |  17 MB     00:00    
Red Hat Enterprise Linux 9 Client Configuration  30 kB/s | 2.2 kB     00:00    
Package git-2.39.3-1.el9_2.x86_64 is already installed.
Package bash-completion-1:2.11-4.el9.noarch is already installed.
Package yum-utils-4.3.0-11.el9_3.noarch is already installed.
Package selinux-policy-devel-38.1.23-1.el9_3.1.noarch is already installed.
Package jq-1.6-15.el9.x86_64 is already installed.
Package rpm-build-4.16.1.3-27.el9_3.x86_64 is already installed.
Error: 
 Problem: problem with installed package selinux-policy-targeted-38.1.23-1.el9_3.1.noarch
  - package osbuild-93-1.el9_3.1.noarch from rhel-9-for-x86_64-appstream-rpms requires (osbuild-selinux if selinux-policy-targeted), but none of the providers can be installed
  - package osbuild-selinux-53-1.el9_0.noarch from rhel-9-for-x86_64-appstream-rpms requires osbuild = 53-1.el9_0, but none of the providers can be installed
  - package osbuild-selinux-53-1.el9_0.noarch from rhel-9-appstream-rhui-rpms requires osbuild = 53-1.el9_0, but none of the providers can be installed
  - package osbuild-selinux-53.1-1.el9_0.noarch from rhel-9-for-x86_64-appstream-rpms requires osbuild = 53.1-1.el9_0, but none of the providers can be installed
  - package osbuild-selinux-53.1-1.el9_0.noarch from rhel-9-appstream-rhui-rpms requires osbuild = 53.1-1.el9_0, but none of the providers can be installed
  - package osbuild-selinux-65-1.el9.noarch from rhel-9-for-x86_64-appstream-rpms requires osbuild = 65-1.el9, but none of the providers can be installed
  - package osbuild-selinux-65-1.el9.noarch from rhel-9-appstream-rhui-rpms requires osbuild = 65-1.el9, but none of the providers can be installed
  - package osbuild-selinux-81-1.el9.noarch from rhel-9-for-x86_64-appstream-rpms requires osbuild = 81-1.el9, but none of the providers can be installed
  - package osbuild-selinux-81-1.el9.noarch from rhel-9-appstream-rhui-rpms requires osbuild = 81-1.el9, but none of the providers can be installed
  - package osbuild-selinux-81-1.el9_2.1.noarch from rhel-9-for-x86_64-appstream-rpms requires osbuild = 81-1.el9_2.1, but none of the providers can be installed
  - package osbuild-selinux-81-1.el9_2.1.noarch from rhel-9-appstream-rhui-rpms requires osbuild = 81-1.el9_2.1, but none of the providers can be installed
  - package osbuild-selinux-93-1.el9.noarch from rhel-9-for-x86_64-appstream-rpms requires osbuild = 93-1.el9, but none of the providers can be installed
  - package osbuild-selinux-93-1.el9.noarch from rhel-9-appstream-rhui-rpms requires osbuild = 93-1.el9, but none of the providers can be installed
  - cannot install both osbuild-93-1.el9_3.1.noarch from rhel-9-for-x86_64-appstream-rpms and osbuild-53-1.el9_0.noarch from rhel-9-for-x86_64-appstream-rpms
  - cannot install both osbuild-93-1.el9_3.1.noarch from rhel-9-for-x86_64-appstream-rpms and osbuild-53.1-1.el9_0.noarch from rhel-9-for-x86_64-appstream-rpms
  - cannot install both osbuild-93-1.el9_3.1.noarch from rhel-9-for-x86_64-appstream-rpms and osbuild-65-1.el9.noarch from rhel-9-for-x86_64-appstream-rpms
  - cannot install both osbuild-93-1.el9_3.1.noarch from rhel-9-for-x86_64-appstream-rpms and osbuild-81-1.el9.noarch from rhel-9-for-x86_64-appstream-rpms
  - cannot install both osbuild-93-1.el9_3.1.noarch from rhel-9-for-x86_64-appstream-rpms and osbuild-81-1.el9_2.1.noarch from rhel-9-for-x86_64-appstream-rpms
  - cannot install both osbuild-93-1.el9_3.1.noarch from rhel-9-for-x86_64-appstream-rpms and osbuild-93-1.el9.noarch from rhel-9-for-x86_64-appstream-rpms
  - cannot install both osbuild-53-1.el9_0.noarch from rhel-9-appstream-rhui-rpms and osbuild-93-1.el9_3.1.noarch from rhel-9-for-x86_64-appstream-rpms
  - cannot install both osbuild-53.1-1.el9_0.noarch from rhel-9-appstream-rhui-rpms and osbuild-93-1.el9_3.1.noarch from rhel-9-for-x86_64-appstream-rpms
  - cannot install both osbuild-65-1.el9.noarch from rhel-9-appstream-rhui-rpms and osbuild-93-1.el9_3.1.noarch from rhel-9-for-x86_64-appstream-rpms
  - cannot install both osbuild-81-1.el9.noarch from rhel-9-appstream-rhui-rpms and osbuild-93-1.el9_3.1.noarch from rhel-9-for-x86_64-appstream-rpms
  - cannot install both osbuild-81-1.el9_2.1.noarch from rhel-9-appstream-rhui-rpms and osbuild-93-1.el9_3.1.noarch from rhel-9-for-x86_64-appstream-rpms
  - cannot install both osbuild-93-1.el9.noarch from rhel-9-appstream-rhui-rpms and osbuild-93-1.el9_3.1.noarch from rhel-9-for-x86_64-appstream-rpms
  - cannot install the best candidate for the job
  - nothing provides selinux-policy >= 38.1.23-1.el9_3.2 needed by osbuild-selinux-93-1.el9_3.1.noarch from rhel-9-for-x86_64-appstream-rpms
  - nothing provides selinux-policy-base >= 38.1.23-1.el9_3.2 needed by osbuild-selinux-93-1.el9_3.1.noarch from rhel-9-for-x86_64-appstream-rpms
(try to add '--allowerasing' to command line to replace conflicting packages or '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages)
+ 19:51:55.850737209 microshift/scripts/image-builder/../dnf_retry.sh:28 	rc=1
+ 19:51:55.852799889 microshift/scripts/image-builder/../dnf_retry.sh:30 	sudo dnf clean -y all
Updating Subscription Management repositories.
58 files removed
+ 19:51:57.299222175 microshift/scripts/image-builder/../dnf_retry.sh:33 	exit 1

dhellmann avatar Feb 07 '24 20:02 dhellmann

More background in https://github.com/openshift/enhancements/pull/1562

dhellmann avatar Feb 08 '24 17:02 dhellmann

/retest-required

dhellmann avatar Feb 08 '24 17:02 dhellmann

I moved the commit to delete the FDO test to #3038

dhellmann avatar Feb 19 '24 13:02 dhellmann

The CNCF tests timed out collecting results. https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/pr-logs/pull/openshift_microshift/2952/pull-ci-openshift-microshift-main-metal-periodic-test/1759975202717962240/artifacts/metal-periodic-test/openshift-microshift-e2e-metal-tests/artifacts/scenario-info/el92-src@cncf-conformance/run.log

The progress messages reported before then all say

{
  "name": "e2e",
  "node": "global",
  "timestamp": "2024-02-20T17:37:26.16711178Z",
  "msg": "Test Suite starting",
  "total": 363,
  "completed": 0
}

dhellmann avatar Feb 20 '24 19:02 dhellmann

/retest-required

dhellmann avatar Feb 20 '24 20:02 dhellmann

@pmtk , would you like to take a look if I missed anything? Please, unhold otherwise.

/lgtm /hold

ggiguash avatar Feb 22 '24 16:02 ggiguash

/hold cancel

Lost the LGTM because I had to rebase. Removing the hold to make it clear the PR is available for review.

dhellmann avatar Feb 22 '24 17:02 dhellmann

@pmtk , would you like to take a look if I missed anything? Please, unhold otherwise.

/lgtm /hold

ggiguash avatar Feb 22 '24 17:02 ggiguash

/hold cancel

@pmtk please take another look at this when you have a few minutes

dhellmann avatar Feb 27 '24 18:02 dhellmann

/test microshift-metal-tests

pmtk avatar Feb 28 '24 08:02 pmtk

/hold

Need to rebase after #3079 merges

dhellmann avatar Feb 28 '24 16:02 dhellmann 

Building edge-commit from rhel-9.2-microshift-4.14 --parent rhel-9.2 --url http://10.192.10.207:8080/repo
+ 22:48:19.125119040 ./bin/build_images.sh:340 	build_cmd='sudo composer-cli compose start-ostree --parent rhel-9.2 --url http://10.192.10.207:8080/repo --ref rhel-9.2-microshift-4.14 rhel-9.2-microshift-4.14 edge-commit'
++ 22:48:19.126649880 ./bin/build_images.sh:341 	seq 3
+ 22:48:19.128846588 ./bin/build_images.sh:341 	for _ in $(seq 3)
+ 22:48:19.130049451 ./bin/build_images.sh:342 	set +e
++ 22:48:19.131572494 ./bin/build_images.sh:343 	sudo composer-cli compose start-ostree --parent rhel-9.2 --url http://10.192.10.207:8080/repo --ref rhel-9.2-microshift-4.14 rhel-9.2-microshift-4.14 edge-commit
ERROR: DepsolveError: DNF error occurred: MarkingErrors: Error occurred when marking packages for installation: Problems in request:
missing packages: microshift-4.14.0~rc.7-202310241737.p0.g1586504.assembly.rc.7.el9*, microshift-greenboot-4.14.0~rc.7-202310241737.p0.g1586504.assembly.rc.7.el9*, microshift-networking-4.14.0~rc.7-202310241737.p0.g1586504.assembly.rc.7.el9*, microshift-selinux-4.14.0~rc.7-202310241737.p0.g1586504.assembly.rc.7.el9*

dhellmann avatar Mar 06 '24 14:03 dhellmann

/retest-required

dhellmann avatar Mar 06 '24 18:03 dhellmann

/hold cancel

dhellmann avatar Mar 06 '24 21:03 dhellmann

/lgtm

pmtk avatar Mar 07 '24 18:03 pmtk

/hold

pmtk avatar Mar 07 '24 18:03 pmtk

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dhellmann, ggiguash, pmtk

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:
  • ~~OWNERS~~ [dhellmann,ggiguash,pmtk]

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

openshift-ci[bot] avatar Mar 07 '24 18:03 openshift-ci[bot]

/hold cancel

I'll take care of the suggested cleanup in a follow-up PR.

dhellmann avatar Mar 07 '24 18:03 dhellmann

/retest-required

Remaining retests: 0 against base HEAD 0bdc4cc88f04d1c4dd47ce15d35f3f221f74dea2 and 2 for PR HEAD 9d43c9d697831468ed6d41b7dfc0b8237ee3b14f in total

openshift-ci-robot avatar Mar 07 '24 21:03 openshift-ci-robot

@dhellmann: all tests passed!

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

openshift-ci[bot] avatar Mar 07 '24 21:03 openshift-ci[bot]