kops icon indicating copy to clipboard operation
kops copied to clipboard

test: Use ephemeral discovery store for AWS

Open xmudrii opened this issue 5 months ago • 18 comments

This PR is a follow up on https://github.com/kubernetes/k8s.io/issues/5127 to use an ephemeral discovery store/S3 bucket instead of a static one (s3://k8s-kops-ci-prow).

Related to https://github.com/kubernetes/k8s.io/issues/5127

cc @ameukam

xmudrii avatar Jul 28 '25 11:07 xmudrii

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: Once this PR has been reviewed and has the lgtm label, please assign olemarkus for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

k8s-ci-robot avatar Jul 28 '25 11:07 k8s-ci-robot

cc @hakman @rifelpet They know more about me for the discovery store.

ameukam avatar Jul 28 '25 11:07 ameukam

/test pull-kops-e2e-k8s-aws-cilium-1-33

ameukam avatar Jul 28 '25 11:07 ameukam

/test pull-kops-aws-distro-al2023

ameukam avatar Jul 28 '25 11:07 ameukam

@xmudrii @ameukam tests are temporarily broken, so you may have to wait a few days with this.

hakman avatar Jul 28 '25 12:07 hakman

@xmudrii @ameukam tests are temporarily broken, so you may have to wait a few days with this.

@hakman The current state of CI don't prevent us to validate some aspects of the PR: :-P

I0728 12:16:03.905852   16831 s3.go:127] Bucket k8s-infra-kops-state-4d6a-20250728120558 created successfully
I0728 12:16:04.427119   16831 s3.go:127] Bucket k8s-infra-kops-discovery-4d6a-20250728121603 created successfully
Deleted cluster: "presubmit.test-cncf-aws.k8s.io"
I0728 12:19:33.040823   16831 s3.go:173] Bucket k8s-infra-kops-state-4d6a-20250728120558 deleted
I0728 12:19:33.294451   16831 s3.go:173] Bucket k8s-infra-kops-discovery-4d6a-20250728121603 deleted

ameukam avatar Jul 28 '25 12:07 ameukam

@hakman @rifelpet Please let us know once the tests are fixed. As @ameukam pointed out, this already looks promising, I'll do some more tests once they are working

xmudrii avatar Jul 28 '25 13:07 xmudrii

@xmudrii Mind rebase your PR to include https://github.com/kubernetes/kops/pull/17523 ?

ameukam avatar Jul 29 '25 12:07 ameukam

/test all

hakman avatar Jul 29 '25 12:07 hakman

/test pull-kops-aws-distro-al2023

xmudrii avatar Aug 01 '25 14:08 xmudrii

/test presubmit-kops-aws-boskos

xmudrii avatar Aug 05 '25 16:08 xmudrii

/test pull-kops-aws-distro-al2023

xmudrii avatar Aug 05 '25 18:08 xmudrii

/retest

ameukam avatar Oct 06 '25 17:10 ameukam

/retest

ameukam avatar Oct 07 '25 10:10 ameukam

/retest

ameukam avatar Oct 15 '25 19:10 ameukam

@xmudrii: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
presubmit-kops-aws-boskos 76657d3a7c8eae8ed303747eb98c326146d68eb2 link true /test presubmit-kops-aws-boskos
pull-kops-e2e-k8s-aws-amazonvpc 826b8a1e50a809332d5b2ea1a17b42657d5a29c6 link true /test pull-kops-e2e-k8s-aws-amazonvpc
pull-kops-e2e-k8s-aws-calico 826b8a1e50a809332d5b2ea1a17b42657d5a29c6 link true /test pull-kops-e2e-k8s-aws-calico

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

k8s-ci-robot avatar Oct 15 '25 19:10 k8s-ci-robot

From https://docs.aws.amazon.com/AmazonS3/latest/userguide/access-control-block-public-access.html

By default, new buckets, access points, and objects don't allow public access.

We should define the block policy with PutPublicAccessBlock

@hakman @xmudrii WDYT ?

ameukam avatar Oct 16 '25 09:10 ameukam

From https://docs.aws.amazon.com/AmazonS3/latest/userguide/access-control-block-public-access.html

By default, new buckets, access points, and objects don't allow public access.

We should define the block policy with PutPublicAccessBlock

@hakman @xmudrii WDYT ?

I think we should have a working, stable environment and take it from there. I still don't understand why we need this.

hakman avatar Oct 16 '25 09:10 hakman

Merged via https://github.com/kubernetes/kops/pull/17809. Thank you @ameukam & @xmudrii ! /close

hakman avatar Dec 18 '25 12:12 hakman

@hakman: Closed this PR.

In response to this:

Merged via https://github.com/kubernetes/kops/pull/17809. Thank you @ameukam & @xmudrii ! /close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

k8s-ci-robot avatar Dec 18 '25 12:12 k8s-ci-robot

PR needs rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

k8s-ci-robot avatar Dec 18 '25 12:12 k8s-ci-robot