test-infra icon indicating copy to clipboard operation
test-infra copied to clipboard

Refactor and rewrite Python scripts in releng/ in Go

Open xmudrii opened this issue 2 years ago • 25 comments

What should be cleaned up or changed:

We have a bunch of Python scripts in releng/ directory. These scripts are used to handle creating release branch jobs. These scripts also:

  • fetch values such as latest Kubernetes and Go version
  • handle updating auto-generated files
  • handle removing jobs for EOL release branches
  • wrap config-rotator and config-forker written in Go

These Python scripts have several problems:

  • We need to run them in a Docker container to ensure correct Python version and environment. There are some issues and challenges doing that on Mac M1 and M2
  • Kubernetes is a Go project and many of us are more experienced in Go. Having these scripts in Go would make it easier to run and test those scripts, but also refactor and debug when needed

That said, I think we should consider rewriting these scripts in Go. Additionally, we should consider wrapping everything (config-rotator, config-forker, and existing Python scripts) in a single binary.

Provide any links for context:

See #29387 for more details

/priority important-longterm /sig release cc @kubernetes/release-engineering

xmudrii avatar Apr 28 '23 17:04 xmudrii

I think this is a good idea.

jeremyrickard avatar May 02 '23 14:05 jeremyrickard

+1

cpanato avatar May 02 '23 14:05 cpanato

hey, can I work on this? and can you provide the main references to what exactly is needed to get this issue resolved as I am not much experienced in go but willing to learn more about this and contribute to solving this issue.

wasup-yash avatar May 15 '23 19:05 wasup-yash

hey, can I work on this? and can you provide the main references to what exactly is needed to get this issue resolved as I am not much experienced in go but willing to learn more about this and contribute to solving this issue.

@xmudrii any updates on this how can i get started with this ?

wasup-yash avatar Jun 06 '23 13:06 wasup-yash

@wasup-yash Sorry for delay. I'm on PTO for the next week or two, but I can follow up on this once I'm back.

xmudrii avatar Jun 06 '23 15:06 xmudrii

@wasup-yash Sorry for delay. I'm on PTO for the next week or two, but I can follow up on this once I'm back.

no worries xD

wasup-yash avatar Jun 06 '23 16:06 wasup-yash

/assign

sbdtu5498 avatar Jun 16 '23 12:06 sbdtu5498

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Mark this issue as fresh with /remove-lifecycle stale
  • Close this issue with /close
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

k8s-triage-robot avatar Jan 22 '24 18:01 k8s-triage-robot

/remove-lifecycle stale

xmudrii avatar Jan 22 '24 18:01 xmudrii

/milestone v1.31

dims avatar Apr 02 '24 12:04 dims

@dims: The provided milestone is not valid for this repository. Milestones in this repository: [someday, v1.24, v1.25]

Use /milestone clear to clear the milestone.

In response to this:

/milestone v1.31

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

k8s-ci-robot avatar Apr 02 '24 12:04 k8s-ci-robot

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Mark this issue as fresh with /remove-lifecycle stale
  • Close this issue with /close
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

k8s-triage-robot avatar Jul 01 '24 12:07 k8s-triage-robot

/remove-lifecycle stale /assign

cpanato avatar Jul 01 '24 12:07 cpanato

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Mark this issue as fresh with /remove-lifecycle stale
  • Close this issue with /close
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

k8s-triage-robot avatar Sep 29 '24 13:09 k8s-triage-robot

/remove-lifecycle stale

Update: some of the Python scripts might be removed as we consider replacing them with already existing fork-per-release mechanism.

xmudrii avatar Sep 30 '24 08:09 xmudrii

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Mark this issue as fresh with /remove-lifecycle stale
  • Close this issue with /close
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

k8s-triage-robot avatar Dec 29 '24 08:12 k8s-triage-robot

/remove-lifecycle stale

cpanato avatar Dec 29 '24 09:12 cpanato

@Rajalakshmi-Girish is working on getting rid of some of these Python scripts by utilizing forker and rotator. /unassign @xmudrii @sbdtu5498 /assign @Rajalakshmi-Girish

xmudrii avatar Dec 30 '24 13:12 xmudrii

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Mark this issue as fresh with /remove-lifecycle stale
  • Close this issue with /close
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

k8s-triage-robot avatar Mar 30 '25 13:03 k8s-triage-robot

/remove-lifecycle stale

xmudrii avatar Apr 08 '25 08:04 xmudrii

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Mark this issue as fresh with /remove-lifecycle stale
  • Close this issue with /close
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

k8s-triage-robot avatar Jul 07 '25 09:07 k8s-triage-robot

/remove-lifecycle stale

xmudrii avatar Jul 17 '25 11:07 xmudrii

/assign

mbianchidev avatar Aug 24 '25 01:08 mbianchidev

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Mark this issue as fresh with /remove-lifecycle stale
  • Close this issue with /close
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

k8s-triage-robot avatar Nov 22 '25 02:11 k8s-triage-robot

/remove-lifecycle stale

xmudrii avatar Nov 23 '25 22:11 xmudrii