community icon indicating copy to clipboard operation
community copied to clipboard

[Kubeflow 1.10] Create Dependencies version list

Open rimolive opened this issue 1 year ago • 1 comments

This issue will be used for tracking, discussing and sharing the dependencies versions.

Please note these versions are subject to agreement of all WG and the release team, and may suffer changes in the following days.

Component Version used in 1.9 Version used in 1.10
KServe 1.33.1
Knative-serving 1.12.4 1.15
Knative-eventing 1.12.6 1.15
Istio 1.22.1 1.23/1.24
Kubernetes 1.29 1.32/1.33
Cert-Manager 1.14.5 1.16
Kustomize 5.2.1 5.4
Dex 2.39.1 2.41
Argo 3.3.10 3.4.16
Tekton 0.53.2 0.53.6
oauth2-proxy 7.6.0 7.7

rimolive avatar Oct 16 '24 18:10 rimolive

Cert-manager should be 1.16. please keep in mind that all the numbers I provided above for the table are approximations and a rough guidance for the implementation at manifests WG and for other working groups.

juliusvonkohout avatar Oct 18 '24 07:10 juliusvonkohout

/assign @juliusvonkohout

rimolive avatar Nov 04 '24 15:11 rimolive

/assign @juliusvonkohout @tarekabouzeid

rimolive avatar Nov 04 '24 16:11 rimolive

@rimolive @juliusvonkohout should we update Kubernetes version to 1.32 and istio to 1.23.2 ?

tarekabouzeid avatar Nov 04 '24 17:11 tarekabouzeid

@rimolive @juliusvonkohout should we update Kubernetes version to 1.32 and istio to 1.23.2 ?

If istio 1.24 and kubernetes 1.33 is available we will at least try to upgrade our cicd. That does not mean that it does not work with older versions.

juliusvonkohout avatar Nov 05 '24 08:11 juliusvonkohout

Dex and oauth2-proxy are updated in https://github.com/kubeflow/manifests/pull/2916

juliusvonkohout avatar Nov 18 '24 18:11 juliusvonkohout

Knative is coming as well and afterwards cert-manager https://github.com/kubeflow/manifests/pull/2917

juliusvonkohout avatar Nov 19 '24 09:11 juliusvonkohout

knative-serving and knative-eventing can be combined and are now working on 1.16. Tekton should be removed

juliusvonkohout avatar Nov 19 '24 16:11 juliusvonkohout

cert-manager 1.16.1 comes here https://github.com/kubeflow/manifests/pull/2919

juliusvonkohout avatar Nov 19 '24 16:11 juliusvonkohout

@richarddli as per @juliusvonkohout comment we need to update this issue to reflect the following versions:

  • knative-serving 1.16
  • knative-eventing 1.16
  • tekton @juliusvonkohout is recommending to remove it.
  • Dex 2.41.1
  • oauth2-proxy 7.7.1
  • cert-manager 1.16.1

varodrig avatar Nov 25 '24 03:11 varodrig

waiting on kubernetes manifests to test support versions 1.32/1.33. from @andreyvelich suggested that we should support 3 versions.https://www.kubeflow.org/docs/releases/kubeflow-1.9/ previous release. to follow up on this . CC @juliusvonkohout . Discussed on the Release meeting and community meeting.

We need involvement from all working groups to move this forward. We need confirmation from each working group we need for this release about what version of Kubernetes you are testing and which ones can you support for this release 1.10:

AutoML WG - @saileshd1402

  1. the versions of Kubernetes that you are testing
  2. will you be able to include more Kubernetes versions on this release including Kubernetes versions 1.29 to 1.33? Consider that you need to test your module to ensure everything will work as expected. Thanks.

Training WG - @saileshd1402

  1. the versions of Kubernetes that you are testing
  2. will you be able to include more Kubernetes versions on this release including Kubernetes versions 1.29 to 1.33? Consider that you need to test your module to ensure everything will work as expected. Thanks.

Notebooks WG - @mvlassis

  1. the versions of Kubernetes that you are testing
  2. will you be able to include more Kubernetes versions on this release including Kubernetes versions 1.29 to 1.33? Consider that you need to test your module to ensure everything will work as expected. Thanks.

Data WG - @milosjava

  1. the versions of Kubernetes that you are testing
  2. will you be able to include more Kubernetes versions on this release including Kubernetes versions 1.29 to 1.33? Consider that you need to test your module to ensure everything will work as expected. Thanks.

Pipelines WG - @hbelmiro

  1. the versions of Kubernetes that you are testing
  2. will you be able to include more Kubernetes versions on this release including Kubernetes versions 1.29 to 1.33? Consider that you need to test your module to ensure everything will work as expected. Thanks.

Platform WG - @tarekabouzeid

  1. the versions of Kubernetes that you are testing
  2. will you be able to include more Kubernetes versions on this release including Kubernetes versions 1.29 to 1.33? Consider that you need to test your module to ensure everything will work as expected. Thanks.

KServe WG - @vrajjbhatt

  1. the versions of Kubernetes that you are testing
  2. will you be able to include more Kubernetes versions on this release including Kubernetes versions 1.29 to 1.33? Consider that you need to test your module to ensure everything will work as expected. Thanks.

CC @andreyvelich, @juliusvonkohout

varodrig avatar Dec 02 '24 17:12 varodrig

Training WG:

  • Tracking issue: https://github.com/kubeflow/training-operator/issues/2291
  • We will run our E2Es on Kubernetes: v1.28-v1.31

AutoML WG:

  • Tracking issue: https://github.com/kubeflow/katib/issues/2457
  • We will run our E2Es on Kubernetes: v1.28-v1.31

cc @kubeflow/wg-training-leads @astefanutti @Electronic-Waste

andreyvelich avatar Dec 03 '24 17:12 andreyvelich

from @hbelmiro We currently test Pipelines with 1.29

varodrig avatar Dec 09 '24 16:12 varodrig

For the Charmed Kubeflow distribution (developed by Canonical), our team will be able to support Kubernetes version v1.32 for testing Kubeflow 1.10.

mvlassis avatar Dec 09 '24 17:12 mvlassis

Notebook test supports the latest from kind (K8s 1.31) but wg is looking into making a matrix of 1.29 and fwd, not expecting issue for K8s 1.32 as well from @mvlassis

varodrig avatar Dec 09 '24 17:12 varodrig

AutoML Looking into e2e testing for the K8s 1.29, 1.30, now will be working on the 1.31 tests

varodrig avatar Dec 09 '24 17:12 varodrig

from the Release meeting:

  • tekton although no longer used
  • Argo will be updated by KFP version update
  • of interest to the Platform WG is K8s 1.32, Istio 1.24 (which are the remainig ones)

tarilabs avatar Dec 09 '24 17:12 tarilabs

@rimolive @varodrig @tarilabs I created a PR to run Pipelines e2e tests with Kubernetes from 1.29 to 1.31.

  • https://github.com/kubeflow/pipelines/pull/11450

hbelmiro avatar Dec 09 '24 20:12 hbelmiro

summary Image

varodrig avatar Dec 16 '24 16:12 varodrig

I just upgraded Kubernetes to 1.32, so only istio 1.24 is missing plus any Bugfix releases.

juliusvonkohout avatar Dec 18 '24 14:12 juliusvonkohout

to follow up today

components versions tested versions to be tested
Pipelines 1.29 to 1.31  
AutoML 1.29, 1.30 1.31
notebooks 1.31 1.32
training v1.28-v1.31  
Training v1.28-v1.31  
platform/manifests 1.32  
Data (registry)    

varodrig avatar Jan 06 '25 16:01 varodrig

We are testing 1.30 in Katib now, related PR: https://github.com/kubeflow/katib/pull/2463. I think it has not been fully tested yet:)

Also cc👀 @kubeflow/wg-automl-leads @tariq-hasan @helenxie-bit @doris-xm

Electronic-Waste avatar Jan 07 '25 01:01 Electronic-Waste

The team at Canonical wants to prepare for the manifests update, and I wanted to ask what the final list of supported versions for Kubernetes will be for the 1.10 release. I remember that we had discussed about multiple versions, but I think the supported versions is not clearly displayed on the thread here, so disambiguating could be useful.

mvlassis avatar Jan 14 '25 09:01 mvlassis

The team at Canonical wants to prepare for the manifests update, and I wanted to ask what the final list of supported versions for Kubernetes will be for the 1.10 release. I remember that we had discussed about multiple versions, but I think the supported versions is not clearly displayed on the thread here, so disambiguating could be useful.

I aim for 1.29-1.32

juliusvonkohout avatar Jan 15 '25 12:01 juliusvonkohout

The team at Canonical wants to prepare for the manifests update, and I wanted to ask what the final list of supported versions for Kubernetes will be for the 1.10 release. I remember that we had discussed about multiple versions, but I think the supported versions is not clearly displayed on the thread here, so disambiguating could be useful.

I aim for 1.29-1.32

@mvlassis let us know if you need anything else. but it should till 1.31. @juliusvonkohout let us know if you have any concerns. that's the version most of the components were tested. 1:29 to 1:31 cc @mvlassis

varodrig avatar Jan 15 '25 14:01 varodrig

I think we can move this to Done. @juliusvonkohout

cc @rimolive

varodrig avatar Mar 26 '25 20:03 varodrig

1.31-1.32 is our official support target, but it should work on 1.29+ as well.

juliusvonkohout avatar Mar 27 '25 11:03 juliusvonkohout