spark-operator icon indicating copy to clipboard operation
spark-operator copied to clipboard

Change deprecated v1beta1 CRD to v1

Open bitodt opened this issue 4 years ago • 9 comments

As per helm3's warning: apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition

bitodt avatar May 13 '21 10:05 bitodt

Thanks for your pull request. It looks like this may be your first contribution to a Google open source project (if not, look below for help). Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

:memo: Please visit https://cla.developers.google.com/ to sign.

Once you've signed (or fixed any issues), please reply here with @googlebot I signed it! and we'll verify it.


What to do if you already signed the CLA

Individual signers
Corporate signers

ℹ️ Googlers: Go here for more info.

google-cla[bot] avatar May 13 '21 10:05 google-cla[bot]

@googlebot I signed it!

bitodt avatar May 13 '21 10:05 bitodt

@orfeas0 could you please bump up the chart version in this PR? Thanks!

liyinan926 avatar May 19 '21 03:05 liyinan926

@orfeas0 could you please bump up the chart version in this PR? Thanks!

Bumped version, but not appVersion. Is this ok?

bitodt avatar May 19 '21 07:05 bitodt

Can you resolve the conflict?

liyinan926 avatar May 25 '21 15:05 liyinan926

Looks like the chart integration test failed with the following message:

Error: failed to install CRD crds/sparkoperator.k8s.io_scheduledsparkapplications.yaml: CustomResourceDefinition.apiextensions.k8s.io "scheduledsparkapplications.sparkoperator.k8s.io" is invalid: [spec.versions[0].schema.openAPIV3Schema: Required value: schemas are required, metadata.annotations[api-approved.kubernetes.io]: Required value: protected groups must have approval annotation "api-approved.kubernetes.io", see https://github.com/kubernetes/enhancements/pull/1111]

liyinan926 avatar May 25 '21 15:05 liyinan926

I don't get the test fail, is it because I'm missing permissions? What's the process?

bitodt avatar Jun 02 '21 14:06 bitodt

I don't get the test fail, is it because I'm missing permissions? What's the process?

@orfeas0 @liyinan926

Seems you need to have a PR in kubernetes GitHub then once you have approval you add this annotation:

metadata:
  annotations:
    "api-approved.kubernetes.io": "https://github.com/kubernetes/kubernetes/pull/PRNUMBER"

I think this is only due to the fact the sparkoperator team used a protected internal URL spec for the CRD spec with:

sparkoperator.k8s.io

If it was just:

sparkoperator.spark.io

then you'd need no such annotation.

So I suppose best idea is to submit a PR or an issue on kubernetes repo and ask them how to proceed. I'll be rooting for you because I need this, but I am not part of the project so not my place to make such a request externally.

sharkymcdongles avatar Jun 08 '21 06:06 sharkymcdongles

I think this is superceded by https://github.com/kubeflow/spark-operator/pull/1298 and can be closed now

zevisert avatar Mar 20 '24 19:03 zevisert