pulumi-kubernetes icon indicating copy to clipboard operation
pulumi-kubernetes copied to clipboard

Unable to create or patch a longhorn `Node` CustomResource.

Open julienvincent opened this issue 6 months ago • 5 comments

What happened?

I am unable to use a CustomResourcePatch or CustomResource of type:

apiVersion: lonhorn.io/v1beta2
kind: Node

The pulumi engine fails during preview with the following error:

  kubernetes:longhorn.io/v1beta2:NodePatch (longhorn-node-atlas):
    error: Preview failed: resource longhorn-d35080e1/atlas was not successfully created by the Kubernetes API server : the server could not find the requested resource

But the output of kubectl get nodes.longhorn.io atlas returns correctly:

NAME    READY   ALLOWSCHEDULING   SCHEDULABLE   AGE
atlas   True    true              True          19h

So the resource does exist.


Interestingly the error and behaviour is exactly the same regardless of whether I use CustomResourcePatch or CustomResource. In both cases, during preview, it will retry several times to preview the create operation and will fail with the above error.

I can't see anything unique about this resource. I removed all Validating and Mutating webhook configurations that referenced this resource to no effect.

This does not happen for any of the other CustomResources I have tried.

Example

Install the longhorn components on a cluster. You can follow any of the installation steps on their installation docs page.

I have provided a Pulumi helm example below.

Helm Example
new kubernetes.helm.v3.Chart(
  'longhorn',
  {
    namespace,
    fetchOpts: {
      repo: 'https://charts.longhorn.io'
    },
    chart: 'longhorn',
    version: '1.5.3',

    transformations: [
      (resource) => {
        const exclude_jobs = ['longhorn-uninstall'];
        if (resource.kind === 'Job' && exclude_jobs.includes(resource.metadata.name)) {
          resource.apiVersion = 'v1';
          resource.kind = 'List';
        }
      }
    ],

    values: {
      helmPreUpgradeCheckerJob: {
        enabled: false
      }
    }
  },
  {
    provider: params.provider
  }
);

Then try create or patch a CR of kind Node

The below CustomResourcePatch triggers this error. Changing it to a CustomResource has the exact same effect.

return new kubernetes.apiextensions.CustomResourcePatch(
  `longhorn-node-atlas`,
  {
    apiVersion: 'longhorn.io/v1beta2',
    kind: 'Node',

    metadata: {
      name: 'atlas',
      namespace: 'longhorn-d35080e1',
      annotations: {
        'pulumi.com/patchForce': 'true'
      }
    },

    spec: {
      allowScheduling: true,
      evictionRequested: false,
      instanceManagerCPURequest: 0,
      disks: {}
    }
  },
  {
    provider: params.provider
  }
);

Output of pulumi about

pulumi about
CLI          
Version      3.94.2
Go Version   go1.21.4
Go Compiler  gc

Plugins
NAME    VERSION
nodejs  unknown

Host     
OS       darwin
Version  14.1.1
Arch     arm64

This project is written in nodejs: executable='/Users/julienvincent/.local/share/rtx/installs/node/20.7.0/bin/node' version='v20.7.0'

Current Stack: julienvincent/daedalus-kubernetes/root

TYPE                                                                       URN
pulumi:pulumi:Stack                                                        urn:pulumi:root::daedalus-kubernetes::pulumi:pulumi:Stack::daedalus-kubernetes-root
pulumi:providers:pulumi                                                    urn:pulumi:root::daedalus-kubernetes::pulumi:providers:pulumi::default
pulumi:providers:gcp                                                       urn:pulumi:root::daedalus-kubernetes::pulumi:providers:gcp::root
pulumi:providers:aws                                                       urn:pulumi:root::daedalus-kubernetes::pulumi:providers:aws::root
pulumi:providers:random                                                    urn:pulumi:root::daedalus-kubernetes::pulumi:providers:random::default_4_15_0
gcp:serviceaccount/account:Account                                         urn:pulumi:root::daedalus-kubernetes::gcp:serviceaccount/account:Account::velero-account
gcp:storage/bucket:Bucket                                                  urn:pulumi:root::daedalus-kubernetes::gcp:storage/bucket:Bucket::velero-bucket
aws:iam/user:User                                                          urn:pulumi:root::daedalus-kubernetes::aws:iam/user:User::cert-manager-dns01
aws:iam/user:User                                                          urn:pulumi:root::daedalus-kubernetes::aws:iam/user:User::external-dns-aws-user
aws:iam/user:User                                                          urn:pulumi:root::daedalus-kubernetes::aws:iam/user:User::alerts-smtp-user
aws:iam/policy:Policy                                                      urn:pulumi:root::daedalus-kubernetes::aws:iam/policy:Policy::alerts-smtp-policy
random:index/randomPassword:RandomPassword                                 urn:pulumi:root::daedalus-kubernetes::random:index/randomPassword:RandomPassword::influxdb-admin-password
random:index/randomId:RandomId                                             urn:pulumi:root::daedalus-kubernetes::random:index/randomId:RandomId::admin-key
random:index/randomPassword:RandomPassword                                 urn:pulumi:root::daedalus-kubernetes::random:index/randomPassword:RandomPassword::admin-secret
random:index/randomPassword:RandomPassword                                 urn:pulumi:root::daedalus-kubernetes::random:index/randomPassword:RandomPassword::influxdb-admin-token
gcp:serviceaccount/key:Key                                                 urn:pulumi:root::daedalus-kubernetes::gcp:serviceaccount/key:Key::velero-key
gcp:projects/iAMMember:IAMMember                                           urn:pulumi:root::daedalus-kubernetes::gcp:projects/iAMMember:IAMMember::velero-storage-member
aws:iam/accessKey:AccessKey                                                urn:pulumi:root::daedalus-kubernetes::aws:iam/accessKey:AccessKey::cert-manager-dns01
aws:iam/userPolicy:UserPolicy                                              urn:pulumi:root::daedalus-kubernetes::aws:iam/userPolicy:UserPolicy::dns01-manager
aws:iam/accessKey:AccessKey                                                urn:pulumi:root::daedalus-kubernetes::aws:iam/accessKey:AccessKey::external-dns-aws-access-key
aws:iam/userPolicy:UserPolicy                                              urn:pulumi:root::daedalus-kubernetes::aws:iam/userPolicy:UserPolicy::external-dns-aws-policy
aws:iam/accessKey:AccessKey                                                urn:pulumi:root::daedalus-kubernetes::aws:iam/accessKey:AccessKey::alerts-smtp-access-key
aws:iam/userPolicyAttachment:UserPolicyAttachment                          urn:pulumi:root::daedalus-kubernetes::aws:iam/userPolicyAttachment:UserPolicyAttachment::alerts-smtp-policy-attachment
pulumi:pulumi:StackReference                                               urn:pulumi:root::daedalus-kubernetes::pulumi:pulumi:StackReference::cluster
pulumi:providers:kubernetes                                                urn:pulumi:root::daedalus-kubernetes::pulumi:providers:kubernetes::root-provider
kubernetes:kustomize:Directory                                             urn:pulumi:root::daedalus-kubernetes::kubernetes:kustomize:Directory::csi-snapshot-controller-crds
kubernetes:helm.sh/v3:Chart                                                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart::external-dns
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:ServiceAccount::local-storage-provisioner
kubernetes:core/v1:Namespace                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:Namespace::velero
kubernetes:core/v1:ConfigMap                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:ConfigMap::local-storage-provisioner
kubernetes:core/v1:Namespace                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:Namespace::iot
kubernetes:yaml:ConfigFile                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:yaml:ConfigFile::external-dns-crd
kubernetes:core/v1:Namespace                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:Namespace::minio
kubernetes:core/v1:Namespace                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:Namespace::admin-components
kubernetes:helm.sh/v3:Chart                                                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart::external-ingress
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:Service::mongo
kubernetes:kustomize:Directory                                             urn:pulumi:root::daedalus-kubernetes::kubernetes:kustomize:Directory::csi-snapshot-controller
kubernetes:core/v1:Namespace                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:Namespace::longhorn
kubernetes:helm.sh/v3:Chart                                                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart::longhorn
kubernetes:helm.sh/v3:Chart                                                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart::internal-ingress
kubernetes:storage.k8s.io/v1:StorageClass                                  urn:pulumi:root::daedalus-kubernetes::kubernetes:storage.k8s.io/v1:StorageClass::local-path
kubernetes:helm.sh/v3:Chart                                                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart::cert-manager
kubernetes:helm.sh/v3:Chart                                                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart::velero
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::prometheus-role
kubernetes:helm.sh/v3:Chart                                                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart::influxdb
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:Service::redpanda-public
kubernetes:helm.sh/v3:Chart                                                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart::minio
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::prometheus-operator-role
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:Service::redpanda-console
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:Service::redpanda
kubernetes:snapshot.storage.k8s.io/v1:VolumeSnapshotClass                  urn:pulumi:root::daedalus-kubernetes::kubernetes:snapshot.storage.k8s.io/v1:VolumeSnapshotClass::longhorn
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:Service::registry
kubernetes:yaml:ConfigGroup                                                urn:pulumi:root::daedalus-kubernetes::kubernetes:yaml:ConfigGroup::prometheus-operator-crds
kubernetes:helm.sh/v3:Chart                                                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart::grafana
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::local-storage-provisioner
kubernetes:core/v1:Namespace                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:Namespace::guest-ns-kobie
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:apps/v1:Deployment::local-storage-provisioner
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:yaml:ConfigFile$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::dnsendpoints.externaldns.k8s.io
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:ServiceAccount::prometheus-operator-sa
kubernetes:monitoring.coreos.com/v1:PrometheusRule                         urn:pulumi:root::daedalus-kubernetes::kubernetes:monitoring.coreos.com/v1:PrometheusRule::targets-alert
kubernetes:networking.k8s.io/v1:Ingress                                    urn:pulumi:root::daedalus-kubernetes::kubernetes:networking.k8s.io/v1:Ingress::influxdb
kubernetes:core/v1:Secret                                                  urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:Secret::alert-manager-config
kubernetes:core/v1:Secret                                                  urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:Secret::external-dns-credentials
kubernetes:core/v1:Secret                                                  urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:Secret::cert-manager-dns01-credentials
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:ServiceAccount::prometheus-sa
kubernetes:monitoring.coreos.com/v1:PrometheusRule                         urn:pulumi:root::daedalus-kubernetes::kubernetes:monitoring.coreos.com/v1:PrometheusRule::watchdog
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:Service::prometheus-operator
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::velero/velero
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ServiceAccount::velero/velero-server
kubernetes:velero.io/v1:VolumeSnapshotLocation                             urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:velero.io/v1:VolumeSnapshotLocation::velero/default
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::serverstatusrequests.velero.io
kubernetes:monitoring.coreos.com/v1:PrometheusRule                         urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:monitoring.coreos.com/v1:PrometheusRule::velero/velero
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apps/v1:Deployment::velero/velero
kubernetes:velero.io/v1:BackupStorageLocation                              urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:velero.io/v1:BackupStorageLocation::velero/default
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::downloadrequests.velero.io
kubernetes:core/v1:Secret                                                  urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Secret::velero/velero
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::deletebackuprequests.velero.io
kubernetes:velero.io/v1:Schedule                                           urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:velero.io/v1:Schedule::velero/velero-full-cluster-backup
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::podvolumebackups.velero.io
kubernetes:rbac.authorization.k8s.io/v1:Role                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:Role::velero/velero-server
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::volumesnapshotlocations.velero.io
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::velero-server
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::datauploads.velero.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::backuprepositories.velero.io
kubernetes:rbac.authorization.k8s.io/v1:RoleBinding                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:RoleBinding::velero/velero-server
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::backupstoragelocations.velero.io
kubernetes:apps/v1:DaemonSet                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apps/v1:DaemonSet::velero/node-agent
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::datadownloads.velero.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::restores.velero.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::podvolumerestores.velero.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::schedules.velero.io
kubernetes:core/v1:PersistentVolumeClaim                                   urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:PersistentVolumeClaim::influxdb-data
kubernetes:core/v1:PersistentVolumeClaim                                   urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:PersistentVolumeClaim::registry-data
kubernetes:core/v1:PersistentVolumeClaim                                   urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:PersistentVolumeClaim::mongo-data
kubernetes:core/v1:PersistentVolumeClaim                                   urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:PersistentVolumeClaim::redpanda-data
kubernetes:rbac.authorization.k8s.io/v1:RoleBinding                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:RoleBinding::kube-system/cert-manager:leaderelection
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::cert-manager-webhook:subjectaccessreviews
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::cert-manager-controller-clusterissuers
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::backups.velero.io
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::cert-manager-controller-issuers
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::cert-manager-controller-orders
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::cert-manager-controller-certificatesigningrequests
kubernetes:core/v1:ConfigMap                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ConfigMap::admin-components/cert-manager-webhook
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::cert-manager-cainjector
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::cert-manager-controller-clusterissuers
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::cert-manager-controller-approve:cert-manager-io
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::cert-manager-controller-ingress-shim
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::cert-manager-controller-approve:cert-manager-io
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::cert-manager-controller-challenges
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::cert-manager-controller-certificates
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ServiceAccount::admin-components/cert-manager
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::cert-manager-cainjector
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::cert-manager-controller-challenges
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::cert-manager-view
kubernetes:rbac.authorization.k8s.io/v1:Role                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:Role::admin-components/cert-manager-startupapicheck:create-cert
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::cert-manager-controller-certificatesigningrequests
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::cert-manager-webhook:subjectaccessreviews
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::cert-manager-edit
kubernetes:admissionregistration.k8s.io/v1:ValidatingWebhookConfiguration  urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:admissionregistration.k8s.io/v1:ValidatingWebhookConfiguration::cert-manager-webhook
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::admin-components/cert-manager
kubernetes:rbac.authorization.k8s.io/v1:RoleBinding                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:RoleBinding::kube-system/cert-manager-cainjector:leaderelection
kubernetes:rbac.authorization.k8s.io/v1:RoleBinding                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:RoleBinding::admin-components/cert-manager-webhook:dynamic-serving
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ServiceAccount::admin-components/cert-manager-cainjector
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::cert-manager-controller-issuers
kubernetes:batch/v1:Job                                                    urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:batch/v1:Job::admin-components/cert-manager-startupapicheck
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ServiceAccount::admin-components/cert-manager-webhook
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apps/v1:Deployment::admin-components/cert-manager-cainjector
kubernetes:admissionregistration.k8s.io/v1:MutatingWebhookConfiguration    urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:admissionregistration.k8s.io/v1:MutatingWebhookConfiguration::cert-manager-webhook
kubernetes:rbac.authorization.k8s.io/v1:RoleBinding                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:RoleBinding::admin-components/cert-manager-startupapicheck:create-cert
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::admin-components/cert-manager-webhook
kubernetes:rbac.authorization.k8s.io/v1:Role                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:Role::kube-system/cert-manager-cainjector:leaderelection
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::cert-manager-controller-certificates
kubernetes:rbac.authorization.k8s.io/v1:Role                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:Role::kube-system/cert-manager:leaderelection
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::orders.acme.cert-manager.io
kubernetes:rbac.authorization.k8s.io/v1:Role                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:Role::admin-components/cert-manager-webhook:dynamic-serving
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::certificaterequests.cert-manager.io
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apps/v1:Deployment::admin-components/cert-manager-webhook
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::cert-manager-controller-ingress-shim
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::cert-manager-controller-orders
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ServiceAccount::admin-components/cert-manager-startupapicheck
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apps/v1:Deployment::admin-components/cert-manager
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::internal-ingress-ingress-nginx
kubernetes:core/v1:ConfigMap                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ConfigMap::admin-components/internal-ingress-ingress-nginx-controller
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ServiceAccount::admin-components/internal-ingress-ingress-nginx
kubernetes:networking.k8s.io/v1:IngressClass                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:networking.k8s.io/v1:IngressClass::nginx-internal
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ServiceAccount::admin-components/external-ingress-ingress-nginx
kubernetes:core/v1:ConfigMap                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ConfigMap::admin-components/external-ingress-ingress-nginx-controller
kubernetes:rbac.authorization.k8s.io/v1:RoleBinding                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:RoleBinding::admin-components/external-ingress-ingress-nginx
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::certificates.cert-manager.io
kubernetes:networking.k8s.io/v1:IngressClass                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:networking.k8s.io/v1:IngressClass::nginx-external
kubernetes:rbac.authorization.k8s.io/v1:Role                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:Role::admin-components/internal-ingress-ingress-nginx
kubernetes:rbac.authorization.k8s.io/v1:RoleBinding                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:RoleBinding::admin-components/internal-ingress-ingress-nginx
kubernetes:rbac.authorization.k8s.io/v1:Role                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:Role::admin-components/external-ingress-ingress-nginx
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::admin-components/external-ingress-ingress-nginx-controller
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::external-ingress-ingress-nginx
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::admin-components/internal-ingress-ingress-nginx-controller
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::external-ingress-ingress-nginx
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::internal-ingress-ingress-nginx
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apps/v1:Deployment::admin-components/internal-ingress-ingress-nginx-controller
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apps/v1:Deployment::admin-components/external-ingress-ingress-nginx-controller
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::challenges.acme.cert-manager.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::issuers.cert-manager.io
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::minio/minio-console
kubernetes:batch/v1:Job                                                    urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:batch/v1:Job::minio/minio-post-job
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::minio/minio
kubernetes:core/v1:ConfigMap                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ConfigMap::minio/minio
kubernetes:networking.k8s.io/v1:Ingress                                    urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:networking.k8s.io/v1:Ingress::minio/minio
kubernetes:core/v1:Secret                                                  urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Secret::minio/minio
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ServiceAccount::minio/minio-sa
kubernetes:networking.k8s.io/v1:Ingress                                    urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:networking.k8s.io/v1:Ingress::minio/minio-console
kubernetes:core/v1:PersistentVolumeClaim                                   urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:PersistentVolumeClaim::minio/minio
kubernetes:core/v1:ConfigMap                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:ConfigMap::console-config
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apps/v1:Deployment::minio/minio
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:yaml:ConfigGroup$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::prometheusrules.monitoring.coreos.com
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::clusterissuers.cert-manager.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:yaml:ConfigGroup$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::probes.monitoring.coreos.com
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:yaml:ConfigGroup$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::podmonitors.monitoring.coreos.com
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:yaml:ConfigGroup$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::servicemonitors.monitoring.coreos.com
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:yaml:ConfigGroup$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::scrapeconfigs.monitoring.coreos.com
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:yaml:ConfigGroup$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::alertmanagerconfigs.monitoring.coreos.com
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:yaml:ConfigGroup$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::alertmanagers.monitoring.coreos.com
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:yaml:ConfigGroup$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::thanosrulers.monitoring.coreos.com
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:yaml:ConfigGroup$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::prometheuses.monitoring.coreos.com
kubernetes:networking.k8s.io/v1:NetworkPolicy                              urn:pulumi:root::daedalus-kubernetes::kubernetes:networking.k8s.io/v1:NetworkPolicy::guest-ns-kobie
kubernetes:rbac.authorization.k8s.io/v1:Role                               urn:pulumi:root::daedalus-kubernetes::kubernetes:rbac.authorization.k8s.io/v1:Role::[email protected]
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::[email protected]
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::local-storage-provisioner
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:kustomize:Directory$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::snapshot-controller-role
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:kustomize:Directory$kubernetes:core/v1:ServiceAccount::kube-system/snapshot-controller
kubernetes:rbac.authorization.k8s.io/v1:RoleBinding                        urn:pulumi:root::daedalus-kubernetes::kubernetes:kustomize:Directory$kubernetes:rbac.authorization.k8s.io/v1:RoleBinding::kube-system/snapshot-controller-leaderelection
kubernetes:rbac.authorization.k8s.io/v1:Role                               urn:pulumi:root::daedalus-kubernetes::kubernetes:kustomize:Directory$kubernetes:rbac.authorization.k8s.io/v1:Role::kube-system/snapshot-controller-leaderelection
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:kustomize:Directory$kubernetes:apps/v1:Deployment::kube-system/snapshot-controller
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:kustomize:Directory$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::snapshot-controller-runner
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::prometheus-operator-role-binding
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:apps/v1:Deployment::prometheus-operator
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:kustomize:Directory$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::volumesnapshotclasses.snapshot.storage.k8s.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:kustomize:Directory$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::volumesnapshotcontents.snapshot.storage.k8s.io
kubernetes:cert-manager.io/v1:ClusterIssuer                                urn:pulumi:root::daedalus-kubernetes::kubernetes:cert-manager.io/v1:ClusterIssuer::letsencrypt
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::prometheus-role-binding
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ServiceAccount::admin-components/external-dns
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::external-dns-viewer
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:kustomize:Directory$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::volumesnapshots.snapshot.storage.k8s.io
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::admin-components/external-dns
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apps/v1:Deployment::admin-components/external-dns
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::external-dns
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:yaml:ConfigGroup$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::prometheusagents.monitoring.coreos.com
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:apps/v1:Deployment::registry
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:apps/v1:Deployment::redpanda
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:apps/v1:Deployment::mongo
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:apps/v1:Deployment::redpanda-console
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::[email protected]
kubernetes:rbac.authorization.k8s.io/v1:RoleBinding                        urn:pulumi:root::daedalus-kubernetes::kubernetes:rbac.authorization.k8s.io/v1:RoleBinding::[email protected]
kubernetes:cert-manager.io/v1:Certificate                                  urn:pulumi:root::daedalus-kubernetes::kubernetes:cert-manager.io/v1:Certificate::alerts-telemetry-julienvincent-io
kubernetes:cert-manager.io/v1:Certificate                                  urn:pulumi:root::daedalus-kubernetes::kubernetes:cert-manager.io/v1:Certificate::console-kafka-julienvincent-io
kubernetes:cert-manager.io/v1:Certificate                                  urn:pulumi:root::daedalus-kubernetes::kubernetes:cert-manager.io/v1:Certificate::telemetry-julienvincent-io
kubernetes:cert-manager.io/v1:Certificate                                  urn:pulumi:root::daedalus-kubernetes::kubernetes:cert-manager.io/v1:Certificate::registry-julienvincent-io
kubernetes:cert-manager.io/v1:Certificate                                  urn:pulumi:root::daedalus-kubernetes::kubernetes:cert-manager.io/v1:Certificate::prometheus-telemetry-julienvincent-io
kubernetes:cert-manager.io/v1:Certificate                                  urn:pulumi:root::daedalus-kubernetes::kubernetes:cert-manager.io/v1:Certificate::storage-daedalus-julienvincent-io
kubernetes:helm.sh/v3:Chart                                                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart::kube-state-metrics
kubernetes:helm.sh/v3:Chart                                                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart::node-exporter
kubernetes:monitoring.coreos.com/v1:Alertmanager                           urn:pulumi:root::daedalus-kubernetes::kubernetes:monitoring.coreos.com/v1:Alertmanager::alert-manager
kubernetes:monitoring.coreos.com/v1:ServiceMonitor                         urn:pulumi:root::daedalus-kubernetes::kubernetes:monitoring.coreos.com/v1:ServiceMonitor::kubelet-monitor
kubernetes:monitoring.coreos.com/v1:PrometheusRule                         urn:pulumi:root::daedalus-kubernetes::kubernetes:monitoring.coreos.com/v1:PrometheusRule::kubernetes-metadata-rules
kubernetes:networking.k8s.io/v1:Ingress                                    urn:pulumi:root::daedalus-kubernetes::kubernetes:networking.k8s.io/v1:Ingress::redpanda-console-ingress
kubernetes:monitoring.coreos.com/v1:PrometheusRule                         urn:pulumi:root::daedalus-kubernetes::kubernetes:monitoring.coreos.com/v1:PrometheusRule::workload-health-rules
kubernetes:networking.k8s.io/v1:Ingress                                    urn:pulumi:root::daedalus-kubernetes::kubernetes:networking.k8s.io/v1:Ingress::grafana
kubernetes:networking.k8s.io/v1:Ingress                                    urn:pulumi:root::daedalus-kubernetes::kubernetes:networking.k8s.io/v1:Ingress::registry-ingress
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ServiceAccount::admin-components/kube-state-metrics
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::admin-components/kube-state-metrics
kubernetes:monitoring.coreos.com/v1:ServiceMonitor                         urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:monitoring.coreos.com/v1:ServiceMonitor::admin-components/kube-state-metrics
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::kube-state-metrics
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apps/v1:Deployment::admin-components/kube-state-metrics
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::admin-components/node-exporter-prometheus-node-exporter
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ServiceAccount::admin-components/node-exporter-prometheus-node-exporter
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::kube-state-metrics
kubernetes:monitoring.coreos.com/v1:ServiceMonitor                         urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:monitoring.coreos.com/v1:ServiceMonitor::admin-components/node-exporter-prometheus-node-exporter
kubernetes:monitoring.coreos.com/v1:PodMonitor                             urn:pulumi:root::daedalus-kubernetes::kubernetes:monitoring.coreos.com/v1:PodMonitor::pod-monitor
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:Service::alert-manager
kubernetes:cert-manager.io/v1:ClusterIssuer                                urn:pulumi:root::daedalus-kubernetes::kubernetes:cert-manager.io/v1:ClusterIssuer::internal
kubernetes:apps/v1:DaemonSet                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apps/v1:DaemonSet::admin-components/node-exporter-prometheus-node-exporter
kubernetes:cert-manager.io/v1:Issuer                                       urn:pulumi:root::daedalus-kubernetes::kubernetes:cert-manager.io/v1:Issuer::self-signed-issuer
kubernetes:core/v1:Secret                                                  urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Secret::admin-components/influxdb-influxdb2-auth
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ServiceAccount::admin-components/influxdb-influxdb2
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::admin-components/influxdb-influxdb2
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::longhorn-d35080e1/longhorn-replica-manager
kubernetes:core/v1:ConfigMap                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ConfigMap::longhorn-d35080e1/longhorn-storageclass
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ServiceAccount::longhorn-d35080e1/longhorn-service-account
kubernetes:apps/v1:StatefulSet                                             urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apps/v1:StatefulSet::admin-components/influxdb-influxdb2
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::longhorn-bind
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::longhorn-support-bundle
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ServiceAccount::longhorn-d35080e1/longhorn-support-bundle
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::longhorn-d35080e1/longhorn-frontend
kubernetes:networking.k8s.io/v1:Ingress                                    urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:networking.k8s.io/v1:Ingress::longhorn-d35080e1/longhorn-ingress
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::longhorn-d35080e1/longhorn-recovery-backend
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::longhorn-d35080e1/longhorn-conversion-webhook
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::longhorn-d35080e1/longhorn-engine-manager
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::longhorn-d35080e1/longhorn-admission-webhook
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::longhorn-d35080e1/longhorn-backend
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::systemrestores.longhorn.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::backupvolumes.longhorn.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::settings.longhorn.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::orphans.longhorn.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::supportbundles.longhorn.io
kubernetes:apps/v1:DaemonSet                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apps/v1:DaemonSet::longhorn-d35080e1/longhorn-manager
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::backingimagedatasources.longhorn.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::backups.longhorn.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::backingimagemanagers.longhorn.io
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::longhorn-role
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::recurringjobs.longhorn.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::systembackups.longhorn.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::snapshots.longhorn.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::sharemanagers.longhorn.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::engines.longhorn.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::backuptargets.longhorn.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::backingimages.longhorn.io
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apps/v1:Deployment::longhorn-d35080e1/longhorn-ui
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apps/v1:Deployment::longhorn-d35080e1/longhorn-driver-deployer
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::volumeattachments.longhorn.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::engineimages.longhorn.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::nodes.longhorn.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::instancemanagers.longhorn.io
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::replicas.longhorn.io
kubernetes:monitoring.coreos.com/v1:Prometheus                             urn:pulumi:root::daedalus-kubernetes::kubernetes:monitoring.coreos.com/v1:Prometheus::prometheus
kubernetes:networking.k8s.io/v1:Ingress                                    urn:pulumi:root::daedalus-kubernetes::kubernetes:networking.k8s.io/v1:Ingress::alert-manager
kubernetes:cert-manager.io/v1:Certificate                                  urn:pulumi:root::daedalus-kubernetes::kubernetes:cert-manager.io/v1:Certificate::ca-cert
kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition                urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apiextensions.k8s.io/v1:CustomResourceDefinition::volumes.longhorn.io
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:core/v1:Service::prometheus
kubernetes:networking.k8s.io/v1:Ingress                                    urn:pulumi:root::daedalus-kubernetes::kubernetes:networking.k8s.io/v1:Ingress::prometheus
kubernetes:rbac.authorization.k8s.io/v1:RoleBinding                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:RoleBinding::admin-components/grafana
kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRoleBinding::grafana-clusterrolebinding
kubernetes:core/v1:ConfigMap                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ConfigMap::admin-components/grafana
kubernetes:core/v1:Service                                                 urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Service::admin-components/grafana
kubernetes:core/v1:ConfigMap                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ConfigMap::admin-components/grafana-dashboards-misc
kubernetes:core/v1:PersistentVolumeClaim                                   urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:PersistentVolumeClaim::admin-components/grafana
kubernetes:core/v1:ServiceAccount                                          urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ServiceAccount::admin-components/grafana
kubernetes:core/v1:ConfigMap                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ConfigMap::admin-components/grafana-dashboards-cluster
kubernetes:core/v1:ConfigMap                                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:ConfigMap::longhorn-d35080e1/longhorn-default-setting
kubernetes:rbac.authorization.k8s.io/v1:Role                               urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:Role::admin-components/grafana
kubernetes:rbac.authorization.k8s.io/v1:ClusterRole                        urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:rbac.authorization.k8s.io/v1:ClusterRole::grafana-clusterrole
kubernetes:apps/v1:Deployment                                              urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:apps/v1:Deployment::admin-components/grafana
kubernetes:core/v1:Secret                                                  urn:pulumi:root::daedalus-kubernetes::kubernetes:helm.sh/v3:Chart$kubernetes:core/v1:Secret::admin-components/grafana


Found no pending operations associated with root

Backend        
Name           pulumi.com
URL            https://app.pulumi.com/julienvincent
User           julienvincent
Organizations  REDACTED
Token type     personal

Pulumi locates its logs in /var/folders/qk/n2bhz7rs6s7gnx46vk7tc2vr0000gn/T/ by default

Additional context

No response

Contributing

Vote on this issue by adding a 👍 reaction. To contribute a fix for this issue, leave a comment (and link to your pull request, if you've opened one already).

julienvincent avatar Dec 26 '23 14:12 julienvincent

@julienvincent can you confirm the "atlas" resource is using version v1beta2 of the nodes.lonhorn.io CRD? I'm curious if it's maybe on v1beta1 and not getting picked up due to a version mismatch.

blampe avatar Jan 08 '24 18:01 blampe

I've constructed a standalone repro for this issue here: https://github.com/mjeffryes/nodejs-repros/tree/7a7623e2bbea882de36993a966b10d9f056ff9f5

(I can confirm that the versions match in my repro, the node is running v1beta2.)

mjeffryes avatar Jan 09 '24 04:01 mjeffryes

@mjeffryes Awesome! Thanks for the repro repo.

@blampe I suppose this answers your question, but yes my "atlas" node is using version v1beta2. But regardless this even fails when trying to create a new resource that doesn't exist yet (not using Patch).

Let me know if you need anything else from me!

julienvincent avatar Jan 09 '24 15:01 julienvincent

Let me point out that apiversions are 'views' over the objects in the API server; there's no notion of an object being associated with one version or another. In other words, any given object is visible in +all+ apiversions of a resource.

EronWright avatar Jan 19 '24 22:01 EronWright

Any update on this?

julienvincent avatar Feb 20 '24 16:02 julienvincent