crossplane icon indicating copy to clipboard operation
crossplane copied to clipboard
verified publisher icon crossplane

Cannot resolve package dependencies: missing dependencies: [xpkg.upbound.io/upbound/provider-family-aws]

Open sonderteo opened this issue 1 year ago • 4 comments

What happened?

Upon installing an AWS provider for crossplane, it never goes healthy stating it cannot resolve the dependency for provider-aws-family. I am unable to find any other error messages or explanation as to what it is doing. All other crossplane providers are installed and healthy.

Warning ResolveDependencies 50s (x20 over 15m) packages/providerrevision.pkg.crossplane.io cannot resolve package dependencies: missing dependencies: [xpkg.upbound.io/upbound/provider-family-aws]

How can we reproduce it?

Install an AWS provider and wait

What environment did it happen in?

Crossplane version: 0.14.2

Include at least the version or commit of Crossplane you were running. Consider also including your:

  • Cloud provider or hardware configuration: AWS
  • Kubernetes version (use kubectl version): 1.25
  • Kubernetes distribution (e.g. Tectonic, GKE, OpenShift) EKS

sonderteo avatar Feb 07 '24 20:02 sonderteo

Did you install the required provider-family-aws?

It's resolving an interdependency between the two providers.

blut avatar Feb 14 '24 12:02 blut

Did you install the required provider-family-aws?

It's resolving an interdependency between the two providers.

According to the documentation the provider-aws-family gets installed automatically when installing your first AWS provider (S3, elasticache etc) which is what we did here which produced the error. There is nowhere in the AWS provider documentation outlining installing the provider family manually.

sonderteo avatar Feb 14 '24 16:02 sonderteo

Thanks for taking the time to share your experience here @sonderteo. The family provider should indeed get installed on its own successfully. I just tried to reproduce this behavior now with the same Crossplane version you reported (v1.14.2), but I was unable to. Some details:

❯ crossplane xpkg install provider xpkg.upbound.io/upbound/provider-aws-accessanalyzer:v1.1.0

❯ kubectl get pkg
NAME                                                             INSTALLED   HEALTHY   PACKAGE                                                      AGE
provider.pkg.crossplane.io/upbound-provider-aws-accessanalyzer   True        True      xpkg.upbound.io/upbound/provider-aws-accessanalyzer:v1.1.0   65s
provider.pkg.crossplane.io/upbound-provider-family-aws           True        True      xpkg.upbound.io/upbound/provider-family-aws:v1.1.0           59s

❯ crossplane beta trace provider.pkg.crossplane.io/upbound-provider-aws-accessanalyzer
NAME                                                                   VERSION   INSTALLED   HEALTHY   STATE    STATUS
Provider/upbound-provider-aws-accessanalyzer                           v1.1.0    True        True      -        HealthyPackageRevision
├─ ProviderRevision/upbound-provider-aws-accessanalyzer-de66b90ee349   v1.1.0    -           True      Active   HealthyPackageRevision
└─ Provider/upbound-provider-family-aws                                v1.1.0    True        True      -        HealthyPackageRevision
   └─ ProviderRevision/upbound-provider-family-aws-3756efeec089        v1.1.0    -           True      Active   HealthyPackageRevision

Some more debugging information that might be helpful here from your environment would be the output of:

  • a trace command similar to above for the provider you've installed
  • a kubectl describe ProviderRevision <name> for the provider-family-aws provider that is failing, for example upbound-provider-family-aws-3756efeec089 on my machine
  • kubectl get lock lock -o yaml

jbw976 avatar Feb 21 '24 17:02 jbw976

I hit this issue too or related I think. ProviderConfigs are failing to deploy, in this cluster, among 29 clusters with the same deployment I managed to put this one in a state I cannot get it out, freaking amazing:

one or more objects failed to apply, reason: resource mapping not found for name: "aws-iam-pc" namespace: "crossplane" from "/dev/shm/676710520": no matches for kind "ProviderConfig" in version "aws.upbound.io/v1beta1" ensure CRDs are installed first,resource mapping not found for name: "aws-s3-pc" namespace: "crossplane" from "/dev/shm/2169161997": no matches for kind "ProviderConfig" in version "aws.upbound.io/v1beta1" ensure CRDs are installed first,resource mapping not found for name: "aws-ssm-pc" namespace: "crossplane" from "/dev/shm/3653408236": no matches for kind "ProviderConfig" in version "aws.upbound.io/v1beta1" ensure CRDs are installed first (retried 3 times).

aws-family-provider is not installed indeed:

apiVersion: v1
items:
- apiVersion: pkg.crossplane.io/v1
  kind: Provider
  metadata:
    annotations:
      argocd.argoproj.io/sync-options: SkipDryRunOnMissingResource=true
      argocd.argoproj.io/sync-wave: "10"
      argocd.argoproj.io/tracking-id: develop_services.us-east-1.develop-crossplane:pkg.crossplane.io/Provider:crossplane/aws-iam-provider
      kubectl.kubernetes.io/last-applied-configuration: |
        {"apiVersion":"pkg.crossplane.io/v1","kind":"Provider","metadata":{"annotations":{"argocd.argoproj.io/sync-options":"SkipDryRunOnMissingResource=true","argocd.argoproj.io/sync-wave":"10","argocd.argoproj.io/tracking-id":"develop_services.us-east-1.develop-crossplane:pkg.crossplane.io/Provider:crossplane/aws-iam-provider"},"name":"aws-iam-provider"},"spec":{"package":"xpkg.upbound.io/upbound/provider-aws-iam:v1.4.0","packagePullPolicy":"Always","runtimeConfigRef":{"apiVersion":"pkg.crossplane.io/v1beta1","kind":"DeploymentRuntimeConfig","name":"aws-drc"}}}
    creationTimestamp: "2024-05-16T19:26:16Z"
    generation: 1
    name: aws-iam-provider
    resourceVersion: "329805502"
    uid: 1f05af19-8522-4fa4-b542-276ac5270679
  spec:
    ignoreCrossplaneConstraints: false
    package: xpkg.upbound.io/upbound/provider-aws-iam:v1.4.0
    packagePullPolicy: Always
    revisionActivationPolicy: Automatic
    revisionHistoryLimit: 1
    runtimeConfigRef:
      apiVersion: pkg.crossplane.io/v1beta1
      kind: DeploymentRuntimeConfig
      name: aws-drc
    skipDependencyResolution: false
  status:
    conditions:
    - lastTransitionTime: "2024-05-16T19:26:27Z"
      reason: HealthyPackageRevision
      status: "True"
      type: Healthy
    - lastTransitionTime: "2024-05-16T19:26:16Z"
      reason: ActivePackageRevision
      status: "True"
      type: Installed
    currentIdentifier: xpkg.upbound.io/upbound/provider-aws-iam:v1.4.0
    currentRevision: aws-iam-provider-851b41fe5217
- apiVersion: pkg.crossplane.io/v1
  kind: Provider
  metadata:
    annotations:
      argocd.argoproj.io/sync-options: SkipDryRunOnMissingResource=true
      argocd.argoproj.io/sync-wave: "10"
      argocd.argoproj.io/tracking-id: develop_services.us-east-1.develop-crossplane:pkg.crossplane.io/Provider:crossplane/aws-s3-provider
      kubectl.kubernetes.io/last-applied-configuration: |
        {"apiVersion":"pkg.crossplane.io/v1","kind":"Provider","metadata":{"annotations":{"argocd.argoproj.io/sync-options":"SkipDryRunOnMissingResource=true","argocd.argoproj.io/sync-wave":"10","argocd.argoproj.io/tracking-id":"develop_services.us-east-1.develop-crossplane:pkg.crossplane.io/Provider:crossplane/aws-s3-provider"},"name":"aws-s3-provider"},"spec":{"package":"xpkg.upbound.io/upbound/provider-aws-s3:v1.4.0","packagePullPolicy":"Always","runtimeConfigRef":{"apiVersion":"pkg.crossplane.io/v1beta1","kind":"DeploymentRuntimeConfig","name":"aws-drc"}}}
    creationTimestamp: "2024-05-16T19:26:16Z"
    generation: 1
    name: aws-s3-provider
    resourceVersion: "329805489"
    uid: 2121f9dc-2ec3-46be-b461-bc4d0985b020
  spec:
    ignoreCrossplaneConstraints: false
    package: xpkg.upbound.io/upbound/provider-aws-s3:v1.4.0
    packagePullPolicy: Always
    revisionActivationPolicy: Automatic
    revisionHistoryLimit: 1
    runtimeConfigRef:
      apiVersion: pkg.crossplane.io/v1beta1
      kind: DeploymentRuntimeConfig
      name: aws-drc
    skipDependencyResolution: false
  status:
    conditions:
    - lastTransitionTime: "2024-05-16T19:26:27Z"
      reason: HealthyPackageRevision
      status: "True"
      type: Healthy
    - lastTransitionTime: "2024-05-16T19:26:16Z"
      reason: ActivePackageRevision
      status: "True"
      type: Installed
    currentIdentifier: xpkg.upbound.io/upbound/provider-aws-s3:v1.4.0
    currentRevision: aws-s3-provider-6f461b0ba11f
- apiVersion: pkg.crossplane.io/v1
  kind: Provider
  metadata:
    annotations:
      argocd.argoproj.io/sync-options: SkipDryRunOnMissingResource=true
      argocd.argoproj.io/sync-wave: "10"
      argocd.argoproj.io/tracking-id: develop_services.us-east-1.develop-crossplane:pkg.crossplane.io/Provider:crossplane/aws-ssm-provider
      kubectl.kubernetes.io/last-applied-configuration: |
        {"apiVersion":"pkg.crossplane.io/v1","kind":"Provider","metadata":{"annotations":{"argocd.argoproj.io/sync-options":"SkipDryRunOnMissingResource=true","argocd.argoproj.io/sync-wave":"10","argocd.argoproj.io/tracking-id":"develop_services.us-east-1.develop-crossplane:pkg.crossplane.io/Provider:crossplane/aws-ssm-provider"},"name":"aws-ssm-provider"},"spec":{"package":"xpkg.upbound.io/upbound/provider-aws-ssm:v1.4.0","packagePullPolicy":"Always","runtimeConfigRef":{"apiVersion":"pkg.crossplane.io/v1beta1","kind":"DeploymentRuntimeConfig","name":"aws-drc"}}}
    creationTimestamp: "2024-05-16T19:26:16Z"
    generation: 1
    name: aws-ssm-provider
    resourceVersion: "329805654"
    uid: 278d230a-ab80-4b98-89ee-3715096a743d
  spec:
    ignoreCrossplaneConstraints: false
    package: xpkg.upbound.io/upbound/provider-aws-ssm:v1.4.0
    packagePullPolicy: Always
    revisionActivationPolicy: Automatic
    revisionHistoryLimit: 1
    runtimeConfigRef:
      apiVersion: pkg.crossplane.io/v1beta1
      kind: DeploymentRuntimeConfig
      name: aws-drc
    skipDependencyResolution: false
  status:
    conditions:
    - lastTransitionTime: "2024-05-16T19:26:36Z"
      reason: HealthyPackageRevision
      status: "True"
      type: Healthy
    - lastTransitionTime: "2024-05-16T19:26:16Z"
      reason: ActivePackageRevision
      status: "True"
      type: Installed
    currentIdentifier: xpkg.upbound.io/upbound/provider-aws-ssm:v1.4.0
    currentRevision: aws-ssm-provider-6c302db84d29
- apiVersion: pkg.crossplane.io/v1
  kind: Provider
  metadata:
    annotations:
      argocd.argoproj.io/sync-options: SkipDryRunOnMissingResource=true
      argocd.argoproj.io/sync-wave: "10"
      argocd.argoproj.io/tracking-id: develop_services.us-east-1.develop-crossplane:pkg.crossplane.io/Provider:crossplane/grafana-cloud-provider
      kubectl.kubernetes.io/last-applied-configuration: |
        {"apiVersion":"pkg.crossplane.io/v1","kind":"Provider","metadata":{"annotations":{"argocd.argoproj.io/sync-options":"SkipDryRunOnMissingResource=true","argocd.argoproj.io/sync-wave":"10","argocd.argoproj.io/tracking-id":"develop_services.us-east-1.develop-crossplane:pkg.crossplane.io/Provider:crossplane/grafana-cloud-provider"},"name":"grafana-cloud-provider"},"spec":{"package":"nexus.aveng.me:5000/grafana/provider-grafana:v0.16.0","packagePullPolicy":"Always","packagePullSecrets":[{"name":"nexus-registry-credentials"}],"runtimeConfigRef":{"apiVersion":"pkg.crossplane.io/v1beta1","kind":"DeploymentRuntimeConfig","name":"grafana-cloud-drc"}}}
    creationTimestamp: "2024-05-16T19:26:16Z"
    generation: 1
    name: grafana-cloud-provider
    resourceVersion: "329805578"
    uid: cdfc38c3-aef8-4bf3-a9f7-74a95dd02b2f
  spec:
    ignoreCrossplaneConstraints: false
    package: nexus.aveng.me:5000/grafana/provider-grafana:v0.16.0
    packagePullPolicy: Always
    packagePullSecrets:
    - name: nexus-registry-credentials
    revisionActivationPolicy: Automatic
    revisionHistoryLimit: 1
    runtimeConfigRef:
      apiVersion: pkg.crossplane.io/v1beta1
      kind: DeploymentRuntimeConfig
      name: grafana-cloud-drc
    skipDependencyResolution: false
  status:
    conditions:
    - lastTransitionTime: "2024-05-16T19:26:31Z"
      reason: HealthyPackageRevision
      status: "True"
      type: Healthy
    - lastTransitionTime: "2024-05-16T19:26:16Z"
      reason: ActivePackageRevision
      status: "True"
      type: Installed
    currentIdentifier: nexus.aveng.me:5000/grafana/provider-grafana:v0.16.0
    currentRevision: grafana-cloud-provider-a87c9d6abbae
kind: List
metadata:
  resourceVersion: ""


apiVersion: pkg.crossplane.io/v1beta1
kind: Lock
metadata:
  creationTimestamp: "2024-04-01T14:42:48Z"
  finalizers:
  - lock.pkg.crossplane.io
  generation: 66
  name: lock
  resourceVersion: "329804867"
  uid: 9e91da8e-decb-43d9-8f7c-2f3e5d74d822
packages:
- dependencies: []
  name: grafana-cloud-provider-a2eb32d2cba3
  source: nexus.aveng.me:5000/attcs-crossplane-provider-grafana
  type: Provider
  version: v0.16.0
- dependencies: []
  name: upbound-provider-family-aws-bac5d48bd353
  source: xpkg.upbound.io/upbound/provider-family-aws
  type: Provider
  version: v1.4.0
- dependencies:
  - constraints: '>= 0.0.0'
    package: xpkg.upbound.io/upbound/provider-family-aws
    type: Provider
  name: aws-ssm-provider-6c302db84d29
  source: xpkg.upbound.io/upbound/provider-aws-ssm
  type: Provider
  version: v1.4.0
- dependencies:
  - constraints: '>= 0.0.0'
    package: xpkg.upbound.io/upbound/provider-family-aws
    type: Provider
  name: aws-s3-provider-6f461b0ba11f
  source: xpkg.upbound.io/upbound/provider-aws-s3
  type: Provider
  version: v1.4.0
- dependencies:
  - constraints: '>= 0.0.0'
    package: xpkg.upbound.io/upbound/provider-family-aws
    type: Provider
  name: aws-iam-provider-851b41fe5217
  source: xpkg.upbound.io/upbound/provider-aws-iam
  type: Provider
  version: v1.4.0
- dependencies: []
  name: grafana-cloud-provider-a87c9d6abbae
  source: nexus.aveng.me:5000/grafana/provider-grafana
  type: Provider
  version: v0.16.0

I'm quite sick and tired of hitting the same old issues without any fix or having to apply whatever workaround somebody found. I don't knot how this has become known in the Devops world... If I was not forced to use this piece of software I would stay lightyears away...

josemrs avatar May 16 '24 19:05 josemrs

Crossplane does not currently have enough maintainers to address every issue and pull request. This issue has been automatically marked as stale because it has had no activity in the last 90 days. It will be closed in 14 days if no further activity occurs. Leaving a comment starting with /fresh will mark this issue as not stale.

github-actions[bot] avatar Aug 15 '24 01:08 github-actions[bot]