pulumi-kubernetes icon indicating copy to clipboard operation
pulumi-kubernetes copied to clipboard

Attempting to deploy large CRDs hangs indefinitely with yaml.ConfigFile and kustomize.Directory

Open Insomniak47 opened this issue 2 years ago • 2 comments

Hello!

  • Vote on this issue by adding a 👍 reaction
  • To contribute a fix for this issue, leave a comment (and link to your pull request, if you've opened one already)

Issue details

Hardware: 2021 M1 Pro Macbook Pro Pulumi cli version: 3.28.0 (ARM64) SDK: python

When attempting preview using a kustomize file to deploy argo CRDs (individually 1 eventually succeeds, the full deployment does not) pulumi preview hangs indefinitely.

When attempting to preview individual (large) crds via a kustomize file pulumi preview hangs indefinitely

When attempting to use the results of kustomize build (the sum of all resources from the argo deployment) from a local file to deploy yaml.ConfigFile pulumi preview hangs indefinitely.

Steps to reproduce

Minimal kubernetes and python files:

Targeting the kustomize directory:

apiVersion: kustomize.config.k8s.io/v1beta1
kind: Kustomization

namespace: argocd

resources:
  - "https://github.com/argoproj/argo-cd//manifests/ha/cluster-install
kustomize.Directory(
    "argo-bootstrap",
    directory="./",
)

Each of the individual (large crds targeted directly with kustomize.Directory will also have the same effect.

As a single file:

apiVersion: kustomize.config.k8s.io/v1beta1
kind: Kustomization

namespace: argocd

resources:
  - "https://github.com/argoproj/argo-cd//manifests/ha/cluster-install
kustomize build > test/resources.yaml

pulumi_kubernetes.yaml.ConfigFile("my-resource", file="./test/resources.yaml")

Expected: pulumi completes a preview in a reasonably short amount of time.

Actual: pulumi hangs indefinitely

To note:

If I apply the CRDs individually as opposed to together the smallest of the CRDs succeeds the others hang forever (or at least >30m)

Related:

#1130

Insomniak47 avatar Apr 06 '22 17:04 Insomniak47

This is likely a dupe of https://github.com/pulumi/pulumi/issues/8717

viveklak avatar Apr 07 '22 07:04 viveklak

This could be helpful: https://github.com/pulumi/pulumi-kubernetes/issues/1867#issuecomment-1107353905

cbcmg avatar Apr 30 '22 12:04 cbcmg