kpt
kpt copied to clipboard
Published
20 hours ago •
kptdev
kptdev
porch: packagevariant leaves lingering packages after an error during delete
Expected behavior
Package variant resource will not be finalized until the underlying package revisions are deleted.
Actual behavior
If an error occurs during deletion, the resource is still deleted but the revision remains.
Information
I think that's what happened.
I have two PackageVariantSets. One targets the "edge" package at "edge" repos, the other targets the "distribution" package at "regional" repos.
Notice the second line here - the "distribution" package in the "edge-02" repo.
Initially, I messed up my label selectors and ended up with both packages in every repo. I fixed, that, and it most packages got cleaned up. But this one lingers. On top of that, this is the same repo exhibiting #3877 so that may be related.
Below are some logs. During the course of these log entries, I:
- Created a bogus repo (jbelamaric-us-regional-1-edge-01). You can ignore errors related to that.
- Updated all the repos to point to a new GH repos - that is why the initial errors complain about not being allowed to create outside of the directory, then those errors go away. You can ignore those, I filed a separate issue for that.
- Created to PVSs with no label selectors, which resulted in lots too many packages.
- Modified those PVSs to have the right label selectors, which resulted in most getting cleaned up as expected.
PackageVariant"={"name":"cachingdns-edge-44f604043046c915ea89667128b276b9c03211b7","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-44f604043046c915ea89667128b276b9c03211b7" "namespace"="default" "reconcileID"="e7bc0eba-250c-4a9c-a866-98f8e371114c"
I0313 17:59:13.775374 1 packagevariant_controller.go:253] package variant "cachingdns-edge-3db6d6fd4034d91b43cfba1b3f214b338dd2c13e" is creating package revision ""
E0313 17:59:13.790501 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: cannot create cachingdns-edge outside of repository directory \"us-east2-regional\"" "PackageVariant"={"name":"cachingdns-edge-3db6d6fd4034d91b43cfba1b3f214b338dd2c13e","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-3db6d6fd4034d91b43cfba1b3f214b338dd2c13e" "namespace"="default" "reconcileID"="8726e387-6975-4c46-bd66-076f6c8c5401"
I0313 17:59:13.790724 1 packagevariant_controller.go:253] package variant "cachingdns-edge-1814fa6e4e19c2507662a33a34990cc2aa10d90c" is creating package revision ""
E0313 17:59:13.806605 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: cannot create cachingdns-edge outside of repository directory \"us-east2-regional\"" "PackageVariant"={"name":"cachingdns-edge-1814fa6e4e19c2507662a33a34990cc2aa10d90c","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-1814fa6e4e19c2507662a33a34990cc2aa10d90c" "namespace"="default" "reconcileID"="4e67c0b0-781e-461e-80d5-7734d15393aa"
I0313 17:59:13.807042 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
I0313 17:59:21.236935 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-regional" "namespace"="default" "reconcileID"="e666f0dd-3111-4f66-ad51-c816de773207"
E0313 17:59:21.700693 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="d8593223-96ac-4130-878c-14e326d5d30d"
I0313 17:59:36.293245 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-regional-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-regional-02" "namespace"="default" "reconcileID"="c422fd0a-6171-434a-8b93-4ce1803c5913"
I0313 17:59:51.442873 1 packagevariant_controller.go:391] package variant "cachingdns-distribution-e70d94512a16274168e15bf45a4bd4af16a81af4" is deleting package revision "nephio-testorg-packages-b8a77c9291ed23c13374d15c95701290bca620c4"
I0313 17:59:52.955121 1 packagevariant_controller.go:391] package variant "cachingdns-edge-81efd5d48a18a6c3e5375dbae96e483f65afd166" is deleting package revision "nephio-testorg-packages-2b25be17935446aa51259603f04aea26c7395c83"
I0313 18:01:09.450966 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-01" "namespace"="default" "reconcileID"="55a948ee-5795-450a-8e5f-8bb2591abcd6"
I0313 18:02:55.582905 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"jbelamaric-us-regional-1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="jbelamaric-us-regional-1-edge-01" "namespace"="default" "reconcileID"="a36d9471-8281-4b1f-8141-060042ef79b7"
I0313 18:02:55.666802 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"jbelamaric-us-regional-1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="jbelamaric-us-regional-1-edge-01" "namespace"="default" "reconcileID"="1213723a-fa7a-4b0c-a851-f4a10abbc907"
I0313 18:03:32.021923 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-regional-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-regional-01" "namespace"="default" "reconcileID"="aaa2239d-2b76-4650-85ac-74c057dac55f"
W0313 18:03:52.625216 1 reflector.go:347] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:169: watch of *v1alpha1.PackageRevision ended with: very short watch: pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:169: Unexpected watch close - watch lasted less than a second and no items received
W0313 18:03:54.070075 1 reflector.go:424] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:169: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
E0313 18:03:54.070311 1 reflector.go:140] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:169: Failed to watch *v1alpha1.PackageRevision: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
W0313 18:03:57.053514 1 reflector.go:424] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:169: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
E0313 18:03:57.053552 1 reflector.go:140] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:169: Failed to watch *v1alpha1.PackageRevision: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
I0313 18:04:00.740643 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-01" "namespace"="default" "reconcileID"="5bf45fc4-b5b5-45ae-b4e1-de2e7f7c201e"
I0313 18:04:01.030191 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-02" "namespace"="default" "reconcileID"="f5438b21-d24f-4a0f-831f-03c3579b3d40"
I0313 18:04:01.348121 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-03","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-03" "namespace"="default" "reconcileID"="d0509244-6f04-4fff-9bc0-64675dcabda5"
I0313 18:04:01.502832 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-01" "namespace"="default" "reconcileID"="084f13d5-380a-4a38-a3ff-807b6b54f320"
W0313 18:04:01.562450 1 reflector.go:424] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:169: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
E0313 18:04:01.562486 1 reflector.go:140] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:169: Failed to watch *v1alpha1.PackageRevision: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
I0313 18:04:01.617193 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-04","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-04" "namespace"="default" "reconcileID"="e3277a68-3556-416f-88da-6c9b31d276fb"
I0313 18:04:01.880571 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-regional" "namespace"="default" "reconcileID"="2002eb10-0def-4768-b9b9-8c35714d0a3c"
I0313 18:04:02.158217 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central2-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central2-regional" "namespace"="default" "reconcileID"="84656ce9-a03e-42a2-a14f-5e7168f9b673"
I0313 18:04:02.543854 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-edge-01" "namespace"="default" "reconcileID"="4aaa8843-5a53-48fb-8973-f1b3e97c544e"
I0313 18:04:03.228167 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-edge-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-edge-02" "namespace"="default" "reconcileID"="2f14b48d-f439-474c-b117-b92374ecd589"
I0313 18:04:03.612069 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-regional-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-regional-01" "namespace"="default" "reconcileID"="57a93f6f-cf28-4f4c-afad-f74144b6d103"
I0313 18:04:03.869995 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-regional-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-regional-02" "namespace"="default" "reconcileID"="3d04cc15-d882-4b67-9bd5-bffa30815cbb"
I0313 18:04:04.120911 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east2-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east2-regional" "namespace"="default" "reconcileID"="d4bbc4f5-5831-4663-8d7a-13be99e4a705"
W0313 18:04:12.401806 1 reflector.go:424] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:169: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
E0313 18:04:12.401927 1 reflector.go:140] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:169: Failed to watch *v1alpha1.PackageRevision: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
W0313 18:04:29.539444 1 reflector.go:424] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:169: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
E0313 18:04:29.539488 1 reflector.go:140] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:169: Failed to watch *v1alpha1.PackageRevision: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
I0313 18:04:51.501319 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-02" "namespace"="default" "reconcileID"="22dd6269-c7b1-45dc-bd9e-04767d1e97ad"
I0313 18:04:52.191673 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-03","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-03" "namespace"="default" "reconcileID"="e87c24bf-fc98-43f5-b0c4-cf6c15a7ac55"
I0313 18:04:52.845884 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-04","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-04" "namespace"="default" "reconcileID"="2a77164d-2bb1-4013-98cf-e8eb5ad8475a"
I0313 18:04:53.480927 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-regional" "namespace"="default" "reconcileID"="41496c4a-cd74-429f-b574-e282157ba175"
I0313 18:04:54.224204 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central2-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central2-regional" "namespace"="default" "reconcileID"="bec405a0-c9cd-47cc-bc59-8fd1c2271b91"
I0313 18:04:54.812948 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-edge-01" "namespace"="default" "reconcileID"="2a5cd583-165f-498f-a6a0-3b2ef7558993"
I0313 18:04:55.468464 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-edge-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-edge-02" "namespace"="default" "reconcileID"="24a6ccde-e281-46c7-8f26-6311579340f3"
I0313 18:04:56.102471 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-regional-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-regional-01" "namespace"="default" "reconcileID"="254110c0-6dc0-46d0-92cd-29170d335473"
I0313 18:04:56.752269 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-regional-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-regional-02" "namespace"="default" "reconcileID"="81de1c65-a269-4b1d-aa00-1b1a7a2a7fb5"
I0313 18:04:57.159524 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-04","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-04" "namespace"="default" "reconcileID"="3e642b4e-13f9-41ca-90aa-ebabffebf5bc"
I0313 18:04:57.400774 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east2-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east2-regional" "namespace"="default" "reconcileID"="8fa46897-6ff8-4731-af4e-8ca290953e5d"
I0313 18:07:00.506806 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-0217939f628bf54afb6943a0627f3d09fe742e9d" is creating package revision ""
E0313 18:07:00.691127 1 packagevariantset_controller.go:87] could not update status: %!w(*errors.StatusError=&{{{ } { <nil>} Failure Operation cannot be fulfilled on packagevariantsets.config.porch.kpt.dev "cachingdns-distribution": the object has been modified; please apply your changes to the latest version and try again Conflict 0xc001a5aea0 409}})
I0313 18:07:10.600419 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-3db2beebe861a3635cb29dbc0b2796831b45e722" is creating package revision ""
I0313 18:07:20.725135 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-52cb15c06dc9252e966897bde315bc6b2e06af4f" is creating package revision ""
I0313 18:07:31.699647 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
I0313 18:07:36.849268 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-03","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-03" "namespace"="default" "reconcileID"="527c8d75-a4ab-4b9e-9a6b-c311ce1d196f"
E0313 18:07:40.988387 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="11e7bd73-3f53-4361-b113-929d7a884b33"
I0313 18:07:40.988782 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-aa744beda50aeca1e21e30a4f051925feb1a2ce1" is creating package revision ""
I0313 18:07:51.201757 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-da1f6e67333a94395f762b408610024a06551cf6" is creating package revision ""
I0313 18:08:01.270323 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-1e718cfbdb754e386474da9aa91bd159ed27c6d7" is creating package revision ""
I0313 18:08:11.583944 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-e70d94512a16274168e15bf45a4bd4af16a81af4" is creating package revision ""
I0313 18:08:22.098916 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-d1579cce150353b437bdaa9845702b33f0900cdc" is creating package revision ""
I0313 18:08:32.092352 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-d03b4237896078449f4eefd10654a507dc05a5c2" is creating package revision ""
I0313 18:08:41.775837 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-54154c218b775b84e280258f12f684c813e76c49" is creating package revision ""
I0313 18:08:51.780863 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-3474f7e88ab1a657f0f8789641859c5496138bbb" is creating package revision ""
I0313 18:09:01.890495 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-aa0bd84da557680b052811b54e528625c13907cf" is creating package revision ""
I0313 18:09:12.108607 1 packagevariant_controller.go:253] package variant "cachingdns-edge-edf34f330bd64333cb936090fb4682e1d84f0159" is creating package revision ""
I0313 18:09:14.834905 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-edge-01" "namespace"="default" "reconcileID"="443b86d8-baee-45fe-9270-13733d667fb6"
I0313 18:09:22.088533 1 packagevariant_controller.go:253] package variant "cachingdns-edge-5fa03feb18a7c84b9d679feaf238fa30b77d0367" is creating package revision ""
I0313 18:09:32.053636 1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:09:41.520419 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="cb295f3f-328a-4b0b-a8cf-9c207429f2ce"
I0313 18:09:41.520692 1 packagevariant_controller.go:253] package variant "cachingdns-edge-d2e51383eec3a112e1eff888b8b7d79f2666dd70" is creating package revision ""
I0313 18:09:51.678636 1 packagevariant_controller.go:253] package variant "cachingdns-edge-81efd5d48a18a6c3e5375dbae96e483f65afd166" is creating package revision ""
I0313 18:09:52.942476 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east2-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east2-regional" "namespace"="default" "reconcileID"="46fc8bf6-1144-4e87-ad76-904365342b5d"
I0313 18:10:02.374747 1 packagevariant_controller.go:253] package variant "cachingdns-edge-596ce7b3b682f6eb284d7c1aec74aaaf179ad834" is creating package revision ""
I0313 18:10:12.177360 1 packagevariant_controller.go:253] package variant "cachingdns-edge-3cc7f3a7d7f8d27acc6375cba42b5cc168d70fa0" is creating package revision ""
I0313 18:10:21.909806 1 packagevariant_controller.go:253] package variant "cachingdns-edge-1814fa6e4e19c2507662a33a34990cc2aa10d90c" is creating package revision ""
I0313 18:10:30.526326 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central2-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central2-regional" "namespace"="default" "reconcileID"="0c0e5ca6-d81b-4071-b4dc-33bdc8394fa5"
I0313 18:10:31.975924 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:10:41.585061 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-02" "namespace"="default" "reconcileID"="cf84b7ab-acca-452e-925f-4356fd6c30a4"
I0313 18:10:42.007707 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2f8615dd1c070224361d0837bbeb825c7306a223" is creating package revision ""
I0313 18:10:44.245933 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"nephio-packages","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="nephio-packages" "namespace"="default" "reconcileID"="129d4337-3db7-4018-8b45-0c971b72c71c"
I0313 18:10:51.998386 1 packagevariant_controller.go:253] package variant "cachingdns-edge-3db6d6fd4034d91b43cfba1b3f214b338dd2c13e" is creating package revision ""
I0313 18:11:02.268616 1 packagevariant_controller.go:253] package variant "cachingdns-edge-44f604043046c915ea89667128b276b9c03211b7" is creating package revision ""
I0313 18:11:11.992835 1 packagevariant_controller.go:253] package variant "cachingdns-edge-6b3bac48e67223051e4e47b5c52095eda9c1ee35" is creating package revision ""
I0313 18:11:18.030204 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-edge-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-edge-02" "namespace"="default" "reconcileID"="dde34ef7-3f6a-48f3-af4f-38184fd0e6c8"
I0313 18:11:21.884452 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
I0313 18:11:22.416078 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"nephio-testorg-packages","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="nephio-testorg-packages" "namespace"="default" "reconcileID"="3fd1ddd7-3d3d-4b18-8a98-443b035933a3"
E0313 18:11:31.180325 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="c1fabba7-7482-436f-8d27-04cea22f71f6"
I0313 18:11:31.180555 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-aa744beda50aeca1e21e30a4f051925feb1a2ce1" is creating package revision ""
I0313 18:11:41.025162 1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:11:50.510744 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="6b9044c6-7070-4735-bb06-fa93d9a6bc1f"
I0313 18:11:50.511850 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:12:00.786544 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
E0313 18:12:10.181175 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="7a08c516-531d-4d55-b139-fe3c4ce8606a"
I0313 18:12:10.182091 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-aa744beda50aeca1e21e30a4f051925feb1a2ce1" is creating package revision ""
I0313 18:12:20.403966 1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:12:29.799489 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="f811d6ad-0252-4bb2-8c80-1b36ab3eaa8b"
I0313 18:12:29.802730 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
E0313 18:12:38.994049 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="7d67d989-9941-4362-bc42-3c19f8730815"
I0313 18:12:38.995388 1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:12:48.283880 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="71340528-3b30-49bb-be60-0706831204bf"
I0313 18:12:48.285383 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
E0313 18:12:57.990042 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="fc1017fa-27db-4a34-9487-505718fc1c77"
I0313 18:12:57.993438 1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:13:07.700514 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="97c47e8c-4a04-4e1b-9aff-72c116fc25b8"
I0313 18:13:07.701225 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-aa744beda50aeca1e21e30a4f051925feb1a2ce1" is creating package revision ""
I0313 18:13:17.589477 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:13:27.700614 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
E0313 18:13:37.182208 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="610b2441-ffd1-46cd-acaf-ee7a3006b1b6"
I0313 18:13:37.182712 1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:13:46.584854 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="09a1e98c-85b1-4772-8bfb-862c7d4e677c"
I0313 18:13:46.588913 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
E0313 18:13:56.038509 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="a2741d08-9984-45f3-abe4-57c6798dd565"
I0313 18:13:56.039314 1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:14:05.681003 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="15b2c4b1-957e-4e6e-b64f-ae30653e02c9"
I0313 18:14:05.682192 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-aa744beda50aeca1e21e30a4f051925feb1a2ce1" is creating package revision ""
I0313 18:14:15.709650 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:14:25.978518 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
E0313 18:14:35.371404 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="6460b061-222e-43c3-b6d1-f10d56fd6a36"
I0313 18:14:35.371877 1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:14:43.783172 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="2f9b1338-23e4-4cfd-8f31-1fd88845f68b"
I0313 18:14:43.785518 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
E0313 18:14:51.772747 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="40c142a3-661f-4ffe-8f81-5b1e238e6435"
I0313 18:14:51.773487 1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:15:01.142179 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="82bf21be-a174-41b3-bf31-d1c4d2e6680e"
I0313 18:15:01.143387 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:15:11.200652 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
I0313 18:15:13.294087 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-regional-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-regional-02" "namespace"="default" "reconcileID"="c6c69bf3-01cf-46dc-85bc-f672019bb8ad"
I0313 18:15:20.237704 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-regional" "namespace"="default" "reconcileID"="9c345fe5-262f-4807-870f-7ce4e47bd8ea"
E0313 18:15:20.475467 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="eda96f7e-2b2e-437e-a0c3-5e75f14ce4da"
I0313 18:15:20.477324 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-aa744beda50aeca1e21e30a4f051925feb1a2ce1" is creating package revision ""
I0313 18:15:30.487326 1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:15:39.772774 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="ed931adc-34e3-42b0-b684-f1842acb9a8e"
I0313 18:15:39.773820 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
E0313 18:15:49.025821 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="5c944675-8302-4ee8-afb5-3296568e66ad"
I0313 18:15:49.035235 1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:15:58.474383 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="b3b38364-36e4-4ea4-a273-61308bae19f7"
I0313 18:15:58.474780 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:16:08.588304 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
E0313 18:16:17.828625 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="2d591c43-7494-470c-9de0-c2cfb54bb9a5"
I0313 18:16:17.830169 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-aa744beda50aeca1e21e30a4f051925feb1a2ce1" is creating package revision ""
I0313 18:16:27.759115 1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:16:36.981095 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="ac415013-9961-4654-8066-fcc261f0ac70"
I0313 18:16:36.982267 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
E0313 18:16:46.274411 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="c82b8d89-33da-472a-84b4-9a685bcc28a3"
I0313 18:16:46.275259 1 packagevariant_controller.go:391] package variant "cachingdns-distribution-0217939f628bf54afb6943a0627f3d09fe742e9d" is deleting package revision "us-central1-edge-01-18eaa9e70fb515c8ba059c1845dc086e199bc971"
I0313 18:16:47.140224 1 packagevariant_controller.go:391] package variant "cachingdns-distribution-aa744beda50aeca1e21e30a4f051925feb1a2ce1" is deleting package revision "us-central1-edge-02-fc7423180fca156fb104e1dfce5f5b376e1c502d"
I0313 18:16:48.242993 1 packagevariant_controller.go:391] package variant "cachingdns-distribution-d03b4237896078449f4eefd10654a507dc05a5c2" is deleting package revision "us-east1-edge-02-7f8f17797d33b8b2c9e962dfde19f66f82080873"
I0313 18:16:49.070429 1 packagevariant_controller.go:391] package variant "cachingdns-edge-6b3bac48e67223051e4e47b5c52095eda9c1ee35" is deleting package revision "us-east1-edge-01-459f97554e7a1551072260a0bc616f6c4e9f7968"
I0313 18:16:49.452010 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-01" "namespace"="default" "reconcileID"="e56eea43-c435-4b78-97ae-dcf7086ead8a"
I0313 18:16:49.977931 1 packagevariant_controller.go:391] package variant "cachingdns-distribution-52cb15c06dc9252e966897bde315bc6b2e06af4f" is deleting package revision "us-east1-regional-01-72d397520036dd95fd49d60589b7a76edab5709e"
I0313 18:16:50.824240 1 packagevariant_controller.go:391] package variant "cachingdns-edge-1814fa6e4e19c2507662a33a34990cc2aa10d90c" is deleting package revision "us-central2-regional-61337a26846b08673db6f1dda9a0c2b400d7d530"
I0313 18:16:51.771041 1 packagevariant_controller.go:391] package variant "cachingdns-distribution-aa0bd84da557680b052811b54e528625c13907cf" is deleting package revision "us-east2-regional-183271f74d1feed2ffe5058c938945067b2c8559"
I0313 18:16:52.973381 1 packagevariant_controller.go:391] package variant "cachingdns-edge-596ce7b3b682f6eb284d7c1aec74aaaf179ad834" is deleting package revision "us-central1-edge-01-fc057482816768663fef81c4e5252856a632751d"
I0313 18:16:55.073200 1 packagevariant_controller.go:391] package variant "cachingdns-distribution-3474f7e88ab1a657f0f8789641859c5496138bbb" is deleting package revision "us-east1-edge-01-c33d6160bdbc87f50862314263c6b66b0c942c87"
I0313 18:16:56.292847 1 packagevariant_controller.go:391] package variant "cachingdns-edge-edf34f330bd64333cb936090fb4682e1d84f0159" is deleting package revision "us-east1-edge-02-2b0efaed7ac3998524a8b01e968a5c29843d5cf4"
I0313 18:16:57.131006 1 packagevariant_controller.go:391] package variant "cachingdns-distribution-1e718cfbdb754e386474da9aa91bd159ed27c6d7" is deleting package revision "us-central1-regional-92794a396633223eff36ed41701210b6e319d5f5"
I0313 18:16:57.926144 1 packagevariant_controller.go:391] package variant "cachingdns-edge-81efd5d48a18a6c3e5375dbae96e483f65afd166" is deleting package revision "nephio-testorg-packages-2b25be17935446aa51259603f04aea26c7395c83"
I0313 18:16:59.023316 1 packagevariant_controller.go:391] package variant "cachingdns-edge-3db6d6fd4034d91b43cfba1b3f214b338dd2c13e" is deleting package revision "us-east1-regional-01-fc3ae4127a352016fafdf217432c0e9911bef5c0"
I0313 18:16:59.718494 1 packagevariant_controller.go:391] package variant "cachingdns-edge-2f8615dd1c070224361d0837bbeb825c7306a223" is deleting package revision "us-central1-regional-a55b2dc3b9eb8166391ec9c982af4dbbab110ab4"
E0313 18:16:59.770018 1 controller.go:326] "msg"="Reconciler error" "error"="packagevariants.config.porch.kpt.dev \"cachingdns-edge-3db6d6fd4034d91b43cfba1b3f214b338dd2c13e\" not found" "PackageVariantSet"={"name":"cachingdns-edge","namespace":"default"} "controller"="packagevariantset" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariantSet" "name"="cachingdns-edge" "namespace"="default" "reconcileID"="7c5c08e6-7b90-4f49-9ea4-e336e7839eea"
I0313 18:17:00.574814 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:17:10.384451 1 packagevariant_controller.go:391] package variant "cachingdns-edge-44f604043046c915ea89667128b276b9c03211b7" is deleting package revision "us-central1-edge-03-e01e67636b8d845b321a650a3423d07b9881b97c"
I0313 18:17:11.386012 1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:17:20.695144 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="9bc23df4-849c-4994-8249-dcad2985c7ed"
I0313 18:17:20.695408 1 packagevariant_controller.go:391] package variant "cachingdns-edge-3cc7f3a7d7f8d27acc6375cba42b5cc168d70fa0" is deleting package revision "us-central1-edge-04-fc22f957113a122cf04158b8dfe079c9f7503e99"
I0313 18:17:21.535146 1 packagevariant_controller.go:391] package variant "cachingdns-edge-d2e51383eec3a112e1eff888b8b7d79f2666dd70" is deleting package revision "us-east2-regional-1da781a462c2da7a456724f78b95f8f4309ccb83"
I0313 18:17:22.493557 1 packagevariant_controller.go:391] package variant "cachingdns-distribution-3db2beebe861a3635cb29dbc0b2796831b45e722" is deleting package revision "us-central1-edge-04-47c74857b5973ac840a3f6e03633e869ccf896d7"
I0313 18:17:23.288718 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
E0313 18:17:31.193941 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="4afaf6ee-fd59-4b25-9fc8-c26bd25d191c"
I0313 18:17:31.194794 1 packagevariant_controller.go:391] package variant "cachingdns-distribution-e70d94512a16274168e15bf45a4bd4af16a81af4" is deleting package revision "nephio-testorg-packages-b8a77c9291ed23c13374d15c95701290bca620c4"
I0313 18:17:32.628761 1 packagevariant_controller.go:391] package variant "cachingdns-distribution-d1579cce150353b437bdaa9845702b33f0900cdc" is deleting package revision "us-central2-regional-322bcb84ae8a8a6ddd40513f3a2bb55f99b3f75a"
I0313 18:17:33.394270 1 packagevariant_controller.go:391] package variant "cachingdns-distribution-54154c218b775b84e280258f12f684c813e76c49" is deleting package revision "us-east1-regional-02-bed387c8e383e4c20355bcb496811b300b3da653"
I0313 18:17:34.136121 1 packagevariant_controller.go:391] package variant "cachingdns-edge-5fa03feb18a7c84b9d679feaf238fa30b77d0367" is deleting package revision "us-east1-regional-02-427451728a9ccc67eb4bd3016f31cdfbc975a0d8"
I0313 18:17:35.031853 1 packagevariant_controller.go:391] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is deleting package revision "us-central1-edge-02-84ac1ac174d3be6eb56f8954660663b0250d0683"
I0313 18:17:35.812539 1 packagevariant_controller.go:391] package variant "cachingdns-distribution-da1f6e67333a94395f762b408610024a06551cf6" is deleting package revision "us-central1-edge-03-f160e46929543bb0d37d4629e3588c3452028082"
I0313 18:17:36.524061 1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:17:45.996465 1 controller.go:326] "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="71c166ed-13c1-48ce-bfc3-1c2194691b9f"
I0313 18:17:45.996882 1 packagevariant_controller.go:253] package variant "cachingdns-edge-3cc7f3a7d7f8d27acc6375cba42b5cc168d70fa0" is creating package revision ""
I0313 18:17:56.478325 1 packagevariant_controller.go:391] package variant "cachingdns-edge-3cc7f3a7d7f8d27acc6375cba42b5cc168d70fa0" is deleting package revision "us-central1-edge-04-fc22f957113a122cf04158b8dfe079c9f7503e99"
I0313 18:17:57.320978 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-d1579cce150353b437bdaa9845702b33f0900cdc" is creating package revision ""
I0313 18:18:07.281718 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-54154c218b775b84e280258f12f684c813e76c49" is creating package revision ""
I0313 18:18:17.067967 1 packagevariant_controller.go:253] package variant "cachingdns-edge-6b3bac48e67223051e4e47b5c52095eda9c1ee35" is creating package revision ""
I0313 18:18:27.113790 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-52cb15c06dc9252e966897bde315bc6b2e06af4f" is creating package revision ""
I0313 18:18:37.056430 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-aa0bd84da557680b052811b54e528625c13907cf" is creating package revision ""
I0313 18:18:48.458300 1 packagevariant_controller.go:253] package variant "cachingdns-edge-596ce7b3b682f6eb284d7c1aec74aaaf179ad834" is creating package revision ""
I0313 18:18:58.562309 1 packagevariant_controller.go:253] package variant "cachingdns-edge-edf34f330bd64333cb936090fb4682e1d84f0159" is creating package revision ""
I0313 18:19:08.377007 1 packagevariant_controller.go:253] package variant "cachingdns-distribution-1e718cfbdb754e386474da9aa91bd159ed27c6d7" is creating package revision ""
I0313 18:19:18.254919 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:19:28.022432 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-regional-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-regional-01" "namespace"="default" "reconcileID"="5f08843b-2a21-4172-8a0d-49b3926d4ce7"
I0313 18:19:28.422466 1 packagevariant_controller.go:253] package variant "cachingdns-edge-44f604043046c915ea89667128b276b9c03211b7" is creating package revision ""
I0313 18:19:38.669921 1 packagevariant_controller.go:253] package variant "cachingdns-edge-3cc7f3a7d7f8d27acc6375cba42b5cc168d70fa0" is creating package revision ""
I0313 18:19:52.092301 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:20:27.160086 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-04","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-04" "namespace"="default" "reconcileID"="e0658d80-0b2c-430c-bbd7-99a4da182ead"
I0313 18:20:52.391453 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:21:55.397122 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:22:53.081726 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:22:54.849554 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-03","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-03" "namespace"="default" "reconcileID"="7cfcb47b-5afe-4b9a-9b46-dafb1d8db709"
I0313 18:23:53.573213 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:24:23.836150 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-edge-01" "namespace"="default" "reconcileID"="1d20f65c-0438-4b70-b4bb-354e018528f6"
I0313 18:24:52.784016 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:25:33.942958 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east2-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east2-regional" "namespace"="default" "reconcileID"="bd8d0c4e-75ae-4319-b006-14574bd67047"
I0313 18:25:41.527282 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central2-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central2-regional" "namespace"="default" "reconcileID"="f6c65967-ff2d-436a-9e0e-b4c778344544"
I0313 18:25:52.783944 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:26:15.585856 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-02" "namespace"="default" "reconcileID"="7d14dca4-83f0-4530-b8fd-d6da5c048518"
I0313 18:26:19.246354 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"nephio-packages","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="nephio-packages" "namespace"="default" "reconcileID"="3d99ac7f-b767-4117-b1b8-f856d3aea33d"
I0313 18:26:29.031070 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-edge-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-edge-02" "namespace"="default" "reconcileID"="92107336-1f94-4ee3-a9b1-292b77eae0e6"
I0313 18:26:48.416481 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"nephio-testorg-packages","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="nephio-testorg-packages" "namespace"="default" "reconcileID"="496ad545-da7d-4d77-b3c5-7733884a8108"
I0313 18:26:53.286102 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:27:53.280878 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:28:53.571858 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:29:52.998968 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:30:52.250602 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-regional" "namespace"="default" "reconcileID"="a61795d8-0eef-4a6b-9f0d-be20cbe36374"
I0313 18:30:53.295560 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-regional-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-regional-02" "namespace"="default" "reconcileID"="08622e55-b16a-46e1-808b-d5086bb9d150"
I0313 18:30:53.477016 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:31:52.328034 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:32:22.453643 1 oci.go:39] "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-01" "namespace"="default" "reconcileID"="9bb4c401-dac7-45f5-a501-ad6dbe3088e0"
I0313 18:32:59.794208 1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
Steps to reproduce the behavior
Weirdly, the long list of bogus packages does NOT appear here in the screenshot of the GUI, but it does appear in the CLI output in #3877 - @ChristopherFry why would the GUI show different packages than the CLI?
(By "bogus" I am referring to the "extra created" ones, not the "not deleted" one....but maybe it's related?)
I deleted the PackageVariantSets, it deleted the packagevariants, but am seeing failures during delete - I am wondering if GitHub is rate limiting me:
I0314 17:21:02.896440 1 packagevariant_controller.go:391] package variant "cachingdns-distribution-d1579cce150353b437bdaa9845702b33f0900cdc" is deleting package revision "us-central2-regional-322bcb84ae8a8a6ddd40513f3a2bb55f99b3f75a"
E0314 17:21:36.981660 1 packagevariant_controller.go:447] error deleting package revision: Timeout: request did not complete within requested timeout - context deadline exceeded
I0314 17:21:37.004845 1 packagevariant_controller.go:391] package variant "cachingdns-distribution-aa0bd84da557680b052811b54e528625c13907cf" is deleting package revision "us-east2-regional-183271f74d1feed2ffe5058c938945067b2c8559"
E0314 17:22:11.174918 1 packagevariant_controller.go:447] error deleting package revision: Timeout: request did not complete within requested timeout - context deadline exceeded
I0314 17:22:11.202134 1 packagevariant_controller.go:391] package variant "cachingdns-distribution-54154c218b775b84e280258f12f684c813e76c49" is deleting package revision "us-east1-regional-02-bed387c8e383e4c20355bcb496811b300b3da653"
E0314 17:22:45.389736 1 packagevariant_controller.go:447] error deleting package revision: Timeout: request did not complete within requested timeout - context deadline exceeded
I0314 17:22:45.424858 1 packagevariant_controller.go:391] package variant "cachingdns-distribution-1e718cfbdb754e386474da9aa91bd159ed27c6d7" is deleting package revision "us-central1-regional-92794a396633223eff36ed41701210b6e319d5f5"
E0314 17:23:19.579428 1 packagevariant_controller.go:447] error deleting package revision: Timeout: request did not complete within requested timeout - context deadline exceeded
The branches still exist in GH. Shouldn't the finalizer prevent deletion of the PackageVariant until the branch is cleaned up?
Weirdly, the long list of bogus packages does NOT appear here in the screenshot of the GUI, but it does appear in the CLI output in https://github.com/GoogleContainerTools/kpt/issues/3877 - @ChristopherFry why would the GUI show different packages than the CLI?
When the UI displays the list of packages, it aggregates the package revisions by package name (in addition to repository name), so this is causing the difference in packages listed in the CLI and UI.
For example, looking at the CLI output from https://github.com/GoogleContainerTools/kpt/issues/3877#issue-1622062863 (snippet below), the UI would aggregate these into a single row when viewing deployment packages since all these package revisions share the same package name (cachingdns-distribution) for the same repository (us-central1-edge-02).
jbelamaric@jbelamaric:~/proj/tmp/cachingdns-topology$ kpt alpha rpkg get | grep packagevariant
...
us-central1-edge-02-06a45d5516402094e3150d7fd24ae5ab857a2cf2 cachingdns-distribution packagevariant-4 false Draft us-central1-edge-02
us-central1-edge-02-3df1fdf1ccfd97e68b3bf998220c3a2948b10e01 cachingdns-distribution packagevariant-6 false Draft us-central1-edge-02
us-central1-edge-02-93594975a009c248ddf9dd362d7cdd5e5ff6e0e5 cachingdns-distribution packagevariant-2 false Draft us-central1-edge-02
us-central1-edge-02-9f4cb6e8866d95d3fe3d1ab30b2ddf70621005e8 cachingdns-distribution packagevariant-5 false Draft us-central1-edge-02
us-central1-edge-02-d3b22ec4000657ed8ce88ffc6d7551ba4561c101 cachingdns-distribution packagevariant-3 false Draft us-central1-edge-02
us-central1-edge-02-f399f895cabbe912a980f5428a88b4720d9b583e cachingdns-distribution packagevariant-1 false Draft us-central1-edge-02
...
@johnbelamaric Do you happen to have the logs from porch-server when this happened? I would expect there to be some error there that might explain why the deletion timed out.
There unfortunately isn't an easy way to rely on finalizers for waiting until the branch is deleted. This happens in the aggregated APIServer, so it happens synchronously during the delete request. Ideally we should handle this in a controller so we can do it asynchronously. Moving to CRDs for PackageRevision would allow us to do this: https://github.com/GoogleContainerTools/kpt/issues/3630
I don't have the raw logs anymore but I will share them with you on Cloud Logging.
So the reason these delete calls times out, is because they coincide with the Porch sync against git, which takes some time and holds a lock while it happens. But as far as I can tell from the logs, the request eventually goes through and it looks like the delete operation succeeded. Did the branches ever get deleted from git?
My previous comment was about relying on finalizers in porch for deletion, which is difficult with the aggregated apiserver. We should be able to rely on finalizers on packagevariant to make sure it doesn't get deleted until the underlying package has also been deleted.