Jesse Bye
Jesse Bye
Hey @A-Hilaly , I can confirm what @brandonphan is saying. We are currently seeing this with sqs-controller v0.0.3. Logs are below. You can see at first it deletes and finalizes...
I've consistently observed this with SQS controller. I have a suspicion it's happened with other controllers too, but don't have enough data to confirm that. @brandonphan probably has a better...
@jaypipes one additional thing to note, we often tear down dozens of queues all at once. That's typically when I observe this problem - so maybe some kind of race...
@A-Hilaly I checked but we only have one replica for each AWS controller we are using. We are using the Helm charts provided in the repos with no overrides.
@A-Hilaly I was wondering if there might be a simple solution to this. In the resource manager `Delete` function, could it check the error and *only* if the error is...
Yeah, it's being very difficult to reproduce. If I create/delete ~100 queues in sequence, it won't happen. However, if I create the queues from a Helm chart, then uninstall the...
@A-Hilaly looks like the correct code is `sqs.ErrCodeQueueDoesNotExist`
I'll give it my best shot too and will let you know if I find a way to reproduce it reliably.
Something just occurred to me. We use DLQs with many of our queues. When we create queues, we create them all simultaneously; queue and associated DLQ. The queue fails to...
Ok, I've been creating sets of 1,500 queues and tearing them down, all in parallel, using Helm... still no errors. *THEN* I created 15 ArgoCD applications with the same Helm...