Airflow-on-Fargate
Airflow-on-Fargate copied to clipboard
Create SQS queue with CloudFormation
Hello,
It looks like you allow Celery to create SQS queue outside of CloudFormation stack. As for me it doesn't look good since you lose control towards the resource. Why don't you create the queue with CloudFormation and pass the url of the queue to Celery? I didn't find the information how to do that (like which parameters to use). Maybe you could show an example how to do that?
Thanks.
That’s a very valid point. I tried to find a way to pass existing SQS queue to Celery, but couldn’t find any, at that time. Looks like Celery added support for using Predefined queues. I'm bit occupied now, but will try to do some experiments, to make sure its working.
If you got some time to do so, send me a pull-request.
I might get a PR together for creating an elasticache with redis