asif2017 comments

Repositories
Issues
Comments

Results 1 comments of


                                            asif2017

Airflow Core Parallelism set to 512 but still the tasks are running at max 32 task at a time.

Okay, I got the issue I have set it up the AIRFLOW_CORE_PARALLELISM but I was missing one more setting AIRFLOW__CELERY__WORKER_CONCURRENCY, which is by default 16 per worker. This needs to...