Jarek Potiuk

Finaly :). RIGHT before a meetup where I will talk about CI/CD tests :)

Should we add description about it to https://github.com/apache/airflow/blob/main/contributing-docs/13_metadata_database_updates.rst ? I think that one needs a bit more love and describe the process of adding migration scripts in a bit more...

> Should this be an airflow command? I feel the end users probably never need this. It would fit better for this to be a breeze command instead, or just...

This is a very risky change if you have not thoroughly tested various configurations and I think it's for the worse on production systems. When you are using it on...

> Here are some benefits: > The maximum scheduling delay between two nodes is reduced from 10 seconds to less than 1 second. > System throughput increased by more than...

And I am not totally against it - I am just surprised to see such numbers on Linux. It's been running like that for years, so it would be interesting...

@hussein-awala > This pool executor is only used to execute short-running tasks, I don't think it will impact the memory usage, and I believe that this kind of objects (process/thread...

Also cc: @ashb @kaxil => maybe there is another reason why we are doing it this way for Celery Executor. I think this change has the potential to change resource...

> The above data is my running results in the Linux environment. If ProcessPoolExecutor is created every time, no problem will be seen at the beginning, but over time the...

And just to add a little bit of context - why I am surprised to see it .... It's not that I am stubborn. I just looked deeper: The current...