airflow icon indicating copy to clipboard operation
airflow copied to clipboard

openlineage: use `ProcessPoolExecutor` over `ThreadPoolExecutor`.

Open JDarDagran opened this issue 1 year ago • 0 comments


This may possibly fix #39232. I tested the solution many times locally and deployed in Astro Cloud (so it gives me quite certainty it works).

I don't really know how to write tests for the change (load test is the thing but do we do this in regular tests?). Some guidance would be very much helpful.

JDarDagran avatar Apr 24 '24 14:04 JDarDagran