Jarek Potiuk
Jarek Potiuk
Approved to see.
Is this one redy to merge ? WDYT @malthe @mik-laj ?
> I am having exactly the same issue with my Airflow 2.5.1 Are you using the official chart that has the safeguards as mentioned in ? > The new liveness...
Yes. You need to run similar monitoring and restarting of Celery on your own. Liveness Probe runs periodicaly check if any component is responding and will restart it when it...
> @dstandish dude, it's passed about 30 minutes since after applying your solution. my celery worker was throwing `connection reset by peer.` errors and freezing very frequently, but now the...
> We could set those in the Helm Chart too ? Yeah. Good idea.
> I'd wait with the doc changes to see if celery 5.4.0 solves this problem from the root then we can simply bump version I think it depends if those...
And just to add a bit more context to the discussion. It's a known fact that a number of our users have some troubles with stability running Celery-based deployment. I...
And the new PR for "ack_late" - to complete the picture: https://github.com/apache/airflow/pull/37066
> What is the current status of this? Looking forward to the feature of having multiple dag folders within the helm chart. If you would like to contribute it @apinchuk1...