Jarek Potiuk
Jarek Potiuk
> I read the discussion and thank you for the discussion, it was illuminating for me :) > As far as I understand, there is no need for this implementation...
Assigned both of you know - I guess if no response is heard soon, feel free to work on it @jeff3071 -> in the end you can merge the solutions...
Checked my changes, verifided the installation. The new chart install airflow 3.0.2 nicely wiht default settings.
Yes. That's exactly how I envisioned solving this problem. @dstandish ?
FYI. Breaking changes to FileTaskHandler is not a problem - we can work out back-compatibility or simply break it for Airflow 3 - this is not a big deal, since...
Sure. It can be separate set of PRs and that issue can remain "umbrella" - you do not need to have more issues. PRs are enough
> IIRC this should be fine when task done but may present challenges when task is in flight because at any moment the location of the logs may shift eg...
> Taking S3TaskHandler as an example, it requires additional refactoring and might need a read_stream method added to S3Hook that returns a generator-based result: https://github.com/apache/airflow/blob/main/providers/src/airflow/providers/amazon/aws/log/s3_task_handler.py#L136-L192 > From my perspective, for...
Rebased after we fixed main issue
Applied and closed/reopened to trigger the build