sqlmesh icon indicating copy to clipboard operation
sqlmesh copied to clipboard

Application plan in airflow is broken

Open serkef opened this issue 8 months ago • 3 comments

When I apply some changes in multiple models, the application plan is broken. Some expected tasks are missing and the tasks are not in the correct order. This affects the correctness of the data. I haven't managed to create a small reproduction of this, but I've met it multiple times across 0.101 and 0.104 versions.

Here I changed all my models' types to be incremental by partition instead of date (new model kind supporting bq). The DAG is wrong. Most of the models are missing snapshots and task dependency is wrong. image image

serkef avatar Jun 17 '24 15:06 serkef