Gabe Wolofsky

icon company @CityofToronto icon location Toronto, Canada icon location Data Specialist at Toronto Transportation Services' Data Operations Team

Results 73 issues of Gabe Wolofsky

#1070 use `pre_execute` to reduce # of tasks in partition create taskgroups

## What this pull request accomplishes: - switch from using `@task.short_circuit` operators to `pre_execute` = reduces # of tasks for partition creates. - Originally intended to use `@task.run_if` which would...

Airflow

Use new Airflow 2.10.0's new `@run_if` task decorator in partition create statements

Airflow

1065 miovision stop aggregating bikes in crosswalk

## What this pull request accomplishes: - Make sure bikes in crosswalk and bike exits do not end up in aggregate tables (via intersection_movements) - Delete existing bikes in crosswalk...

Miovision