Update NTD validation models for 2024 (Blackcat)

[erikamov]

User story / feature request

As an Analyst I want to use NTD validation models for 2024 data

Acceptance Criteria

Check if the models bellow are displaying data for the correct year (2024).

Intermediate models:

• cal-itp-data-infra.staging.int_ntd_a10_facilitiesdata
• cal-itp-data-infra.staging.int_ntd_rr20_financial_fare_revenues
• cal-itp-data-infra.staging.int_ntd_rr20_financial_specific_funds
• cal-itp-data-infra.staging.int_ntd_rr20_financial_total_exp
• cal-itp-data-infra.staging.int_ntd_rr20_service_1alldata
• cal-itp-data-infra.staging.int_ntd_rr20_service_3ratios_wide

Mart models:

• cal-itp-data-infra.mart_ntd_validation.fct_ntd_rr20_funds_checks
• cal-itp-data-infra.mart_ntd_validation.fct_ntd_rr20_service_checks

Models bellow are not in use anymore and can be dropped:

• cal-itp-data-infra.staging.stg_ntd_2022_rr20_exp_by_mode
• cal-itp-data-infra.staging.stg_ntd_2022_rr20_financial
• cal-itp-data-infra.staging.stg_ntd_2022_rr20_service

Notes

Process details and changes described on Deliverable 4 - NTD Data Orchestration Pipeline

Based on a conversation with Christian Suyat, some changes need to done for 2024:

• Add new columns on external_table_all_ntdreports.yml (need a list from him)
• Replace some hardcode years used a filters on the sql files or make them based on the current year and last year so we don't need to change it again in the future (example int_ntd_a10_facilitiesdata.sql)

Other related links: DAG, stg, int, mart models.