Problem Statement

The fda_enforcement airflow DAG fails. I suspect something about the data format changed, but haven't been able to figure it out. The problem can be traced to an error in the transform-staging task. Maybe someone else has more insight?

For reference, I'm attaching my log file.

This is due to an ndc column not existing in the raw data. I did change this data source recently - which might have something to do with it: #214

The actual error is happening in my macro ndc_format.sql - but the real reason it's erroring is that an ndc column doesn't exist at all. See screenshot below.