reach
reach copied to clipboard
Airflow: Have the PolicyDag write its results to a publicly accessible CDN
Build plan
- Add a step in Airflow to write the public datasets to a public CDN
Acceptance criteria
- The data is publicly downloadable at a good rate
Alternatives considered
- We already have this data publicly accessible in S3. We might consider it good enough, but it requires strong access control and it probably be better not to give away our buckets, where we also store non-public data