reach icon indicating copy to clipboard operation
reach copied to clipboard

Airflow: Have the PolicyDag write its results to a publicly accessible CDN

Open kristinenielsen opened this issue 5 years ago • 0 comments

Build plan

  • Add a step in Airflow to write the public datasets to a public CDN

Acceptance criteria

  • The data is publicly downloadable at a good rate

Alternatives considered

  • We already have this data publicly accessible in S3. We might consider it good enough, but it requires strong access control and it probably be better not to give away our buckets, where we also store non-public data

kristinenielsen avatar Jan 16 '20 13:01 kristinenielsen