etl
etl copied to clipboard
A compute graph for loading and transforming OWID's data
### One-liner We have multiple tools in `etl` and `owid.catalog` ready to be used, but they are not visible to users. ### Context & details As we develop and add...
## Suggested improvements * [x] Switch server destruction from 1 day to 3 days * [x] Improve WARNING if chart has been updated on live - We could at least...
## What - Capture the ETL output for each branch build in `data-catalog` - On ETL change, identify the common commit with `master` and diff against that ## Why? Why...
## What When a PR body says "No data changes expected", make the data diff check strict (i.e. fail with a red cross on any differences). ## Why / Why...
Bumps [fastapi](https://github.com/tiangolo/fastapi) from 0.109.0 to 0.109.1. Release notes Sourced from fastapi's releases. 0.109.1 Security fixes ⬆️ Upgrade minimum version of python-multipart to >=0.0.7 to fix a vulnerability when using form...
Suggested improvements: * [ ] Move datadiff to automated staging server which would give it persistence (and a new commit wouldn't be rebuilding everything from scratch) * [ ] Efficiently...
## Context - We currently propagate and merge some/many metadata fields when you do common operations between `Table` columns - Since then, we have added more fields, and these do...
[← 2023](https://github.com/owid/etl/issues/1285) | [↑ Engineering](https://github.com/owid/engineering/issues/39) ## 2024 Q1 - [x] #1964 - [x] Support editing metadata from the Grapher admin - [x] https://github.com/owid/owid-issues/issues/1365 - [x] https://github.com/owid/etl/pull/2328 ## 2024 Q2 -...
## Sub-tasks - #525 - #546 - #509
getting attention to countries by the news (The Guardian)