etl
etl copied to clipboard
A compute graph for loading and transforming OWID's data
Main issue https://github.com/owid/owid-issues/issues/1620
Needed by https://github.com/owid/etl/pull/3305
Enable editing of explorers on staging servers. - New staging servers create a branch in `owid-content` - Explorer steps in ETL commits to that branch on the staging server (previously...
Hey @Marigold - it looks like the data for suspected cases is base64 encoded in the [WHO Shiny App](https://worldhealthorg.shinyapps.io/mpx_global/#26_Case_definitions). I've had a go at extracting it here, but not sure...
Implements https://github.com/owid/etl/issues/3257 ## TODO - [x] `etlr cherry` is still failing on `ModuleNotFoundError: No module named 'owid'` - [x] migrate all packages in `lib/` - [ ] Add useful UV...
**NOTE: This PR should be closed without merging, once we receive feedback from USGS/BGS. Otherwise, we can simply close it from 2024-09-16 (when the minerals topic page will be published).**
## Problem Anecdotally, it seems like there's often a random failure in a staging server pipeline, but if you manually retry it on Buildkite it works. ## Expected behaviour We'd...