etl

etl copied to clipboard

chart-sync: use more informative user name in approval tool

3

## Problem Currently, when a user uses the chart-sync, all charts modified in the source server are put in the queue of the chart approval tool under the user name...

lucasrodes

SSLError when running grapher steps

7

## Problem While working on [this branch](https://github.com/owid/etl/pull/2416), and running, e.g. `etl run faostat --grapher` I sometimes get the following error: ``` botocore.exceptions.SSLError: SSL validation failed for https://078fcdfed9955087315dd86792e71a7e.r2.cloudflarestorage.com/owid-api-staging/prosado/v1/indicators/831789.data.json [SSL: SSLV3_ALERT_BAD_RECORD_MAC] ssl/tls...

pabloarosado

List the main person(s) working in each ETL step

2

## Problem We currently have no easy way to know who has worked in a particular ETL step or grapher dataset. If, for example, something odd is found in the...

pabloarosado

✨owidle: add column headers

1

I have been enjoying exploring the etl tool and the owidle game lately. I have been sitting on these changes locally and thought to push them in case they are...

tristannew

⬆️ Bump black from 22.12.0 to 24.3.0 in /lib/walden

1

Bumps [black](https://github.com/psf/black) from 22.12.0 to 24.3.0. Release notes Sourced from black's releases. 24.3.0 Highlights This release is a milestone: it fixes Black's first CVE security vulnerability. If you run Black...

dependabot[bot]

🎉 Create function to import run from a previous version of a step

6

## Summary Create a helper function to import the `run` function from a previous version. This could let us avoid duplicating a lot of code, every time we update a...

pabloarosado

Skip chart revision for charts with identical data

2

## What Improve the chart revision flow by skipping charts that have no differences. ## Why? Why now? Currently, charts are queued up for manual review even when there are...

larsyencken

Nullable dtypes from Numpy have inconsistent behaviour

2

## Overview Pandas methods to handle missing data sometimes don't work correctly, if new-style nullable dtypes are being used. The problem is still present in Pandas 2.0.3. See: - https://github.com/pandas-dev/pandas/issues/49818...

larsyencken

One line command for detecting and enqueuing chart revisions

1

## Problem In some workflows, you do not have just one dataset that you are managing, you have a lot. In that case, it's a real hassle to use chart...

larsyencken

Add a maintainer field to the metadata

2

## Problem When we use the admin, it shows when indicators were last changed but not who changed them, which makes it more annoying to ask questions or follow up...

larsyencken