open-grid-emissions icon indicating copy to clipboard operation
open-grid-emissions copied to clipboard

Make pipeline work for pre-2019 data

Open gailin-p opened this issue 2 years ago • 1 comments

Where per-fuel type 930 data isn't available (before July 2018), should default to other hourly profile methods. This would allow the pipeline to work for older years

gailin-p avatar Jun 23 '22 20:06 gailin-p

Whenever we add new years of data, there are a few things we need to do:

  • Check whether the data to be downloaded uses the same url pattern as before
  • For any data not loaded from pudl, check that column names and positions are the same
  • Check any steps that involve manually updating data (any step that uses a table in data/manual/ to make sure they apply to each year
  • Run the full pipeline and examine any validation messages

grgmiller avatar Aug 16 '22 22:08 grgmiller