Updating manual tables

[grgmiller]

The data/manual folder contains several manual tables. This issue describes how each of these are updated

• ba_reference: update using manually_update_ba_reference.ipynb. Could be updated on a quarterly basis
  • Check https://www.ferc.gov/power-sales-and-markets/electric-quarterly-reports-eqr and look for the "Allowable Entries for Balancing Authorities and Hubs". The most recent file uploaded as of 12/8/2023 is https://www.ferc.gov/sites/default/files/2020-05/allowable-entries1_0.xls
  • Also check the EIA-930 data reference tables and List of Balancing Authorities posted on https://www.eia.gov/electricity/gridmonitor/about
• default_gross_to_net_ratios.csv: Check the EIA Electric Power Monthly Technical Notes (Appendix C)
• eGRID2020_crosswalk_of_EIA_ID_to_EPA_ID.csv: check table C-5 of the eGRID technical guide
• emission_factors_for_co2_ch4_n2o: triggered by updates to EPA AP-42 or IPCC
• emission_factors_for_nox: triggered by updates to EPA AP-42 or IPCC
• emission_factors_for_so2: triggered by updates to EPA AP-42 or IPCC
• energy_source_groups: check fuel categories used by EIA-930 and eGRID each year. Also check all fuel codes in the EIA-923 and EIA-860 tables. Check https://catalystcoop-pudl.readthedocs.io/en/latest/data_dictionaries/codes_and_labels.html#energy-sources-eia
• epa_eia_crosswalk_manual: run manually_identify_crosswalk_updates. Check updates to PSDC.
• geothermal_emission_factors: Triggered by updates to AP-42 or IPCC
• ipcc_gwp: Triggered by release of new IPCC Assessment Report every few years. AR6 released in 2021, AR7 not expected until 2027
• physical_ba: check transmission_distribution_owner_name each year
• plants_not_connected_to_grid: Check PSDC and eGRID
• steam_units_to_remove: Check if there are any plant_id_epa in CEMS that do not map to EIA and only report steam
• updated_oth_energy_source_codes: run manually_update_OTH_fuel_code and check for plants with OTH fuel code
• utility_name_ba_code_map: check for utility names that are not mapped to a ba code

[grgmiller]

2022 Update:

• [x] ba_reference: no update to the FERC table, new retirements of GLHB and GRIF according to EIA
• [x] default_gross_to_net_ratios.csv: No updates
• [x] eGRID2020_crosswalk_of_EIA_ID_to_EPA_ID.csv: updated based on eGRID2021. One new plant added to list
• [x] emission_factors_for_co2_ch4_n2o: No updates to AP-42 or IPCC
• [x] emission_factors_for_nox: No updates to AP-42 or IPCC
• [x] emission_factors_for_so2: No updates to AP-42 or IPCC
• [x] energy_source_groups: no changes based on pudl metadata
• [x] epa_eia_crosswalk_manual:
• [x] geothermal_emission_factors: no changes to source data
• [x] ipcc_gwp: most current report is still AR6
• [ ] physical_ba
• [x] plants_not_connected_to_grid: no changes based on eGRID2021
• [ ] steam_units_to_remove:
• [x] updated_oth_energy_source_codes: ran notebook, no new matches needed
• [x] utility_name_ba_code_map: ran notebook, added several new maps

[grgmiller]

When updating NOx and SO2 factors:

• Always use the lowest of like values to be conservative
• All parts of a combined cycle turbine should use the combustion turbine factors