open-grid-emissions
open-grid-emissions copied to clipboard
Fix EIA-923 Allocation Error
When running the 2021 data pipeline with our new data validation checks, the following warning is raised:
2023-06-09 17:39:24,002 [WARNING] oge.validation:78 Allocated EIA-923 doesn't match input data for plants:
2023-06-09 17:39:24,002 [WARNING] oge.validation:79 Percentage Difference:
2023-06-09 17:39:24,004 [WARNING] oge.validation:80
net_generation_mwh fuel_consumed_mmbtu fuel_consumed_for_electricity_mmbtu
plant_id_eia
1206 -0.001076 -0.002514 -0.002514
1316 0.023964 0.000000 0.000000
52148 -0.000151 -0.000023 -0.000111
54224 -0.000207 -0.000113 -0.000161
54967 -1.000000 -1.000000 -1.000000
58256 0.411966 0.000000 0.000000
59260 -0.475486 -0.475496 -0.475496
59825 -1.000000 -1.000000 -1.000000
63098 -1.000000 -1.000000 -1.000000
2023-06-09 17:39:24,004 [WARNING] oge.validation:81 EIA-923 Input Totals:
2023-06-09 17:39:24,006 [WARNING] oge.validation:82
net_generation_mwh fuel_consumed_mmbtu fuel_consumed_for_electricity_mmbtu
plant_id_eia
1206 56313.000 493763.0 493763.0
1316 2003.000 32704.0 32704.0
52148 10585.000 779330.0 62793.0
54224 72122.771 1329124.0 409850.0
54967 1.960 24.0 24.0
58256 585.000 7304.0 7304.0
59260 1760.000 28873.0 28873.0
59825 9539.000 84354.0 84354.0
63098 1.000 6.0 6.0
2023-06-09 17:39:24,006 [WARNING] oge.validation:85 Allocated Totals:
2023-06-09 17:39:24,008 [WARNING] oge.validation:86
net_generation_mwh fuel_consumed_mmbtu fuel_consumed_for_electricity_mmbtu
plant_id_eia
1206 56252.431817 4.925215e+05 492521.524247
1316 2051.000000 3.270400e+04 32704.000000
52148 10583.399000 7.793120e+05 62786.000000
54224 72107.811000 1.328974e+06 409784.000000
54967 0.000000 0.000000e+00 0.000000
58256 826.000000 7.304000e+03 7304.000000
59260 923.144000 1.514400e+04 15144.000000
59825 0.000000 0.000000e+00 0.000000
63098 0.000000 0.000000e+00 0.000000
Some of these might be due to rounding errors, but there are several plants where a large portion of fuel generation (or all fuel/generation) is disappearing somewhere in the allocation process.
It may be worth updating our dependencies first to see if/how this issue changes. It is possible this may be a bug somewhere in the pudl code.