pypsa-eur
pypsa-eur copied to clipboard
Eurostat 2023 data for energy totals
Changes proposed in this Pull Request
Reads in the latest eurostat report from 2023 and uses it for building energy totals. Since the JRC IDEES data is only available for 2015, the energy balances are scaled by the factor of eurostat[report_year]/eurostat[2015] data as well. The latest swiss energy totals are added to ensure consistent energy totals.
To complement the PR, please add the eurostat data from 2023 to the zenodo data.
Missing is only the passenger car efficiency and the number of passenger cars that are initially in the JRC IDEES but not in the eurostat data set.
Comparison between 2023 and 2016 reports for the year 2013 show no difference except for Norway and Switzerland. energy_totals_comparison.csv
Checklist
- [x] I tested my contribution locally and it seems to work fine.
- [x] Code and workflow changes are sufficiently documented.
- [x] Changed dependencies are added to
envs/environment.yaml
. - [x] Changes in configuration options are added in all of
config.default.yaml
. - [x] Changes in configuration options are also documented in
doc/configtables/*.csv
. - [ ] A release note
doc/release_notes.rst
is added.
@toniseibold great! Just a few remarks:
- in the long-term we would like to move away from the Zenodo sector-bundle repository. Can you add to the
retrieve_sector_databundle.py
some lines which download the necessary files from Eurostat directly? - The new data set is still also containing the previous years and the UK, so there is no need to keep the old ones, right? This simplifies the script, you can use as an input only the new one an remove the
if-else
statement depending on which Eurostat input you use. - Can you do some comparison of the output files between previous Eurostat and the new?
- in the long-term we would like to move away from the Zenodo sector-bundle repository. Can you add to the
retrieve_sector_databundle.py
some lines which download the necessary files from Eurostat directly?
I think, a separate rule retrieve_eurostat
would be better to have a clear distinction
@toniseibold
Have you done some comparison of the output files between previous Eurostat and the new? Can you plot it here or confirm that the outputs are similar? The CI is failing for the script build_energy_totals.py
can you make sure that it is running through? It seems to be connected with the swiss data and the year 2019
Checked output of energy_totals.csv
before and after and value changes are in an acceptable range.