osemosys_global icon indicating copy to clipboard operation
osemosys_global copied to clipboard

Is there a way to quickly prepare data in SAND for use in OSeMOSYS Global?

Open williamrodz opened this issue 1 year ago • 4 comments

Idea

We have a lot of Thailand scenario data in SAND excel files. We'd love to run these scenarios within the OSeMOSYS Global framework. Is there a way to quickly transform data for use in OSeMOSYS Global?

Thank you for the wisdom!

Is your feature related to a bug?

No response

Suggested Soltuion

An "import" command or GUI interface through the dashboard that allows you to choose SAND data and output neatly into a results/<SCENARIO>/data folder

Additional Info

No response

williamrodz avatar Apr 10 '24 10:04 williamrodz

Hi @williamrodz; thanks for the question!

To clarify, your workflow would include the following:

  1. Generate input data for Thailand and a few surrounding regions/countries using OSeMOSYS Global
  2. Replace the OSeMOSYS Global Thailand data with your Thailand data
  3. Use OSeMOSYS Global to solve the model (with updated Thailand data) and visualize the results

trevorb1 avatar Apr 10 '24 19:04 trevorb1

@javiermm15 is working on a script that can take otoole compatible csvs for a country model and ingest the information into an OSeMOSYS Global data set based on a config file indicating which parameters map. Not quite public yet, but should be published soon.

When that's published, if the SAND files can be converted to otoole compatible csvs then it'd be possible to ingest the SAND data with an appropriate mapping config file.

tniet avatar Jun 03 '24 18:06 tniet

@tniet @trevorb1 Any updates on this?

maartenbrinkerink avatar Sep 02 '24 20:09 maartenbrinkerink

@maartenbrinkerink There is a different work stream that converts SAND files into otoole format. However, Im not sure off the top of my head the ease of transferring this data into OSeMOSYS Global, or the benefits. A couple thoughts:

  • SANDs has locked spatial, temporal*, and technological scope I believe (*there is a macro to aggregate down from 96 ts, but cant go higher resolution than 96)
  • SANDs is multi-sector. This may make the transfer of naming a bit complicated
  • The main benefits of ingesting SANDs data would be the inclusion of surround regions, imo. However, coordinating parameters (such as consistent costs) between SANDs and OG may require some thought.

Long-term would be good to have a method to allow for the transferring of data. I agree with your milestone here :). Near-term I dont believe there is an easy, and automatic way to do this.

trevorb1 avatar Sep 02 '24 20:09 trevorb1