Koen van Greevenbroek

Results 65 comments of Koen van Greevenbroek

Another one: it seems that the combination of `biomass_spatial: true` and `biomass_transport: false` leads to an infeasible model! (With the rest of the config having default settings.) This is particularly...

Just to add another perspective to the discussion, I believe the non-sparse nature of xarray is also impacting the memory footprint of solving pypsa-eur networks. Here is an example of...

Thanks for the quick response! Reassuring to know that a low memory footprint is actually possible. I might try with a few different xarray versions then; the above was using...

It was based on linopy 0.3.8. When testing out https://github.com/PyPSA/linopy/commit/456052e97dee54b4efe7ddc06596217fc9bb1912 it seemed like it reduced the overall memory footprint, but I'm about to do some more detailed testing (master branch...

Some very preliminary investigation seems to indicate that perhaps myopic foresight optimisation is really the culprit here? This is the result from even a fairly low-resolution network: ![image](https://github.com/PyPSA/linopy/assets/74298901/e1c8b1f2-25a0-45d4-a4a9-5d956797dae2) I've also...

Regardless of memory spikes, I will just note that, to my best understanding, there is no reason in principle why the optimisation at 2050 should take more time and memory...

Last thing before logging off for the weekend: Here is the memory spike replicated with upstream pypsa-eur and latest version of linopy: ![image](https://github.com/PyPSA/linopy/assets/74298901/83af4c12-747a-4823-a29a-0c6187c31ec1) This is using pypsa-eur at commit [95805a8d](https://github.com/PyPSA/pypsa-eur/commits/95805a8d)...

I'm not sure exactly how much time I'll have to look into this the coming week or two, so if anyone else has the time/opportunity, feel free to dig in....

As you can see in the PR mentioning this issue, I've implemented a kind of aggregation over build-years that solves pypsa-eurs problems with performance. But It doesn't rule out the...

Unfortunately, that doesn't look like it fixes the issue. Here is a comparison with and without `lp-polars`: ![image](https://github.com/PyPSA/linopy/assets/74298901/4c294753-f7b7-4987-9d0d-7c1e85249514) The `lp-polars` option seems faster to be sure, but it actually uses...