pypsa-earth icon indicating copy to clipboard operation
pypsa-earth copied to clipboard

Create speed measurement infrastructure

Open pz-max opened this issue 11 months ago • 1 comments

Describe the feature you'd like to see

Sometimes we make code changes and don't recognize its speed impacts.

It would be good to track for each rule (and ideally each function within the rule) the performance comparing PR branch to OS main. I saw some Python packages doing that in the past (just remembered they used Azure infra) and reading some UNIX & C wisdoms measuring that stuff is generally a good idea.

pz-max avatar Mar 21 '24 21:03 pz-max

Describe the feature you'd like to see

Sometimes we make code changes and don't recognize its speed impacts.

It would be good to track for each rule (and ideally each function within the rule) the performance comparing PR branch to OS main. I saw some Python packages doing that in the past (just remembered they used Azure infra) and reading some UNIX & C wisdoms measuring that stuff is generally a good idea.

Absolutely agree. It would be not a good idea to compromise the performance, given the goal to keep at least continental scope.

As a clarification question: do you mean profiling methods integrated into the development workflow? Or do you also have in mind something more deep, like integration wit computational/platform infrastructure?

ekatef avatar Mar 22 '24 08:03 ekatef