web-to-desktop-framework-comparison icon indicating copy to clipboard operation
web-to-desktop-framework-comparison copied to clipboard

Published 20 hours ago • verified publisher icon Elanis

Randomize execution order to prevent side effects (from other runs or Github CI itself) affecting too much results

Open Elanis opened this issue 2 years ago • 0 comments
trafficstars

We should create a list of 15 runs of each framework and profile (Release/Debug), shuffle this list and run in this order. E.g, possible run order:

  • electron release
  • tauri debug
  • nw.js release
  • electron debug
  • wails debug
  • tauri debug
  • electron release
  • nw.js debug
  • and so on

This will prevent results being affected by memory being re-used, webview being re-used, or CI environment affecting results in a good/bad way for only one framework.

Elanis avatar Apr 27 '23 07:04 Elanis