ReBench
ReBench copied to clipboard
Equality between run configurations not all-inclusive
There are characteristics in run configurations that do not influence the cmd line, and thus, are ignored when comparing configs.
This can cause unexpected equalities and unexpected behavior. We need to define a strategy how to handle this.
Do we merge run configs, do we simply reject them, or do we have both. When merging, is that always sensible/desirable? Should we always run what creates more data?
Possibly relevant to consider #21.