benchexec
benchexec copied to clipboard
sosy-lab
BenchExec: A Framework for Reliable Benchmarking and Resource Measurement
[Mytkowicz et al.][1] found that adding a random number of bytes to the environment has an important effect on the end runtime because it affects memory layout, which could align...
- Implement `randomizeEnvSize` - Test `randomizeEnvSize` - FIx outputhandler when env contains UTF-8 chars. My prompt, for example, contains an ANSI escape sequence.
When merging run sets with a `` tag, the table with the benchmark environment contains all the individual values for run-set names, command-line options, etc. separated by `;`, like this:...
`runexec` could report how many files were created by a run, and how many of these matched the result-files pattern and were copied to the output directory. This could be...
The "Filter Rows" possibility should be extended to allow easily filtering for rows that have differing values in their `status` columns, just like the "diff" table that table-generator also produces....
The method [`setHashSearch`](https://github.com/sosy-lab/benchexec/blob/2695205de2376efb3b519b7dc5d1770825c9f0d3/benchexec/tablegenerator/react-table/src/utils/utils.js#L229) is not well designed and should be refactored. It implements both the creation of the new hash string as well as (optionally) two(!) different side effects of...
Not all special characters are handled correctly if a user enters them as a filter for task ids or textual columns because of missing escaping. Some of them just do...
We are using react-router 5 in our HTML table, and [version 6 has been released](https://remix.run/blog/react-router-v6). Upgrading needs some work on our side ([guide](https://reactrouter.com/docs/en/v6/upgrading/v5)). We have to replace `` with ``...
Currently, each input file in a benchmark set needs to have a unique name, it is not sufficient to have equally-named files in different directories. The reason is that the...
We want to support the following workflow, which is useful for quickly looking at results: 1. Run `table-generator` on some results. 2. Open resulting HTML file with Firefox or Chrome...