benchexec

benchexec copied to clipboard

Kill processes in container before copying output files

2

Currently, the following happens at the end of a run in container mode: - Main process of tool is stopped (because it terminates or because it is killed due to...

PhilippWendler

Syntax highlighting of files loaded in overlay panes

2

In #402, it is suggested to parse the file loaded for link overlays if it is a task-definition file, and provide a richer and interactive view of the file for...

PhilippWendler

Prevent creation of large log files

1

`runexec` has an option `--maxOutputSize` and will truncate the tool log if it exceeds the given size. However, this is applied only after the run ended. While the run is...

PhilippWendler

Prevent truncation of output file by tool

1

When a tool truncates the file descriptors that it has for `stdout` and `stderr`, this leads to truncation of the log file with the output. So a tool can undo...

PhilippWendler

Add option in table definition to set width of columns

1

Provide an option in the table definition and the user can set the column width to meaningful values. Some users anyway set the number of digits there in order to...

dbeyer

Add substitution variable ${datafile_path}, similar to ${logfile_path}

2

There are two sets of result files that BenchExec produces: - Log files (those results that the tool outputs to stdout) - Data files (those results that the tool outputs...

dbeyer

Check input XML files against DTD

9

This benchmark definition: https://github.com/sosy-lab/sv-comp/blob/svcomp19/benchmark-defs/cpa-seq-validate-violation-witnesses.xml claims to follow the benchmark-definition format 1.4, but uses the tag `` which came only with version 1.9. Shouldn't BenchExec check the XML files that it...

dbeyer

For example benchexec -Dfoo=bar benchmark.xml would replace `${foo}` by `bar` in benchmark.xml just like `${rundefinition_name}`.

gernst

Sometimes the benchmarked process wants to use cgroups itself. BenchExec prevents this (in container mode) by mounting the cgroup hierarchy read-only. If we would not do this, the benchmarked process...

PhilippWendler

Improper usage of sys.exit()

6

I noticed that, especially in runexecutor.RunExecutor, sys.exit() is used to handle error cases quite often. It's fine to simply exit the interpreter from code which is only meant to be...

catdog2