Stefan Marr
Stefan Marr
Currently, we don't have support for any top-level expressions. And it happens from time to time that the top-level module definition (i.e. the main class) in a file does not...
When the repo of the submodule is updated, and no head points to the required revision, we get a commit-not-found error. `build.xml` should include fallback code to fetch more revisions,...
The current implementation of object literals is unfortunately not yet taking into account value semantics properly: ``` class Foo new: v = Value ( | public v = v. |...
Currently, we retry benchmarks on the same executor even when the binary is missing. I think, we could correctly interpret the error, and abort them, which may slightly improve the...
The data files don't have a header line, which makes it a bit a challenge to guess which column is which. We probably also should document the data format in...
Expand the basic documentation to cover all features, and expand the set of tutorials to cover the common use cases.
To help new users with ReBench, 5min tutorials would be very helpful. Goal of such tutorials would be to show that it takes less time to learn ReBench than it...
The community has a number of analyses that "everyone" uses. Providing them as reusable building blocks would make the day-to-day data analysis much easier. Each analysis should come with documentation,...
The goal is to have a somewhat common UI that enables easy reuse of analyses from previous projects, or experiments. ReBenchDB will need an API to access data, as well...
Add support for exporting data and scripts to create self-contained and archivable artifacts to ReBenchDB. Data and scripts need to be packaged so that evaluators of artifacts can reproduce results,...