benchpress

benchpress copied to clipboard

would make it easy to interoperate with other tools, providing json data (and accepting json payloads for things like scheduling tasks). edit: json, protobuf (ocaml-protoc), … to be decided

c-cube

Probably [vega-lite](https://vega.github.io/vega-lite/) in browser, with some json obtained from the server (we can make a tiny json library for it for the server I think) would be prettier and more...

c-cube

handle proof checking

1

-[x] add `(proof_produce " --some --additional --args $proof_file")` to prover stanza - [x] add `(proof_checker "checker $problem --whatever $proof")` to prover stanza (or maybe a separate stanza with the `(proof_checker...

c-cube

Filter full results to only keep differing results

4

On a view such as https://benchpress.cedeela.fr/show_table/res-20200515T222015-2eed2c42-3d64-4611-956f-341d3b2d54ab.sqlite/?offset=0 , it would be useful to be able to list only the results that differ between provers (and this list would be linked to...

Gbury

c-cube

It is very convenient that currently benchpress records the time for each prover run, but it would be even more useful to also have an estimation of the memory used...

Gbury

https://component.kitchen/elix/AutoCompleteComboBox could be nice. Completion should be doable for provers and results (but not problem, too many of them).

c-cube

Name dirs in config file

1

Similarly to how provers are identified by a name (rather than their command line), it would be useful to be able to name directories. This would allow a few things...

Gbury

- [ ] ability to specify stdout/stderr - [ ] match errcode instead of output (cf minisat: 10/20) - [ ] priorities to try more specify regex first cc @gbury

c-cube

http://make.mad-scientist.net/papers/jobserver-implementation/

c-cube