replacing hard-wired benchmark suites with benchmark factory

[joergkurtwegner]

Dear all, could we please replace the hard-wired benchmark suites with a "benchmark factory" (software engineering) pattern. Here I chose a "singleton pattern" as "factory pattern". Any benchmark version self-registers itself with a name like "v1, "v2, "trivial", but more importantly, it enables to register other benchmarks we might be interested in without changing the guacamol package code.

Penny for your thoughts.

Also, any thought on how we could load goal-oriented benchmarks from file rather? I realize its non-trivial, but maybe at least some we could load from files, as the hard-wired coding is too inflexible for accumulating bigger benchmarks we might be interested in.

[avaucher]

Dear Jörg,

Thank you for the pull request and suggestions!

Before being able to consider this PR, our legal department tells us that a CLA is going to be necessary and they are putting one in place at the moment.

Can you let us know if you are contributing on behalf of yourself or your company?
This may make a difference for the CLA.

And to answer to your question: a basic mechanism for loading benchmark definitions from files should be quite easy to add once there is a factory mechanism as you suggest in this PR. To do so, a user could register a custom factory dealing with files from outside guacamol, if I see it correctly.

[joergkurtwegner]

Please send me a copy of the CLA for review /.Joerg