automlbenchmark icon indicating copy to clipboard operation
automlbenchmark copied to clipboard

Website with results?

Open pplonski opened this issue 4 years ago • 2 comments

Thank you for this package! I'm working on my AutoML python package and this benchmark suite is very needed.

I have a question, is there any website that publishes results of benchmarking from available frameworks?

pplonski avatar Apr 15 '20 08:04 pplonski

Hi @pplonski, currently the only published results are 1 year old: you can find them on the application website, and in the reports folder. Those same results are also available as an OpenML Study.

@PGijsbers do you have any update about the new website to explore results?

sebhrusen avatar Apr 15 '20 17:04 sebhrusen

The plan is to use OpenML to publish the benchmark results. We are currently working on a new front-end, but our plan for a hackathon for the final push unfortunately got postponed due to the pandemic. You can see the results here (click on "Analysis").

The other part of the project is making the results of this benchmark (almost) automatically upload to OpenML. When that's done it will be easier to keep results up to date.

PGijsbers avatar Apr 15 '20 18:04 PGijsbers