bayesmark icon indicating copy to clipboard operation
bayesmark copied to clipboard

Benchmark framework to easily compare Bayesian optimization methods on real machine learning tasks

Results 12 bayesmark issues
Sort by recently updated
recently updated
newest added

Hello, just mentioning that the option used for Nevergrad in your plots is OnePlusOne. As pointed out during early stages of BayesMark, OnePlusOne is certainly not the best tool for...

Instead of using the sklearn models, is it possible to add new optimization problems in bayesmark?

Bumps [pyyaml](https://github.com/yaml/pyyaml) from 5.1.1 to 5.4. Changelog Sourced from pyyaml's changelog. 5.4 (2021-01-19) yaml/pyyaml#407 -- Build modernization, remove distutils, fix metadata, build wheels, CI to GHA yaml/pyyaml#472 -- Fix for...

dependencies

Issue: Running Bayesmark on Windows using Cygwin throws an exception in cmd_parse.py. This is because PosixPath does not work in Windows. Resolution: Instead of using PosixPath, use Path instead. Instantiating...

bayesmark/build_wheel.sh is using sdist command and therefore not building a wheel file

Thanks for a great project. I'm using the benchmarking function in `bayesmark/sklearn_func.py`. This file defines several benchmark functions using `sklearn`. A "space" is defined for each function's hyperparameters. How is...

question

I found no explanation of the `visible_to_opt` and `generalization` in the documentation, are they some kind of linear transformation to the normalized mean score?

documentation
question

Put the import of `gitpython` in a try-except because it is not needed for the version number when installing off the wheel (`PyPI`).

enhancement

Allow the user to call experiments with an argument file: commands can be called like `bayesmark-exp --args args.yaml` instead of specifying arguments. All the arguments are simply in the `yaml`...

enhancement