bayesmark icon indicating copy to clipboard operation
bayesmark copied to clipboard

How is {log, logit, bilog} determined in `bayesmark/sklearn_func.py`?

Open HideakiImamura opened this issue 4 years ago • 1 comments

Thanks for a great project. I'm using the benchmarking function in bayesmark/sklearn_func.py. This file defines several benchmark functions using sklearn. A "space" is defined for each function's hyperparameters. How is this "space" determined?

# RF
rf_cfg = {
    "max_depth": {"type": "int", "space": "linear", "range": (1, 15)},
    "max_features": {"type": "real", "space": "logit", "range": (0.01, 0.99)},
    "min_samples_split": {"type": "real", "space": "logit", "range": (0.01, 0.99)},
    "min_samples_leaf": {"type": "real", "space": "logit", "range": (0.01, 0.49)},
    "min_weight_fraction_leaf": {"type": "real", "space": "logit", "range": (0.01, 0.49)},
    "min_impurity_decrease": {"type": "real", "space": "linear", "range": (0.0, 0.5)},
}

In particular, I'd like to know how {log, logit, bilog} is determined here. Is there anything that would help me?

HideakiImamura avatar Aug 27 '20 04:08 HideakiImamura

The user determines the space based on where they want more "search resolution". For instance, logit space will make algorithms more inclined to search near 0 and 1.

rdturnermtl avatar Sep 09 '20 19:09 rdturnermtl