Giuseppe Casalicchio

The part > NB: we have potentially more columns we need to join like se and the stuff from survival... was not addressed in the PR, therefore we could leave...

```r mbo.iters = budget - 4*length(ps$pars) surrogate.lrn = makeLearner("regr.km", predict.type = "se", nugget = 10^-6) mbo.ctrl = makeMBOControl() mbo.ctrl = setMBOControlTermination(mbo.ctrl, iters = mbo.iters) mbo.ctrl = mlr:::makeTuneControlMBO(learner = surrogate.lrn, mbo.control...

I would be happy with replacing this line here https://github.com/ja-thomas/autoxgboost/blob/b64048e603751bcba9b6e212c775baff8ababccb/R/autoxgboost.R#L171 with `crossval(lrn, task.train, measure)$aggr`. And yes, I would ignore `task.test` data here completely (on which the early-stopping is based). But...

Do we have an API for this now? If not, you could request this in the main issue tracker. However, you could use `getOMLRun(x, only.xml=TRUE)` from https://github.com/openml/openml-r/pull/347 this should be...

The API is not working, see https://github.com/openml/OpenML/issues/411#issuecomment-313318472 . Will have a look when this is fixed.

I started to work on this here https://github.com/openml/openml-r/pull/378

Done in https://github.com/openml/openml-r/pull/378, we now have the `listOMLSetup` function where you can provide a vector of setup.ids (e.g. from the `listOMLRunEvaluations`) and get their hyperparameter settings of each setup.

it's supported by the REST API but not 100% documented in https://www.openml.org/api_docs/#!/setup/get_setup_id

Nope, you can also ask for all parameter configurations of a specific flow. This is only one request and it already gives you more than one run (but a maximum...

Although, I see that we havn't solved this perfectly in mlr, this is the current status: 1) A flow is determined by its external.version (which is a crc32 hash generated...