mlr3tuning icon indicating copy to clipboard operation
mlr3tuning copied to clipboard

learner API: new function predict_trace

Open berndbischl opened this issue 6 years ago • 5 comments

many learners have a "sequence" parameter so you can get full trace from a single training run.

e.g. ntree, boosting rounds, or the "s" param in glmnet

this is should be supported.

basically we need to allow to "mark up" one hyperparam in the set, with a tag. and then maybe not have a new predict_trace function but handle this in the normal predict

berndbischl avatar Jul 09 '19 16:07 berndbischl

Proposal: tag the Param with "sequential"

jakob-r avatar Jul 09 '19 16:07 jakob-r

Proposal: tag the Param with "sequential"

that is not very precise, and debatable whether the "s" param in glmnet falls under it tag = "predict_trace" or "predict_sequential" ?

berndbischl avatar Jul 10 '19 07:07 berndbischl

Then the Param would have the tags "train" , "predict" and "predict_sequential", right?

jakob-r avatar Jul 11 '19 18:07 jakob-r

I think the current "predict" tag is actually enough, but we would have to adjust tuning to handle predict-time-only parameters efficiently

mb706 avatar Jul 11 '19 21:07 mb706

I think the current "predict" tag is actually enough, but we would have to adjust tuning to handle predict-time-only parameters efficiently

yes, michel and me discussed this a bit. we need an issue in mlr3tuning now to documents the current thoughts

berndbischl avatar Jul 12 '19 10:07 berndbischl