mlr3pipelines icon indicating copy to clipboard operation
mlr3pipelines copied to clipboard

Train graph asynch parallel

Open berndbischl opened this issue 6 years ago • 2 comments

we should be able during toposort to asynchronoulsy start jobs with future / callr

berndbischl avatar Jan 10 '19 16:01 berndbischl

Under what conditions would this be useful?

mb706 avatar Jan 10 '19 20:01 mb706

in the scenario where a) the graph can at least be partially evaluated in parallel b) the individual jobs (job = compute 1 pipeop / node) take quite long c) you care about time

berndbischl avatar Jan 10 '19 20:01 berndbischl