Do all Steps execute parallel?

[denyslazarenko]

Is it necessary to divide executions inside my class to be separate Thread or just divide them between Steps? For example, I can to fit KNN, PCA in one class method and parallel them or create two separate classes for them...

[jakubczakon]

Sorry for late response. For now steps execute in one thread and when I do parallelization I simply run operations within a single step in parallel rather than execute multiple steps in parallel.

That being said it would be a nice feature to have. Feel free to PR if you are working on something like that.

[kamil-kaczmarek]

@tankz0r @jakubczakon

Multiple people asked us about parallel execution of multiple Steps (i.e. training many models simultaneously). We are considering adding some simple parallelization, but at this point I cannot make any commitments about timing. For sure we will keep you updated @tankz0r !