Parallel Training Needed plz

[87003697]

🚀 Feature

Hi, is parallel training one of the features that you are working on ? Or when can we expect your realization support data parallel or even data distributed parallel?

NOTE: Please look at the existing list of Issues tagged with the label 'enhancement`. Only open a new issue if you do not see your feature request there.

Motivation

Pitch

NOTE: we only consider adding new features if they are useful for many users.

[bottler]

For implicitron, yes, this is something we are aiming for.

[kjchalup]

This should be already available in Implicitron, please take a look and reopen the issue with more explanation / a concrete use-case if the current functionality is not sufficient.