Request: Add a PyTorch example

[Minyus]

An example to train a PyTorch model using a simple dataset such as MNIST will be helpful.

[issue-label-bot[bot]]

Issue-Label Bot is automatically applying the labels:

Label	Probability
kind/feature	0.98

Please mark this comment with :thumbsup: or :thumbsdown: to give our bot feedback! Links: app homepage, dashboard and code for this bot.

[terrytangyuan]

You can use PyTorch with Horovod. Otherwise, we don’t have any examples yet with just PyTorch and contribution’s welcomed!

[Minyus]

Yes, I found an MNIST example to use Horovod and PyTorch at:

https://github.com/horovod/horovod/blob/master/examples/pytorch_mnist.py

Thank you.

[asahalyft]

Hi @Minyus were you able to run pytorch or pytorch lightning using mpi operator with horovod. Could you please share the yaml that you applied?