How to launch jobs on vast.ai instances

[Tiiiger]

Hi @mryab ,

Really cool work! I am trying to replicate the experiments you mentioned in the paper.

I am wondering how do you set up the vast.ai workflow? I wonder if you have similar code like the notebook you showed for AWS https://github.com/yandex-research/moshpit-sgd/blob/main/language_modeling/run_training_aws.ipynb? It would be really helpful if you can share that.

Thank you in advance!

[mryab]

Hi, thank you for your interest in this project! Right now we don't have a definite guide on running the experiments in closed-port environments, but we are working on merging such an example in the hivemind repo. At some point later (likely in a month or two) we'll add similar examples to this repo (along with ImageNet part of expertiments), but feel free to track upstream progress and ping me if you need any help!