accelerate
accelerate copied to clipboard
Be able to use `notebook_launcher` with TPUs on cloud TPU instances
Currently, the notebook_launchersupport TPUs only on Kaggle or Google Colab. I would like to be able to use notebook_launcher on a cloud TPU instance.
We could introduce a the distributed_type as a parameter of the notebook_launcher and refactor in_colab and in_kaggle to use_tpu with addition if distributed_type is set.
cc @muellerzr