accelerate icon indicating copy to clipboard operation
accelerate copied to clipboard

Be able to use `notebook_launcher` with TPUs on cloud TPU instances

Open philschmid opened this issue 2 years ago • 1 comments

Currently, the notebook_launchersupport TPUs only on Kaggle or Google Colab. I would like to be able to use notebook_launcher on a cloud TPU instance.

We could introduce a the distributed_type as a parameter of the notebook_launcher and refactor in_colab and in_kaggle to use_tpu with addition if distributed_type is set.

philschmid avatar Jan 11 '23 17:01 philschmid

cc @muellerzr

sgugger avatar Jan 12 '23 09:01 sgugger