pytorch-lightning icon indicating copy to clipboard operation
pytorch-lightning copied to clipboard
verified publisher icon Lightning-AI

TPU related documentation updates

Open carmocca opened this issue 2 years ago • 0 comments

📚 Documentation

There's several TPU specific topics to update in the documentation before the v2.1 release

Update the guide in Trainer with:

  • [ ] v4 support
  • [ ] gcloud instructions
  • [ ] PjRT support

Write a full guide for running on TPUs with Fabric:

  • Installation + gcloud instructions
  • How to use the accelerator
  • Launching processes
  • Where to use mark_step()
  • Potential pitfalls and how to avoid them (recompilation etc)
  • FSDP ...

Creating this issue to track this.

Additional context

https://pytorch.org/xla/release/2.0 already contains a lot of useful information to pull from

cc @borda @carmocca @JackCaoG @steventk-g @Liyang90 @justusschock @awaelchli

carmocca avatar Apr 27 '23 14:04 carmocca