tutorials
tutorials copied to clipboard
[BUG] - missing file - tp_tutorial.py
Add Link
https://github.com/pytorch/tutorials/blob/main/intermediate_source/TP_tutorial.rst#how-to-apply-tensor-parallel
Describe the bug
Hi, in this tutorial, there is an example command suggested to run the tutorial code. However, as of today, tp_tutorial.py
file does not exist in this repo. It looks like the file was accidentally not pushed. It would be great if it could be added.
# run this via torchrun: torchrun --standalone --nproc_per_node=8 ./tp_tutorial.py
Describe your environment
Linux - Ubuntu.