tutorials icon indicating copy to clipboard operation
tutorials copied to clipboard

[BUG] - missing file - tp_tutorial.py

Open SeungjunNah opened this issue 8 months ago • 1 comments

Add Link

https://github.com/pytorch/tutorials/blob/main/intermediate_source/TP_tutorial.rst#how-to-apply-tensor-parallel

Describe the bug

Hi, in this tutorial, there is an example command suggested to run the tutorial code. However, as of today, tp_tutorial.py file does not exist in this repo. It looks like the file was accidentally not pushed. It would be great if it could be added.

# run this via torchrun: torchrun --standalone --nproc_per_node=8 ./tp_tutorial.py

Describe your environment

Linux - Ubuntu.

SeungjunNah avatar Jun 25 '24 22:06 SeungjunNah