Ankur Srivastava

### System Info PyTorch version: 2.1.1+cu121 CUDA used to build PyTorch: 12.1 GPUs: NVIDIA A100-SXM4-80GB Nodes: 2 GPUs per node: 8 NCCL version: 2.18.6 Python: 3.10 Installed llama like below:...

*Issue #, if available:* *Description of changes:* Added steps to: 1. Install Nsight 2. Added examples for NCCL Tests, Nemotron-15B, PyTorch FSDP on a Slurm cluster 3. Added steps to...

Install nvidia-container-cli

1

Can we add the following to the post-install scripts to install nvidia-container-cli? ``` curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg \ && curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list | \...

Esm2 on Sagemaker Hyperpod

2

*Issue #, if available:* *Description of changes:* By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.