NeMo
NeMo copied to clipboard
NVIDIA
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
🚀 PR to bump `NVIDIA/Megatron-LM` in `requirements/manifest.json` to `0595ef2b0c93f8d61f473c9f99f9ff73803ff919`. 📝 Please remember the following to-do's before merge: - [ ] Verify the presubmit CI 🙏 Please merge this PR only...
🚀 PR to bump `NVIDIA/Megatron-LM` in `requirements/manifest.json` to `64cb6bd7a155c4e742514ed1024407fb97d0a367`. 📝 Please remember the following to-do's before merge: - [ ] Verify the presubmit CI 🙏 Please merge this PR only...
> [!IMPORTANT] > The `Update branch` button must only be pressed in very rare occassions. > An outdated branch is never blocking the merge of a PR. > Please reach...
🚀 PR to bump `NVIDIA/Megatron-LM` in `requirements/manifest.json` to `32737be6efbff557e2e8a5a50e36cefeed1a7c7e`. 📝 Please remember the following to-do's before merge: - [ ] Verify the presubmit CI 🙏 Please merge this PR only...
🚀 PR to bump `NVIDIA/Megatron-LM` in `requirements/manifest.json` to `64cb6bd7a155c4e742514ed1024407fb97d0a367`. 📝 Please remember the following to-do's before merge: - [ ] Verify the presubmit CI 🙏 Please merge this PR only...
I'm trying to do some AutoModel pre-training and see how throughput scales from 4 GPUs to 8 GPUs and what I'm seeing in the throughput metrics has confused me, so...
> [!IMPORTANT] > The `Update branch` button must only be pressed in very rare occassions. > An outdated branch is never blocking the merge of a PR. > Please reach...
**Describe the bug** The training step time remains constant for Gemma3 HFAutoModel and MockDataModule, regardless of the "global_batch_size" and "micro_batch_size" values set in MockDataModule. **Steps/Code to reproduce bug** The "gemma3_automodel_test.py":...
