malay-nagda

# What does this PR do ? Add a one line overview of what this PR aims to accomplish. **Collection**: [Note which collection this PR will affect] # Changelog -...

# What does this PR do ? Add FLOPsMeasurementCallback only if tensorboard logger (`exp_manager.create_tensorboard_logger`) is enabled. **Collection**: [Run CICD] # Changelog ``` if self.cfg.get('exp_manager', {}).get('create_tensorboard_logger', False): callbacks.append(FLOPsMeasurementCallback(self.cfg)) ``` # Usage...

# What does this PR do ? Add a one line overview of what this PR aims to accomplish. **Collection**: [Note which collection this PR will affect] # Changelog -...

use lightning logger

1

# What does this PR do ? Add a one line overview of what this PR aims to accomplish. **Collection**: [Note which collection this PR will affect] # Changelog -...

# What does this PR do ? Add performance optimizations as a param **Collection**: [llm] # Changelog ``` if performance_mode: recipe = pretrain_performance_optimizations(recipe) ``` # Usage ```python from nemo.collections.llm.recipes.llama3_8b import...

use null tokenizer

2

> [!IMPORTANT] > The `Update branch` button must only be pressed in very rare occassions. > An outdated branch is never blocking the merge of a PR. > Please reach...

> [!IMPORTANT] > The `Update branch` button must only be pressed in very rare occassions. > An outdated branch is never blocking the merge of a PR. > Please reach...

> [!IMPORTANT] > The `Update branch` button must only be pressed in very rare occassions. > An outdated branch is never blocking the merge of a PR. > Please reach...

> [!IMPORTANT] > The `Update branch` button must only be pressed in very rare occassions. > An outdated branch is never blocking the merge of a PR. > Please reach...