RagingPandas

Help understanding GPU memory spikes during GRPO training.

4

Hello, I'm currently experimenting with the performance of various configurations of GRPO to run on H200 gpus (2 nodes, 8 H200s per node). Regardless of my configuration I'm seeing large,...