agent-lightning
agent-lightning copied to clipboard
Rollout phase takes lots of time, and I find that only 1 of 8 GPU is working when rollout.
Is it possible to accelerate rollout by taking advantage of all the GPU?
This should not happen. Can you post your training script?