Training Speed Problem

[0three]

Hi, I've tried to reproduce the training-generator phase.

However, the training speed seems too slow.

I use 4 A100 for default training. It takes almost 4 minutes for 4 iterations. 4 GPUs are all 100% GPU-utils.