Exiam6

icon company New York University icon location New York

Results 1 issues of Exiam6

RuntimeError: batch size must be positive when accum_steps > batch size in dynamic batching

2 comment

Hi jianyuan, thanks for this amazing work! When using gradient accumulation with dynamic batching, the training crashes with RuntimeError: batch size must be positive if the dynamically computed batch size...