How much is the GPU memory-Usage?

[luanyunteng]

I try to run your code on 4 1080Ti GPUs, and I found that there is not enough memory under your default setting (256 batchsize, regular model). So I want to know how could you run the model on 8 Xp GPUs. Thanks a lot.