CUDA Memory allocation is not equal.

[HyoKong]

Thank you so much for your nice work!

May I ask why the cuda memory allocation is not equal? I think is the gather function when we render single image and gather all the tensors from each gpu to the main gpu. May I ask how to solve this issue?

Thank you so much!