TransUNet icon indicating copy to clipboard operation
TransUNet copied to clipboard

Published 20 hours ago • verified publisher icon Beckschen

Scaling issue

Open sagarpgs opened this issue 3 years ago • 0 comments

The model does not scale on multiple GPU units on a single CPU. It create multiple copies of model (when using distributed data parallel) and add all the load to cuda(0), instead of evenly distributing load to all cuda devices. This results in out of memory issues. Appreciate your help on this.

sagarpgs avatar Jun 29 '21 18:06 sagarpgs