Can I have more card reasoning? I used a high-resolution image to reason that the 32G graphics card was not enough.

Open hjb25286 opened this issue 1 year ago • 1 comments

Can I have more GPUs inference? I used a high-resolution image to reason that the 32G graphics card was not enough.

Oct 21 '24 02:10 hjb25286

Currently, we do not support multi-GPU inference. However, you can try using the tile mode(inference_ccsr_tile.py in CCSR-v1 and test_ccsr_tile.py in CCSR-v2 to reduce GPU memory usage during inference.

Dec 12 '24 02:12 csslc