ContrastiveSeg icon indicating copy to clipboard operation
ContrastiveSeg copied to clipboard

Published 20 hours ago • verified publisher icon tfzhou

多卡并行时，queue的更新情况

Open DingHuilsp opened this issue 10 months ago • 0 comments

代码中实现的，是不是多卡并行时，每个GPU的queue独立更新？，我感觉应该像moco一样，先keys = concat_all_gather(keys)，再统一进行更新，是不是更合理一点？

DingHuilsp avatar Jan 06 '25 09:01 DingHuilsp