UER-py icon indicating copy to clipboard operation
UER-py copied to clipboard

Published 20 hours ago • verified publisher icon dbiir

gate_cnn 模型GPU多卡训练报错

Open TestNLP opened this issue 3 years ago • 1 comments

image

python环境： image

GPU cuda配置 image

多卡跑bert模型预训练是可以的

TestNLP avatar Aug 17 '22 02:08 TestNLP

一直不断的重复下面的信息：

Waiting in store based barrier to initialize process group for rank: 5, key: store_based_barrier_key:1 (world_size=4, worker_count=19, timeout=0:30:00)

GPU卡是：GeForce RTX 3090，BERT可以，gate_cnn为啥不行呢

TestNLP avatar Aug 17 '22 02:08 TestNLP