朱弘泽

Results 6 comments of 朱弘泽

指定gpu运行失败：using GPU 0 to perform barrier as devices used by this process are currently unknown. This can potentially cause a hang if this rank to GPU mapping is incorrect.

大家解决了吗？

指定gpu运行失败：using GPU 0 to perform barrier as devices used by this process are currently unknown. This can potentially cause a hang if this rank to GPU mapping is incorrect.

我使用八卡节点的4卡镜像时也会遇到类似的错误。使用八卡镜像正常。

指定gpu运行失败：using GPU 0 to perform barrier as devices used by this process are currently unknown. This can potentially cause a hang if this rank to GPU mapping is incorrect.

> > 我使用八卡节点的4卡镜像时也会遇到类似的错误。使用八卡镜像正常。 > > 没有解决，一直没有跑起来 确实很奇怪，我用八卡镜像指定export CUDA_VISIBLE_DEVICES=7,2,4 也没有问题，但一但使用4卡镜像就会报错。

指定gpu运行失败：using GPU 0 to perform barrier as devices used by this process are currently unknown. This can potentially cause a hang if this rank to GPU mapping is incorrect.

(WorkerDict pid=324403) You are attempting to use Flash Attention 2.0 without specifying a torch dtype. This might lead to unexpected behaviour Loading checkpoint shards: 0%| | 0/2 [00:00

指定gpu运行失败：using GPU 0 to perform barrier as devices used by this process are currently unknown. This can potentially cause a hang if this rank to GPU mapping is incorrect.

> > (WorkerDict pid=324403) You are attempting to use Flash Attention 2.0 without specifying a torch dtype. This might lead to unexpected behaviour Loading checkpoint shards: 0%| | 0/2 [00:00

Please update README.md

Please. We need this good job!