modulus icon indicating copy to clipboard operation
modulus copied to clipboard

🐛[BUG]: NCCL_ASYNC_ERROR_HANDLING deprecation warning

Open simonbyrne opened this issue 7 months ago • 0 comments

Version

0.6.0

On which installation method(s) does this occur?

Docker

Describe the issue

NCCL_ASYNC_ERROR_HANDLING environment variable (set here) has been deprecated in favor of TORCH_NCCL_ASYNC_ERROR_HANDLING https://github.com/pytorch/pytorch/pull/114077

It looks like the docs haven't been updated though: https://pytorch.org/docs/main/notes/cuda.html#id5

Minimum reproducible example

No response

Relevant log output


[W Utils.hpp:135] Warning: Environment variable NCCL_ASYNC_ERROR_HANDLING is deprecated; use TORCH_NCCL_ASYNC_ERROR_HANDLING instead (function getCvarInt)
[W Utils.hpp:135] Warning: Environment variable NCCL_ASYNC_ERROR_HANDLING is deprecated; use TORCH_NCCL_ASYNC_ERROR_HANDLING instead (function getCvarInt)
[W Utils.hpp:135] Warning: Environment variable NCCL_ASYNC_ERROR_HANDLING is deprecated; use TORCH_NCCL_ASYNC_ERROR_HANDLING instead (function getCvarInt)
[W Utils.hpp:135] Warning: Environment variable NCCL_ASYNC_ERROR_HANDLING is deprecated; use TORCH_NCCL_ASYNC_ERROR_HANDLING instead (function getCvarInt)
[W Utils.hpp:135] Warning: Environment variable NCCL_ASYNC_ERROR_HANDLING is deprecated; use TORCH_NCCL_ASYNC_ERROR_HANDLING instead (function getCvarInt)
[W Utils.hpp:135] Warning: Environment variable NCCL_ASYNC_ERROR_HANDLING is deprecated; use TORCH_NCCL_ASYNC_ERROR_HANDLING instead (function getCvarInt)
[W Utils.hpp:135] Warning: Environment variable NCCL_ASYNC_ERROR_HANDLING is deprecated; use TORCH_NCCL_ASYNC_ERROR_HANDLING instead (function getCvarInt)
[W Utils.hpp:135] Warning: Environment variable NCCL_ASYNC_ERROR_HANDLING is deprecated; use TORCH_NCCL_ASYNC_ERROR_HANDLING instead (function getCvarInt)

Environment details

No response

simonbyrne avatar Jun 28 '24 15:06 simonbyrne