DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard

pre-commit check for torch.cuda in code

Open delock opened this issue 2 years ago • 0 comments

This PR add checks for CUDA specific code in DeepSpeed. The purpose is to avoid accidental usage of CUDA code in new code.

Two kinds of code are checked against:

  1. torch.cuda code which calls PyTorch cuda runtime.
  2. tensor.cuda() which converts tensor to cuda device.

Also port remaining cuda specific code which can be ported.

delock avatar Mar 09 '23 11:03 delock