pyrovelocity icon indicating copy to clipboard operation
pyrovelocity copied to clipboard

enforce deterministic GPU algorithms

Open cameronraysmith opened this issue 1 year ago ā€¢ 0 comments

See torch.use_deterministic_algorithms and CUDA cublas results reproducibility.

import os
os.environ["CUBLAS_WORKSPACE_CONFIG"] = ":4096:8"
print(os.environ["CUBLAS_WORKSPACE_CONFIG"])

import numpy as np
import torch

torch.use_deterministic_algorithms(True)

SEED = 1

np.random.seed(seed=SEED)
torch.manual_seed(SEED)

cameronraysmith avatar Sep 14 '23 22:09 cameronraysmith