PiPPy icon indicating copy to clipboard operation
PiPPy copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

Sharded RNG Operations

Open crutcher opened this issue 3 years ago • 0 comments

Authoring and testing sharded RNG operations needs love.

  • Setting the seed, via torch.manual_seed(seed) does not dispatch to shards.
  • Constructing ops so that they'll produce the same RNG choices, no matter the sharding, is complicated.
  • Testing

crutcher avatar Sep 26 '22 16:09 crutcher