data icon indicating copy to clipboard operation
data copied to clipboard
verified publisher icon pytorch

[Nodes] ParallelMap state is not guraranteed with in_order=False

Open andrewkho opened this issue 1 year ago • 0 comments

🐛 Describe the bug

Currently ParallelMap does not guarantee reproducibility if in_order = False, we should add a .. warning to the docstring and the flag, and also think about ways to have some level of guarantee

https://github.com/pytorch/data/blob/main/torchdata/nodes/map.py#L285-L286

Versions

nightly

andrewkho avatar Dec 13 '24 19:12 andrewkho