data icon indicating copy to clipboard operation
data copied to clipboard
verified publisher icon pytorch

[1/n] DataLoader2 initial support for randomness control

Open ejguan opened this issue 3 years ago • 9 comments

Summary: Add the initial support for DataLoader2 to control randomness over the pipeline:

  • Implement SeedGenerator
  • Change API of ReadingService.initialize_iteration to take seed generator from DataLoader2
  • The seed generator will be the single source of randomness within the pipeline

Differential Revision: D38947827

ejguan avatar Sep 29 '22 20:09 ejguan

This pull request was exported from Phabricator. Differential Revision: D38947827

facebook-github-bot avatar Sep 29 '22 20:09 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D38947827

facebook-github-bot avatar Sep 29 '22 20:09 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D38947827

facebook-github-bot avatar Sep 29 '22 20:09 facebook-github-bot

I might need to re-create a new PR via ghexport to support a stack of Diffs.

ejguan avatar Sep 30 '22 18:09 ejguan

This pull request was exported from Phabricator. Differential Revision: D38947827

facebook-github-bot avatar Oct 04 '22 15:10 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D38947827

facebook-github-bot avatar Oct 04 '22 18:10 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D38947827

facebook-github-bot avatar Oct 04 '22 23:10 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D38947827

facebook-github-bot avatar Oct 05 '22 18:10 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D38947827

facebook-github-bot avatar Oct 06 '22 16:10 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D38947827

facebook-github-bot avatar Jan 17 '23 19:01 facebook-github-bot

@ejguan has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot avatar Jan 17 '23 19:01 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D38947827

facebook-github-bot avatar Jan 17 '23 21:01 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D38947827

facebook-github-bot avatar Jan 17 '23 21:01 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D38947827

facebook-github-bot avatar Jan 17 '23 23:01 facebook-github-bot

@ejguan merged this pull request in pytorch/data@38e0d03454a9018cb7ebf76e6b31379db913f8a1.

facebook-github-bot avatar Jan 18 '23 02:01 facebook-github-bot