data icon indicating copy to clipboard operation
data copied to clipboard

Give an option to either provide dataset or dataset_size in distributed sampler

Open ramanishsingh opened this issue 8 months ago • 1 comments

Currently the StatefulDistributedSampler takes the dataset as an argument, but only uses the length/size of the dataset. Adding an option to provide size of the dataset instead, for more flexibility.

ramanishsingh avatar Apr 29 '25 07:04 ramanishsingh

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/data/1479

Note: Links to docs will display an error until the docs builds have been completed.

:x: 1 Cancelled Job

As of commit 1116f96480e1f1b46b0c287dc1a217efbbead2c0 with merge base aef2409183169349a7bbdfbfdc2b21074e44c7bd (image):

CANCELLED JOB - The following job was cancelled. Please retry:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

pytorch-bot[bot] avatar Apr 29 '25 07:04 pytorch-bot[bot]