Kevin Tse

Offline discussion: * Initialize when `__len__` is called. First, check if RS is initialized, if not, initialize RS, then call `self.ReadingService.get_datapipe_length`(delegating to RS). * Need to change interface of RS...

@nivekt has imported this pull request. If you are a Facebook employee, you can view this diff [on Phabricator](https://www.internalfb.com/diff/D38999743).

@nivekt has imported this pull request. If you are a Facebook employee, you can view this diff [on Phabricator](https://www.internalfb.com/diff/D38999743).

@nivekt has imported this pull request. If you are a Facebook employee, you can view this diff [on Phabricator](https://www.internalfb.com/diff/D38999743).

@nivekt has imported this pull request. If you are a Meta employee, you can view this diff [on Phabricator](https://www.internalfb.com/diff/D38999743).

@nivekt has imported this pull request. If you are a Meta employee, you can view this diff [on Phabricator](https://www.internalfb.com/diff/D38999743).

@NicolasHug I am in the processing of going through both setups, running them on our AWS cluster, and identifying the differences. I agree that combining the efforts is the right...

"Auto doc gen for RC release" - I believe we can add a GH action for that (i.e. whenever a push is made to the branch `release/0.x.0`, build a doc...

In the graph above, `DP1` depends on `DP3`, why would that be the case? `DP3` modifying some state that `DP1` depends on? Is there an example of an use case...

@ezeli I think having a custom DataPipe seems fine for your use case. I am open to add that to the library if there are more users who have a...