data icon indicating copy to clipboard operation
data copied to clipboard

[Nodes] Drop-in Replacement for DataLoader and StatefulDataLoader

Open andrewkho opened this issue 1 year ago • 0 comments

🚀 The feature

Provide users utility functions to have drop-in replacement for the well-known torch.utils.data.DataLoader, as well as StatefulDataLoader.

Motivation, pitch

We should be able to re-construct exactly (or pretty darn close) the behaviour of torch.utils.DataLoader and torchdata.StatefulDataLoader by configuring Nodes in a certain way. We should provide these utilities for users as something practical, and as a starting point/reference implementation to get started and make tweaks as they need.

Alternatives

No response

Additional context

No response

andrewkho avatar Dec 09 '24 17:12 andrewkho