lighter
lighter copied to clipboard
Enhance Dataloader Configuration
🚀 Feature Request
A lot of dataloader arguments are mentioned in system
parameters. For example, batch_size
, drop_last_batch
.
Would be good to have a way to set other parameters of the dataloader such as prefetch_factor
, persist_workers
and potentially other future additions to this.
🛰 Alternatives
Maybe we can add a partial dataloader to the system config? and give it dataset
and sampler
later?