braindecode icon indicating copy to clipboard operation
braindecode copied to clipboard

Default parallelization when creating datasets

Open hubertjb opened this issue 3 years ago • 0 comments

As mentioned in #288, we could uniformize the Dataset classes API a bit more, which would allow us to provide parallel loading to all datasets by default. For instance, we could require every custom dataset class implements a _create_dataset method (sometimes called _load_raw in existing datasets I think) and take care of the joblib loop by default in a create_datasets method that all datasets inherit.

@gemeinl

hubertjb avatar Jul 08 '21 18:07 hubertjb