split-folders icon indicating copy to clipboard operation
split-folders copied to clipboard

Need to split time series data into train/val/test, but cannot shuffle

Open Cavernoso opened this issue 3 years ago • 0 comments

As I am working with time series data, the information cannot be shuffled. Data volume is to big and therefore, I will use keras.train_on_batch since loading full dataset into RAM memory is not feasible. Spliting the data into train, test and validation folders would be helpfull. I am trying to use the split-folder library, but I could not identify how to avoid the shuffling process. Is it possible de-activate the shuffle?

Cavernoso avatar Jan 05 '23 21:01 Cavernoso