NVTabular icon indicating copy to clipboard operation
NVTabular copied to clipboard

[FEA] Implement full shuffle

Open benfred opened this issue 5 years ago • 0 comments

Issue by benfred Tuesday Apr 21, 2020 at 17:48 GMT Originally opened as https://github.com/rapidsai/recsys/issues/51


We're currently only shuffling each chunk, and then writing the shuffled values to partitions in order. We should also shuffle each partition afterwards to truly randomize the order

benfred avatar Jun 04 '20 23:06 benfred