Albert Zeyer
Albert Zeyer
> Every process gets its own RNG initialized from the PPDataset RNG How exactly? This is basically #1762. We don't really have a solution for that yet. > I spawn...
> Besides that it's not very different. But we have noticed that the memory consumption when using `MultiProcDataset` can be quite large and with this implementation I want to reduce...
> In this PR ([#1765](https://github.com/rwth-i6/returnn/pull/1765)) I've used (conceptually) `rng_seed_for_worker=self.get_random_seed_for_epoch(epoch=epoch * num_workers + worker_idx)`. I think the function simply uses the provided epoch number as a seed. This makes every worker...