[BUG] Executors require more compute than might be necessary.

[DriesSmit]

Describe the bug When using my own instance of Reverb and Launchpad I can scale up to 10 executors. However, when I use Mava I can only scale to 6 executors without diminishing returns.

To Reproduce No steps to reproduce as it requires local code. Just a note for possible future investigation.

Expected behaviour Mava scales up to 10 executors before diminishing returns kick in.

Context (Environment) For every training run a single machine with 68 Gbs of RAM was used. We use 10 workers running on 12 CPU cores (Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz)

Additional context

Possible Solution .