Add tests for scripts like train_hypergrid with replay_buffer > 0

[saleml]

A recent PR introduced a bug where train_hypergrid doesn't converge if replay_buffer is set to 100.

This should be caught with the tests !