[TEST] Parameter Server Integration

[mmorris44]

What do you want to test?

Full integration test for parameter server.

Outline of test structure

Should use all components typically found in the parameter server and run without error, but not using launchpad. See the jax IPPO example for how the components are typically logically distributed between core nodes. If multiple tests are required to cover different distinct cases (e.g. value-based vs policy-gradient), then they should be included.

Definition of done

Test(s) passing and including all typical components.

Mandatory checklist before making a PR

• [ ] The success criteria laid down in “Definition of done” are met.
• [ ] Test code is documented - docstrings for methods and classes, static types for arguments.
• [ ] Documentation is updated - README, CONTRIBUTING, or other documentation.