refactor: allow hot swapping the config

[sbruens]

Instead of keeping track of a diff of ports to keep open, we introduce reusable listeners that can be hot-swapped by remaining open until the last user of the listener closes it.

This pulls out the listener changes from #182, which is focused on adding a new config format.