No remote message handler registered for this message

[zlatinb]

Expected behavior

The CompletableFuture for start()-ing Atomix to return from join()

Actual behavior

The join() call never returns, and in the logs at FINE level I see the following:

FINE: RaftClient{system-partition-1} - OpenSessionRequest{node=mainNode, serviceName=atomix-primary-elector, serviceType=PRIMARY_ELECTOR, readConsistency=SEQUENTIAL, minTimeout=250, maxTimeout=30000} failed! Reason: io.atomix.cluster.messaging.MessagingException$NoRemoteHandler: No remote message handler registered for this message

Steps to reproduce

Start several Atomix instances on different hosts

Minimal yet complete reproducer code (or URL to code)

https://gist.github.com/zlatinb/a84518bde5d13fab21b144da3111b816

Environment

• Atomix: 3.0.8 and 3.1.5
• OS: OSX and Linux
• JVM 11.0.2