etcdserver/api/v3rpc: grpc: addrConn.resetTransport failed to create client transport

[mthenw]

This is a Bug Report

When etcd client (libkv) cannot connect to etcd instance event gateway logs following messages:

2017-10-27 14:59:03.206243 I | etcdserver/api/v3rpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: dial tcp 127.0.0.1:2379: getsockopt: connection refused"; Reconnecting to {127.0.0.1:2379 <nil>}
2017-10-27 14:59:04.207386 I | etcdserver/api/v3rpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: dial tcp 127.0.0.1:2379: getsockopt: connection refused"; Reconnecting to {127.0.0.1:2379 <nil>}

It's known issue cause by grpc-go impl that shouldn't log to stdout/stderr: https://github.com/grpc/grpc-go/issues/1044.

Another issue is that even though we silence most logs from etcd above logs are still outputted.

[mthenw]

I reported this issue in etcd repo https://github.com/coreos/etcd/issues/8778.

[fargozhu]

and this message is related with which scenarios? Is there a root cause for it? I start seeing them and I can see that no event is . triggered anymore (which makes sense).

[mthenw]

@fargozhu it happens when EG instance cannot connect to etcd.