etcd
etcd copied to clipboard
Published
1 day ago
•
etcd-io
etcd-io
Receiving error logs while trying to perform etcd operations
Bug report criteria
- [X] This bug report is not security related, security issues should be disclosed privately via [email protected].
- [X] This is not a support request or question, support requests or questions should be raised in the etcd discussion forums.
- [X] You have read the etcd bug reporting guidelines.
- [X] Existing open issues along with etcd frequently asked questions have been checked and this is not a duplicate.
What happened?
While trying to write test case for the #17329, I encountered that there were a lot of error logs that were present. Logs are used to provide useful debug information to users, however, if mislabeled they could cause user to lose trust and ignore errors. For error logs to be useful they should only be emitted where there is something wrong.
We should prevent issues like https://github.com/etcd-io/etcd/issues/17245 where a change in code started generating a large number of error logs.
Proposed in https://github.com/etcd-io/etcd/pull/17249#issuecomment-1893399469 with agreement between maintainers.
What did you expect to happen?
In an ideal scenario, there should be no error logs since everything is running perfectly well.
How can we reproduce it (as minimally and precisely as possible)?
- Try to setup an etcd cluster and perform some basic operations.
- Look for the logs
- You'll find bunch of error logs irrespective of the fact everything seems to be working fine.
Anything else we need to know?
No response
Etcd version (please run commands below)
$ etcd --version
etcd Version: 3.4.27
Git SHA: c92fb80f3
Go Version: go1.19.10
Go OS/Arch: linux/amd64
$ etcdctl version
etcdctl version: 3.4.27
API version: 3.4
Etcd configuration (command line flags or environment variables)
paste your configuration here
Etcd debug information (please run commands below, feel free to obfuscate the IP address or FQDN in the output)
$ etcdctl member list -w table
# paste output here
$ etcdctl --endpoints=<member list> endpoint status -w table
# paste output here
Relevant log output
56 = {string} "{"level":"info","ts":"2024-02-13T23:12:29.872018+0530","caller":"osutil/interrupt_unix.go:65","msg":"received signal; shutting down","signal":"terminated"}\r\n"
57 = {string} "{"level":"info","ts":"2024-02-13T23:12:29.872078+0530","caller":"embed/etcd.go:393","msg":"closing etcd server","name":"TestErrorLogs-test-0","data-dir":"/tmp/TestErrorLogs875755182/002","advertise-peer-urls":["http://localhost:20001"],"advertise-client-urls":["http://localhost:20000"]}\r\n"
58 = {string} "{"level":"warn","ts":"2024-02-13T23:12:29.87219+0530","caller":"embed/serve.go:161","msg":"stopping insecure grpc server due to error","error":"accept tcp 127.0.0.1:20000: use of closed network connection"}\r\n"
59 = {string} "{"level":"error","ts":"2024-02-13T23:12:29.872322+0530","caller":"embed/etcd.go:857","msg":"setting up serving from embedded etcd failed.","error":"http: Server closed","stacktrace":"go.etcd.io/etcd/server/v3/embed.(*Etcd).errHandler\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:857\ngo.etcd.io/etcd/server/v3/embed.(*serveCtx).serve.func3\n\tgo.etcd.io/etcd/server/v3/embed/serve.go:176"}\r\n"
60 = {string} "{"level":"warn","ts":"2024-02-13T23:12:29.872357+0530","caller":"embed/serve.go:163","msg":"stopped insecure grpc server due to error","error":"accept tcp 127.0.0.1:20000: use of closed network connection"}\r\n"
61 = {string} "{"level":"error","ts":"2024-02-13T23:12:29.87243+0530","caller":"embed/etcd.go:857","msg":"setting up serving from embedded etcd failed.","error":"accept tcp 127.0.0.1:20000: use of closed network connection","stacktrace":"go.etcd.io/etcd/server/v3/embed.(*Etcd).errHandler\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:857\ngo.etcd.io/etcd/server/v3/embed.(*Etcd).serveClients.func1\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:770"}\r\n"
62 = {string} "{"level":"info","ts":"2024-02-13T23:12:29.872478+0530","caller":"etcdserver/server.go:1251","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"ca50e9357181d758","current-leader-member-id":"ca50e9357181d758"}\r\n"
63 = {string} "{"level":"info","ts":"2024-02-13T23:12:29.872542+0530","caller":"etcdserver/server.go:2247","msg":"server has stopped; stopping storage version's monitor"}\r\n"
64 = {string} "{"level":"info","ts":"2024-02-13T23:12:29.872555+0530","caller":"etcdserver/server.go:2224","msg":"server has stopped; stopping cluster version's monitor"}\r\n"
65 = {string} "{"level":"info","ts":"2024-02-13T23:12:29.886106+0530","caller":"embed/etcd.go:587","msg":"stopping serving peer traffic","address":"127.0.0.1:20001"}\r\n"
66 = {string} "{"level":"error","ts":"2024-02-13T23:12:29.886214+0530","caller":"embed/etcd.go:857","msg":"setting up serving from embedded etcd failed.","error":"accept tcp 127.0.0.1:20001: use of closed network connection","stacktrace":"go.etcd.io/etcd/server/v3/embed.(*Etcd).errHandler\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:857\ngo.etcd.io/etcd/server/v3/embed.(*Etcd).servePeers.func3\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:609"}\r\n"
67 = {string} "{"level":"info","ts":"2024-02-13T23:12:29.886309+0530","caller":"embed/etcd.go:592","msg":"stopped serving peer traffic","address":"127.0.0.1:20001"}\r\n"
Thanks for raising this followup https://github.com/etcd-io/etcd/pull/17423#discussion_r1489264573
