go-zero icon indicating copy to clipboard operation
go-zero copied to clipboard

Infinite output of ETCD logs, causing service crashes

Open bCoder778 opened this issue 1 year ago • 4 comments

Describe the bug A large number of identical error logs without any pauses result in 100% CPU usage. The log files exceeded a few gigabytes in a short amount of time, causing the server to crash.

To Reproduce

The program started working normally, but after running for a period of time, it began to output the same logs without restrictions, causing the server to crash

  1. The code is

Etcd: Hosts: - ...:379 Key: *.rpc User: user Pass: *

  1. The error is

"etcd monitor chan has been canceled, error: rpc error: code = Unauthenticated desc = etcdserver: invalid auth token","level":"error"}

Environments (please complete the following information):

  • etcd:docker
  • go-zero version v1.6.1

bCoder778 avatar Dec 29 '23 02:12 bCoder778

We have also encountered this problem. You can try to downgrade the version of gRPC a bit; that's how we resolved it.

codeErrorSleep avatar Dec 29 '23 08:12 codeErrorSleep

We have also encountered this problem. You can try to downgrade the version of gRPC a bit; that's how we resolved it.

Thank you very much. Can you tell me which specific version of GRPC you are using

bCoder778 avatar Jan 08 '24 01:01 bCoder778

Has it been resolved yet?

arllen133 avatar Jul 15 '24 05:07 arllen133