harmony icon indicating copy to clipboard operation
harmony copied to clipboard

p2p: exceeded node message handler deadline

Open rlan35 opened this issue 2 years ago • 0 comments

Mainnet shard 0 consensus stuck at block https://explorer.harmony.one/block/24285106.

During the time when the shard couldn't produce new block, lots of following error messages are printed.

{"level":"warn","topic":"harmony/0.0.1/node/beacon","caller":"/home/sp/harmony/harmony/node/node.go:891","time":"2022-03-20T07:00:22.926066208Z","message":"[context] exceeded node message handler deadline"}
{"level":"warn","topic":"harmony/0.0.1/node/beacon","caller":"/home/sp/harmony/harmony/node/node.go:891","time":"2022-03-20T07:00:22.926330517Z","message":"[context] exceeded node message handler deadline"}
{"level":"warn","topic":"harmony/0.0.1/node/beacon","caller":"/home/sp/harmony/harmony/node/node.go:891","time":"2022-03-20T07:00:22.926646785Z","message":"[context] exceeded node message handler deadline"} 

We need to further understand what's causing such warning and fix the issue on p2p level.

TODOs:

  1. Add more info about the type and content of the p2p message that caused such issue.
  2. Add rate limit on p2p messages that could cause such issue.

rlan35 avatar Mar 22 '22 05:03 rlan35