private ibft network node error
While operating 4 IBFT private nodes of version 24.3.0, one of the nodes that is not the bootnode is experiencing the following
error: 2024-06-13 09:24:59.989+09:00 | nioEventLoopGroup-3-2 | INFO | TransactionPoolFactory | Node out of sync, disabling transaction handling 2024-06-13 09:27:07.047+09:00 | nioEventLoopGroup-3-2 | WARN | BftEventQueue | Queue size exceeded trying to add new bft event org.hyperledger.besu.consensus.common.bft.events.BftReceivedMessageEvent@771c9137
This issue persists despite server resource adequacy, restarting the server, and deleting the data directory before restarting. What is the solution to this problem?
Hi there - can you provide any more details on your machine configuration and specs? As well, maybe more logs above and after this issue? It is hard to see what is happening from the above.
Was this triggered by any specific behavior? Or just during normal operation of the node? Any more information will be helpful, thank you!
I am currently using version 24.3.0 with 4 nodes, each deployed on a separate server. I have designated bootnodes on node 1 and node 3. However, node 2 is experiencing the following error. This is the additional log you mentioned.
2024-06-25 15:05:35.737+09:00 | main | INFO | Runner | Starting Ethereum main loop ... 2024-06-25 15:05:35.737+09:00 | main | INFO | NatService | No NAT environment detected so no service could be started 2024-06-25 15:05:35.737+09:00 | main | INFO | NetworkRunner | Starting Network. 2024-06-25 15:05:35.751+09:00 | nioEventLoopGroup-2-1 | INFO | RlpxAgent | P2P RLPx agent started and listening on /[0:0:0:0:0:0:0:0]:30306. 2024-06-25 15:05:35.753+09:00 | main | INFO | PeerDiscoveryAgent | Starting peer discovery agent on host=0.0.0.0, port=30306 2024-06-25 15:05:35.769+09:00 | vert.x-eventloop-thread-1 | INFO | VertxPeerDiscoveryAgent | Started peer discovery agent successfully, on effective host=0:0:0:0:0:0:0:0%0 and port=30306 2024-06-25 15:05:35.770+09:00 | vert.x-eventloop-thread-1 | INFO | PeerDiscoveryAgent | P2P peer discovery agent started and listening on /[0:0:0:0:0:0:0:0%0]:30306 2024-06-25 15:05:35.823+09:00 | vert.x-eventloop-thread-1 | INFO | PeerDiscoveryAgent | Writing node record to disk. NodeRecord{seq=1, publicKey=0x026a07fa89b4473a02544e8134f3905f94cffb56b0eb43a70b2c8f92f6b931def9, udpAddress=Optional[/192.168.40.82:30306], tcpAddress=Optional[/192.168.40.82:30306], asBase64=-Je4QPKjiaMnVxmqvYr7vK8gCYcuPo9s6nZkNnHTZAfocfsYYxCNW_JDiGwbYhh00og3_Cz4D_jZQ8jCfJXaEfYfXw4Bg2V0aMfGhLoHJfuAgmlkgnY0gmlwhMCoKFKJc2VjcDI1NmsxoQJqB_qJtEc6AlROgTTzkF-Uz_tWsOtDpwssj5L2uTHe-YN0Y3CCdmKDdWRwgnZi, nodeId=0xcad57f4d18a17409ee5a41533ceed6c3a1e20744cc110ceebf6f0fa913cbad72, customFields={tcp=30306, udp=30306, ip=0xc0a82852, eth=[[0xba0725fb, 0x]], id=V4, secp256k1=0x026a07fa89b4473a02544e8134f3905f94cffb56b0eb43a70b2c8f92f6b931def9}} 2024-06-25 15:05:35.850+09:00 | main | INFO | DefaultP2PNetwork | Enode URL enode://6a07fa89b4473a02544e8134f3905f94cffb56b0eb43a70b2c8f92f6b931def9a5d4e2108d44fdac34b87d9ad709ae1d25d2e7fe12523d9acf532d8cc1bf90a4@192.168.40.82:30306 2024-06-25 15:05:35.851+09:00 | main | INFO | DefaultP2PNetwork | Node address 0x3ceed6c3a1e20744cc110ceebf6f0fa913cbad72 2024-06-25 15:05:35.864+09:00 | main | INFO | NetworkRunner | Supported capabilities: [eth/63, eth/64, eth/65, eth/66], [IBF/1], [snap/1] 2024-06-25 15:05:35.864+09:00 | main | INFO | DefaultSynchronizer | Starting synchronizer. 2024-06-25 15:05:35.865+09:00 | main | INFO | FastSyncDownloader | Starting sync 2024-06-25 15:05:35.865+09:00 | main | INFO | FastSyncDownloader | Clearing bonsai flat account db 2024-06-25 15:05:36.109+09:00 | nioEventLoopGroup-3-2 | INFO | TransactionPoolFactory | Node is in sync, enabling transaction handling 2024-06-25 15:05:36.441+09:00 | main | INFO | PivotSelectorFromPeers | Selecting block number 2969765 as fast sync pivot block. 2024-06-25 15:05:36.445+09:00 | main | INFO | PivotBlockRetriever | Retrieve a pivot block that can be confirmed by at least 2 peers. 2024-06-25 15:05:36.446+09:00 | main | INFO | PivotBlockConfirmer | Confirm pivot block 2969765 with at least 2 peers. 2024-06-25 15:05:36.455+09:00 | main | INFO | Runner | Ethereum main loop is up. 2024-06-25 15:05:36.456+09:00 | nioEventLoopGroup-3-2 | INFO | PivotBlockConfirmer | Received 1 confirmation(s) for pivot block header 2969765: 0xf0b450a5f8e5434922e329c4701cd4dff568efe0bbb36c3b63b10c5012a88cec 2024-06-25 15:05:36.458+09:00 | nioEventLoopGroup-3-3 | INFO | PivotBlockConfirmer | Confirmed pivot block at 2969765: 0xf0b450a5f8e5434922e329c4701cd4dff568efe0bbb36c3b63b10c5012a88cec 2024-06-25 15:05:36.464+09:00 | nioEventLoopGroup-3-3 | INFO | FastWorldStateDownloader | Begin downloading world state from peers for block 2969765 (0xf0b450a5f8e5434922e329c4701cd4dff568efe0bbb36c3b63b10c5012a88cec). State root 0xe7ca42cfa8b54b2c5d49750b94c99a658124955695b1d77cf223d770d1cf58e9 2024-06-25 15:05:36.499+09:00 | nioEventLoopGroup-3-2 | INFO | TransactionPoolFactory | Node out of sync, disabling transaction handling 2024-06-25 15:06:07.267+09:00 | EthScheduler-Services-13 (importBlock) | INFO | ImportBlocksStep | Block import progress: 236200 of 2969765 (7%) 2024-06-25 15:06:37.903+09:00 | EthScheduler-Services-13 (importBlock) | INFO | ImportBlocksStep | Block import progress: 481600 of 2969765 (16%) 2024-06-25 15:07:08.521+09:00 | EthScheduler-Services-13 (importBlock) | INFO | ImportBlocksStep | Block import progress: 717000 of 2969765 (24%) 2024-06-25 15:07:39.071+09:00 | EthScheduler-Services-13 (importBlock) | INFO | ImportBlocksStep | Block import progress: 928800 of 2969765 (31%) 2024-06-25 15:07:43.031+09:00 | nioEventLoopGroup-3-3 | WARN | BftEventQueue | Queue size exceeded trying to add new bft event org.hyperledger.besu.consensus.common.bft.events.BftReceivedMessageEvent@37424bcb
genesis.json
{ "config" : { "chainId" : 1337, "berlinBlock" : 0, "ibft2" : { "blockperiodseconds" : 2, "epochlength" : 30000, "requesttimeoutseconds" : 4 } }, "nonce" : "0x0", "timestamp" : "0x58ee40ba", "gasLimit" : "0x47b760", "difficulty" : "0x1", "mixHash" : "0x63746963616c2062797a616e74696e65206661756c7420746f6c6572616e6365", "coinbase" : "0x0000000000000000000000000000000000000000", "alloc" : { "fe3b557e8fb62b89f4916b721be55ceb828dbd73" : { "privateKey" : "8f2a55949038a9610f50fb23b5883af3b4ecb3c3bb792cbcefbd1542c692be63", "comment" : "private key and this comment are ignored. In a real chain, the private key should NOT be stored", "balance" : "0xad78ebc5ac6200000" }, "627306090abaB3A6e1400e9345bC60c78a8BEf57" : { "privateKey" : "c87509a1c067bbde78beb793e6fa76530b6382a4c0241e5e4a9ec0a0f44dc0d3", "comment" : "private key and this comment are ignored. In a real chain, the private key should NOT be stored", "balance" : "90000000000000000000000" }, "f17f52151EbEF6C7334FAD080c5704D77216b732" : { "privateKey" : "ae6ae8e5ccbfb04590405997ee2d52d2b330726137b875053c36d94e974d162f", "comment" : "private key and this comment are ignored. In a real chain, the private key should NOT be stored", "balance" : "90000000000000000000000" } }, "extraData" : "0xf87ea00000000000000000000000000000000000000000000000000000000000000000f85494353d384d02abfc5f5d78eb1c7126d0d5da6a8db1945969bd48790849cf536a470a3cd35227d23427fa94ad50fe7726e7f37daf6b7ccd2e7bb465456b662a943ceed6c3a1e20744cc110ceebf6f0fa913cbad72808400000000c0" }
######################
config2.toml
#Valid TOML config file data-path="/home/app/Besu/24.3.0/Besu-node/IBFT-Network/node2/data"
#Chain genesis-file="/home/app/Besu/24.3.0/Besu-node/IBFT-Network/genesis.json"
#Network bootnodes=[
"enode://0e8ded09d403650ea888c19d062c2b46f6f82d3015baf51c8aa5967a619418b7b77cde6a224ce973d9db7935e1bde6d7923b51e7bd54e2a9d726de431470d8a5@192.168.40.81:30305"
]
#P2P Network p2p-host="192.168.40.82" p2p-port=30306 max-peers=1000
#RPC rpc-http-enabled=true rpc-http-host="0.0.0.0" rpc-http-port=8546 rpc-http-cors-origins=["all"] host-allowlist=["*"] rpc-http-api=["ADMIN","ETH","NET","WEB3","MINER","PERM","PLUGINS","IBFT","DEBUG"] logging="INFO"
#IBFT not Mining miner-enabled=false #database pruning-enabled=true
######################
start.sh
#!/bin/bash
BESU_HOME=/home/app/Besu/24.3.0/Besu-node/IBFT-Network
BESU_BIN=besu-node2.pid
BESU_LOG=besu-node2.log
export JAVA_OPTS="-Xms8g -Xmx16g -XX:+UseG1GC -XX:MaxGCPauseMillis=200 -XX:G1ReservePercent=20 -XX:InitiatingHeapOccupancyPercent=35"
besu --config-file=config2.toml --min-gas-price=0 --sync-mode=FAST --sync-min-peers=2 --metrics-enabled --metrics-host=0.0.0.0 --metrics-port=9546 >> $BESU_HOME/logs/$BESU_LOG &
echo $! > $BESU_HOME/bin/$BESU_BIN
######################
nohup_start.sh
echo besu node2 start
BESU_HOME=/home/app/Besu/24.3.0/Besu-node/IBFT-Network
BESU_LOG=besu-node2.log
export JAVA_OPTS="-Xms8g -Xmx16g -XX:+UseG1GC -XX:MaxGCPauseMillis=200 -XX:G1ReservePercent=20 -XX:InitiatingHeapOccupancyPercent=35"
nohup sh $BESU_HOME/start2.sh >> $BESU_HOME/logs/$BESU_LOG 2>&1 &
closing due to inactivity. if you're still having issues, suggest firstly updating to a newer version of besu to make sure you have any bugfixes