erigon
erigon copied to clipboard
Published
20 hours ago •
erigontech
erigontech
goerli / prater stopped recieving blocks
System information
Erigon version: v2022.08.02
OS & Version: Linux
Commit hash : 35c4faa
Our eragon/teku node has fallen off (Payload for child of block root 0x89c728290.... was invalid and Fork choice missing header wth hash dc90c904fa2...)
https://stats.goerli.net/ shows only 4 nodes active.
Last block on prater according to both beaconcha.in and our node is 3692511/115390@2022-08-18T10:22:22Z (27 min ago)
The erigon node just has this looping in the logs since the incident started:
INFO[08-18|11:03:48.055] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:03:48.055] [1/16 Headers] Fork choice missing header with hash dc90c904fa2c2d742a23a76e044fd1174913a16620adf27544b3077a85abc48e
INFO[08-18|11:03:48.056] RPC Daemon notified of new headers from=7426169 to=7426170 header sending=3.364µs log sending=80ns
INFO[08-18|11:03:48.056] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:03:48.056] [1/16 Headers] Fork choice missing header with hash dc90c904fa2c2d742a23a76e044fd1174913a16620adf27544b3077a85abc48e
INFO[08-18|11:03:48.056] RPC Daemon notified of new headers from=7426169 to=7426170 header sending=3.24µs log sending=79ns
eth_blockNumber RPC does not procees from 7426170.
UPDATE:
After ~50min the node was restarted. Blocks seem to pick up but there is still an ongoing fork and interruption in the consensus network and we don't have any finalization:
[sudo] password for user:
WARNING: Localhost DNS setting (--dns=127.0.0.1) may fail in containers.
INFO[08-18|11:04:30.481] Build info git_branch=HEAD git_tag=v2022.08.02-dirty git_commit=35c4faa1b41e8379a74d0385505add0dd450c2ed
INFO[08-18|11:04:30.481] Starting Erigon on Görli testnet...
INFO[08-18|11:04:30.483] Maximum peer count ETH=100 total=100
INFO[08-18|11:04:30.483] starting HTTP APIs APIs=eth,debug,net,trace,web3,erigon,engine
INFO[08-18|11:04:30.483] torrent verbosity level=INF
INFO[08-18|11:04:32.586] Set global gas cap cap=50000000
INFO[08-18|11:04:32.602] Opening Database label=chaindata path=/app/chaindata
INFO[08-18|11:04:32.628] Initialised chain configuration config="{ChainID: 5, Homestead: 0, DAO: <nil>, DAO Support: true, Tangerine Whistle: 0, Spurious Dragon: 0, Byzantium: 0, Constantinople: 0, Petersburg: 0, Istanbul: 1561651, Muir Glacier: <
nil>, Berlin: 4460644, London: 5062605, Arrow Glacier: <nil>, Gray Glacier: <nil>, Terminal Total Difficulty: 10790000, Merge Netsplit: <nil>, Engine: clique}" genesis=0xbf7e331f7f7c1dd2e05159666b3bf8bc7a8a3a9eb1d518969eab529dd9b88c1a
INFO[08-18|11:04:32.628] Effective prune_flags= snapshot_flags="--snapshots=true" history.v2=false
INFO[08-18|11:04:36.873] Initialising Ethereum protocol network=5
INFO[08-18|11:04:39.360] Starting private RPC server on=127.0.0.1:9091
INFO[08-18|11:04:39.360] new subscription to logs established
INFO[08-18|11:04:39.360] rpc filters: subscribing to Erigon events
INFO[08-18|11:04:39.360] new subscription to newHeaders established
INFO[08-18|11:04:39.360] New txs subscriber joined
INFO[08-18|11:04:44.054] Reading JWT secret path=/app/token.txt
INFO[08-18|11:04:44.055] HTTP endpoint opened for Engine API url=localhost:8555 ws=true ws.compression=true
INFO[08-18|11:04:44.055] HTTP endpoint opened url=localhost:8554 ws=true ws.compression=true grpc=false
INFO[08-18|11:04:44.065] [Snapshots] Fetching torrent files metadata
INFO[08-18|11:04:44.067] [Snapshots] Stat blocks=7336k indices=7336k alloc=972.2MB sys=1.6GB
INFO[08-18|11:04:44.073] Started P2P networking version=66 XXXX
INFO[08-18|11:04:44.073] RPC Daemon notified of new headers from=7426169 to=7426170 header sending=12.41µs log sending=352ns
INFO[08-18|11:04:44.073] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:04:46.845] [txpool] Started
INFO[08-18|11:04:48.127] [1/16 Headers] Fork choice missing header with hash 24926b75a4530699bc67e7f6db44f53cba3aa58b00b5479bb1b103b26e8a3fbb
INFO[08-18|11:04:48.127] [1/16 Headers] Downloading PoS headers... height=0 hash=0x24926b75a4530699bc67e7f6db44f53cba3aa58b00b5479bb1b103b26e8a3fbb requestId=1
INFO[08-18|11:04:48.128] RPC Daemon notified of new headers from=7426169 to=7426170 header sending=3.628µs log sending=262ns
INFO[08-18|11:04:48.128] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:05:39.362] [txpool] stat block=7426169 pending=1430 baseFee=188 queued=10970 alloc=1.2GB sys=1.6GB
WARN[08-18|11:06:01.842] Unexpected header hash=0x7e4bde852acaef941bfd9f0d00d976f68c3245a1e7621afa0862c6b0dd1bc4b7 expected=0x24926b75a4530699bc67e7f6db44f53cba3aa58b00b5479bb1b103b26e8a3fbb
WARN[08-18|11:06:32.257] Unexpected header hash=0x7cd5f0a182fa9d56d216cbdcded410074bbb3ba45c4f3d862201ab05fbc4ef62 expected=0x24926b75a4530699bc67e7f6db44f53cba3aa58b00b5479bb1b103b26e8a3fbb
INFO[08-18|11:06:34.510] posAnchor blockHeight=7426275
INFO[08-18|11:06:35.938] [5/7 Execution] Completed on block=7426170
INFO[08-18|11:06:36.593] [5/7 Execution] Completed on block=7426171
INFO[08-18|11:06:36.873] [p2p] GoodPeers eth66=1
INFO[08-18|11:06:36.975] [5/7 Execution] Completed on block=7426172
INFO[08-18|11:06:37.449] [5/7 Execution] Completed on block=7426173
INFO[08-18|11:06:38.222] [5/7 Execution] Completed on block=7426174
INFO[08-18|11:06:39.241] [5/7 Execution] Completed on block=7426175
INFO[08-18|11:06:39.362] [txpool] stat block=7426169 pending=1437 baseFee=188 queued=10988 alloc=1.4GB sys=1.6GB
INFO[08-18|11:06:41.207] [5/7 Execution] Completed on block=7426176
INFO[08-18|11:06:41.724] [5/7 Execution] Completed on block=7426177
INFO[08-18|11:06:42.184] [5/7 Execution] Completed on block=7426178
INFO[08-18|11:06:42.739] [5/7 Execution] Completed on block=7426179
INFO[08-18|11:06:43.346] [5/7 Execution] Completed on block=7426180
INFO[08-18|11:06:43.992] [5/7 Execution] Completed on block=7426181
INFO[08-18|11:06:44.786] [5/7 Execution] Completed on block=7426182
INFO[08-18|11:06:45.400] [5/7 Execution] Completed on block=7426183
INFO[08-18|11:06:46.159] [5/7 Execution] Completed on block=7426184
INFO[08-18|11:06:47.155] [5/7 Execution] Completed on block=7426185
INFO[08-18|11:06:47.663] [4/7 Senders] Started from=7426169 to=7426186
INFO[08-18|11:06:47.684] [5/7 Execution] Blocks execution from=7426169 to=7426186
INFO[08-18|11:06:47.880] [5/7 Execution] Completed on block=7426186
INFO[08-18|11:06:47.880] [6/7 HashState] Promoting plain state from=7426169 to=7426186
INFO[08-18|11:06:47.880] [6/7 HashState] Incremental promotion from=7426169 to=7426186 codes=true csbucket=AccountChangeSet
INFO[08-18|11:06:47.884] [6/7 HashState] Incremental promotion from=7426169 to=7426186 codes=false csbucket=AccountChangeSet
INFO[08-18|11:06:47.886] [6/7 HashState] Incremental promotion from=7426169 to=7426186 codes=false csbucket=StorageChangeSet
INFO[08-18|11:06:47.899] [7/7 IntermediateHashes] Generating intermediate hashes from=7426169 to=7426186
INFO[08-18|11:06:48.250] [4/7 Senders] Started from=7426169 to=7426187
INFO[08-18|11:06:48.274] [5/7 Execution] Blocks execution from=7426169 to=7426187
INFO[08-18|11:06:48.489] [5/7 Execution] Completed on block=7426187
INFO[08-18|11:06:48.489] [6/7 HashState] Promoting plain state from=7426169 to=7426187
INFO[08-18|11:06:48.489] [6/7 HashState] Incremental promotion from=7426169 to=7426187 codes=true csbucket=AccountChangeSet
INFO[08-18|11:06:48.495] [6/7 HashState] Incremental promotion from=7426169 to=7426187 codes=false csbucket=AccountChangeSet
INFO[08-18|11:06:48.498] [6/7 HashState] Incremental promotion from=7426169 to=7426187 codes=false csbucket=StorageChangeSet
INFO[08-18|11:06:48.515] [7/7 IntermediateHashes] Generating intermediate hashes from=7426169 to=7426187
INFO[08-18|11:06:49.161] [4/7 Senders] Started from=7426169 to=7426188
INFO[08-18|11:06:49.182] [5/7 Execution] Blocks execution from=7426169 to=7426188
INFO[08-18|11:06:49.475] [5/7 Execution] Completed on block=7426188
INFO[08-18|11:06:49.475] [6/7 HashState] Promoting plain state from=7426169 to=7426188
INFO[08-18|11:06:49.475] [6/7 HashState] Incremental promotion from=7426169 to=7426188 codes=true csbucket=AccountChangeSet
INFO[08-18|11:06:49.484] [6/7 HashState] Incremental promotion from=7426169 to=7426188 codes=false csbucket=AccountChangeSet
INFO[08-18|11:06:49.488] [6/7 HashState] Incremental promotion from=7426169 to=7426188 codes=false csbucket=StorageChangeSet
INFO[08-18|11:06:49.504] [7/7 IntermediateHashes] Generating intermediate hashes from=7426169 to=7426188
INFO[08-18|11:06:50.293] [4/7 Senders] Started from=7426169 to=7426189
INFO[08-18|11:06:50.318] [5/7 Execution] Blocks execution from=7426169 to=7426189
INFO[08-18|11:06:50.675] [5/7 Execution] Completed on block=7426189
INFO[08-18|11:06:50.675] [6/7 HashState] Promoting plain state from=7426169 to=7426189
INFO[08-18|11:06:50.675] [6/7 HashState] Incremental promotion from=7426169 to=7426189 codes=true csbucket=AccountChangeSet
INFO[08-18|11:06:50.684] [6/7 HashState] Incremental promotion from=7426169 to=7426189 codes=false csbucket=AccountChangeSet
INFO[08-18|11:06:50.688] [6/7 HashState] Incremental promotion from=7426169 to=7426189 codes=false csbucket=StorageChangeSet
INFO[08-18|11:06:50.710] [7/7 IntermediateHashes] Generating intermediate hashes from=7426169 to=7426189
INFO[08-18|11:06:51.295] [4/7 Senders] Started from=7426169 to=7426190
INFO[08-18|11:06:51.313] [5/7 Execution] Blocks execution from=7426169 to=7426190
INFO[08-18|11:06:51.574] [5/7 Execution] Completed on block=7426190
INFO[08-18|11:06:51.574] [6/7 HashState] Promoting plain state from=7426169 to=7426190
INFO[08-18|11:06:51.574] [6/7 HashState] Incremental promotion from=7426169 to=7426190 codes=true csbucket=AccountChangeSet
INFO[08-18|11:06:51.577] [6/7 HashState] Incremental promotion from=7426169 to=7426190 codes=false csbucket=AccountChangeSet
INFO[08-18|11:06:51.580] [6/7 HashState] Incremental promotion from=7426169 to=7426190 codes=false csbucket=StorageChangeSet
INFO[08-18|11:06:51.597] [7/7 IntermediateHashes] Generating intermediate hashes from=7426169 to=7426190
INFO[08-18|11:06:51.948] [4/7 Senders] Started from=7426169 to=7426191
INFO[08-18|11:06:51.968] [5/7 Execution] Blocks execution from=7426169 to=7426191
INFO[08-18|11:06:52.339] [5/7 Execution] Completed on block=7426191
INFO[08-18|11:06:52.339] [6/7 HashState] Promoting plain state from=7426169 to=7426191
INFO[08-18|11:06:52.339] [6/7 HashState] Incremental promotion from=7426169 to=7426191 codes=true csbucket=AccountChangeSet
INFO[08-18|11:06:52.344] [6/7 HashState] Incremental promotion from=7426169 to=7426191 codes=false csbucket=AccountChangeSet
INFO[08-18|11:06:52.349] [6/7 HashState] Incremental promotion from=7426169 to=7426191 codes=false csbucket=StorageChangeSet
INFO[08-18|11:06:52.367] [7/7 IntermediateHashes] Generating intermediate hashes from=7426169 to=7426191
INFO[08-18|11:06:52.798] [4/7 Senders] Started from=7426169 to=7426192
INFO[08-18|11:06:52.821] [5/7 Execution] Blocks execution from=7426169 to=7426192
INFO[08-18|11:06:53.167] [5/7 Execution] Completed on block=7426192
INFO[08-18|11:06:53.167] [6/7 HashState] Promoting plain state from=7426169 to=7426192
INFO[08-18|11:06:53.167] [6/7 HashState] Incremental promotion from=7426169 to=7426192 codes=true csbucket=AccountChangeSet
INFO[08-18|11:06:53.173] [6/7 HashState] Incremental promotion from=7426169 to=7426192 codes=false csbucket=AccountChangeSet
INFO[08-18|11:06:53.177] [6/7 HashState] Incremental promotion from=7426169 to=7426192 codes=false csbucket=StorageChangeSet
INFO[08-18|11:06:53.194] [7/7 IntermediateHashes] Generating intermediate hashes from=7426169 to=7426192
INFO[08-18|11:06:53.859] [4/7 Senders] Started from=7426169 to=7426193
INFO[08-18|11:06:53.884] [5/7 Execution] Blocks execution from=7426169 to=7426193
INFO[08-18|11:06:54.206] [5/7 Execution] Completed on block=7426193
INFO[08-18|11:06:54.206] [6/7 HashState] Promoting plain state from=7426169 to=7426193
INFO[08-18|11:06:54.206] [6/7 HashState] Incremental promotion from=7426169 to=7426193 codes=true csbucket=AccountChangeSet
INFO[08-18|11:06:54.212] [6/7 HashState] Incremental promotion from=7426169 to=7426193 codes=false csbucket=AccountChangeSet
INFO[08-18|11:06:54.215] [6/7 HashState] Incremental promotion from=7426169 to=7426193 codes=false csbucket=StorageChangeSet
INFO[08-18|11:06:54.233] [7/7 IntermediateHashes] Generating intermediate hashes from=7426169 to=7426193
INFO[08-18|11:06:54.965] [4/7 Senders] Started from=7426169 to=7426194
INFO[08-18|11:06:54.982] [5/7 Execution] Blocks execution from=7426169 to=7426194
INFO[08-18|11:06:55.376] [5/7 Execution] Completed on block=7426194
INFO[08-18|11:06:55.376] [6/7 HashState] Promoting plain state from=7426169 to=7426194
INFO[08-18|11:06:55.376] [6/7 HashState] Incremental promotion from=7426169 to=7426194 codes=true csbucket=AccountChangeSet
INFO[08-18|11:06:55.384] [6/7 HashState] Incremental promotion from=7426169 to=7426194 codes=false csbucket=AccountChangeSet
INFO[08-18|11:06:55.388] [6/7 HashState] Incremental promotion from=7426169 to=7426194 codes=false csbucket=StorageChangeSet
INFO[08-18|11:06:55.405] [7/7 IntermediateHashes] Generating intermediate hashes from=7426169 to=7426194
INFO[08-18|11:06:55.928] [4/7 Senders] Started from=7426169 to=7426195
INFO[08-18|11:06:55.953] [5/7 Execution] Blocks execution from=7426169 to=7426195
INFO[08-18|11:06:56.295] [5/7 Execution] Completed on block=7426195
INFO[08-18|11:06:56.295] [6/7 HashState] Promoting plain state from=7426169 to=7426195
INFO[08-18|11:06:56.295] [6/7 HashState] Incremental promotion from=7426169 to=7426195 codes=true csbucket=AccountChangeSet
INFO[08-18|11:06:56.300] [6/7 HashState] Incremental promotion from=7426169 to=7426195 codes=false csbucket=AccountChangeSet
INFO[08-18|11:06:56.303] [6/7 HashState] Incremental promotion from=7426169 to=7426195 codes=false csbucket=StorageChangeSet
INFO[08-18|11:06:56.322] [7/7 IntermediateHashes] Generating intermediate hashes from=7426169 to=7426195
INFO[08-18|11:06:56.692] [4/7 Senders] Started from=7426169 to=7426196
INFO[08-18|11:06:56.718] [5/7 Execution] Blocks execution from=7426169 to=7426196
INFO[08-18|11:06:57.076] [5/7 Execution] Completed on block=7426196
INFO[08-18|11:06:57.076] [6/7 HashState] Promoting plain state from=7426169 to=7426196
INFO[08-18|11:06:57.076] [6/7 HashState] Incremental promotion from=7426169 to=7426196 codes=true csbucket=AccountChangeSet
INFO[08-18|11:06:57.082] [6/7 HashState] Incremental promotion from=7426169 to=7426196 codes=false csbucket=AccountChangeSet
INFO[08-18|11:06:57.086] [6/7 HashState] Incremental promotion from=7426169 to=7426196 codes=false csbucket=StorageChangeSet
INFO[08-18|11:06:57.105] [7/7 IntermediateHashes] Generating intermediate hashes from=7426169 to=7426196
INFO[08-18|11:06:58.011] [4/7 Senders] Started from=7426169 to=7426197
INFO[08-18|11:06:58.032] [5/7 Execution] Blocks execution from=7426169 to=7426197
INFO[08-18|11:06:58.404] [5/7 Execution] Completed on block=7426197
INFO[08-18|11:06:58.404] [6/7 HashState] Promoting plain state from=7426169 to=7426197
INFO[08-18|11:06:58.404] [6/7 HashState] Incremental promotion from=7426169 to=7426197 codes=true csbucket=AccountChangeSet
INFO[08-18|11:06:58.411] [6/7 HashState] Incremental promotion from=7426169 to=7426197 codes=false csbucket=AccountChangeSet
INFO[08-18|11:06:58.414] [6/7 HashState] Incremental promotion from=7426169 to=7426197 codes=false csbucket=StorageChangeSet
INFO[08-18|11:06:58.433] [7/7 IntermediateHashes] Generating intermediate hashes from=7426169 to=7426197
INFO[08-18|11:06:58.876] [4/7 Senders] Started from=7426169 to=7426198
INFO[08-18|11:06:58.897] [5/7 Execution] Blocks execution from=7426169 to=7426198
INFO[08-18|11:06:59.303] [5/7 Execution] Completed on block=7426198
INFO[08-18|11:06:59.303] [6/7 HashState] Promoting plain state from=7426169 to=7426198
INFO[08-18|11:06:59.303] [6/7 HashState] Incremental promotion from=7426169 to=7426198 codes=true csbucket=AccountChangeSet
INFO[08-18|11:06:59.308] [6/7 HashState] Incremental promotion from=7426169 to=7426198 codes=false csbucket=AccountChangeSet
INFO[08-18|11:06:59.312] [6/7 HashState] Incremental promotion from=7426169 to=7426198 codes=false csbucket=StorageChangeSet
INFO[08-18|11:06:59.332] [7/7 IntermediateHashes] Generating intermediate hashes from=7426169 to=7426198
INFO[08-18|11:06:59.864] [4/7 Senders] Started from=7426169 to=7426199
INFO[08-18|11:06:59.883] [5/7 Execution] Blocks execution from=7426169 to=7426199
INFO[08-18|11:07:00.360] [5/7 Execution] Completed on block=7426199
INFO[08-18|11:07:00.360] [6/7 HashState] Promoting plain state from=7426169 to=7426199
INFO[08-18|11:07:00.360] [6/7 HashState] Incremental promotion from=7426169 to=7426199 codes=true csbucket=AccountChangeSet
INFO[08-18|11:07:00.367] [6/7 HashState] Incremental promotion from=7426169 to=7426199 codes=false csbucket=AccountChangeSet
INFO[08-18|11:07:00.373] [6/7 HashState] Incremental promotion from=7426169 to=7426199 codes=false csbucket=StorageChangeSet
INFO[08-18|11:07:00.401] [7/7 IntermediateHashes] Generating intermediate hashes from=7426169 to=7426199
INFO[08-18|11:07:00.906] [4/7 Senders] Started from=7426169 to=7426200
INFO[08-18|11:07:00.928] [5/7 Execution] Blocks execution from=7426169 to=7426200
INFO[08-18|11:07:01.325] [5/7 Execution] Completed on block=7426200
INFO[08-18|11:07:01.325] [6/7 HashState] Promoting plain state from=7426169 to=7426200
INFO[08-18|11:07:01.325] [6/7 HashState] Incremental promotion from=7426169 to=7426200 codes=true csbucket=AccountChangeSet
INFO[08-18|11:07:01.331] [6/7 HashState] Incremental promotion from=7426169 to=7426200 codes=false csbucket=AccountChangeSet
INFO[08-18|11:07:01.336] [6/7 HashState] Incremental promotion from=7426169 to=7426200 codes=false csbucket=StorageChangeSet
INFO[08-18|11:07:01.356] [7/7 IntermediateHashes] Generating intermediate hashes from=7426169 to=7426200
INFO[08-18|11:07:01.755] [4/7 Senders] Started from=7426169 to=7426201
INFO[08-18|11:07:01.777] [5/7 Execution] Blocks execution from=7426169 to=7426201
INFO[08-18|11:07:02.169] [5/7 Execution] Completed on block=7426201
INFO[08-18|11:07:02.169] [6/7 HashState] Promoting plain state from=7426169 to=7426201
INFO[08-18|11:07:02.169] [6/7 HashState] Incremental promotion from=7426169 to=7426201 codes=true csbucket=AccountChangeSet
INFO[08-18|11:07:02.174] [6/7 HashState] Incremental promotion from=7426169 to=7426201 codes=false csbucket=AccountChangeSet
INFO[08-18|11:07:02.179] [6/7 HashState] Incremental promotion from=7426169 to=7426201 codes=false csbucket=StorageChangeSet
INFO[08-18|11:07:02.198] [7/7 IntermediateHashes] Generating intermediate hashes from=7426169 to=7426201
INFO[08-18|11:07:02.351] PoS headers verified and saved requestId=1 fork head=0xb8ffd3854f0af7d96ebceb8891460599926c1c110f4127bda376a958139b0df7
INFO[08-18|11:07:02.351] [1/16 Headers] DONE in=2m14.22293417s
INFO[08-18|11:07:02.367] RPC Daemon notified of new headers from=7426169 to=7426466 header sending=236.631µs log sending=283ns
INFO[08-18|11:07:02.367] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:07:02.383] [1/16 Headers] Fork choice missing header with hash b9576e1a98d88a290ce2c1e399f3b859503657183939e5fc7ccad1b731622ac4
INFO[08-18|11:07:02.383] [1/16 Headers] Downloading PoS headers... height=0 hash=0xb9576e1a98d88a290ce2c1e399f3b859503657183939e5fc7ccad1b731622ac4 requestId=2
INFO[08-18|11:07:02.384] RPC Daemon notified of new headers from=7426169 to=7426466 header sending=193.216µs log sending=290ns
INFO[08-18|11:07:02.384] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:07:02.397] [1/16 Headers] Fork choice missing header with hash abe6052e013be30206081de5ce01f3a3ffb45c478ced5aec8f779cf8bb4befcc
INFO[08-18|11:07:02.398] RPC Daemon notified of new headers from=7426169 to=7426466 header sending=165.786µs log sending=226ns
INFO[08-18|11:07:02.398] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:07:02.411] [1/16 Headers] Fork choice missing header with hash f3fe66c66ca4921d623891236a4061fa1617879fcbb1be79f4178505ff8f7930
INFO[08-18|11:07:02.411] RPC Daemon notified of new headers from=7426169 to=7426466 header sending=166.351µs log sending=269ns
INFO[08-18|11:07:02.411] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:07:02.995] PoS headers verified and saved requestId=2 fork head=0x7cd5f0a182fa9d56d216cbdcded410074bbb3ba45c4f3d862201ab05fbc4ef62
INFO[08-18|11:07:03.000] RPC Daemon notified of new headers from=7426169 to=7426478 header sending=197.913µs log sending=308ns
INFO[08-18|11:07:03.000] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:07:03.000] [1/16 Headers] Fork choice missing header with hash f3fe66c66ca4921d623891236a4061fa1617879fcbb1be79f4178505ff8f7930
INFO[08-18|11:07:03.000] [1/16 Headers] Downloading PoS headers... height=0 hash=0xf3fe66c66ca4921d623891236a4061fa1617879fcbb1be79f4178505ff8f7930 requestId=4
INFO[08-18|11:07:03.000] RPC Daemon notified of new headers from=7426169 to=7426478 header sending=105.394µs log sending=114ns
INFO[08-18|11:07:03.000] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:07:03.250] PoS headers verified and saved requestId=4 fork head=0xabe6052e013be30206081de5ce01f3a3ffb45c478ced5aec8f779cf8bb4befcc
INFO[08-18|11:07:03.255] RPC Daemon notified of new headers from=7426169 to=7426480 header sending=119.309µs log sending=215ns
INFO[08-18|11:07:03.255] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:07:03.261] [1/16 Headers] Fork choice re-org headerNumber=7426480 forkingPoint=7426169
INFO[08-18|11:07:03.262] UnwindTo block=7426169 bad_block_hash=0x0000000000000000000000000000000000000000000000000000000000000000
INFO[08-18|11:07:03.262] [1/16 Headers] Unsettled forkchoice after unwind height=7426480 forkchoice="&{HeadBlockHash:0xf3fe66c66ca4921d623891236a4061fa1617879fcbb1be79f4178505ff8f7930 SafeBlockHash:0x02782193a7a4488e0707899a1e826c851e4074bb87493f8b8dda7b58
4875421b FinalizedBlockHash:0x99f24832abf9b6747faddc0b804f5c84f82bf4363a8057ed033d0d887ea39d42}"
INFO[08-18|11:07:03.264] [4/16 Bodies] Processing bodies... from=7426169 to=7426480
^[[A^[[A^[[AINFO[08-18|11:07:12.538] [4/16 Bodies] Processed highest=7426480
INFO[08-18|11:07:12.538] [5/16 Senders] Started from=7426169 to=7426480
INFO[08-18|11:07:12.728] [6/16 Execution] Blocks execution from=7426169 to=7426480
INFO[08-18|11:07:25.852] [6/16 Execution] Completed on block=7426480
INFO[08-18|11:07:25.860] [8/16 HashState] Promoting plain state from=7426169 to=7426480
INFO[08-18|11:07:25.860] [8/16 HashState] Incremental promotion from=7426169 to=7426480 codes=true csbucket=AccountChangeSet
INFO[08-18|11:07:26.770] [8/16 HashState] Incremental promotion from=7426169 to=7426480 codes=false csbucket=AccountChangeSet
INFO[08-18|11:07:28.690] [8/16 HashState] Incremental promotion from=7426169 to=7426480 codes=false csbucket=StorageChangeSet
INFO[08-18|11:07:33.428] [9/16 IntermediateHashes] Generating intermediate hashes from=7426169 to=7426480
INFO[08-18|11:07:39.362] [txpool] stat block=7426201 pending=1451 baseFee=188 queued=11039 alloc=1.9GB sys=2.1GB
INFO[08-18|11:07:47.664] [10/16 CallTraces] Pruned call trace intermediate table from=7336169 to=7336479
INFO[08-18|11:07:59.171] [13/16 LogIndex] processing from=7426170 to=7426480
47s
INFO[08-18|11:08:06.100] RPC Daemon notified of new headers from=7426169 to=7426480 header sending=8.764668ms log sending=389ns
INFO[08-18|11:08:06.100] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:08:06.191] [1/16 Headers] Fork choice missing header with hash 5b29eabfb1e319411a11ba15a339831522c84ba41d0f8b4a984956446afc660a
INFO[08-18|11:08:06.191] [1/16 Headers] Downloading PoS headers... height=0 hash=0x5b29eabfb1e319411a11ba15a339831522c84ba41d0f8b4a984956446afc660a requestId=5
INFO[08-18|11:08:06.192] RPC Daemon notified of new headers from=7426480 to=7426481 header sending=23.763µs log sending=453ns
INFO[08-18|11:08:06.192] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:08:06.247] [1/16 Headers] Fork choice missing header with hash 110f65c50c759d832e95b74b0a0457bfc825ba6ad8347a3b6a0b44bff046eb39
INFO[08-18|11:08:06.249] RPC Daemon notified of new headers from=7426480 to=7426481 header sending=21.189µs log sending=269ns
INFO[08-18|11:08:06.249] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:08:06.301] [1/16 Headers] Fork choice missing header with hash e7763a7f3536ecd7e9fd9b6f7184db69b1de7cb49c1c96f9764149e61272dd4e
INFO[08-18|11:08:06.302] RPC Daemon notified of new headers from=7426480 to=7426481 header sending=18.552µs log sending=289ns
INFO[08-18|11:08:06.302] [1/16 Headers] Waiting for Beacon Chain...
WARN[08-18|11:08:07.805] Unexpected header hash=0xe7763a7f3536ecd7e9fd9b6f7184db69b1de7cb49c1c96f9764149e61272dd4e expected=0x5b29eabfb1e319411a11ba15a339831522c84ba41d0f8b4a984956446afc660a
INFO[08-18|11:08:09.633] [5/7 Execution] Completed on block=7426481
INFO[08-18|11:08:09.772] PoS headers verified and saved requestId=5 fork head=0xf3fe66c66ca4921d623891236a4061fa1617879fcbb1be79f4178505ff8f7930
INFO[08-18|11:08:09.777] RPC Daemon notified of new headers from=7426480 to=7426481 header sending=22.272µs log sending=510ns
INFO[08-18|11:08:09.777] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:08:09.778] [1/16 Headers] Fork choice missing header with hash e7763a7f3536ecd7e9fd9b6f7184db69b1de7cb49c1c96f9764149e61272dd4e
INFO[08-18|11:08:09.778] [1/16 Headers] Downloading PoS headers... height=0 hash=0xe7763a7f3536ecd7e9fd9b6f7184db69b1de7cb49c1c96f9764149e61272dd4e requestId=7
INFO[08-18|11:08:09.780] RPC Daemon notified of new headers from=7426480 to=7426481 header sending=18.323µs log sending=640ns
INFO[08-18|11:08:09.780] [1/16 Headers] Waiting for Beacon Chain...
WARN[08-18|11:08:10.198] Unexpected header hash=0x7e4bde852acaef941bfd9f0d00d976f68c3245a1e7621afa0862c6b0dd1bc4b7 expected=0xe7763a7f3536ecd7e9fd9b6f7184db69b1de7cb49c1c96f9764149e61272dd4e
INFO[08-18|11:08:15.874] [5/7 Execution] Completed on block=7426482
INFO[08-18|11:08:16.301] [5/7 Execution] Completed on block=7426483
INFO[08-18|11:08:16.333] PoS headers verified and saved requestId=7 fork head=0x110f65c50c759d832e95b74b0a0457bfc825ba6ad8347a3b6a0b44bff046eb39
INFO[08-18|11:08:16.337] RPC Daemon notified of new headers from=7426480 to=7426483 header sending=5.612µs log sending=201ns
INFO[08-18|11:08:16.337] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:08:16.337] [1/16 Headers] Fork choice re-org headerNumber=7426483 forkingPoint=7426480
INFO[08-18|11:08:16.337] UnwindTo block=7426480 bad_block_hash=0x0000000000000000000000000000000000000000000000000000000000000000
INFO[08-18|11:08:16.337] [1/16 Headers] Unsettled forkchoice after unwind height=7426483 forkchoice="&{HeadBlockHash:0xe7763a7f3536ecd7e9fd9b6f7184db69b1de7cb49c1c96f9764149e61272dd4e SafeBlockHash:0x297d1dd5e3523020a4be6187653fd3244f00b7bc0e4135c71d5c5f86
0b10519c FinalizedBlockHash:0x02782193a7a4488e0707899a1e826c851e4074bb87493f8b8dda7b584875421b}"
INFO[08-18|11:08:17.066] [6/16 Execution] Completed on block=7426483
INFO[08-18|11:08:17.325] RPC Daemon notified of new headers from=7426480 to=7426483 header sending=39.763µs log sending=692ns
INFO[08-18|11:08:17.325] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:08:24.229] [1/16 Headers] New payload missing parent
INFO[08-18|11:08:24.229] [1/16 Headers] Downloading PoS headers... height=7426484 hash=0x9a3bb007ee3bec94eaef01c0fb4efff824288972c39358aed2c0165a890ff6ba requestId=8
INFO[08-18|11:08:24.338] RPC Daemon notified of new headers from=7426483 to=7426484 header sending=12.544µs log sending=421ns
INFO[08-18|11:08:24.338] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:08:25.342] [5/7 Execution] Completed on block=7426484
INFO[08-18|11:08:25.433] PoS headers verified and saved requestId=8 fork head=0xe7763a7f3536ecd7e9fd9b6f7184db69b1de7cb49c1c96f9764149e61272dd4e
INFO[08-18|11:08:25.438] RPC Daemon notified of new headers from=7426483 to=7426484 header sending=18.407µs log sending=1.036µs
INFO[08-18|11:08:25.439] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:08:25.560] [5/7 Execution] Completed on block=7426485
INFO[08-18|11:08:25.661] RPC Daemon notified of new headers from=7426483 to=7426485 header sending=9.268µs log sending=207ns
INFO[08-18|11:08:25.661] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:08:36.242] [5/7 Execution] Completed on block=7426486
INFO[08-18|11:08:36.300] RPC Daemon notified of new headers from=7426483 to=7426486 header sending=12.653µs log sending=320ns
INFO[08-18|11:08:36.300] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:08:36.309] [1/16 Headers] Fork choice re-org headerNumber=7426486 forkingPoint=7426483
INFO[08-18|11:08:36.309] UnwindTo block=7426483 bad_block_hash=0x0000000000000000000000000000000000000000000000000000000000000000
INFO[08-18|11:08:36.309] [1/16 Headers] Unsettled forkchoice after unwind height=7426486 forkchoice="&{HeadBlockHash:0x9c6b5d89fc82b0a5d941e347ce981f371300b97144fa7ceb018e6311ac6b9cd3 SafeBlockHash:0x297d1dd5e3523020a4be6187653fd3244f00b7bc0e4135c71d5c5f86
0b10519c FinalizedBlockHash:0x02782193a7a4488e0707899a1e826c851e4074bb87493f8b8dda7b584875421b}"
INFO[08-18|11:08:36.381] [6/16 Execution] Completed on block=7426486
INFO[08-18|11:08:36.680] RPC Daemon notified of new headers from=7426483 to=7426486 header sending=10.499µs log sending=218ns
INFO[08-18|11:08:36.680] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:08:36.873] [p2p] GoodPeers eth66=4
INFO[08-18|11:08:39.363] [txpool] stat block=7426486 pending=62 baseFee=176 queued=10629 alloc=1.5GB sys=2.2GB
INFO[08-18|11:08:48.206] [5/7 Execution] Completed on block=7426487
INFO[08-18|11:08:48.260] RPC Daemon notified of new headers from=7426486 to=7426487 header sending=9.305µs log sending=208ns
INFO[08-18|11:08:48.260] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:08:48.268] Flushing in-memory state
INFO[08-18|11:08:48.369] RPC Daemon notified of new headers from=7426486 to=7426487 header sending=15.372µs log sending=302ns
INFO[08-18|11:08:48.369] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:09:09.169] UnwindTo block=7426486 bad_block_hash=0x0000000000000000000000000000000000000000000000000000000000000000
INFO[08-18|11:09:09.169] [6/7 HashState] Unwinding started from=7426487 to=7426486 storage=false codes=true
INFO[08-18|11:09:09.169] [6/7 HashState] Unwinding started from=7426487 to=7426486 storage=false codes=false
INFO[08-18|11:09:09.169] [6/7 HashState] Unwinding started from=7426487 to=7426486 storage=true codes=false
INFO[08-18|11:09:09.170] [7/7 IntermediateHashes] Unwinding from=7426487 to=7426486 csbucket=AccountChangeSet
INFO[08-18|11:09:09.170] [7/7 IntermediateHashes] Unwinding from=7426487 to=7426486 csbucket=StorageChangeSet
INFO[08-18|11:09:09.177] [7/7 IntermediateHashes] Trie root hash=0xcd3623159ad263ebfec983a717e2b24fdc72ba242187c2cff0d89d672c353e5e
INFO[08-18|11:09:09.178] [5/7 Execution] Unwind Execution from=7426487 to=7426486
INFO[08-18|11:09:09.227] [5/7 Execution] Completed on block=7426487
INFO[08-18|11:09:09.246] RPC Daemon notified of new headers from=7426487 to=7426488 header sending=9.412µs log sending=812ns
INFO[08-18|11:09:09.246] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:09:12.218] [5/7 Execution] Completed on block=7426488
INFO[08-18|11:09:12.312] RPC Daemon notified of new headers from=7426487 to=7426488 header sending=10.221µs log sending=225ns
INFO[08-18|11:09:12.312] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:09:12.320] Flushing in-memory state
INFO[08-18|11:09:12.481] RPC Daemon notified of new headers from=7426487 to=7426488 header sending=22.011µs log sending=390ns
INFO[08-18|11:09:12.481] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:09:24.182] [5/7 Execution] Completed on block=7426489
INFO[08-18|11:09:24.219] RPC Daemon notified of new headers from=7426488 to=7426489 header sending=9.152µs log sending=253ns
INFO[08-18|11:09:24.219] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:09:24.225] Flushing in-memory state
INFO[08-18|11:09:24.273] RPC Daemon notified of new headers from=7426488 to=7426489 header sending=12.383µs log sending=254ns
INFO[08-18|11:09:24.273] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:09:36.180] [5/7 Execution] Completed on block=7426490
INFO[08-18|11:09:36.210] RPC Daemon notified of new headers from=7426489 to=7426490 header sending=7.987µs log sending=235ns
INFO[08-18|11:09:36.210] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:09:36.216] Flushing in-memory state
INFO[08-18|11:09:36.274] RPC Daemon notified of new headers from=7426489 to=7426490 header sending=11.012µs log sending=215ns
INFO[08-18|11:09:36.274] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:09:39.705] [txpool] stat block=7426490 pending=74 baseFee=176 queued=10648 alloc=1.8GB sys=2.2GB
INFO[08-18|11:09:48.203] [5/7 Execution] Completed on block=7426491
INFO[08-18|11:09:48.268] RPC Daemon notified of new headers from=7426490 to=7426491 header sending=7.006µs log sending=198ns
INFO[08-18|11:09:48.268] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:09:48.277] Flushing in-memory state
INFO[08-18|11:09:48.383] RPC Daemon notified of new headers from=7426490 to=7426491 header sending=24.557µs log sending=406ns
INFO[08-18|11:09:48.383] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:10:00.217] [5/7 Execution] Completed on block=7426492
INFO[08-18|11:10:00.296] RPC Daemon notified of new headers from=7426491 to=7426492 header sending=8.726µs log sending=213ns
INFO[08-18|11:10:00.296] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:10:00.302] Flushing in-memory state
INFO[08-18|11:10:00.450] RPC Daemon notified of new headers from=7426491 to=7426492 header sending=10.902µs log sending=311ns
INFO[08-18|11:10:00.450] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:10:12.108] [5/7 Execution] Completed on block=7426493
INFO[08-18|11:10:12.121] RPC Daemon notified of new headers from=7426492 to=7426493 header sending=31.372µs log sending=1.094µs
INFO[08-18|11:10:12.121] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:10:12.185] Flushing in-memory state
INFO[08-18|11:10:12.204] RPC Daemon notified of new headers from=7426492 to=7426493 header sending=14.536µs log sending=387ns
INFO[08-18|11:10:12.204] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:10:36.235] [5/7 Execution] Completed on block=7426494
INFO[08-18|11:10:36.361] RPC Daemon notified of new headers from=7426493 to=7426494 header sending=10.457µs log sending=236ns
INFO[08-18|11:10:36.361] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:10:36.370] Flushing in-memory state
INFO[08-18|11:10:36.588] RPC Daemon notified of new headers from=7426493 to=7426494 header sending=12.941µs log sending=300ns
INFO[08-18|11:10:36.588] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:10:36.874] [p2p] GoodPeers eth66=8
INFO[08-18|11:10:39.365] [txpool] stat block=7426494 pending=46 baseFee=176 queued=10638 alloc=1.1GB sys=2.2GB
INFO[08-18|11:10:48.100] [5/7 Execution] Completed on block=7426495
INFO[08-18|11:10:48.105] RPC Daemon notified of new headers from=7426494 to=7426495 header sending=9.467µs log sending=225ns
INFO[08-18|11:10:48.105] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:10:48.202] Flushing in-memory state
INFO[08-18|11:10:48.211] RPC Daemon notified of new headers from=7426494 to=7426495 header sending=12.024µs log sending=226ns
INFO[08-18|11:10:48.211] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:11:00.145] [5/7 Execution] Completed on block=7426496
INFO[08-18|11:11:00.201] RPC Daemon notified of new headers from=7426495 to=7426496 header sending=10.276µs log sending=202ns
INFO[08-18|11:11:00.201] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:11:00.207] Flushing in-memory state
INFO[08-18|11:11:00.307] RPC Daemon notified of new headers from=7426495 to=7426496 header sending=13.044µs log sending=338ns
INFO[08-18|11:11:00.307] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:11:12.102] [5/7 Execution] Completed on block=7426497
INFO[08-18|11:11:12.108] RPC Daemon notified of new headers from=7426496 to=7426497 header sending=20.605µs log sending=592ns
INFO[08-18|11:11:12.108] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:11:12.183] Flushing in-memory state
INFO[08-18|11:11:12.195] RPC Daemon notified of new headers from=7426496 to=7426497 header sending=14.487µs log sending=325ns
INFO[08-18|11:11:12.195] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:11:24.181] [5/7 Execution] Completed on block=7426498
INFO[08-18|11:11:24.209] RPC Daemon notified of new headers from=7426497 to=7426498 header sending=7.732µs log sending=191ns
INFO[08-18|11:11:24.209] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:11:24.215] Flushing in-memory state
INFO[08-18|11:11:24.294] RPC Daemon notified of new headers from=7426497 to=7426498 header sending=11.879µs log sending=323ns
INFO[08-18|11:11:24.294] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:11:36.547] [5/7 Execution] Completed on block=7426499
INFO[08-18|11:11:36.637] RPC Daemon notified of new headers from=7426498 to=7426499 header sending=8.781µs log sending=197ns
INFO[08-18|11:11:36.637] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:11:36.643] Flushing in-memory state
INFO[08-18|11:11:36.784] RPC Daemon notified of new headers from=7426498 to=7426499 header sending=13.586µs log sending=316ns
INFO[08-18|11:11:36.784] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:11:39.361] [txpool] stat block=7426499 pending=56 baseFee=176 queued=10640 alloc=1.4GB sys=2.2GB
INFO[08-18|11:11:48.164] [5/7 Execution] Completed on block=7426500
INFO[08-18|11:11:48.218] RPC Daemon notified of new headers from=7426499 to=7426500 header sending=8.302µs log sending=190ns
INFO[08-18|11:11:48.218] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:11:48.225] Flushing in-memory state
INFO[08-18|11:11:48.327] RPC Daemon notified of new headers from=7426499 to=7426500 header sending=12.416µs log sending=229ns
INFO[08-18|11:11:48.328] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:12:00.107] [5/7 Execution] Completed on block=7426501
INFO[08-18|11:12:00.120] RPC Daemon notified of new headers from=7426500 to=7426501 header sending=27.072µs log sending=975ns
INFO[08-18|11:12:00.120] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:12:00.185] Flushing in-memory state
INFO[08-18|11:12:00.196] RPC Daemon notified of new headers from=7426500 to=7426501 header sending=13.146µs log sending=468ns
INFO[08-18|11:12:00.196] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:12:12.180] [5/7 Execution] Completed on block=7426502
INFO[08-18|11:12:12.207] RPC Daemon notified of new headers from=7426501 to=7426502 header sending=9.337µs log sending=206ns
INFO[08-18|11:12:12.207] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:12:12.215] Flushing in-memory state
INFO[08-18|11:12:12.265] RPC Daemon notified of new headers from=7426501 to=7426502 header sending=13.37µs log sending=716ns
INFO[08-18|11:12:12.265] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:12:24.270] [5/7 Execution] Completed on block=7426503
INFO[08-18|11:12:24.442] RPC Daemon notified of new headers from=7426502 to=7426503 header sending=18.904µs log sending=208ns
INFO[08-18|11:12:24.443] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:12:24.452] Flushing in-memory state
INFO[08-18|11:12:24.687] RPC Daemon notified of new headers from=7426502 to=7426503 header sending=15.764µs log sending=436ns
INFO[08-18|11:12:24.687] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:12:36.540] [5/7 Execution] Completed on block=7426504
INFO[08-18|11:12:36.799] RPC Daemon notified of new headers from=7426503 to=7426504 header sending=25.064µs log sending=236ns
INFO[08-18|11:12:36.799] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:12:36.874] [p2p] GoodPeers eth66=19
INFO[08-18|11:12:36.933] Flushing in-memory state
INFO[08-18|11:12:37.355] RPC Daemon notified of new headers from=7426503 to=7426504 header sending=422.266µs log sending=436ns
INFO[08-18|11:12:37.356] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:12:39.385] [txpool] stat block=7426504 pending=279 baseFee=0 queued=10686 alloc=1.1GB sys=2.2GB
INFO[08-18|11:12:48.529] [5/7 Execution] Completed on block=7426505
INFO[08-18|11:12:48.854] RPC Daemon notified of new headers from=7426504 to=7426505 header sending=395.238µs log sending=194ns
INFO[08-18|11:12:48.854] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:12:48.870] Flushing in-memory state
INFO[08-18|11:12:49.160] RPC Daemon notified of new headers from=7426504 to=7426505 header sending=17.57µs log sending=486ns
INFO[08-18|11:12:49.160] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:13:12.471] [5/7 Execution] Completed on block=7426506
INFO[08-18|11:13:12.933] RPC Daemon notified of new headers from=7426505 to=7426506 header sending=29.412µs log sending=227ns
INFO[08-18|11:13:12.934] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:13:12.944] Flushing in-memory state
INFO[08-18|11:13:13.462] RPC Daemon notified of new headers from=7426505 to=7426506 header sending=25.712µs log sending=475ns
INFO[08-18|11:13:13.463] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:13:37.442] [5/7 Execution] Completed on block=7426507
INFO[08-18|11:13:37.719] RPC Daemon notified of new headers from=7426506 to=7426507 header sending=25.209µs log sending=718ns
INFO[08-18|11:13:37.719] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:13:37.731] Flushing in-memory state
INFO[08-18|11:13:38.005] RPC Daemon notified of new headers from=7426506 to=7426507 header sending=12.627µs log sending=234ns
INFO[08-18|11:13:38.006] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:13:39.364] [txpool] stat block=7426507 pending=80 baseFee=203 queued=10704 alloc=1.4GB sys=2.2GB
INFO[08-18|11:13:48.162] [5/7 Execution] Completed on block=7426508
INFO[08-18|11:13:48.233] RPC Daemon notified of new headers from=7426507 to=7426508 header sending=167.279µs log sending=302ns
INFO[08-18|11:13:48.233] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:13:48.239] Flushing in-memory state
INFO[08-18|11:13:48.329] RPC Daemon notified of new headers from=7426507 to=7426508 header sending=21.685µs log sending=370ns
INFO[08-18|11:13:48.329] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:14:00.388] [5/7 Execution] Completed on block=7426509
INFO[08-18|11:14:00.771] RPC Daemon notified of new headers from=7426508 to=7426509 header sending=490.701µs log sending=211ns
INFO[08-18|11:14:00.771] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:14:00.780] Flushing in-memory state
INFO[08-18|11:14:01.145] RPC Daemon notified of new headers from=7426508 to=7426509 header sending=13.923µs log sending=237ns
INFO[08-18|11:14:01.145] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:14:12.349] [5/7 Execution] Completed on block=7426510
INFO[08-18|11:14:12.628] RPC Daemon notified of new headers from=7426509 to=7426510 header sending=257.96µs log sending=266ns
INFO[08-18|11:14:12.629] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:14:12.641] Flushing in-memory state
INFO[08-18|11:14:12.923] RPC Daemon notified of new headers from=7426509 to=7426510 header sending=23.867µs log sending=308ns
INFO[08-18|11:14:12.923] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:14:24.108] [5/7 Execution] Completed on block=7426511
INFO[08-18|11:14:24.115] RPC Daemon notified of new headers from=7426510 to=7426511 header sending=17.761µs log sending=5.295µs
INFO[08-18|11:14:24.115] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:14:24.191] Flushing in-memory state
INFO[08-18|11:14:24.200] RPC Daemon notified of new headers from=7426510 to=7426511 header sending=24.685µs log sending=401ns
INFO[08-18|11:14:24.201] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:14:36.357] [5/7 Execution] Completed on block=7426512
INFO[08-18|11:14:36.605] RPC Daemon notified of new headers from=7426511 to=7426512 header sending=116.189µs log sending=609ns
INFO[08-18|11:14:36.605] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:14:36.615] Flushing in-memory state
INFO[08-18|11:14:36.874] [p2p] GoodPeers eth66=24
INFO[08-18|11:14:36.905] RPC Daemon notified of new headers from=7426511 to=7426512 header sending=12.351µs log sending=223ns
INFO[08-18|11:14:36.905] [1/16 Headers] Waiting for Beacon Chain...
INFO[08-18|11:14:39.369] [txpool] stat block=7426512 pending=276 baseFee=0 queued=10699 alloc=1.2GB sys=2.2GB
From the #goerli:gitter.im Matrix room, where this was raised:
afr: the network status looks healthy afr: there are just a load of nodes not upgrade for the merge that fell behind 3np: Voting % is recently 80~81%. In 115389 it went down to 66.48% and we're still stuck at 115390 3np: what's the quorum from your end? afr: finalization is down due to the merge afr: but it does not impact the network afr: validators have to update their nodes and were probably not aware of the merge
A bit later the node is responding RPC results up-to-date and in sync with etherscan. So in case there is still an ongoing fork I'm not seeing it anymore.
@3nprob looks like this was a network issue that resolved? Are we good to close?
@revitteth Arguably erigon should handle a situation like this more gracefully. The INFO log is unmanagable and the WARN level isn't super insightful on its own (this is typically but far from always complemented with monitoring obv). It could easily fill up a typical setup quickly if log pruning is not in place and keeping up and a user who is not proficient at parsing them could take a while to figure out what's going on, which is not a great UX when this happens on mainnet and the user might be under pressure.
This issue is stale because it has been open for 40 days with no activity. Remove stale label or comment, or this will be closed in 7 days.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
This issue was closed because it has been stalled for 7 days with no activity.