prysm
prysm copied to clipboard
prysmaticlabs
Sync stuck at head_slot 4700031
🐞 Bug Report
Description
Lots of beacon node doesn't have a parent in db with root errors in log and syncing loops from a specific block.
🔥 Error
block in batch: could not reconstruct parent state
[2022-09-19 17:06:16] INFO initial-sync: Processing block batch of size 63 starting from 0x063c579d... 4700096/4731929 - estimated time remaining 4m57s blocksPerSecond=107.1 peers=43
[2022-09-19 17:06:16] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x91593f4ce1da4260a4475807af54ada66481b2e5529859fbcdd636c59966ac5d (in processBatchedBlocks, slot=4700096)
[2022-09-19 17:06:16] INFO initial-sync: Processing block batch of size 62 starting from 0xe5a59df5... 4700160/4731929 - estimated time remaining 4m48s blocksPerSecond=110.2 peers=44
[2022-09-19 17:06:16] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x099ce628bdb98cd34673e06f779a695a9fa903472f95f778a823c4b271296669 (in processBatchedBlocks, slot=4700160)
[2022-09-19 17:06:16] INFO initial-sync: Processing block batch of size 64 starting from 0xf0b0a565... 4700224/4731929 - estimated time remaining 4m39s blocksPerSecond=113.4 peers=45
[2022-09-19 17:06:16] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x6a644e5ce7eb9063ac0334eb070469ffe1babef71b42fc295a0098410c8509ff (in processBatchedBlocks, slot=4700224)
[2022-09-19 17:06:16] INFO initial-sync: Processing block batch of size 64 starting from 0x4aef416e... 4700288/4731929 - estimated time remaining 4m31s blocksPerSecond=116.6 peers=45
[2022-09-19 17:06:16] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xa165b5186776ed6adbeffbe7f9861a25cfe9e9a79b79fbf63c44f0f3f0fd2433 (in processBatchedBlocks, slot=4700288)
[2022-09-19 17:06:18] INFO initial-sync: Processing block batch of size 64 starting from 0xe2ad65e3... 4700352/4731929 - estimated time remaining 4m23s blocksPerSecond=119.8 peers=45
[2022-09-19 17:06:18] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x0d5b8ab2983591a9dd27b6b6b99540f75de7a6b7f88dfe6dd83ac5e8316b0d79 (in processBatchedBlocks, slot=4700352)
[2022-09-19 17:06:18] INFO initial-sync: Processing block batch of size 63 starting from 0xe08fde61... 4700416/4731929 - estimated time remaining 4m16s blocksPerSecond=123.0 peers=45
[2022-09-19 17:06:18] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xb493b115a9e7dadff196d1fd9092c477b3503a148983a6cd37111a00ba526862 (in processBatchedBlocks, slot=4700416)
[2022-09-19 17:06:18] INFO initial-sync: Processing block batch of size 61 starting from 0x86a688c4... 4700480/4731929 - estimated time remaining 4m9s blocksPerSecond=126.0 peers=45
[2022-09-19 17:06:18] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x027754e93bb1598df359a43c47c11affd9e03bac62bdefe91e3ee09e8ba1734e (in processBatchedBlocks, slot=4700480)
{
"data": {
"head_slot": "4700031",
"sync_distance": "31859",
"is_syncing": true,
"is_optimistic": true
}
}
head_slot is stuck at 4700031
Tried to delete prysm database and sync beacon chain again from scratch but I ended up at near the same block stuck.
🌍 Your Environment
Operating System:
Ubuntu 20.04
What version of Prysm are you running? (Which release)
Prysm version is v3.1.1
is there any other solution we can't start the chain again, if there is any option help
block in batch: could not reconstruct parent state
This seems like a meaningful message and I believe it originates here:
https://github.com/prysmaticlabs/prysm/blob/653ea3b030c3bb99aa3f3d95a8de9f4d6e147930/beacon-chain/blockchain/process_block_helpers.go#L72-L74
Next in the error stack:
https://github.com/prysmaticlabs/prysm/blob/653ea3b030c3bb99aa3f3d95a8de9f4d6e147930/beacon-chain/blockchain/receive_block.go#L93-L97
Was there more to that error? It seems relevant and only partially included in the original report.
For what it's worth, ~0x027754e93bb1598df359a43c47c11affd9e03bac62bdefe91e3ee09e8ba1734e is the merge block.~ I suspect there may be some issue with your connection between execution client and consensus client.
Edit: it's not the merge block, but i still suspect issues with your connection between execution client and consensus client.
I have the same issue with prysm v3.1.1
Here is the log:
time="2022-10-09 07:34:42" level=warning msg="Execution client is not syncing" prefix=powchain time="2022-10-09 07:34:46" level=warning msg="Skip processing batched blocks" error="could not process block in batch: could not set node to invalid: invalid nil or unknown node" prefix=initial-sync time="2022-10-09 07:34:46" level=info msg="Processing block batch of size 64 starting from 0xb47ed5d9... 4855808/4873071 - estimated time remaining 44m57s" blocksPerSecond=6.4 peers=43 prefix=initial-sync time="2022-10-09 07:34:46" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0x0050b9436230d0e65f0bb35e7846879208646620c364ac8f2681ebd82f310855 (in processBatchedBlocks, slot=4855808)" prefix=initial-sync time="2022-10-09 07:34:46" level=info msg="Processing block batch of size 64 starting from 0x8ee6956d... 4855872/4873071 - estimated time remaining 29m51s" blocksPerSecond=9.6 peers=43 prefix=initial-sync time="2022-10-09 07:34:46" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0x50750576d4ebfff6fe3056bf24545def1f8445cdf1740f74e218519d3c7cff91 (in processBatchedBlocks, slot=4855872)" prefix=initial-sync time="2022-10-09 07:34:46" level=info msg="Processing block batch of size 63 starting from 0x80a6c88f... 4855937/4873071 - estimated time remaining 22m23s" blocksPerSecond=12.8 peers=43 prefix=initial-sync time="2022-10-09 07:34:46" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0x38fb3047c2dbf0ab53e311da4551af2d5ab88f3a62f59c10739950d1c515f66e (in processBatchedBlocks, slot=4855937)" prefix=initial-sync time="2022-10-09 07:34:46" level=info msg="Processing block batch of size 64 starting from 0x66a44422... 4856000/4873071 - estimated time remaining 17m50s" blocksPerSecond=15.9 peers=43 prefix=initial-sync time="2022-10-09 07:34:46" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0x4ed21b3e4315a06bf60d6d15f4c6b36a42b2315c313794fd2d6599c04befc997 (in processBatchedBlocks, slot=4856000)" prefix=initial-sync time="2022-10-09 07:34:46" level=info msg="Processing block batch of size 64 starting from 0xc02e3353... 4856064/4873071 - estimated time remaining 14m48s" blocksPerSecond=19.1 peers=43 prefix=initial-sync time="2022-10-09 07:34:46" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0xddbe6ce2b8edaba10a48b36190aafbd2ed92cbf7cded7158a89dccec92e8dd18 (in processBatchedBlocks, slot=4856064)" prefix=initial-sync
I am also still having this issue with 3.1.2.
time="2022-12-12 22:22:06" level=warning msg="Skip processing batched blocks" error="could not process block in batch: timeout from http.Client: received an undefined ee error" prefix=initial-sync
time="2022-12-12 22:22:06" level=info msg="Processing block batch of size 63 starting from 0x0b31e72e... 5276448/5338308 - estimated time remaining 5h27m18s" blocksPerSecond=3.1 peers=44 prefix=initial-sync
time="2022-12-12 22:22:06" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0x00e9a4b57e99937b7102c3c9976a9e3b4d6b1be3ec31eb4a4d5fb0615283a4ed (in processBatchedBlocks, slot=5276448)" prefix=initial-sync
time="2022-12-12 22:22:06" level=info msg="Processing block batch of size 64 starting from 0x7f98e541... 5276512/5338308 - estimated time remaining 2h42m11s" blocksPerSecond=6.3 peers=44 prefix=initial-sync
time="2022-12-12 22:22:06" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0x76e472c975ce22e92b7c8da40df9e103195ff8acc4551ac4c6147650570dcc8d (in processBatchedBlocks, slot=5276512)" prefix=initial-sync
time="2022-12-12 22:22:06" level=info msg="Processing block batch of size 64 starting from 0x8c8dd476... 5276576/5338308 - estimated time remaining 1h47m44s" blocksPerSecond=9.6 peers=44 prefix=initial-sync
time="2022-12-12 22:22:06" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0xc00c3d95c15f5becf6fa3ad3881cc544cd26312ae2037bb9acc02456effe152b (in processBatchedBlocks, slot=5276576)" prefix=initial-sync
time="2022-12-12 22:22:06" level=info msg="Processing block batch of size 64 starting from 0x7f3e62c0... 5276640/5338308 - estimated time remaining 1h20m36s" blocksPerSecond=12.8 peers=44 prefix=initial-sync
time="2022-12-12 22:22:06" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0xbb0edb77eba60e1fdd6024a9c90c9d9b59a793f10fc5f48fa306ad0ac096be1b (in processBatchedBlocks, slot=5276640)" prefix=initial-sync
time="2022-12-12 22:22:06" level=info msg="Processing block batch of size 64 starting from 0xd36730e4... 5276704/5338308 - estimated time remaining 1h4m22s" blocksPerSecond=15.9 peers=44 prefix=initial-sync
time="2022-12-12 22:22:06" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0xae008e1e091f1f78eb63efeba9f86cee503e897499ada8145d6f4ba63f30de39 (in processBatchedBlocks, slot=5276704)" prefix=initial-sync
time="2022-12-12 22:22:06" level=info msg="Processing block batch of size 64 starting from 0x5f6266b4... 5276768/5338308 - estimated time remaining 53m33s" blocksPerSecond=19.1 peers=44 prefix=initial-sync
time="2022-12-12 22:22:06" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0x2cecba47af297345c9f55464a605d4f541b12328c2b01f098422c95dae45912d (in processBatchedBlocks, slot=5276768)" prefix=initial-sync
time="2022-12-12 22:22:06" level=info msg="Processing block batch of size 62 starting from 0x446916d8... 5276832/5338308 - estimated time remaining 46m2s" blocksPerSecond=22.2 peers=44 prefix=initial-sync
time="2022-12-12 22:22:06" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0x2802472642c4b96889801f2951c98c2a8f52ae057128fcda1d0a4c78c6fc286f (in processBatchedBlocks, slot=5276832)" prefix=initial-sync
time="2022-12-12 22:22:14" level=info msg="Processing block batch of size 64 starting from 0x7d8a4a58... 5276384/5338309 - estimated time remaining 40m33s" blocksPerSecond=25.4 peers=42 prefix=initial-sync
time="2022-12-12 22:22:44" level=warning msg="Skip processing batched blocks" error="could not process block in batch: timeout from http.Client: received an undefined ee error" prefix=initial-sync
time="2022-12-12 22:22:44" level=info msg="Processing block batch of size 63 starting from 0x0b31e72e... 5276448/5338311 - estimated time remaining 5h27m19s" blocksPerSecond=3.1 peers=43 prefix=initial-sync
time="2022-12-12 22:22:44" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0x00e9a4b57e99937b7102c3c9976a9e3b4d6b1be3ec31eb4a4d5fb0615283a4ed (in processBatchedBlocks, slot=5276448)" prefix=initial-sync
time="2022-12-12 22:22:44" level=info msg="Processing block batch of size 64 starting from 0x7f98e541... 5276512/5338311 - estimated time remaining 2h42m12s" blocksPerSecond=6.3 peers=43 prefix=initial-sync
time="2022-12-12 22:22:44" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0x76e472c975ce22e92b7c8da40df9e103195ff8acc4551ac4c6147650570dcc8d (in processBatchedBlocks, slot=5276512)" prefix=initial-sync
time="2022-12-12 22:22:44" level=info msg="Processing block batch of size 64 starting from 0x8c8dd476... 5276576/5338311 - estimated time remaining 1h47m44s" blocksPerSecond=9.6 peers=43 prefix=initial-sync
time="2022-12-12 22:22:44" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0xc00c3d95c15f5becf6fa3ad3881cc544cd26312ae2037bb9acc02456effe152b (in processBatchedBlocks, slot=5276576)" prefix=initial-sync
time="2022-12-12 22:22:44" level=info msg="Processing block batch of size 64 starting from 0x7f3e62c0... 5276640/5338311 - estimated time remaining 1h20m36s" blocksPerSecond=12.8 peers=43 prefix=initial-sync
time="2022-12-12 22:22:44" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0xbb0edb77eba60e1fdd6024a9c90c9d9b59a793f10fc5f48fa306ad0ac096be1b (in processBatchedBlocks, slot=5276640)" prefix=initial-sync
time="2022-12-12 22:22:44" level=info msg="Processing block batch of size 64 starting from 0xd36730e4... 5276704/5338311 - estimated time remaining 1h4m22s" blocksPerSecond=15.9 peers=43 prefix=initial-sync
time="2022-12-12 22:22:44" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0xae008e1e091f1f78eb63efeba9f86cee503e897499ada8145d6f4ba63f30de39 (in processBatchedBlocks, slot=5276704)" prefix=initial-sync
time="2022-12-12 22:22:44" level=info msg="Processing block batch of size 64 starting from 0x5f6266b4... 5276768/5338311 - estimated time remaining 53m33s" blocksPerSecond=19.1 peers=43 prefix=initial-sync
time="2022-12-12 22:22:44" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0x2cecba47af297345c9f55464a605d4f541b12328c2b01f098422c95dae45912d (in processBatchedBlocks, slot=5276768)" prefix=initial-sync
time="2022-12-12 22:22:44" level=info msg="Processing block batch of size 62 starting from 0x446916d8... 5276832/5338311 - estimated time remaining 46m3s" blocksPerSecond=22.2 peers=43 prefix=initial-sync
time="2022-12-12 22:22:44" level=warning msg="Skip processing batched blocks" error="beacon node doesn't have a parent in db with root: 0x2802472642c4b96889801f2951c98c2a8f52ae057128fcda1d0a4c78c6fc286f (in processBatchedBlocks, slot=5276832)" prefix=initial-sync
time="2022-12-12 22:22:47" level=info msg="Processing block batch of size 64 starting from 0x7d8a4a58... 5276384/5338312 - estimated time remaining 40m33s" blocksPerSecond=25.4 peers=40 prefix=initial-sync
time="2022-12-12 22:22:56" level=info msg="Peer summary" activePeers=36 inbound=0 outbound=35 prefix=p2p
time="2022-12-12 22:23:56" level=info msg="Peer summary" activePeers=40 inbound=0 outbound=40 prefix=p2p
I'm also seeing this following a prysm crash on 28/01/2023. I tried using a checkpoint but that didn't seem to fix anything. I'm now resyncing from scratch which looks like it'll take around 5 days :(
I hope geth is ok.
When I stopped and restarted prysm with new configuration to log to a file, I got these errors:
[2023-02-01 16:14:33] INFO initial-sync: Processing block batch of size 31 starting from 0x8eded010... 713761/5703670 - estimated time remaining 894h14m56s blocksPerSecond=1.6 peers=6
[2023-02-01 16:14:47] ERROR blockchain: Could not compute head from new attestations error=0xa1f3e05c20676fb4c8cbb2c77d9df00e8786bd1dd98092ea0347e462137d9d7b: unknown justified root
[2023-02-01 16:14:59] ERROR blockchain: Could not compute head from new attestations error=0xa1f3e05c20676fb4c8cbb2c77d9df00e8786bd1dd98092ea0347e462137d9d7b: unknown justified root
[2023-02-01 16:15:05] INFO initial-sync: Processing block batch of size 63 starting from 0xa1f3e05c... 713792/5703673 - estimated time remaining 440h1m29s blocksPerSecond=3.1 peers=15
[2023-02-01 16:15:06] INFO initial-sync: Processing block batch of size 64 starting from 0xd51cb536... 713856/5703673 - estimated time remaining 218h16m37s blocksPerSecond=6.3 peers=15
As you can see get isn't running. I don't want it to talk to geth until it's caught up.
But why is it giving the error "ERROR blockchain: Could not compute head from new attestations"? This is a fresh sync that ran for about 16 hours before I cleanly stopped it and restarted.
Occasionally is has warnings like:
[2023-02-01 16:18:22] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x9c61fe215b91bfa65c675c129491e33903351163ac65dd554288aa76307cd619 (in processBatchedBlocks, slot=719808)
[2023-02-01 16:18:22] INFO initial-sync: Processing block batch of size 62 starting from 0x2d214e56... 719872/5703689 - estimated time remaining 40h4m9s blocksPerSecond=34.5 peers=41
[2023-02-01 16:18:22] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xc83664906e388c5f01f69dfc5b6b4b417c23985741e0b8a72ea6beea237b1d47 (in processBatchedBlocks, slot=719872)
[2023-02-01 16:18:22] INFO initial-sync: Processing block batch of size 62 starting from 0x7f4fc85d... 719936/5703689 - estimated time remaining 36h46m10s blocksPerSecond=37.6 peers=41
[2023-02-01 16:18:22] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xf81dadce96dc6a1099f83004cb962203e9187e55dd64fa6f46aa26a13dc70f7a (in processBatchedBlocks, slot=719936)
[2023-02-01 16:18:22] INFO initial-sync: Processing block batch of size 63 starting from 0x261c156f... 720000/5703689 - estimated time remaining 33h55m49s blocksPerSecond=40.8 peers=41
[2023-02-01 16:18:22] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xecf0baa8ef2d31d20bc2f35d25ef224f31e422c954ec44320997a79d71600d6a (in processBatchedBlocks, slot=720000)
[2023-02-01 16:18:23] INFO initial-sync: Processing block batch of size 60 starting from 0x12d9260c... 719744/5703690 - estimated time remaining 31h36m28s blocksPerSecond=43.8 peers=40
[2023-02-01 16:18:24] INFO initial-sync: Processing block batch of size 62 starting from 0x6ae4c06a... 720064/5703690 - estimated time remaining 29h31m0s blocksPerSecond=46.9 peers=42
[2023-02-01 16:18:24] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x654d82f7f8562b69fda8ec4279add808b6d8dec7ebc2c362165ebae6cbeea467 (in processBatchedBlocks, slot=720064)
[2023-02-01 16:18:24] INFO initial-sync: Processing block batch of size 62 starting from 0x6a6cd33b... 720128/5703690 - estimated time remaining 27h41m11s blocksPerSecond=50.0 peers=42
[2023-02-01 16:18:24] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x5ac852b5424db592194835e7531d1ce9d76a6c23b77475ff4a28af6f8568e7a1 (in processBatchedBlocks, slot=720128)
[2023-02-01 16:18:24] INFO initial-sync: Processing block batch of size 63 starting from 0x7be3385b... 720193/5703690 - estimated time remaining 26h2m42s blocksPerSecond=53.1 peers=42
[2023-02-01 16:18:24] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x5126e83923acb27e307addf845ccb1134e958f58d0fabcd891b753fb323a0f85 (in processBatchedBlocks, slot=720193)
[2023-02-01 16:18:25] INFO p2p: Peer summary activePeers=44 inbound=0 outbound=42
But so far it seems to retry these later and continue ok.
Here is a good example from it doing the initial sync:
[2023-02-02 10:07:33] INFO initial-sync: Processing block batch of size 64 starting from 0x91c4fad8... 1494871/5709035 - estimated time remaining 123h13m16s blocksPerSecond=9.5 peers=41
[2023-02-02 10:07:35] INFO initial-sync: Processing block batch of size 63 starting from 0x40e11cea... 1494935/5709036 - estimated time remaining 92h32m10s blocksPerSecond=12.7 peers=41
[2023-02-02 10:07:37] INFO initial-sync: Processing block batch of size 64 starting from 0x95aa1ca8... 1494999/5709036 - estimated time remaining 73h51m9s blocksPerSecond=15.8 peers=40
[2023-02-02 10:07:39] INFO initial-sync: Processing block batch of size 64 starting from 0x38ab310a... 1495063/5709036 - estimated time remaining 61h26m45s blocksPerSecond=19.1 peers=39
[2023-02-02 10:07:41] INFO initial-sync: Processing block batch of size 63 starting from 0x52b3459d... 1495191/5709036 - estimated time remaining 52h43m32s blocksPerSecond=22.2 peers=43
[2023-02-02 10:07:41] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xdee42511e5050b61486d52b9e73b3b9696fd2e6c0af001709924d7a83eeabfd2 (in processBatchedBlocks, slot=1495191)
[2023-02-02 10:07:48] INFO initial-sync: Processing block batch of size 64 starting from 0x8be73f5c... 1495127/5709037 - estimated time remaining 46h5m1s blocksPerSecond=25.4 peers=46
[2023-02-02 10:07:50] INFO state-gen: Saved state in DB root=74fd6128acae slot=1495040
[2023-02-02 10:07:56] INFO initial-sync: Processing block batch of size 63 starting from 0x52b3459d... 1495191/5709037 - estimated time remaining 73h37m1s blocksPerSecond=15.9 peers=45
As you can see, for some reason it went from block batch 1495063 to 1495191, missing 1495127. So 1495191 failed, then it retried after processing 1495127 and it went through. It seems to me that sometimes it gets out of sequence and things get missed. It doesn't seem like much of a step from there to miss something completely and end up stuck as described at the start of this issue.
That is not really an issue, the node will just try to resync previous ranges. Do you have logs of the error ? The log you have pasted is not uncommon when syncing. Or do you have logs in where prysm was constantly stuck
Well, after waiting days for prysm to resync, it got to around 4700000 then just kept spinning:
[2023-02-06 18:21:13] INFO initial-sync: Processing block batch of size 63 starting from 0xe2b572d7... 4700077/5740304 - estimated time remaining 45h51m55s blocksPerSecond=6.3 peers=43
[2023-02-06 18:21:13] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xccb6e261d72f4890cfd84caa3d7fde75f5aacd701de74e4b7e7560d2a813b46b (in processBatchedBlocks, slot=4700077)
[2023-02-06 18:21:13] INFO initial-sync: Processing block batch of size 63 starting from 0x59e4a5c3... 4700141/5740304 - estimated time remaining 30h34m30s blocksPerSecond=9.4 peers=43
[2023-02-06 18:21:13] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x19f5b8038915ba8f2ce1fec375d4a10278d596dfc278686acf3b49a8b350a5ea (in processBatchedBlocks, slot=4700141)
[2023-02-06 18:21:13] INFO initial-sync: Processing block batch of size 63 starting from 0x3cbea89e... 4700205/5740304 - estimated time remaining 22h55m47s blocksPerSecond=12.6 peers=43
[2023-02-06 18:21:13] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x2bff2fee58130e0407fbb28e2c430a17938d2044d78670a4042ffb824b3d281f (in processBatchedBlocks, slot=4700205)
[2023-02-06 18:21:13] INFO initial-sync: Processing block batch of size 64 starting from 0x26268e72... 4700269/5740304 - estimated time remaining 18h17m5s blocksPerSecond=15.8 peers=43
[2023-02-06 18:21:13] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x39e4c69f084427ec2ae2ccdb370da97349317d17fd4cd48b1f088e009db9825c (in processBatchedBlocks, slot=4700269)
[2023-02-06 18:21:13] INFO initial-sync: Processing block batch of size 64 starting from 0xacbc1c36... 4700333/5740304 - estimated time remaining 15h12m15s blocksPerSecond=19.0 peers=43
[2023-02-06 18:21:13] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xf682d2a18d961726398f9538cdd96c7cb9b712cdecdef9b2026bbff5cb13e2ca (in processBatchedBlocks, slot=4700333)
[2023-02-06 18:21:13] INFO initial-sync: Processing block batch of size 64 starting from 0x1ef5478c... 4700397/5740304 - estimated time remaining 13h0m42s blocksPerSecond=22.2 peers=43
[2023-02-06 18:21:13] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xbb9482c4f27122af9660d6ea06c207ac3100ee555f8c4f14b840b128d1d7be21 (in processBatchedBlocks, slot=4700397)
[2023-02-06 18:21:13] INFO initial-sync: Processing block batch of size 60 starting from 0x2d2680f4... 4700461/5740304 - estimated time remaining 11h27m43s blocksPerSecond=25.2 peers=43
[2023-02-06 18:21:13] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x73af93b27f0ce10204515f27c7995c80f16302c9d8a2a710c2ac9f4f48bddf60 (in processBatchedBlocks, slot=4700461)
[2023-02-06 18:21:18] INFO initial-sync: Processing block batch of size 63 starting from 0x810a0040... 4700013/5740304 - estimated time remaining 10h11m34s blocksPerSecond=28.4 peers=42
[2023-02-06 18:21:23] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: rpc client is not initialized: received an undefined ee error
[2023-02-06 18:21:23] INFO initial-sync: Processing block batch of size 63 starting from 0xe2b572d7... 4700077/5740305 - estimated time remaining 10h11m32s blocksPerSecond=28.4 peers=45
[2023-02-06 18:21:23] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xccb6e261d72f4890cfd84caa3d7fde75f5aacd701de74e4b7e7560d2a813b46b (in processBatchedBlocks, slot=4700077)
[2023-02-06 18:21:23] INFO initial-sync: Processing block batch of size 63 starting from 0x59e4a5c3... 4700141/5740305 - estimated time remaining 9h10m21s blocksPerSecond=31.5 peers=45
[2023-02-06 18:21:23] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x19f5b8038915ba8f2ce1fec375d4a10278d596dfc278686acf3b49a8b350a5ea (in processBatchedBlocks, slot=4700141)
[2023-02-06 18:21:23] INFO initial-sync: Processing block batch of size 63 starting from 0x3cbea89e... 4700205/5740305 - estimated time remaining 8h20m17s blocksPerSecond=34.6 peers=45
[2023-02-06 18:21:23] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x2bff2fee58130e0407fbb28e2c430a17938d2044d78670a4042ffb824b3d281f (in processBatchedBlocks, slot=4700205)
[2023-02-06 18:21:23] INFO initial-sync: Processing block batch of size 64 starting from 0x26268e72... 4700269/5740305 - estimated time remaining 7h37m57s blocksPerSecond=37.9 peers=45
[2023-02-06 18:21:23] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x39e4c69f084427ec2ae2ccdb370da97349317d17fd4cd48b1f088e009db9825c (in processBatchedBlocks, slot=4700269)
After restarting I have:
[2023-02-06 18:35:57] INFO File logging initialized
[2023-02-06 18:35:57] WARN The http-web3provider flag has been deprecated and will be removed in a future release,please use the execution endpoint flag instead execution-endpoint
[2023-02-06 18:35:57] WARN flags: Running on Ethereum Mainnet
[2023-02-06 18:35:57] WARN node: In order to receive transaction fees from proposing blocks, you must provide flag --suggested-fee-recipient with a valid ethereum address when starting your beacon node. Please see our documentation for more information on this requirement (https://docs.prylabs.network/docs/execution-node/fee-recipient).
[2023-02-06 18:35:57] INFO node: Checking DB database-path=G:\Crypto\Ethereum\prysm\data\beaconchaindata
[2023-02-06 18:35:57] INFO db: Opening Bolt DB at G:\Crypto\Ethereum\prysm\data\beaconchaindata/beaconchain.db
[2023-02-06 18:35:57] INFO node: Deposit contract: 0x00000000219ab540356cbb839cbe05303d7705fa
[2023-02-06 18:36:51] INFO p2p: Running node with peer id of 16Uiu2HAmBR8yR2hZmzmNzn52YmHHxp9zQ4W8rZDb2kNDov6HSZfV
[2023-02-06 18:36:51] INFO initial-sync: Waiting for state to be initialized
[2023-02-06 18:36:51] INFO rpc: gRPC server listening on port address=127.0.0.1:4000
[2023-02-06 18:36:51] WARN rpc: You are using an insecure gRPC server. If you are running your beacon node and validator on the same machines, you can ignore this message. If you want to know how to enable secure connections, see: https://docs.prylabs.network/docs/prysm-usage/secure-grpc
[2023-02-06 18:36:51] INFO node: Starting beacon node version=Prysm/v3.2.0/3d6d0a12dd189abcd2cfbba1c3d56505a1dd595c. Built at: 2022-12-16 00:44:11+00:00
[2023-02-06 18:36:51] INFO blockchain: Blockchain data already exists in DB, initializing...
[2023-02-06 18:36:51] INFO gateway: Starting API middleware
[2023-02-06 18:36:51] INFO initial-sync: Starting initial chain sync...
[2023-02-06 18:36:51] INFO initial-sync: Waiting for enough suitable peers before syncing required=3 suitable=0
[2023-02-06 18:36:51] INFO gateway: Starting gRPC gateway address=127.0.0.1:3500
[2023-02-06 18:36:51] INFO p2p: Started discovery v5 ENR=enr:-MK4QAGkv6scXXTJApTWQ5oKWUAtGZ0tQg7mrJ96lYJrdaV9NTSmOyNTIqQMU85-_LwPn86EKUCb7-Y35wA3FxnN5DaGAYYoBD15h2F0dG5ldHOIAAAAAAAAAACEZXRoMpBKJsWLAgAAAP__________gmlkgnY0gmlwhArc-gKJc2VjcDI1NmsxoQLtl-5_f7glJBeiWmlM7ELQTxELubVrjEFyOt722PfogIhzeW5jbmV0cwCDdGNwgjLIg3VkcIIu4A
[2023-02-06 18:36:51] INFO p2p: Node started p2p server multiAddr=/ip4/10.220.250.2/tcp/13000/p2p/16Uiu2HAmBR8yR2hZmzmNzn52YmHHxp9zQ4W8rZDb2kNDov6HSZfV
[2023-02-06 18:36:52] INFO db: Cleaning up dirty states count=1
[2023-02-06 18:36:53] ERROR powchain: Could not connect to execution endpoint error=could not dial execution node: Timed out waiting for pipe '//./pipe/geth.ipc' to come available
[2023-02-06 18:36:58] INFO initial-sync: Processing block batch of size 31 starting from 0xc9e30b71... 4699937/5740382 - estimated time remaining 186h27m34s blocksPerSecond=1.6 peers=10
[2023-02-06 18:37:27] INFO initial-sync: Processing block batch of size 64 starting from 0xb436b927... 4699968/5740385 - estimated time remaining 90h18m50s blocksPerSecond=3.2 peers=53
[2023-02-06 18:37:33] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: rpc client is not initialized: received an undefined ee error
[2023-02-06 18:37:33] INFO initial-sync: Processing block batch of size 63 starting from 0x35967a9b... 4700032/5740385 - estimated time remaining 45h30m35s blocksPerSecond=6.3 peers=51
[2023-02-06 18:37:33] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x97b0b7b53582569689c52dbee87990ea2d7a94b17ee823e704c99d07e81b5376 (in processBatchedBlocks, slot=4700032)
[2023-02-06 18:37:34] INFO initial-sync: Processing block batch of size 64 starting from 0xb436b927... 4699968/5740385 - estimated time remaining 30h15m44s blocksPerSecond=9.6 peers=51
[2023-02-06 18:37:36] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:37:39] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: rpc client is not initialized: received an undefined ee error
[2023-02-06 18:37:39] INFO initial-sync: Processing block batch of size 63 starting from 0x063c579d... 4700096/5740386 - estimated time remaining 22h45m12s blocksPerSecond=12.7 peers=45
[2023-02-06 18:37:39] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x91593f4ce1da4260a4475807af54ada66481b2e5529859fbcdd636c59966ac5d (in processBatchedBlocks, slot=4700096)
[2023-02-06 18:37:40] INFO initial-sync: Processing block batch of size 63 starting from 0x35967a9b... 4700032/5740386 - estimated time remaining 18h13m57s blocksPerSecond=15.8 peers=44
[2023-02-06 18:37:40] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x97b0b7b53582569689c52dbee87990ea2d7a94b17ee823e704c99d07e81b5376 (in processBatchedBlocks, slot=4700032)
[2023-02-06 18:37:46] INFO initial-sync: Processing block batch of size 64 starting from 0xb436b927... 4699968/5740386 - estimated time remaining 15h10m15s blocksPerSecond=19.1 peers=48
[2023-02-06 18:37:47] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:37:51] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: rpc client is not initialized: received an undefined ee error
[2023-02-06 18:37:51] INFO initial-sync: Processing block batch of size 63 starting from 0x063c579d... 4700096/5740387 - estimated time remaining 15h12m32s blocksPerSecond=19.0 peers=47
[2023-02-06 18:37:51] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x91593f4ce1da4260a4475807af54ada66481b2e5529859fbcdd636c59966ac5d (in processBatchedBlocks, slot=4700096)
[2023-02-06 18:37:51] INFO p2p: Peer summary activePeers=47 inbound=0 outbound=47
[2023-02-06 18:37:59] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:38:11] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:38:17] INFO initial-sync: Processing block batch of size 64 starting from 0xb436b927... 4699968/5740389 - estimated time remaining 90h18m51s blocksPerSecond=3.2 peers=47
[2023-02-06 18:38:22] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: rpc client is not initialized: received an undefined ee error
[2023-02-06 18:38:22] INFO initial-sync: Processing block batch of size 63 starting from 0x35967a9b... 4700032/5740389 - estimated time remaining 45h30m35s blocksPerSecond=6.3 peers=47
[2023-02-06 18:38:22] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x97b0b7b53582569689c52dbee87990ea2d7a94b17ee823e704c99d07e81b5376 (in processBatchedBlocks, slot=4700032)
[2023-02-06 18:38:23] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:38:35] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:38:37] INFO initial-sync: Processing block batch of size 64 starting from 0xb436b927... 4699968/5740391 - estimated time remaining 30h15m44s blocksPerSecond=9.6 peers=45
[2023-02-06 18:38:42] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: rpc client is not initialized: received an undefined ee error
[2023-02-06 18:38:42] INFO initial-sync: Processing block batch of size 63 starting from 0x35967a9b... 4700032/5740391 - estimated time remaining 45h30m36s blocksPerSecond=6.3 peers=47
[2023-02-06 18:38:42] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x97b0b7b53582569689c52dbee87990ea2d7a94b17ee823e704c99d07e81b5376 (in processBatchedBlocks, slot=4700032)
[2023-02-06 18:38:42] INFO initial-sync: Processing block batch of size 63 starting from 0x063c579d... 4700096/5740391 - estimated time remaining 30h25m4s blocksPerSecond=9.5 peers=47
[2023-02-06 18:38:42] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x91593f4ce1da4260a4475807af54ada66481b2e5529859fbcdd636c59966ac5d (in processBatchedBlocks, slot=4700096)
[2023-02-06 18:38:47] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:38:51] INFO p2p: Peer summary activePeers=46 inbound=0 outbound=46
[2023-02-06 18:38:59] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:39:08] INFO initial-sync: Processing block batch of size 64 starting from 0xb436b927... 4699968/5740393 - estimated time remaining 90h18m52s blocksPerSecond=3.2 peers=47
[2023-02-06 18:39:11] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:39:13] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: rpc client is not initialized: received an undefined ee error
[2023-02-06 18:39:13] INFO initial-sync: Processing block batch of size 63 starting from 0x35967a9b... 4700032/5740394 - estimated time remaining 45h30m36s blocksPerSecond=6.3 peers=47
[2023-02-06 18:39:13] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x97b0b7b53582569689c52dbee87990ea2d7a94b17ee823e704c99d07e81b5376 (in processBatchedBlocks, slot=4700032)
[2023-02-06 18:39:13] INFO initial-sync: Processing block batch of size 63 starting from 0x063c579d... 4700096/5740394 - estimated time remaining 30h25m5s blocksPerSecond=9.5 peers=47
[2023-02-06 18:39:13] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x91593f4ce1da4260a4475807af54ada66481b2e5529859fbcdd636c59966ac5d (in processBatchedBlocks, slot=4700096)
[2023-02-06 18:39:13] INFO initial-sync: Processing block batch of size 62 starting from 0xe5a59df5... 4700160/5740394 - estimated time remaining 22h55m58s blocksPerSecond=12.6 peers=47
[2023-02-06 18:39:13] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x099ce628bdb98cd34673e06f779a695a9fa903472f95f778a823c4b271296669 (in processBatchedBlocks, slot=4700160)
[2023-02-06 18:39:13] INFO initial-sync: Processing block batch of size 64 starting from 0xf0b0a565... 4700224/5740394 - estimated time remaining 18h17m13s blocksPerSecond=15.8 peers=47
[2023-02-06 18:39:13] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x6a644e5ce7eb9063ac0334eb070469ffe1babef71b42fc295a0098410c8509ff (in processBatchedBlocks, slot=4700224)
[2023-02-06 18:39:13] INFO initial-sync: Processing block batch of size 64 starting from 0x4aef416e... 4700288/5740394 - estimated time remaining 15h12m22s blocksPerSecond=19.0 peers=47
[2023-02-06 18:39:13] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xa165b5186776ed6adbeffbe7f9861a25cfe9e9a79b79fbf63c44f0f3f0fd2433 (in processBatchedBlocks, slot=4700288)
[2023-02-06 18:39:13] INFO initial-sync: Processing block batch of size 64 starting from 0xe2ad65e3... 4700352/5740394 - estimated time remaining 13h0m48s blocksPerSecond=22.2 peers=47
[2023-02-06 18:39:13] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x0d5b8ab2983591a9dd27b6b6b99540f75de7a6b7f88dfe6dd83ac5e8316b0d79 (in processBatchedBlocks, slot=4700352)
[2023-02-06 18:39:13] INFO initial-sync: Processing block batch of size 63 starting from 0xe08fde61... 4700416/5740394 - estimated time remaining 11h23m44s blocksPerSecond=25.4 peers=47
[2023-02-06 18:39:13] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xb493b115a9e7dadff196d1fd9092c477b3503a148983a6cd37111a00ba526862 (in processBatchedBlocks, slot=4700416)
[2023-02-06 18:39:16] INFO initial-sync: Processing block batch of size 64 starting from 0xb436b927... 4699968/5740394 - estimated time remaining 10h7m22s blocksPerSecond=28.6 peers=47
[2023-02-06 18:39:21] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: rpc client is not initialized: received an undefined ee error
[2023-02-06 18:39:21] INFO initial-sync: Processing block batch of size 63 starting from 0x35967a9b... 4700032/5740394 - estimated time remaining 9h6m58s blocksPerSecond=31.7 peers=47
[2023-02-06 18:39:21] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x97b0b7b53582569689c52dbee87990ea2d7a94b17ee823e704c99d07e81b5376 (in processBatchedBlocks, slot=4700032)
[2023-02-06 18:39:23] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:39:25] ERROR powchain: Could not connect to execution client endpoint error=could not dial execution node: Timed out waiting for pipe '//./pipe/geth.ipc' to come available
[2023-02-06 18:39:35] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:39:47] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:39:47] INFO initial-sync: Processing block batch of size 64 starting from 0xb436b927... 4699968/5740397 - estimated time remaining 90h18m54s blocksPerSecond=3.2 peers=44
[2023-02-06 18:39:51] INFO p2p: Peer summary activePeers=47 inbound=0 outbound=47
[2023-02-06 18:39:52] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: rpc client is not initialized: received an undefined ee error
[2023-02-06 18:39:59] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:40:11] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:40:19] INFO initial-sync: Processing block batch of size 64 starting from 0xb436b927... 4699968/5740399 - estimated time remaining 90h18m54s blocksPerSecond=3.2 peers=46
[2023-02-06 18:40:23] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:40:24] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: rpc client is not initialized: received an undefined ee error
[2023-02-06 18:40:24] INFO initial-sync: Processing block batch of size 63 starting from 0x35967a9b... 4700032/5740400 - estimated time remaining 45h30m37s blocksPerSecond=6.3 peers=46
[2023-02-06 18:40:24] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x97b0b7b53582569689c52dbee87990ea2d7a94b17ee823e704c99d07e81b5376 (in processBatchedBlocks, slot=4700032)
[2023-02-06 18:40:24] INFO initial-sync: Processing block batch of size 63 starting from 0x063c579d... 4700096/5740400 - estimated time remaining 30h25m5s blocksPerSecond=9.5 peers=46
[2023-02-06 18:40:24] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x91593f4ce1da4260a4475807af54ada66481b2e5529859fbcdd636c59966ac5d (in processBatchedBlocks, slot=4700096)
[2023-02-06 18:40:24] INFO initial-sync: Processing block batch of size 62 starting from 0xe5a59df5... 4700160/5740400 - estimated time remaining 22h55m58s blocksPerSecond=12.6 peers=46
[2023-02-06 18:40:24] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x099ce628bdb98cd34673e06f779a695a9fa903472f95f778a823c4b271296669 (in processBatchedBlocks, slot=4700160)
[2023-02-06 18:40:35] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:40:36] INFO initial-sync: Processing block batch of size 64 starting from 0xb436b927... 4699968/5740401 - estimated time remaining 18h17m30s blocksPerSecond=15.8 peers=45
[2023-02-06 18:40:41] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: rpc client is not initialized: received an undefined ee error
[2023-02-06 18:40:41] INFO initial-sync: Processing block batch of size 63 starting from 0x35967a9b... 4700032/5740401 - estimated time remaining 18h20m55s blocksPerSecond=15.8 peers=45
[2023-02-06 18:40:41] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x97b0b7b53582569689c52dbee87990ea2d7a94b17ee823e704c99d07e81b5376 (in processBatchedBlocks, slot=4700032)
[2023-02-06 18:40:41] INFO initial-sync: Processing block batch of size 63 starting from 0x063c579d... 4700096/5740401 - estimated time remaining 15h17m22s blocksPerSecond=18.9 peers=45
[2023-02-06 18:40:41] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x91593f4ce1da4260a4475807af54ada66481b2e5529859fbcdd636c59966ac5d (in processBatchedBlocks, slot=4700096)
[2023-02-06 18:40:42] INFO initial-sync: Processing block batch of size 62 starting from 0xe5a59df5... 4700160/5740401 - estimated time remaining 13h8m3s blocksPerSecond=22.0 peers=44
[2023-02-06 18:40:42] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x099ce628bdb98cd34673e06f779a695a9fa903472f95f778a823c4b271296669 (in processBatchedBlocks, slot=4700160)
[2023-02-06 18:40:47] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:40:47] INFO initial-sync: Processing block batch of size 64 starting from 0xf0b0a565... 4700224/5740402 - estimated time remaining 18h17m14s blocksPerSecond=15.8 peers=43
[2023-02-06 18:40:47] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x6a644e5ce7eb9063ac0334eb070469ffe1babef71b42fc295a0098410c8509ff (in processBatchedBlocks, slot=4700224)
[2023-02-06 18:40:47] INFO initial-sync: Processing block batch of size 64 starting from 0x4aef416e... 4700288/5740402 - estimated time remaining 15h12m22s blocksPerSecond=19.0 peers=43
[2023-02-06 18:40:47] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xa165b5186776ed6adbeffbe7f9861a25cfe9e9a79b79fbf63c44f0f3f0fd2433 (in processBatchedBlocks, slot=4700288)
[2023-02-06 18:40:47] INFO initial-sync: Processing block batch of size 64 starting from 0xe2ad65e3... 4700352/5740402 - estimated time remaining 13h0m49s blocksPerSecond=22.2 peers=43
[2023-02-06 18:40:47] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x0d5b8ab2983591a9dd27b6b6b99540f75de7a6b7f88dfe6dd83ac5e8316b0d79 (in processBatchedBlocks, slot=4700352)
[2023-02-06 18:40:47] INFO initial-sync: Processing block batch of size 63 starting from 0xe08fde61... 4700416/5740402 - estimated time remaining 11h23m45s blocksPerSecond=25.4 peers=43
[2023-02-06 18:40:47] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xb493b115a9e7dadff196d1fd9092c477b3503a148983a6cd37111a00ba526862 (in processBatchedBlocks, slot=4700416)
[2023-02-06 18:40:51] INFO p2p: Peer summary activePeers=47 inbound=0 outbound=45
[2023-02-06 18:40:59] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:40:59] INFO initial-sync: Processing block batch of size 64 starting from 0xb436b927... 4699968/5740403 - estimated time remaining 11h24m2s blocksPerSecond=25.4 peers=47
[2023-02-06 18:41:04] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: rpc client is not initialized: received an undefined ee error
[2023-02-06 18:41:04] INFO initial-sync: Processing block batch of size 63 starting from 0x35967a9b... 4700032/5740403 - estimated time remaining 15h7m49s blocksPerSecond=19.1 peers=45
[2023-02-06 18:41:04] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x97b0b7b53582569689c52dbee87990ea2d7a94b17ee823e704c99d07e81b5376 (in processBatchedBlocks, slot=4700032)
[2023-02-06 18:41:11] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:41:23] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:41:35] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:41:40] ERROR powchain: Could not connect to execution client endpoint error=could not dial execution node: Timed out waiting for pipe '//./pipe/geth.ipc' to come available
[2023-02-06 18:41:42] INFO initial-sync: Processing block batch of size 64 starting from 0xb436b927... 4699968/5740406 - estimated time remaining 90h18m56s blocksPerSecond=3.2 peers=46
[2023-02-06 18:41:47] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:41:47] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: rpc client is not initialized: received an undefined ee error
[2023-02-06 18:41:47] INFO initial-sync: Processing block batch of size 63 starting from 0x35967a9b... 4700032/5740407 - estimated time remaining 45h30m38s blocksPerSecond=6.3 peers=45
[2023-02-06 18:41:47] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x97b0b7b53582569689c52dbee87990ea2d7a94b17ee823e704c99d07e81b5376 (in processBatchedBlocks, slot=4700032)
[2023-02-06 18:41:47] INFO initial-sync: Processing block batch of size 63 starting from 0x063c579d... 4700096/5740407 - estimated time remaining 30h25m6s blocksPerSecond=9.5 peers=45
[2023-02-06 18:41:47] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x91593f4ce1da4260a4475807af54ada66481b2e5529859fbcdd636c59966ac5d (in processBatchedBlocks, slot=4700096)
[2023-02-06 18:41:47] INFO initial-sync: Processing block batch of size 62 starting from 0xe5a59df5... 4700160/5740407 - estimated time remaining 22h55m59s blocksPerSecond=12.6 peers=45
[2023-02-06 18:41:47] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x099ce628bdb98cd34673e06f779a695a9fa903472f95f778a823c4b271296669 (in processBatchedBlocks, slot=4700160)
[2023-02-06 18:41:47] INFO initial-sync: Processing block batch of size 64 starting from 0xf0b0a565... 4700224/5740407 - estimated time remaining 18h17m14s blocksPerSecond=15.8 peers=45
[2023-02-06 18:41:47] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x6a644e5ce7eb9063ac0334eb070469ffe1babef71b42fc295a0098410c8509ff (in processBatchedBlocks, slot=4700224)
[2023-02-06 18:41:47] INFO initial-sync: Processing block batch of size 64 starting from 0x4aef416e... 4700288/5740407 - estimated time remaining 15h12m23s blocksPerSecond=19.0 peers=45
[2023-02-06 18:41:47] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xa165b5186776ed6adbeffbe7f9861a25cfe9e9a79b79fbf63c44f0f3f0fd2433 (in processBatchedBlocks, slot=4700288)
[2023-02-06 18:41:47] INFO initial-sync: Processing block batch of size 64 starting from 0xe2ad65e3... 4700352/5740407 - estimated time remaining 13h0m49s blocksPerSecond=22.2 peers=45
[2023-02-06 18:41:47] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x0d5b8ab2983591a9dd27b6b6b99540f75de7a6b7f88dfe6dd83ac5e8316b0d79 (in processBatchedBlocks, slot=4700352)
[2023-02-06 18:41:51] INFO p2p: Peer summary activePeers=45 inbound=0 outbound=45
[2023-02-06 18:41:59] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:42:11] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:42:23] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:42:35] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:42:47] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:42:51] INFO p2p: Peer summary activePeers=45 inbound=0 outbound=45
[2023-02-06 18:42:59] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:43:11] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
[2023-02-06 18:43:23] ERROR blockchain: Could not compute head from new attestations error=0xb436b92710f8d4831e1a85f76ec4c36dd952113fdf7dab3040a18bf89ffdd09d: unknown justified root
I'm now at a loss as to what to do. It takes days to get to this point.
I was purposely keeping geth offline as I wanted prysm to finish syncing first. When I first setup prysm (pre merge) it could fully sync before talking to geth. It seems that since the POS merge it can only sync as far as 4700000ish, then it needs geth.
Starting geth has got it going again and led to this output:
[2023-02-06 18:47:23] INFO powchain: Connected to new endpoint: //./***
[2023-02-06 18:47:26] INFO blockchain: Validated terminal block mergeBlockHash=0x55b11b918355b1ef9c5db810302ebad0bf2544255b530cdce90674d5887bb286 mergeBlockParentHash=0x2b3ea3cd4befcab070812443affb08bf17a91ce382c714a536ca3cacab82278b mergeBlockParentTotalDifficulty=+58749992660810868737771 mergeBlockTotalDifficulty=+58750003716598352816469 slot=4700013 terminalTotalDifficulty=58750000000000000000000
[2023-02-06 18:47:26] INFO blockchain:
+?$$$$$$?*; ;*?$$$$?*; +!$$$$$$?!;
!##$???$@##$+ !&#@$??$&#@* +@#&$????$##+
!##; +@#&; !##* ;$##* @#$ ;&#+
!##; !##+ ;##$ @#@ $#&* ++;
!##; ;@#&; *##* ?##; ;$##&$!+;
!##?!!!?$##$+ !##+ !##+ ;!$@##&$!;
!##@@@@$$!+ *##* ?##; ;*?@#&!
!##; ;##$ @#@ ;?$; ?##+
!##; ?##! ;?##+ ;##+ ;$#&;
!##; !&#&$??$&#@* ;&#&$$??$$&#@+
+??; ;*?$$$$?+ ;+!?$$$$$!+
;;;;
;+!??$$$?!*+; ;*?$@&&&&&@@$!*;
*?@############&$?+ ;!@###############&$!;
;!@####&@$????$$@#####@! ;?&####$?*++;++*!?@####&?;
*@###&$*; ;*$&###@* *&###@!; ;!@###&!
!###&!; ;?&###? *####! *&###?
!###@+ ;$###$ +###&+ ;$###?
;###&; $###? ;;+*!??$$$$$$$$??!$###* ;@###*
!###! &###?$@&#####################@$?!+; +###$
$###+ ;*?&#################################&$?*; &##&;
$###+ ;!$&########################################&$!; &###;
*###? ;!$################################################$*; +###@
;@###+ +$&####################################################&?; $###!
+###&+ *$##########################################################$+ ;$###$;
*&###?; +$##############################################################?*@###$;
+$###&?+ ;$#####################################################################?;
*@####@&#####################################################################*
+$&##################@?!*++*!$&###################&$?*++*!?$###############&*
$###############&?+ ;!@###############@!; ;!@##############!
;$##############&!; *&###########&!; !&#############!
$##############@+ +@* ;$#########$; +@* ;$#############!
?##############$; *###* $#######$; +&##! ?#############+
+##############$ !#####! $#####@; *#####? ?############@;
@#############@; !#######! ;&####+ *#######? $############?
+##############+ ?#########? $###$ !#########$ +############&;
$#############$ ;$###########? !###? !###########$; $############!
@#############* !#############! ?###$ *#############? +############@
;&############&; +?@#######&$+; ;&####; ;+?@#######&?+; @############;
;#############@ +$&#&$*; ;$#####@; +$&#&$*; $############+
;#############$ *+ ;+; ;*; *&#######&! ;*; ;+; +*; $############*
&############@ ;$@!; +$@! ;?###########$; *@$* ;*$@+ $############*
$############&; ;$#&$*+!@##* +@#############@+ +&#@?++$&#@; @############+
*#############* $######&+ !#################? +@######$; +#############;
@############$ ?####@+ ;$###################$; ;@####$ $############@
*#############* !##@; +@#####################&* ;$##? +#############!
$#############+ *$; ?#########################?; $! +&############&;
;&#############! +$###########################@+ *&#############?
+##############$*; ;?###############################$+ *$##############@;
*###############&$?!!$###################################$?!?$&################+
*###################################&@$$$$@&#################################!
+&##############################&?+; ;+?&#############################?
;$############################@; ;@###########################!
?###########################* *##########################*
+@#############&$!+$#######? ?########$+!$&###########@+
!&###########&; $#######$+ +$########? +&##########?;
;?###########&* *@#######@$!; ;$@########@* *##########$+
;?&##########?; ;*$&####&$* ;!$&####&$* ;$#########@*
;!@#########@!; ;++*+; ;*; ;+*++; ;!&########$*
*$&########&$*; ;*$&#&$*; +*$&#######&?+
;*$&#########&@$$@&#########&@$$@&########&$*;
;+?$&##############################&$?+;
;+!?$@&###################&$$!+;
;++*!??$$$$$$$?!!*+;
;;; ;;+*++; ;;;++;;;++;;; ;+++;;;++++; ;;; ;; ;;; ;;;++;;;+++;; ;;;+++++++; ;+++++;
;@#&+ +$&&@$@&#? @#@@@&#&@@@#$ ;$@@@@#&@@@@! !#@ !#$ +&#&; !#&@@@#&@@@&&; !#&@@@@@@@* $#&@@@&&$+
$#?#@; ?#&!; *#$ &&;;;$#!;;*#$ ;;;*#@;;;; $#? +#&; ;@#?#$ !#!;;*#@;;;@#; ?#$;;;;;;; @#* ;!&#?
*#$ ?#$ *#&; ;+; ++ $#! ;+; *#$ ;&#+ $#* ?#? $#! ;+; +#@ ++ ?#$ $#* ;&#*
;&&; @#* $#$ $#! *#$ !#@; !#$ +#@ ;&#; +#@ ?#@??????! $#* $#$
$#!;;;*#&; $#? $#! *#$ $#? ;&&; ;@#*;;;!#$ +#@ ?#@??????! $#* $#$
!##@@@@@&#$ !#@; $#! *#$ ;&#+ $#* ?#&@@@@@##! +#@ ?#$ $#* @#*
;&&+;;;;;;@#* ;$#$+ @$ $#! *#$ *#@!#? *#@;;;;;;+##+ +#@ ?#$ $#* +$#$
$#* +#&; ;?&#@$$$$#$ +$$&#@$$; ;$$$$@##$$$$* $##@; ;&#+ !#@; $$@##$$* ?#&$$$$$$$! @#@$$$@&@!
;** +*; +*!?!*+; ;******* ;***********+ ;**; ;*+ **; *******+ ;*********+ +*!!!!*;
[2023-02-06 18:47:38] INFO initial-sync: Processing block batch of size 63 starting from 0x35967a9b... 4700032/5740436 - estimated time remaining 45h30m43s blocksPerSecond=6.3 peers=47
[2023-02-06 18:47:45] INFO initial-sync: Processing block batch of size 63 starting from 0x063c579d... 4700096/5740436 - estimated time remaining 45h52m13s blocksPerSecond=6.3 peers=47
[2023-02-06 18:47:50] INFO initial-sync: Processing block batch of size 62 starting from 0xe5a59df5... 4700160/5740437 - estimated time remaining 30h44m27s blocksPerSecond=9.4 peers=47
[2023-02-06 18:47:51] INFO p2p: Peer summary activePeers=47 inbound=0 outbound=47
[2023-02-06 18:47:56] INFO initial-sync: Processing block batch of size 64 starting from 0xf0b0a565... 4700224/5740437 - estimated time remaining 22h55m56s blocksPerSecond=12.6 peers=47
[2023-02-06 18:48:02] INFO state-gen: Saved state in DB root=e5a59df5434c slot=4700160
It has got some way to go to catch up to where geth is. Hopefully things go back to normal within the next 48hrs. I'm hoping I do not need to reset geth or anything like that.
When I checked today prysm has crashed. The last log output is:
[2023-02-08 07:13:00] INFO initial-sync: Processing block batch of size 64 starting from 0x418b3394... 5675916/5751363 - estimated time remaining 6h32m57s blocksPerSecond=3.2 peers=45
[2023-02-08 07:13:22] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: client is closed: received an undefined ee error
[2023-02-08 07:13:22] INFO initial-sync: Processing block batch of size 64 starting from 0xa7cfcfa5... 5675980/5751364 - estimated time remaining 6h32m37s blocksPerSecond=3.2 peers=45
[2023-02-08 07:13:22] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xe6944d4a42cbc25a17a04d8ef7f5f8f19c9054a58e22e905b1862e58826d4382 (in processBatchedBlocks, slot=5675980)
[2023-02-08 07:13:22] INFO initial-sync: Processing block batch of size 64 starting from 0x14cdfa76... 5676044/5751364 - estimated time remaining 3h16m8s blocksPerSecond=6.4 peers=45
[2023-02-08 07:13:22] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xb3576fd7ad086830943c1521a5524912c03ae8a8c3d7444deba5b217aed05bd5 (in processBatchedBlocks, slot=5676044)
[2023-02-08 07:13:22] INFO initial-sync: Processing block batch of size 64 starting from 0xe3a4907c... 5676108/5751364 - estimated time remaining 2h10m39s blocksPerSecond=9.6 peers=45
[2023-02-08 07:13:22] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x7d0b177a6271ad29fa92f3a2ac249250be2261657795ffd0dba891d262ab9f2a (in processBatchedBlocks, slot=5676108)
[2023-02-08 07:13:22] INFO initial-sync: Processing block batch of size 64 starting from 0xd570c54b... 5676172/5751364 - estimated time remaining 1h37m54s blocksPerSecond=12.8 peers=45
[2023-02-08 07:13:22] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xece595fce2d8364b3697fc062c38ff780ec61202d27f0408a5e4fdded51d5774 (in processBatchedBlocks, slot=5676172)
[2023-02-08 07:13:22] INFO initial-sync: Processing block batch of size 63 starting from 0xf241a217... 5676236/5751364 - estimated time remaining 1h18m30s blocksPerSecond=15.9 peers=45
[2023-02-08 07:13:22] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xaf2bb628565cfde3a835223876b448ca551d3c6cbae63ff2cdfa4cf7feba3084 (in processBatchedBlocks, slot=5676236)
[2023-02-08 07:13:22] INFO initial-sync: Processing block batch of size 63 starting from 0x6941d5de... 5676300/5751364 - estimated time remaining 1h5m30s blocksPerSecond=19.1 peers=45
[2023-02-08 07:13:22] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xe8863606d224abb98d20a5eb0d16ebaff2b42f9ad128df45f15cedebf87c4a5d (in processBatchedBlocks, slot=5676300)
[2023-02-08 07:13:22] INFO initial-sync: Processing block batch of size 64 starting from 0x8499233f... 5676364/5751364 - estimated time remaining 56m3s blocksPerSecond=22.3 peers=45
[2023-02-08 07:13:22] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xf7f7f57b7cbd762f73cf555fd18d5d321bcc98dc40da09bbbb767eab8c9d14d4 (in processBatchedBlocks, slot=5676364)
[2023-02-08 07:13:54] INFO p2p: Peer summary activePeers=46 inbound=0 outbound=46
[2023-02-08 07:14:36] INFO initial-sync: Processing block batch of size 64 starting from 0x418b3394... 5675916/5751371 - estimated time remaining 6h32m59s blocksPerSecond=3.2 peers=45
[2023-02-08 07:14:45] INFO initial-sync: Processing block batch of size 64 starting from 0xa7cfcfa5... 5675980/5751371 - estimated time remaining 3h16m19s blocksPerSecond=6.4 peers=45
[2023-02-08 07:14:54] INFO p2p: Peer summary activePeers=45 inbound=0 outbound=45
[2023-02-08 07:15:07] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: client is closed: received an undefined ee error
[2023-02-08 07:15:07] INFO initial-sync: Processing block batch of size 64 starting from 0x14cdfa76... 5676044/5751373 - estimated time remaining 6h32m20s blocksPerSecond=3.2 peers=45
[2023-02-08 07:15:07] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xb3576fd7ad086830943c1521a5524912c03ae8a8c3d7444deba5b217aed05bd5 (in processBatchedBlocks, slot=5676044)
[2023-02-08 07:15:07] INFO initial-sync: Processing block batch of size 64 starting from 0xe3a4907c... 5676108/5751373 - estimated time remaining 3h16m0s blocksPerSecond=6.4 peers=45
[2023-02-08 07:15:07] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x7d0b177a6271ad29fa92f3a2ac249250be2261657795ffd0dba891d262ab9f2a (in processBatchedBlocks, slot=5676108)
[2023-02-08 07:15:07] INFO initial-sync: Processing block batch of size 64 starting from 0xd570c54b... 5676172/5751373 - estimated time remaining 2h10m33s blocksPerSecond=9.6 peers=45
[2023-02-08 07:15:07] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xece595fce2d8364b3697fc062c38ff780ec61202d27f0408a5e4fdded51d5774 (in processBatchedBlocks, slot=5676172)
[2023-02-08 07:15:07] INFO initial-sync: Processing block batch of size 63 starting from 0xf241a217... 5676236/5751373 - estimated time remaining 1h38m13s blocksPerSecond=12.8 peers=45
[2023-02-08 07:15:07] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xaf2bb628565cfde3a835223876b448ca551d3c6cbae63ff2cdfa4cf7feba3084 (in processBatchedBlocks, slot=5676236)
[2023-02-08 07:15:07] INFO initial-sync: Processing block batch of size 63 starting from 0x6941d5de... 5676300/5751373 - estimated time remaining 1h18m41s blocksPerSecond=15.9 peers=45
[2023-02-08 07:15:07] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xe8863606d224abb98d20a5eb0d16ebaff2b42f9ad128df45f15cedebf87c4a5d (in processBatchedBlocks, slot=5676300)
[2023-02-08 07:15:07] INFO initial-sync: Processing block batch of size 64 starting from 0x8499233f... 5676364/5751373 - estimated time remaining 1h5m27s blocksPerSecond=19.1 peers=45
[2023-02-08 07:15:07] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xf7f7f57b7cbd762f73cf555fd18d5d321bcc98dc40da09bbbb767eab8c9d14d4 (in processBatchedBlocks, slot=5676364)
[2023-02-08 07:15:10] INFO initial-sync: Processing block batch of size 64 starting from 0x074bf06f... 5676428/5751373 - estimated time remaining 56m0s blocksPerSecond=22.3 peers=45
[2023-02-08 07:15:10] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xb038e15f74d1f99d744c79746f9e3418d4f04543ef3f19babd8e35786af702c3 (in processBatchedBlocks, slot=5676428)
[2023-02-08 07:15:25] INFO initial-sync: Processing block batch of size 64 starting from 0xa7cfcfa5... 5675980/5751375 - estimated time remaining 49m16s blocksPerSecond=25.5 peers=45
[2023-02-08 07:15:37] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: client is closed: received an undefined ee error
[2023-02-08 07:15:38] INFO initial-sync: Processing block batch of size 64 starting from 0xa7cfcfa5... 5675980/5751376 - estimated time remaining 3h16m20s blocksPerSecond=6.4 peers=45
[2023-02-08 07:15:54] INFO p2p: Peer summary activePeers=45 inbound=0 outbound=45
[2023-02-08 07:15:55] INFO initial-sync: Processing block batch of size 64 starting from 0x14cdfa76... 5676044/5751377 - estimated time remaining 3h16m10s blocksPerSecond=6.4 peers=45
[2023-02-08 07:16:07] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: client is closed: received an undefined ee error
[2023-02-08 07:16:07] INFO initial-sync: Processing block batch of size 64 starting from 0xe3a4907c... 5676108/5751378 - estimated time remaining 3h16m0s blocksPerSecond=6.4 peers=45
[2023-02-08 07:16:07] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x7d0b177a6271ad29fa92f3a2ac249250be2261657795ffd0dba891d262ab9f2a (in processBatchedBlocks, slot=5676108)
[2023-02-08 07:16:07] INFO initial-sync: Processing block batch of size 64 starting from 0xd570c54b... 5676172/5751378 - estimated time remaining 2h10m33s blocksPerSecond=9.6 peers=45
[2023-02-08 07:16:07] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xece595fce2d8364b3697fc062c38ff780ec61202d27f0408a5e4fdded51d5774 (in processBatchedBlocks, slot=5676172)
[2023-02-08 07:16:07] INFO initial-sync: Processing block batch of size 63 starting from 0xf241a217... 5676236/5751378 - estimated time remaining 1h38m13s blocksPerSecond=12.8 peers=45
[2023-02-08 07:16:07] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xaf2bb628565cfde3a835223876b448ca551d3c6cbae63ff2cdfa4cf7feba3084 (in processBatchedBlocks, slot=5676236)
[2023-02-08 07:16:07] INFO initial-sync: Processing block batch of size 63 starting from 0x6941d5de... 5676300/5751378 - estimated time remaining 1h18m41s blocksPerSecond=15.9 peers=45
[2023-02-08 07:16:07] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xe8863606d224abb98d20a5eb0d16ebaff2b42f9ad128df45f15cedebf87c4a5d (in processBatchedBlocks, slot=5676300)
[2023-02-08 07:16:26] INFO initial-sync: Processing block batch of size 64 starting from 0x14cdfa76... 5676044/5751380 - estimated time remaining 1h18m58s blocksPerSecond=15.9 peers=45
[2023-02-08 07:16:37] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: client is closed: received an undefined ee error
[2023-02-08 07:16:44] INFO initial-sync: Processing block batch of size 64 starting from 0x14cdfa76... 5676044/5751381 - estimated time remaining 3h16m11s blocksPerSecond=6.4 peers=45
[2023-02-08 07:16:52] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: client is closed: received an undefined ee error
[2023-02-08 07:16:54] INFO p2p: Peer summary activePeers=45 inbound=0 outbound=45
[2023-02-08 07:17:05] INFO initial-sync: Processing block batch of size 64 starting from 0x14cdfa76... 5676044/5751383 - estimated time remaining 6h32m23s blocksPerSecond=3.2 peers=45
[2023-02-08 07:17:19] INFO initial-sync: Processing block batch of size 64 starting from 0xe3a4907c... 5676108/5751384 - estimated time remaining 3h16m1s blocksPerSecond=6.4 peers=45
[2023-02-08 07:17:37] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: client is closed: received an undefined ee error
[2023-02-08 07:17:37] INFO initial-sync: Processing block batch of size 64 starting from 0xd570c54b... 5676172/5751386 - estimated time remaining 3h15m52s blocksPerSecond=6.4 peers=45
[2023-02-08 07:17:37] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xece595fce2d8364b3697fc062c38ff780ec61202d27f0408a5e4fdded51d5774 (in processBatchedBlocks, slot=5676172)
[2023-02-08 07:17:37] INFO initial-sync: Processing block batch of size 63 starting from 0xf241a217... 5676236/5751386 - estimated time remaining 2h11m9s blocksPerSecond=9.6 peers=45
[2023-02-08 07:17:37] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xaf2bb628565cfde3a835223876b448ca551d3c6cbae63ff2cdfa4cf7feba3084 (in processBatchedBlocks, slot=5676236)
[2023-02-08 07:17:37] INFO initial-sync: Processing block batch of size 63 starting from 0x6941d5de... 5676300/5751386 - estimated time remaining 1h38m32s blocksPerSecond=12.7 peers=45
[2023-02-08 07:17:37] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xe8863606d224abb98d20a5eb0d16ebaff2b42f9ad128df45f15cedebf87c4a5d (in processBatchedBlocks, slot=5676300)
[2023-02-08 07:17:37] INFO initial-sync: Processing block batch of size 64 starting from 0x8499233f... 5676364/5751386 - estimated time remaining 1h18m38s blocksPerSecond=15.9 peers=45
[2023-02-08 07:17:37] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xf7f7f57b7cbd762f73cf555fd18d5d321bcc98dc40da09bbbb767eab8c9d14d4 (in processBatchedBlocks, slot=5676364)
[2023-02-08 07:17:37] INFO initial-sync: Processing block batch of size 64 starting from 0x074bf06f... 5676428/5751386 - estimated time remaining 1h5m24s blocksPerSecond=19.1 peers=45
[2023-02-08 07:17:37] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xb038e15f74d1f99d744c79746f9e3418d4f04543ef3f19babd8e35786af702c3 (in processBatchedBlocks, slot=5676428)
[2023-02-08 07:17:37] INFO initial-sync: Processing block batch of size 63 starting from 0x416ba5ee... 5676492/5751386 - estimated time remaining 56m6s blocksPerSecond=22.2 peers=45
[2023-02-08 07:17:37] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0x22105a1e90002bc755ac60358892b1c05909061f975c6f661a501cbb55c50ecf (in processBatchedBlocks, slot=5676492)
[2023-02-08 07:17:39] INFO initial-sync: Processing block batch of size 64 starting from 0x2a26a1b1... 5676556/5751386 - estimated time remaining 56m3s blocksPerSecond=22.2 peers=45
[2023-02-08 07:17:39] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xf7faccfce91af6ab693a58aea35ad89d2618e57400666a4eff0bc932bc5e6c1f (in processBatchedBlocks, slot=5676556)
[2023-02-08 07:17:47] INFO initial-sync: Processing block batch of size 64 starting from 0xe3a4907c... 5676108/5751387 - estimated time remaining 49m17s blocksPerSecond=25.4 peers=45
The console error output is 631722 characters, far beyond the 65536 character limit in comments here, and that isn't even all of it as it overfilled my windows scrollback. The final lines are:
goroutine 1984527383 [runnable]:
runtime.gopark(0x0?, 0xc008db5198?, 0x48?, 0x52?, 0xc008db51c8?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc01a5918d0 sp=0xc01a5918b0 pc=0x441376
runtime.netpollblock(0xc1e21d9085f82320?, 0xb53c153b?, 0x5f?)
GOROOT/src/runtime/netpoll.go:526 +0xf7 fp=0xc01a591908 sp=0xc01a5918d0 pc=0x4372f7
internal/poll.runtime_pollWait(0x2e3231e8, 0x72)
GOROOT/src/runtime/netpoll.go:305 +0x89 fp=0xc01a591928 sp=0xc01a591908 pc=0x46a409
internal/poll.(*pollDesc).wait(0x13?, 0x1000?, 0x0)
GOROOT/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc01a591950 sp=0xc01a591928 pc=0x4e9dd2
internal/poll.execIO(0xc008db5198, 0x23566d0)
GOROOT/src/internal/poll/fd_windows.go:175 +0xe5 fp=0xc01a5919a8 sp=0xc01a591950 pc=0x4eb405
internal/poll.(*FD).Read(0xc008db5180, {0xc04fdb9000, 0x1000, 0x1000})
GOROOT/src/internal/poll/fd_windows.go:441 +0x26b fp=0xc01a591a38 sp=0xc01a5919a8 pc=0x4ec28b
net.(*netFD).Read(0xc008db5180, {0xc04fdb9000?, 0xc0542f0000?, 0x0?})
GOROOT/src/net/fd_posix.go:55 +0x29 fp=0xc01a591a80 sp=0xc01a591a38 pc=0x561ee9
net.(*conn).Read(0xc0baea4478, {0xc04fdb9000?, 0x0?, 0xc0542f0000?})
GOROOT/src/net/net.go:183 +0x45 fp=0xc01a591ac8 sp=0xc01a591a80 pc=0x57a145
bufio.(*Reader).Read(0xc016d25320, {0xc04fdb23f0, 0x2, 0xc01a591b78?})
GOROOT/src/bufio/bufio.go:237 +0x1bb fp=0xc01a591b00 sp=0xc01a591ac8 pc=0x59cc5b
io.ReadAtLeast({0x25db140, 0xc016d25320}, {0xc04fdb23f0, 0x2, 0x2}, 0x2)
GOROOT/src/io/io.go:332 +0x9a fp=0xc01a591b48 sp=0xc01a591b00 pc=0x4bba7a
io.ReadFull(...)
GOROOT/src/io/io.go:351
github.com/libp2p/go-libp2p/p2p/security/noise.(*secureSession).readNextInsecureMsgLen(0xc04fdb2360)
external/com_github_libp2p_go_libp2p/p2p/security/noise/rw.go:133 +0x3b fp=0xc01a591b88 sp=0xc01a591b48 pc=0x140f75b
github.com/libp2p/go-libp2p/p2p/security/noise.(*secureSession).Read(0xc04fdb2360, {0xc0542f0000, 0x1000, 0x1000})
external/com_github_libp2p_go_libp2p/p2p/security/noise/rw.go:52 +0x22f fp=0xc01a591c48 sp=0xc01a591b88 pc=0x140edcf
bufio.(*Reader).fill(0xc013f3e660)
GOROOT/src/bufio/bufio.go:106 +0xff fp=0xc01a591c80 sp=0xc01a591c48 pc=0x59c67f
bufio.(*Reader).ReadByte(0xc013f3e660)
GOROOT/src/bufio/bufio.go:265 +0x2c fp=0xc01a591ca0 sp=0xc01a591c80 pc=0x59ce4c
github.com/multiformats/go-varint.ReadUvarint({0x25db120, 0xc013f3e660})
external/com_github_multiformats_go_varint/varint.go:80 +0x5a fp=0xc01a591ce8 sp=0xc01a591ca0 pc=0xf8cb7a
github.com/libp2p/go-mplex.(*Multiplex).readNextHeader(0xc0a10ac600?)
external/com_github_libp2p_go_mplex/multiplex.go:566 +0x25 fp=0xc01a591d08 sp=0xc01a591ce8 pc=0x142c625
github.com/libp2p/go-mplex.(*Multiplex).handleIncoming(0xc004d7fd60)
external/com_github_libp2p_go_mplex/multiplex.go:374 +0x146 fp=0xc01a591fc8 sp=0xc01a591d08 pc=0x142b526
github.com/libp2p/go-mplex.NewMultiplex.func1()
external/com_github_libp2p_go_mplex/multiplex.go:158 +0x26 fp=0xc01a591fe0 sp=0xc01a591fc8 pc=0x142a106
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc01a591fe8 sp=0xc01a591fe0 pc=0x471141
created by github.com/libp2p/go-mplex.NewMultiplex
external/com_github_libp2p_go_mplex/multiplex.go:158 +0x4f7
goroutine 1349236007 [select, 784 minutes]:
runtime.gopark(0xc00a3edb40?, 0x3?, 0xf8?, 0xbc?, 0xc00a3edb12?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc00a3ed998 sp=0xc00a3ed978 pc=0x441376
runtime.selectgo(0xc00a3edb40, 0xc00a3edb0c, 0x0?, 0x0, 0x3f?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc00a3edad8 sp=0xc00a3ed998 pc=0x450e7c
github.com/libp2p/go-mplex.(*Stream).waitForData(0xc0226a7450)
external/com_github_libp2p_go_mplex/stream.go:70 +0xba fp=0xc00a3edb80 sp=0xc00a3edad8 pc=0x142ce3a
github.com/libp2p/go-mplex.(*Stream).Read(0xc0226a7450, {0xc08fd82000, 0x1000, 0x1000})
external/com_github_libp2p_go_mplex/stream.go:117 +0x65 fp=0xc00a3edc08 sp=0xc00a3edb80 pc=0x142d165
github.com/libp2p/go-libp2p/p2p/muxer/mplex.(*stream).Read(0xc00a3edc58?, {0xc08fd82000?, 0xc009e484e0?, 0x3?})
external/com_github_libp2p_go_libp2p/p2p/muxer/mplex/stream.go:17 +0x1e fp=0xc00a3edc50 sp=0xc00a3edc08 pc=0x142e7de
github.com/libp2p/go-libp2p/p2p/net/swarm.(*Stream).Read(0xc0ad584200, {0xc08fd82000?, 0x2030083?, 0x20?})
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_stream.go:55 +0x36 fp=0xc00a3edcc8 sp=0xc00a3edc50 pc=0x11f23d6
bufio.(*Reader).fill(0xc07e82a840)
GOROOT/src/bufio/bufio.go:106 +0xff fp=0xc00a3edd00 sp=0xc00a3edcc8 pc=0x59c67f
bufio.(*Reader).ReadByte(0xc07e82a840)
GOROOT/src/bufio/bufio.go:265 +0x2c fp=0xc00a3edd20 sp=0xc00a3edd00 pc=0x59ce4c
github.com/multiformats/go-varint.ReadUvarint({0x25db120, 0xc07e82a840})
external/com_github_multiformats_go_varint/varint.go:80 +0x5a fp=0xc00a3edd68 sp=0xc00a3edd20 pc=0xf8cb7a
github.com/libp2p/go-msgio/protoio.(*uvarintReader).ReadMsg(0xc089ef5a40, {0x25ebfa0, 0xc020f1c3f0})
external/com_github_libp2p_go_msgio/protoio/uvarint_reader.go:70 +0x85 fp=0xc00a3eddf0 sp=0xc00a3edd68 pc=0x102c1c5
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream(0xc0171c1c00, {0x2601940, 0xc0ad584200})
external/com_github_libp2p_go_libp2p_pubsub/comm.go:66 +0x30d fp=0xc00a3edf50 sp=0xc00a3eddf0 pc=0x138a68d
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream-fm({0x2601940?, 0xc0ad584200?})
<autogenerated>:1 +0x39 fp=0xc00a3edf78 sp=0xc00a3edf50 pc=0x13bbf39
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).SetStreamHandler.func1({0xc062fb23e0, 0xe}, {0x30c03708?, 0xc0ad584200})
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:577 +0x76 fp=0xc00a3edfb0 sp=0xc00a3edf78 pc=0x10ffb96
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler.func1()
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x36 fp=0xc00a3edfe0 sp=0xc00a3edfb0 pc=0x10fea76
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00a3edfe8 sp=0xc00a3edfe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x74f
goroutine 1891599141 [select, 156 minutes]:
runtime.gopark(0xc05819bee8?, 0x3?, 0x0?, 0x0?, 0xc05819beba?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc05819bd08 sp=0xc05819bce8 pc=0x441376
runtime.selectgo(0xc05819bee8, 0xc05819beb4, 0xc05819bee0?, 0x0, 0x0?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc05819be48 sp=0xc05819bd08 pc=0x450e7c
github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).loop(0xc03a267450, {0x25f1710, 0xc0662415c0}, 0xc04f79eec0?)
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:89 +0x105 fp=0xc05819bfb0 sp=0xc05819be48 pc=0x10a0d65
github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).start.func1()
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:71 +0x32 fp=0xc05819bfe0 sp=0xc05819bfb0 pc=0x10a0c32
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc05819bfe8 sp=0xc05819bfe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).start
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:71 +0xf8
goroutine 24127949 [select, 11 minutes]:
runtime.gopark(0xc0123f5f90?, 0x2?, 0x60?, 0x5e?, 0xc0123f5f74?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc0123f5df8 sp=0xc0123f5dd8 pc=0x441376
runtime.selectgo(0xc0123f5f90, 0xc0123f5f70, 0xc0123f5f60?, 0x0, 0xb74db2?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc0123f5f38 sp=0xc0123f5df8 pc=0x450e7c
github.com/ethereum/go-ethereum/p2p/enode.(*DB).expirer(0xc02c2ca180)
external/com_github_ethereum_go_ethereum/p2p/enode/nodedb.go:315 +0xd0 fp=0xc0123f5fc8 sp=0xc0123f5f38 pc=0x132fef0
github.com/ethereum/go-ethereum/p2p/enode.(*DB).ensureExpirer.func1.1()
external/com_github_ethereum_go_ethereum/p2p/enode/nodedb.go:306 +0x26 fp=0xc0123f5fe0 sp=0xc0123f5fc8 pc=0x132fde6
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0123f5fe8 sp=0xc0123f5fe0 pc=0x471141
created by github.com/ethereum/go-ethereum/p2p/enode.(*DB).ensureExpirer.func1
external/com_github_ethereum_go_ethereum/p2p/enode/nodedb.go:306 +0x5a
goroutine 1271486544 [select]:
runtime.gopark(0xc045231ef8?, 0x2?, 0xa6?, 0xdb?, 0xc045231eec?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc045231d78 sp=0xc045231d58 pc=0x441376
runtime.selectgo(0xc045231ef8, 0xc045231ee8, 0x4420ab98?, 0x0, 0x17c668?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc045231eb8 sp=0xc045231d78 pc=0x450e7c
github.com/libp2p/go-mplex.(*Multiplex).Accept(...)
external/com_github_libp2p_go_mplex/multiplex.go:180
github.com/libp2p/go-libp2p/p2p/muxer/mplex.(*conn).AcceptStream(0xc014f63b80)
external/com_github_libp2p_go_libp2p/p2p/muxer/mplex/conn.go:39 +0x6c fp=0xc045231f28 sp=0xc045231eb8 pc=0x142e70c
github.com/libp2p/go-libp2p/p2p/net/upgrader.(*transportConn).AcceptStream(0xc00035efd0?)
<autogenerated>:1 +0x2a fp=0xc045231f40 sp=0xc045231f28 pc=0x11fbfea
github.com/libp2p/go-libp2p/p2p/net/swarm.(*Conn).start.func1()
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_conn.go:110 +0xae fp=0xc045231fe0 sp=0xc045231f40 pc=0x11ebcae
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc045231fe8 sp=0xc045231fe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/net/swarm.(*Conn).start
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_conn.go:105 +0x56
goroutine 1932807 [select, 11 minutes]:
runtime.gopark(0xc015e43b40?, 0x3?, 0x3?, 0x0?, 0xc015e43b12?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc015e43998 sp=0xc015e43978 pc=0x441376
runtime.selectgo(0xc015e43b40, 0xc015e43b0c, 0x0?, 0x0, 0x2f?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc015e43ad8 sp=0xc015e43998 pc=0x450e7c
github.com/libp2p/go-mplex.(*Stream).waitForData(0xc00be45450)
external/com_github_libp2p_go_mplex/stream.go:70 +0xba fp=0xc015e43b80 sp=0xc015e43ad8 pc=0x142ce3a
github.com/libp2p/go-mplex.(*Stream).Read(0xc00be45450, {0xc053e15000, 0x1000, 0x1000})
external/com_github_libp2p_go_mplex/stream.go:117 +0x65 fp=0xc015e43c08 sp=0xc015e43b80 pc=0x142d165
github.com/libp2p/go-libp2p/p2p/muxer/mplex.(*stream).Read(0xc015e43c58?, {0xc053e15000?, 0xc009e484e0?, 0x3?})
external/com_github_libp2p_go_libp2p/p2p/muxer/mplex/stream.go:17 +0x1e fp=0xc015e43c50 sp=0xc015e43c08 pc=0x142e7de
github.com/libp2p/go-libp2p/p2p/net/swarm.(*Stream).Read(0xc053e1c000, {0xc053e15000?, 0x203009a?, 0x20?})
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_stream.go:55 +0x36 fp=0xc015e43cc8 sp=0xc015e43c50 pc=0x11f23d6
bufio.(*Reader).fill(0xc053e1a480)
GOROOT/src/bufio/bufio.go:106 +0xff fp=0xc015e43d00 sp=0xc015e43cc8 pc=0x59c67f
bufio.(*Reader).ReadByte(0xc053e1a480)
GOROOT/src/bufio/bufio.go:265 +0x2c fp=0xc015e43d20 sp=0xc015e43d00 pc=0x59ce4c
github.com/multiformats/go-varint.ReadUvarint({0x25db120, 0xc053e1a480})
external/com_github_multiformats_go_varint/varint.go:80 +0x5a fp=0xc015e43d68 sp=0xc015e43d20 pc=0xf8cb7a
github.com/libp2p/go-msgio/protoio.(*uvarintReader).ReadMsg(0xc0502d7f40, {0x25ebfa0, 0xc026b30930})
external/com_github_libp2p_go_msgio/protoio/uvarint_reader.go:70 +0x85 fp=0xc015e43df0 sp=0xc015e43d68 pc=0x102c1c5
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream(0xc0171c1c00, {0x2601940, 0xc053e1c000})
external/com_github_libp2p_go_libp2p_pubsub/comm.go:66 +0x30d fp=0xc015e43f50 sp=0xc015e43df0 pc=0x138a68d
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream-fm({0x2601940?, 0xc053e1c000?})
<autogenerated>:1 +0x39 fp=0xc015e43f78 sp=0xc015e43f50 pc=0x13bbf39
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).SetStreamHandler.func1({0xc053e12730, 0xe}, {0x30c03708?, 0xc053e1c000})
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:577 +0x76 fp=0xc015e43fb0 sp=0xc015e43f78 pc=0x10ffb96
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler.func1()
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x36 fp=0xc015e43fe0 sp=0xc015e43fb0 pc=0x10fea76
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc015e43fe8 sp=0xc015e43fe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x74f
goroutine 16272638 [select, 2178 minutes]:
runtime.gopark(0xc004d77ee8?, 0x3?, 0x0?, 0x0?, 0xc004d77eba?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc004d77d08 sp=0xc004d77ce8 pc=0x441376
runtime.selectgo(0xc004d77ee8, 0xc004d77eb4, 0x40d4b6?, 0x0, 0x0?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc004d77e48 sp=0xc004d77d08 pc=0x450e7c
github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).loop(0xc080ec74a0, {0x25f1710, 0xc04fe92c80}, 0xc04f79eec0?)
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:89 +0x105 fp=0xc004d77fb0 sp=0xc004d77e48 pc=0x10a0d65
github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).start.func1()
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:71 +0x32 fp=0xc004d77fe0 sp=0xc004d77fb0 pc=0x10a0c32
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc004d77fe8 sp=0xc004d77fe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).start
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:71 +0xf8
goroutine 1651466091 [select, 443 minutes]:
runtime.gopark(0xc012b6fee8?, 0x3?, 0x0?, 0x0?, 0xc012b6feba?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc012b6fd08 sp=0xc012b6fce8 pc=0x441376
runtime.selectgo(0xc012b6fee8, 0xc012b6feb4, 0x32e0700?, 0x0, 0x0?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc012b6fe48 sp=0xc012b6fd08 pc=0x450e7c
github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).loop(0xc03015d770, {0x25f1710, 0xc0b8f1a180}, 0xc04f79eec0?)
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:89 +0x105 fp=0xc012b6ffb0 sp=0xc012b6fe48 pc=0x10a0d65
github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).start.func1()
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:71 +0x32 fp=0xc012b6ffe0 sp=0xc012b6ffb0 pc=0x10a0c32
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc012b6ffe8 sp=0xc012b6ffe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).start
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:71 +0xf8
goroutine 1702717707 [select, 383 minutes]:
runtime.gopark(0xc0bb989f48?, 0x2?, 0x30?, 0x9d?, 0xc0bb989ed4?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc0bb989d30 sp=0xc0bb989d10 pc=0x441376
runtime.selectgo(0xc0bb989f48, 0xc0bb989ed0, 0xc0bb989e01?, 0x0, 0xc0bb989f10?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc0bb989e70 sp=0xc0bb989d30 pc=0x450e7c
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleSendingMessages(0x448165?, {0x25f1710, 0xc02f9b04c0}, {0x26018b0?, 0xc00066ea20}, 0xc08fa22d20)
external/com_github_libp2p_go_libp2p_pubsub/comm.go:164 +0x305 fp=0xc0bb989fa0 sp=0xc0bb989e70 pc=0x138b765
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewPeer.func1()
external/com_github_libp2p_go_libp2p_pubsub/comm.go:117 +0x3a fp=0xc0bb989fe0 sp=0xc0bb989fa0 pc=0x138b13a
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0bb989fe8 sp=0xc0bb989fe0 pc=0x471141
created by github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewPeer
external/com_github_libp2p_go_libp2p_pubsub/comm.go:117 +0x32a
goroutine 576531624 [select, 140 minutes]:
runtime.gopark(0xc0390b1b40?, 0x3?, 0x80?, 0x50?, 0xc0390b1b12?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc0390b1998 sp=0xc0390b1978 pc=0x441376
runtime.selectgo(0xc0390b1b40, 0xc0390b1b0c, 0x0?, 0x0, 0x2a?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc0390b1ad8 sp=0xc0390b1998 pc=0x450e7c
github.com/libp2p/go-mplex.(*Stream).waitForData(0xc022719860)
external/com_github_libp2p_go_mplex/stream.go:70 +0xba fp=0xc0390b1b80 sp=0xc0390b1ad8 pc=0x142ce3a
github.com/libp2p/go-mplex.(*Stream).Read(0xc022719860, {0xc02f03b000, 0x1000, 0x1000})
external/com_github_libp2p_go_mplex/stream.go:117 +0x65 fp=0xc0390b1c08 sp=0xc0390b1b80 pc=0x142d165
github.com/libp2p/go-libp2p/p2p/muxer/mplex.(*stream).Read(0xc0390b1c58?, {0xc02f03b000?, 0xc009e484e0?, 0x3?})
external/com_github_libp2p_go_libp2p/p2p/muxer/mplex/stream.go:17 +0x1e fp=0xc0390b1c50 sp=0xc0390b1c08 pc=0x142e7de
github.com/libp2p/go-libp2p/p2p/net/swarm.(*Stream).Read(0xc0b3c95b80, {0xc02f03b000?, 0x203022e?, 0x20?})
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_stream.go:55 +0x36 fp=0xc0390b1cc8 sp=0xc0390b1c50 pc=0x11f23d6
bufio.(*Reader).fill(0xc0717ee360)
GOROOT/src/bufio/bufio.go:106 +0xff fp=0xc0390b1d00 sp=0xc0390b1cc8 pc=0x59c67f
bufio.(*Reader).ReadByte(0xc0717ee360)
GOROOT/src/bufio/bufio.go:265 +0x2c fp=0xc0390b1d20 sp=0xc0390b1d00 pc=0x59ce4c
github.com/multiformats/go-varint.ReadUvarint({0x25db120, 0xc0717ee360})
external/com_github_multiformats_go_varint/varint.go:80 +0x5a fp=0xc0390b1d68 sp=0xc0390b1d20 pc=0xf8cb7a
github.com/libp2p/go-msgio/protoio.(*uvarintReader).ReadMsg(0xc082bc6740, {0x25ebfa0, 0xc08b87a770})
external/com_github_libp2p_go_msgio/protoio/uvarint_reader.go:70 +0x85 fp=0xc0390b1df0 sp=0xc0390b1d68 pc=0x102c1c5
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream(0xc0171c1c00, {0x2601940, 0xc0b3c95b80})
external/com_github_libp2p_go_libp2p_pubsub/comm.go:66 +0x30d fp=0xc0390b1f50 sp=0xc0390b1df0 pc=0x138a68d
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream-fm({0x2601940?, 0xc0b3c95b80?})
<autogenerated>:1 +0x39 fp=0xc0390b1f78 sp=0xc0390b1f50 pc=0x13bbf39
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).SetStreamHandler.func1({0xc06272ef30, 0xe}, {0x30c03708?, 0xc0b3c95b80})
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:577 +0x76 fp=0xc0390b1fb0 sp=0xc0390b1f78 pc=0x10ffb96
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler.func1()
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x36 fp=0xc0390b1fe0 sp=0xc0390b1fb0 pc=0x10fea76
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0390b1fe8 sp=0xc0390b1fe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x74f
goroutine 1600033456 [IO wait]:
runtime.gopark(0x0?, 0xc05a85f918?, 0xc8?, 0xf9?, 0xc05a85f948?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc01f6f98d0 sp=0xc01f6f98b0 pc=0x441376
runtime.netpollblock(0xb3773b5bf665ff83?, 0x59bb4036?, 0xb7?)
GOROOT/src/runtime/netpoll.go:526 +0xf7 fp=0xc01f6f9908 sp=0xc01f6f98d0 pc=0x4372f7
internal/poll.runtime_pollWait(0x30734980, 0x72)
GOROOT/src/runtime/netpoll.go:305 +0x89 fp=0xc01f6f9928 sp=0xc01f6f9908 pc=0x46a409
internal/poll.(*pollDesc).wait(0x14?, 0x1000?, 0x0)
GOROOT/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc01f6f9950 sp=0xc01f6f9928 pc=0x4e9dd2
internal/poll.execIO(0xc05a85f918, 0x23566d0)
GOROOT/src/internal/poll/fd_windows.go:175 +0xe5 fp=0xc01f6f99a8 sp=0xc01f6f9950 pc=0x4eb405
internal/poll.(*FD).Read(0xc05a85f900, {0xc082b94000, 0x1000, 0x1000})
GOROOT/src/internal/poll/fd_windows.go:441 +0x26b fp=0xc01f6f9a38 sp=0xc01f6f99a8 pc=0x4ec28b
net.(*netFD).Read(0xc05a85f900, {0xc082b94000?, 0xc086314000?, 0x0?})
GOROOT/src/net/fd_posix.go:55 +0x29 fp=0xc01f6f9a80 sp=0xc01f6f9a38 pc=0x561ee9
net.(*conn).Read(0xc096bc4c60, {0xc082b94000?, 0x0?, 0xc086314000?})
GOROOT/src/net/net.go:183 +0x45 fp=0xc01f6f9ac8 sp=0xc01f6f9a80 pc=0x57a145
bufio.(*Reader).Read(0xc07d120c00, {0xc01f857dd0, 0x2, 0xc01f6f9b78?})
GOROOT/src/bufio/bufio.go:237 +0x1bb fp=0xc01f6f9b00 sp=0xc01f6f9ac8 pc=0x59cc5b
io.ReadAtLeast({0x25db140, 0xc07d120c00}, {0xc01f857dd0, 0x2, 0x2}, 0x2)
GOROOT/src/io/io.go:332 +0x9a fp=0xc01f6f9b48 sp=0xc01f6f9b00 pc=0x4bba7a
io.ReadFull(...)
GOROOT/src/io/io.go:351
github.com/libp2p/go-libp2p/p2p/security/noise.(*secureSession).readNextInsecureMsgLen(0xc01f857d40)
external/com_github_libp2p_go_libp2p/p2p/security/noise/rw.go:133 +0x3b fp=0xc01f6f9b88 sp=0xc01f6f9b48 pc=0x140f75b
github.com/libp2p/go-libp2p/p2p/security/noise.(*secureSession).Read(0xc01f857d40, {0xc086314000, 0x1000, 0x1000})
external/com_github_libp2p_go_libp2p/p2p/security/noise/rw.go:52 +0x22f fp=0xc01f6f9c48 sp=0xc01f6f9b88 pc=0x140edcf
bufio.(*Reader).fill(0xc0164aa540)
GOROOT/src/bufio/bufio.go:106 +0xff fp=0xc01f6f9c80 sp=0xc01f6f9c48 pc=0x59c67f
bufio.(*Reader).ReadByte(0xc0164aa540)
GOROOT/src/bufio/bufio.go:265 +0x2c fp=0xc01f6f9ca0 sp=0xc01f6f9c80 pc=0x59ce4c
github.com/multiformats/go-varint.ReadUvarint({0x25db120, 0xc0164aa540})
external/com_github_multiformats_go_varint/varint.go:80 +0x5a fp=0xc01f6f9ce8 sp=0xc01f6f9ca0 pc=0xf8cb7a
github.com/libp2p/go-mplex.(*Multiplex).readNextHeader(0xc076aceba0?)
external/com_github_libp2p_go_mplex/multiplex.go:566 +0x25 fp=0xc01f6f9d08 sp=0xc01f6f9ce8 pc=0x142c625
github.com/libp2p/go-mplex.(*Multiplex).handleIncoming(0xc022706500)
external/com_github_libp2p_go_mplex/multiplex.go:374 +0x146 fp=0xc01f6f9fc8 sp=0xc01f6f9d08 pc=0x142b526
github.com/libp2p/go-mplex.NewMultiplex.func1()
external/com_github_libp2p_go_mplex/multiplex.go:158 +0x26 fp=0xc01f6f9fe0 sp=0xc01f6f9fc8 pc=0x142a106
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc01f6f9fe8 sp=0xc01f6f9fe0 pc=0x471141
created by github.com/libp2p/go-mplex.NewMultiplex
external/com_github_libp2p_go_mplex/multiplex.go:158 +0x4f7
goroutine 371823 [IO wait]:
runtime.gopark(0x0?, 0xc02fd1c298?, 0x48?, 0xc3?, 0xc02fd1c2c8?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc02beb38d0 sp=0xc02beb38b0 pc=0x441376
runtime.netpollblock(0x1b720a72ebb2ba5?, 0x684d6644?, 0xc5?)
GOROOT/src/runtime/netpoll.go:526 +0xf7 fp=0xc02beb3908 sp=0xc02beb38d0 pc=0x4372f7
internal/poll.runtime_pollWait(0x30c03f70, 0x72)
GOROOT/src/runtime/netpoll.go:305 +0x89 fp=0xc02beb3928 sp=0xc02beb3908 pc=0x46a409
internal/poll.(*pollDesc).wait(0x14?, 0x1000?, 0x0)
GOROOT/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc02beb3950 sp=0xc02beb3928 pc=0x4e9dd2
internal/poll.execIO(0xc02fd1c298, 0x23566d0)
GOROOT/src/internal/poll/fd_windows.go:175 +0xe5 fp=0xc02beb39a8 sp=0xc02beb3950 pc=0x4eb405
internal/poll.(*FD).Read(0xc02fd1c280, {0xc00be66000, 0x1000, 0x1000})
GOROOT/src/internal/poll/fd_windows.go:441 +0x26b fp=0xc02beb3a38 sp=0xc02beb39a8 pc=0x4ec28b
net.(*netFD).Read(0xc02fd1c280, {0xc00be66000?, 0xc00bfcd000?, 0x0?})
GOROOT/src/net/fd_posix.go:55 +0x29 fp=0xc02beb3a80 sp=0xc02beb3a38 pc=0x561ee9
net.(*conn).Read(0xc0261888a8, {0xc00be66000?, 0x0?, 0xc00bfcd000?})
GOROOT/src/net/net.go:183 +0x45 fp=0xc02beb3ac8 sp=0xc02beb3a80 pc=0x57a145
bufio.(*Reader).Read(0xc0136f3860, {0xc002756f30, 0x2, 0xc02beb3b78?})
GOROOT/src/bufio/bufio.go:237 +0x1bb fp=0xc02beb3b00 sp=0xc02beb3ac8 pc=0x59cc5b
io.ReadAtLeast({0x25db140, 0xc0136f3860}, {0xc002756f30, 0x2, 0x2}, 0x2)
GOROOT/src/io/io.go:332 +0x9a fp=0xc02beb3b48 sp=0xc02beb3b00 pc=0x4bba7a
io.ReadFull(...)
GOROOT/src/io/io.go:351
github.com/libp2p/go-libp2p/p2p/security/noise.(*secureSession).readNextInsecureMsgLen(0xc002756ea0)
external/com_github_libp2p_go_libp2p/p2p/security/noise/rw.go:133 +0x3b fp=0xc02beb3b88 sp=0xc02beb3b48 pc=0x140f75b
github.com/libp2p/go-libp2p/p2p/security/noise.(*secureSession).Read(0xc002756ea0, {0xc00bfcd000, 0x1000, 0x1000})
external/com_github_libp2p_go_libp2p/p2p/security/noise/rw.go:52 +0x22f fp=0xc02beb3c48 sp=0xc02beb3b88 pc=0x140edcf
bufio.(*Reader).fill(0xc0096835c0)
GOROOT/src/bufio/bufio.go:106 +0xff fp=0xc02beb3c80 sp=0xc02beb3c48 pc=0x59c67f
bufio.(*Reader).ReadByte(0xc0096835c0)
GOROOT/src/bufio/bufio.go:265 +0x2c fp=0xc02beb3ca0 sp=0xc02beb3c80 pc=0x59ce4c
github.com/multiformats/go-varint.ReadUvarint({0x25db120, 0xc0096835c0})
external/com_github_multiformats_go_varint/varint.go:80 +0x5a fp=0xc02beb3ce8 sp=0xc02beb3ca0 pc=0xf8cb7a
github.com/libp2p/go-mplex.(*Multiplex).readNextHeader(0xc0372d3500?)
external/com_github_libp2p_go_mplex/multiplex.go:566 +0x25 fp=0xc02beb3d08 sp=0xc02beb3ce8 pc=0x142c625
github.com/libp2p/go-mplex.(*Multiplex).handleIncoming(0xc0230ad180)
external/com_github_libp2p_go_mplex/multiplex.go:374 +0x146 fp=0xc02beb3fc8 sp=0xc02beb3d08 pc=0x142b526
github.com/libp2p/go-mplex.NewMultiplex.func1()
external/com_github_libp2p_go_mplex/multiplex.go:158 +0x26 fp=0xc02beb3fe0 sp=0xc02beb3fc8 pc=0x142a106
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc02beb3fe8 sp=0xc02beb3fe0 pc=0x471141
created by github.com/libp2p/go-mplex.NewMultiplex
external/com_github_libp2p_go_mplex/multiplex.go:158 +0x4f7
goroutine 1457320567 [select, 664 minutes]:
runtime.gopark(0xc04b0f9f48?, 0x2?, 0x30?, 0x9d?, 0xc04b0f9ed4?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc04b0f9d30 sp=0xc04b0f9d10 pc=0x441376
runtime.selectgo(0xc04b0f9f48, 0xc04b0f9ed0, 0x0?, 0x0, 0xc02b56c4e0?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc04b0f9e70 sp=0xc04b0f9d30 pc=0x450e7c
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleSendingMessages(0x448165?, {0x25f1710, 0xc02f9b04c0}, {0x26018b0?, 0xc09e3bb100}, 0xc098e5bb00)
external/com_github_libp2p_go_libp2p_pubsub/comm.go:164 +0x305 fp=0xc04b0f9fa0 sp=0xc04b0f9e70 pc=0x138b765
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewPeer.func1()
external/com_github_libp2p_go_libp2p_pubsub/comm.go:117 +0x3a fp=0xc04b0f9fe0 sp=0xc04b0f9fa0 pc=0x138b13a
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc04b0f9fe8 sp=0xc04b0f9fe0 pc=0x471141
created by github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewPeer
external/com_github_libp2p_go_libp2p_pubsub/comm.go:117 +0x32a
goroutine 1881151578 [select, 20 minutes]:
runtime.gopark(0xc01635fb40?, 0x3?, 0xd0?, 0x40?, 0xc01635fb12?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc01635f998 sp=0xc01635f978 pc=0x441376
runtime.selectgo(0xc01635fb40, 0xc01635fb0c, 0x0?, 0x0, 0x2f?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc01635fad8 sp=0xc01635f998 pc=0x450e7c
github.com/libp2p/go-mplex.(*Stream).waitForData(0xc022719c70)
external/com_github_libp2p_go_mplex/stream.go:70 +0xba fp=0xc01635fb80 sp=0xc01635fad8 pc=0x142ce3a
github.com/libp2p/go-mplex.(*Stream).Read(0xc022719c70, {0xc01debb000, 0x1000, 0x1000})
external/com_github_libp2p_go_mplex/stream.go:117 +0x65 fp=0xc01635fc08 sp=0xc01635fb80 pc=0x142d165
github.com/libp2p/go-libp2p/p2p/muxer/mplex.(*stream).Read(0xc01635fc58?, {0xc01debb000?, 0xc009e484e0?, 0x3?})
external/com_github_libp2p_go_libp2p/p2p/muxer/mplex/stream.go:17 +0x1e fp=0xc01635fc50 sp=0xc01635fc08 pc=0x142e7de
github.com/libp2p/go-libp2p/p2p/net/swarm.(*Stream).Read(0xc0c1982800, {0xc01debb000?, 0x203007a?, 0x20?})
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_stream.go:55 +0x36 fp=0xc01635fcc8 sp=0xc01635fc50 pc=0x11f23d6
bufio.(*Reader).fill(0xc077f69aa0)
GOROOT/src/bufio/bufio.go:106 +0xff fp=0xc01635fd00 sp=0xc01635fcc8 pc=0x59c67f
bufio.(*Reader).ReadByte(0xc077f69aa0)
GOROOT/src/bufio/bufio.go:265 +0x2c fp=0xc01635fd20 sp=0xc01635fd00 pc=0x59ce4c
github.com/multiformats/go-varint.ReadUvarint({0x25db120, 0xc077f69aa0})
external/com_github_multiformats_go_varint/varint.go:80 +0x5a fp=0xc01635fd68 sp=0xc01635fd20 pc=0xf8cb7a
github.com/libp2p/go-msgio/protoio.(*uvarintReader).ReadMsg(0xc07816f200, {0x25ebfa0, 0xc01e831810})
external/com_github_libp2p_go_msgio/protoio/uvarint_reader.go:70 +0x85 fp=0xc01635fdf0 sp=0xc01635fd68 pc=0x102c1c5
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream(0xc0171c1c00, {0x2601940, 0xc0c1982800})
external/com_github_libp2p_go_libp2p_pubsub/comm.go:66 +0x30d fp=0xc01635ff50 sp=0xc01635fdf0 pc=0x138a68d
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream-fm({0x2601940?, 0xc0c1982800?})
<autogenerated>:1 +0x39 fp=0xc01635ff78 sp=0xc01635ff50 pc=0x13bbf39
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).SetStreamHandler.func1({0xc0bdfae280, 0xe}, {0x30c03708?, 0xc0c1982800})
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:577 +0x76 fp=0xc01635ffb0 sp=0xc01635ff78 pc=0x10ffb96
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler.func1()
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x36 fp=0xc01635ffe0 sp=0xc01635ffb0 pc=0x10fea76
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc01635ffe8 sp=0xc01635ffe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x74f
goroutine 1480289082 [runnable]:
runtime.gopark(0x0?, 0xc083821198?, 0x48?, 0x12?, 0xc0838211c8?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc08bf598d0 sp=0xc08bf598b0 pc=0x441376
runtime.netpollblock(0x3409ebf94fa1ccfb?, 0xafacaafe?, 0x4d?)
GOROOT/src/runtime/netpoll.go:526 +0xf7 fp=0xc08bf59908 sp=0xc08bf598d0 pc=0x4372f7
internal/poll.runtime_pollWait(0x307351f0, 0x72)
GOROOT/src/runtime/netpoll.go:305 +0x89 fp=0xc08bf59928 sp=0xc08bf59908 pc=0x46a409
internal/poll.(*pollDesc).wait(0x14?, 0x1000?, 0x0)
GOROOT/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc08bf59950 sp=0xc08bf59928 pc=0x4e9dd2
internal/poll.execIO(0xc083821198, 0x23566d0)
GOROOT/src/internal/poll/fd_windows.go:175 +0xe5 fp=0xc08bf599a8 sp=0xc08bf59950 pc=0x4eb405
internal/poll.(*FD).Read(0xc083821180, {0xc07b528000, 0x1000, 0x1000})
GOROOT/src/internal/poll/fd_windows.go:441 +0x26b fp=0xc08bf59a38 sp=0xc08bf599a8 pc=0x4ec28b
net.(*netFD).Read(0xc083821180, {0xc07b528000?, 0xc07edca000?, 0x0?})
GOROOT/src/net/fd_posix.go:55 +0x29 fp=0xc08bf59a80 sp=0xc08bf59a38 pc=0x561ee9
net.(*conn).Read(0xc0867831d8, {0xc07b528000?, 0x0?, 0xc07edca000?})
GOROOT/src/net/net.go:183 +0x45 fp=0xc08bf59ac8 sp=0xc08bf59a80 pc=0x57a145
bufio.(*Reader).Read(0xc04b1ff740, {0xc02048cf30, 0x2, 0xc08bf59b78?})
GOROOT/src/bufio/bufio.go:237 +0x1bb fp=0xc08bf59b00 sp=0xc08bf59ac8 pc=0x59cc5b
io.ReadAtLeast({0x25db140, 0xc04b1ff740}, {0xc02048cf30, 0x2, 0x2}, 0x2)
GOROOT/src/io/io.go:332 +0x9a fp=0xc08bf59b48 sp=0xc08bf59b00 pc=0x4bba7a
io.ReadFull(...)
GOROOT/src/io/io.go:351
github.com/libp2p/go-libp2p/p2p/security/noise.(*secureSession).readNextInsecureMsgLen(0xc02048cea0)
external/com_github_libp2p_go_libp2p/p2p/security/noise/rw.go:133 +0x3b fp=0xc08bf59b88 sp=0xc08bf59b48 pc=0x140f75b
github.com/libp2p/go-libp2p/p2p/security/noise.(*secureSession).Read(0xc02048cea0, {0xc07edca000, 0x1000, 0x1000})
external/com_github_libp2p_go_libp2p/p2p/security/noise/rw.go:52 +0x22f fp=0xc08bf59c48 sp=0xc08bf59b88 pc=0x140edcf
bufio.(*Reader).fill(0xc05c2a1560)
GOROOT/src/bufio/bufio.go:106 +0xff fp=0xc08bf59c80 sp=0xc08bf59c48 pc=0x59c67f
bufio.(*Reader).ReadByte(0xc05c2a1560)
GOROOT/src/bufio/bufio.go:265 +0x2c fp=0xc08bf59ca0 sp=0xc08bf59c80 pc=0x59ce4c
github.com/multiformats/go-varint.ReadUvarint({0x25db120, 0xc05c2a1560})
external/com_github_multiformats_go_varint/varint.go:80 +0x5a fp=0xc08bf59ce8 sp=0xc08bf59ca0 pc=0xf8cb7a
github.com/libp2p/go-mplex.(*Multiplex).readNextHeader(0xc0a10ac240?)
external/com_github_libp2p_go_mplex/multiplex.go:566 +0x25 fp=0xc08bf59d08 sp=0xc08bf59ce8 pc=0x142c625
github.com/libp2p/go-mplex.(*Multiplex).handleIncoming(0xc02b06a1e0)
external/com_github_libp2p_go_mplex/multiplex.go:374 +0x146 fp=0xc08bf59fc8 sp=0xc08bf59d08 pc=0x142b526
github.com/libp2p/go-mplex.NewMultiplex.func1()
external/com_github_libp2p_go_mplex/multiplex.go:158 +0x26 fp=0xc08bf59fe0 sp=0xc08bf59fc8 pc=0x142a106
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc08bf59fe8 sp=0xc08bf59fe0 pc=0x471141
created by github.com/libp2p/go-mplex.NewMultiplex
external/com_github_libp2p_go_mplex/multiplex.go:158 +0x4f7
goroutine 1984527388 [select]:
runtime.gopark(0xc02032fef8?, 0x2?, 0xa6?, 0xdb?, 0xc02032feec?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc02032fd78 sp=0xc02032fd58 pc=0x441376
runtime.selectgo(0xc02032fef8, 0xc02032fee8, 0x423d7918?, 0x0, 0x17caf8?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc02032feb8 sp=0xc02032fd78 pc=0x450e7c
github.com/libp2p/go-mplex.(*Multiplex).Accept(...)
external/com_github_libp2p_go_mplex/multiplex.go:180
github.com/libp2p/go-libp2p/p2p/muxer/mplex.(*conn).AcceptStream(0xc004d7fd60)
external/com_github_libp2p_go_libp2p/p2p/muxer/mplex/conn.go:39 +0x6c fp=0xc02032ff28 sp=0xc02032feb8 pc=0x142e70c
github.com/libp2p/go-libp2p/p2p/net/upgrader.(*transportConn).AcceptStream(0xc00035efd0?)
<autogenerated>:1 +0x2a fp=0xc02032ff40 sp=0xc02032ff28 pc=0x11fbfea
github.com/libp2p/go-libp2p/p2p/net/swarm.(*Conn).start.func1()
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_conn.go:110 +0xae fp=0xc02032ffe0 sp=0xc02032ff40 pc=0x11ebcae
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc02032ffe8 sp=0xc02032ffe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/net/swarm.(*Conn).start
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_conn.go:105 +0x56
goroutine 1525333239 [select]:
runtime.gopark(0xc02d1d9ef8?, 0x2?, 0xa6?, 0xdb?, 0xc02d1d9eec?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc02d1d9d78 sp=0xc02d1d9d58 pc=0x441376
runtime.selectgo(0xc02d1d9ef8, 0xc02d1d9ee8, 0x492b8a10?, 0x0, 0x1617d8?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc02d1d9eb8 sp=0xc02d1d9d78 pc=0x450e7c
github.com/libp2p/go-mplex.(*Multiplex).Accept(...)
external/com_github_libp2p_go_mplex/multiplex.go:180
github.com/libp2p/go-libp2p/p2p/muxer/mplex.(*conn).AcceptStream(0xc01f4735e0)
external/com_github_libp2p_go_libp2p/p2p/muxer/mplex/conn.go:39 +0x6c fp=0xc02d1d9f28 sp=0xc02d1d9eb8 pc=0x142e70c
github.com/libp2p/go-libp2p/p2p/net/upgrader.(*transportConn).AcceptStream(0xc00035efd0?)
<autogenerated>:1 +0x2a fp=0xc02d1d9f40 sp=0xc02d1d9f28 pc=0x11fbfea
github.com/libp2p/go-libp2p/p2p/net/swarm.(*Conn).start.func1()
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_conn.go:110 +0xae fp=0xc02d1d9fe0 sp=0xc02d1d9f40 pc=0x11ebcae
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc02d1d9fe8 sp=0xc02d1d9fe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/net/swarm.(*Conn).start
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_conn.go:105 +0x56
goroutine 1349235982 [select]:
runtime.gopark(0xc015a2df90?, 0x2?, 0xe6?, 0xf6?, 0xc015a2df4c?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc015a2dd98 sp=0xc015a2dd78 pc=0x441376
runtime.selectgo(0xc015a2df90, 0xc015a2df48, 0x4?, 0x0, 0xc015a2df18?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc015a2ded8 sp=0xc015a2dd98 pc=0x450e7c
github.com/libp2p/go-mplex.(*Multiplex).handleOutgoing(0xc01ec390e0)
external/com_github_libp2p_go_mplex/multiplex.go:262 +0xd0 fp=0xc015a2dfc8 sp=0xc015a2ded8 pc=0x142aa10
github.com/libp2p/go-mplex.NewMultiplex.func2()
external/com_github_libp2p_go_mplex/multiplex.go:159 +0x26 fp=0xc015a2dfe0 sp=0xc015a2dfc8 pc=0x142a0a6
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc015a2dfe8 sp=0xc015a2dfe0 pc=0x471141
created by github.com/libp2p/go-mplex.NewMultiplex
external/com_github_libp2p_go_mplex/multiplex.go:159 +0x536
goroutine 966355278 [select]:
runtime.gopark(0xc059303f90?, 0x2?, 0xe6?, 0xf6?, 0xc059303f4c?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc059303d98 sp=0xc059303d78 pc=0x441376
runtime.selectgo(0xc059303f90, 0xc059303f48, 0x4?, 0x0, 0x404ea7?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc059303ed8 sp=0xc059303d98 pc=0x450e7c
github.com/libp2p/go-mplex.(*Multiplex).handleOutgoing(0xc0152f12c0)
external/com_github_libp2p_go_mplex/multiplex.go:262 +0xd0 fp=0xc059303fc8 sp=0xc059303ed8 pc=0x142aa10
github.com/libp2p/go-mplex.NewMultiplex.func2()
external/com_github_libp2p_go_mplex/multiplex.go:159 +0x26 fp=0xc059303fe0 sp=0xc059303fc8 pc=0x142a0a6
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc059303fe8 sp=0xc059303fe0 pc=0x471141
created by github.com/libp2p/go-mplex.NewMultiplex
external/com_github_libp2p_go_mplex/multiplex.go:159 +0x536
goroutine 636262091 [select, 1563 minutes]:
runtime.gopark(0xc04bed1f48?, 0x2?, 0x30?, 0x1d?, 0xc04bed1ed4?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc04bed1d30 sp=0xc04bed1d10 pc=0x441376
runtime.selectgo(0xc04bed1f48, 0xc04bed1ed0, 0x0?, 0x0, 0xc02cb0b040?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc04bed1e70 sp=0xc04bed1d30 pc=0x450e7c
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleSendingMessages(0x448165?, {0x25f1710, 0xc02f9b04c0}, {0x26018b0?, 0xc0670cd080}, 0xc0b3bbc180)
external/com_github_libp2p_go_libp2p_pubsub/comm.go:164 +0x305 fp=0xc04bed1fa0 sp=0xc04bed1e70 pc=0x138b765
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewPeer.func1()
external/com_github_libp2p_go_libp2p_pubsub/comm.go:117 +0x3a fp=0xc04bed1fe0 sp=0xc04bed1fa0 pc=0x138b13a
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc04bed1fe8 sp=0xc04bed1fe0 pc=0x471141
created by github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewPeer
external/com_github_libp2p_go_libp2p_pubsub/comm.go:117 +0x32a
goroutine 1702717697 [select, 383 minutes]:
runtime.gopark(0xc04edc1ee8?, 0x3?, 0x0?, 0x0?, 0xc04edc1eba?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc04edc1d08 sp=0xc04edc1ce8 pc=0x441376
runtime.selectgo(0xc04edc1ee8, 0xc04edc1eb4, 0x0?, 0x0, 0x0?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc04edc1e48 sp=0xc04edc1d08 pc=0x450e7c
github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).loop(0xc071537950, {0x25f1710, 0xc0b8802a80}, 0xc04f79eec0?)
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:89 +0x105 fp=0xc04edc1fb0 sp=0xc04edc1e48 pc=0x10a0d65
github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).start.func1()
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:71 +0x32 fp=0xc04edc1fe0 sp=0xc04edc1fb0 pc=0x10a0c32
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc04edc1fe8 sp=0xc04edc1fe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).start
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:71 +0xf8
goroutine 1600033474 [select, 503 minutes]:
runtime.gopark(0xc002349b40?, 0x3?, 0x20?, 0x3?, 0xc002349b12?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc002349998 sp=0xc002349978 pc=0x441376
runtime.selectgo(0xc002349b40, 0xc002349b0c, 0x0?, 0x0, 0x3f?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc002349ad8 sp=0xc002349998 pc=0x450e7c
github.com/libp2p/go-mplex.(*Stream).waitForData(0xc0168fda00)
external/com_github_libp2p_go_mplex/stream.go:70 +0xba fp=0xc002349b80 sp=0xc002349ad8 pc=0x142ce3a
github.com/libp2p/go-mplex.(*Stream).Read(0xc0168fda00, {0xc085bc5000, 0x1000, 0x1000})
external/com_github_libp2p_go_mplex/stream.go:117 +0x65 fp=0xc002349c08 sp=0xc002349b80 pc=0x142d165
github.com/libp2p/go-libp2p/p2p/muxer/mplex.(*stream).Read(0xc002349c58?, {0xc085bc5000?, 0xc009e484e0?, 0x3?})
external/com_github_libp2p_go_libp2p/p2p/muxer/mplex/stream.go:17 +0x1e fp=0xc002349c50 sp=0xc002349c08 pc=0x142e7de
github.com/libp2p/go-libp2p/p2p/net/swarm.(*Stream).Read(0xc0d9ef8800, {0xc085bc5000?, 0x203029a?, 0x20?})
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_stream.go:55 +0x36 fp=0xc002349cc8 sp=0xc002349c50 pc=0x11f23d6
bufio.(*Reader).fill(0xc014e49980)
GOROOT/src/bufio/bufio.go:106 +0xff fp=0xc002349d00 sp=0xc002349cc8 pc=0x59c67f
bufio.(*Reader).ReadByte(0xc014e49980)
GOROOT/src/bufio/bufio.go:265 +0x2c fp=0xc002349d20 sp=0xc002349d00 pc=0x59ce4c
github.com/multiformats/go-varint.ReadUvarint({0x25db120, 0xc014e49980})
external/com_github_multiformats_go_varint/varint.go:80 +0x5a fp=0xc002349d68 sp=0xc002349d20 pc=0xf8cb7a
github.com/libp2p/go-msgio/protoio.(*uvarintReader).ReadMsg(0xc085f8cdc0, {0x25ebfa0, 0xc0a694f490})
external/com_github_libp2p_go_msgio/protoio/uvarint_reader.go:70 +0x85 fp=0xc002349df0 sp=0xc002349d68 pc=0x102c1c5
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream(0xc0171c1c00, {0x2601940, 0xc0d9ef8800})
external/com_github_libp2p_go_libp2p_pubsub/comm.go:66 +0x30d fp=0xc002349f50 sp=0xc002349df0 pc=0x138a68d
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream-fm({0x2601940?, 0xc0d9ef8800?})
<autogenerated>:1 +0x39 fp=0xc002349f78 sp=0xc002349f50 pc=0x13bbf39
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).SetStreamHandler.func1({0xc0bdfb7e70, 0xe}, {0x30c03708?, 0xc0d9ef8800})
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:577 +0x76 fp=0xc002349fb0 sp=0xc002349f78 pc=0x10ffb96
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler.func1()
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x36 fp=0xc002349fe0 sp=0xc002349fb0 pc=0x10fea76
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc002349fe8 sp=0xc002349fe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x74f
goroutine 555830058 [select]:
runtime.gopark(0xc0960abef8?, 0x2?, 0xa6?, 0xdb?, 0xc0960abeec?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc0960abd78 sp=0xc0960abd58 pc=0x441376
runtime.selectgo(0xc0960abef8, 0xc0960abee8, 0x4891ed20?, 0x0, 0x17cf88?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc0960abeb8 sp=0xc0960abd78 pc=0x450e7c
github.com/libp2p/go-mplex.(*Multiplex).Accept(...)
external/com_github_libp2p_go_mplex/multiplex.go:180
github.com/libp2p/go-libp2p/p2p/muxer/mplex.(*conn).AcceptStream(0xc021b192c0)
external/com_github_libp2p_go_libp2p/p2p/muxer/mplex/conn.go:39 +0x6c fp=0xc0960abf28 sp=0xc0960abeb8 pc=0x142e70c
github.com/libp2p/go-libp2p/p2p/net/upgrader.(*transportConn).AcceptStream(0xc00035efd0?)
<autogenerated>:1 +0x2a fp=0xc0960abf40 sp=0xc0960abf28 pc=0x11fbfea
github.com/libp2p/go-libp2p/p2p/net/swarm.(*Conn).start.func1()
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_conn.go:110 +0xae fp=0xc0960abfe0 sp=0xc0960abf40 pc=0x11ebcae
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0960abfe8 sp=0xc0960abfe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/net/swarm.(*Conn).start
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_conn.go:105 +0x56
goroutine 1715081747 [select, 370 minutes]:
runtime.gopark(0xc02a741ee8?, 0x3?, 0x0?, 0x0?, 0xc02a741eba?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc02a741d08 sp=0xc02a741ce8 pc=0x441376
runtime.selectgo(0xc02a741ee8, 0xc02a741eb4, 0x0?, 0x0, 0x0?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc02a741e48 sp=0xc02a741d08 pc=0x450e7c
github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).loop(0xc0855430e0, {0x25f1710, 0xc06eb03640}, 0xc04f79eec0?)
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:89 +0x105 fp=0xc02a741fb0 sp=0xc02a741e48 pc=0x10a0d65
github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).start.func1()
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:71 +0x32 fp=0xc02a741fe0 sp=0xc02a741fb0 pc=0x10a0c32
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc02a741fe8 sp=0xc02a741fe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).start
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:71 +0xf8
goroutine 1932794 [IO wait]:
runtime.gopark(0x0?, 0xc00271c798?, 0x48?, 0xc8?, 0xc00271c7c8?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc0098538d0 sp=0xc0098538b0 pc=0x441376
runtime.netpollblock(0x53b1d2275e2aa94?, 0xcf88acb5?, 0xbe?)
GOROOT/src/runtime/netpoll.go:526 +0xf7 fp=0xc009853908 sp=0xc0098538d0 pc=0x4372f7
internal/poll.runtime_pollWait(0x30734a70, 0x72)
GOROOT/src/runtime/netpoll.go:305 +0x89 fp=0xc009853928 sp=0xc009853908 pc=0x46a409
internal/poll.(*pollDesc).wait(0x14?, 0x1000?, 0x0)
GOROOT/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc009853950 sp=0xc009853928 pc=0x4e9dd2
internal/poll.execIO(0xc00271c798, 0x23566d0)
GOROOT/src/internal/poll/fd_windows.go:175 +0xe5 fp=0xc0098539a8 sp=0xc009853950 pc=0x4eb405
internal/poll.(*FD).Read(0xc00271c780, {0xc0541a8000, 0x1000, 0x1000})
GOROOT/src/internal/poll/fd_windows.go:441 +0x26b fp=0xc009853a38 sp=0xc0098539a8 pc=0x4ec28b
net.(*netFD).Read(0xc00271c780, {0xc0541a8000?, 0xc054692000?, 0x0?})
GOROOT/src/net/fd_posix.go:55 +0x29 fp=0xc009853a80 sp=0xc009853a38 pc=0x561ee9
net.(*conn).Read(0xc0503bf870, {0xc0541a8000?, 0x0?, 0xc054692000?})
GOROOT/src/net/net.go:183 +0x45 fp=0xc009853ac8 sp=0xc009853a80 pc=0x57a145
bufio.(*Reader).Read(0xc0515c95c0, {0xc020beb5f0, 0x2, 0xc009853b78?})
GOROOT/src/bufio/bufio.go:237 +0x1bb fp=0xc009853b00 sp=0xc009853ac8 pc=0x59cc5b
io.ReadAtLeast({0x25db140, 0xc0515c95c0}, {0xc020beb5f0, 0x2, 0x2}, 0x2)
GOROOT/src/io/io.go:332 +0x9a fp=0xc009853b48 sp=0xc009853b00 pc=0x4bba7a
io.ReadFull(...)
GOROOT/src/io/io.go:351
github.com/libp2p/go-libp2p/p2p/security/noise.(*secureSession).readNextInsecureMsgLen(0xc020beb560)
external/com_github_libp2p_go_libp2p/p2p/security/noise/rw.go:133 +0x3b fp=0xc009853b88 sp=0xc009853b48 pc=0x140f75b
github.com/libp2p/go-libp2p/p2p/security/noise.(*secureSession).Read(0xc020beb560, {0xc054692000, 0x1000, 0x1000})
external/com_github_libp2p_go_libp2p/p2p/security/noise/rw.go:52 +0x22f fp=0xc009853c48 sp=0xc009853b88 pc=0x140edcf
bufio.(*Reader).fill(0xc051978f60)
GOROOT/src/bufio/bufio.go:106 +0xff fp=0xc009853c80 sp=0xc009853c48 pc=0x59c67f
bufio.(*Reader).ReadByte(0xc051978f60)
GOROOT/src/bufio/bufio.go:265 +0x2c fp=0xc009853ca0 sp=0xc009853c80 pc=0x59ce4c
github.com/multiformats/go-varint.ReadUvarint({0x25db120, 0xc051978f60})
external/com_github_multiformats_go_varint/varint.go:80 +0x5a fp=0xc009853ce8 sp=0xc009853ca0 pc=0xf8cb7a
github.com/libp2p/go-mplex.(*Multiplex).readNextHeader(0xc05a8464e0?)
external/com_github_libp2p_go_mplex/multiplex.go:566 +0x25 fp=0xc009853d08 sp=0xc009853ce8 pc=0x142c625
github.com/libp2p/go-mplex.(*Multiplex).handleIncoming(0xc009060b40)
external/com_github_libp2p_go_mplex/multiplex.go:374 +0x146 fp=0xc009853fc8 sp=0xc009853d08 pc=0x142b526
github.com/libp2p/go-mplex.NewMultiplex.func1()
external/com_github_libp2p_go_mplex/multiplex.go:158 +0x26 fp=0xc009853fe0 sp=0xc009853fc8 pc=0x142a106
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc009853fe8 sp=0xc009853fe0 pc=0x471141
created by github.com/libp2p/go-mplex.NewMultiplex
external/com_github_libp2p_go_mplex/multiplex.go:158 +0x4f7
goroutine 1839054669 [select]:
runtime.gopark(0xc0825f5ef8?, 0x2?, 0xa6?, 0xdb?, 0xc0825f5eec?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc0825f5d78 sp=0xc0825f5d58 pc=0x441376
runtime.selectgo(0xc0825f5ef8, 0xc0825f5ee8, 0x39cb8ed0?, 0x0, 0x160108?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc0825f5eb8 sp=0xc0825f5d78 pc=0x450e7c
github.com/libp2p/go-mplex.(*Multiplex).Accept(...)
external/com_github_libp2p_go_mplex/multiplex.go:180
github.com/libp2p/go-libp2p/p2p/muxer/mplex.(*conn).AcceptStream(0xc02777bcc0)
external/com_github_libp2p_go_libp2p/p2p/muxer/mplex/conn.go:39 +0x6c fp=0xc0825f5f28 sp=0xc0825f5eb8 pc=0x142e70c
github.com/libp2p/go-libp2p/p2p/net/upgrader.(*transportConn).AcceptStream(0xc00035efd0?)
<autogenerated>:1 +0x2a fp=0xc0825f5f40 sp=0xc0825f5f28 pc=0x11fbfea
github.com/libp2p/go-libp2p/p2p/net/swarm.(*Conn).start.func1()
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_conn.go:110 +0xae fp=0xc0825f5fe0 sp=0xc0825f5f40 pc=0x11ebcae
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0825f5fe8 sp=0xc0825f5fe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/net/swarm.(*Conn).start
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_conn.go:105 +0x56
goroutine 1985641268 [select]:
runtime.gopark(0xc0b0deb548?, 0x3?, 0xe0?, 0xb3?, 0xc0b0deb51a?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc0b0deb3a0 sp=0xc0b0deb380 pc=0x441376
runtime.selectgo(0xc0b0deb548, 0xc0b0deb514, 0xc0b56d0af8?, 0x0, 0x9508?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc0b0deb4e0 sp=0xc0b0deb3a0 pc=0x450e7c
github.com/libp2p/go-mplex.(*Stream).waitForData(0xc00bea8c30)
external/com_github_libp2p_go_mplex/stream.go:70 +0xba fp=0xc0b0deb588 sp=0xc0b0deb4e0 pc=0x142ce3a
github.com/libp2p/go-mplex.(*Stream).Read(0xc00bea8c30, {0xc054196ce3, 0x1, 0x1})
external/com_github_libp2p_go_mplex/stream.go:117 +0x65 fp=0xc0b0deb610 sp=0xc0b0deb588 pc=0x142d165
github.com/libp2p/go-libp2p/p2p/muxer/mplex.(*stream).Read(0xc0c4295ffe?, {0xc054196ce3?, 0x134b38e?, 0x16d99?})
external/com_github_libp2p_go_libp2p/p2p/muxer/mplex/stream.go:17 +0x1e fp=0xc0b0deb658 sp=0xc0b0deb610 pc=0x142e7de
github.com/libp2p/go-libp2p/p2p/net/swarm.(*Stream).Read(0xc0afad8580, {0xc054196ce3?, 0xc0c4286000?, 0xc000840000?})
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_stream.go:55 +0x36 fp=0xc0b0deb6d0 sp=0xc0b0deb658 pc=0x11f23d6
github.com/multiformats/go-multistream.(*lazyClientConn).Read(0x453912?, {0xc054196ce3?, 0x1d67960?, 0xc000da5401?})
external/com_github_multiformats_go_multistream/lazyClient.go:68 +0xa3 fp=0xc0b0deb710 sp=0xc0b0deb6d0 pc=0x1092ee3
github.com/libp2p/go-libp2p/p2p/host/basic.(*streamWrapper).Read(0xc000da5420?, {0xc054196ce3?, 0xc0b0deb780?, 0x134c287?})
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:1019 +0x27 fp=0xc0b0deb740 sp=0xc0b0deb710 pc=0x1102ae7
github.com/prysmaticlabs/prysm/v3/beacon-chain/sync.readStatusCodeNoDeadline({0x26018b0, 0xc0b7221f00}, {0x25f5340, 0x32de7b0})
beacon-chain/sync/error.go:76 +0x65 fp=0xc0b0deb790 sp=0xc0b0deb740 pc=0x1540da5
github.com/prysmaticlabs/prysm/v3/beacon-chain/sync.readResponseChunk({0x26018b0?, 0xc0b7221f00}, {0x25f5200, 0xc000544380}, {0x35e94028, 0xc00010f8c0})
beacon-chain/sync/rpc_chunked_response.go:102 +0x87 fp=0xc0b0deb808 sp=0xc0b0deb790 pc=0x1552cc7
github.com/prysmaticlabs/prysm/v3/beacon-chain/sync.ReadChunkedBlock({0x26018b0?, 0xc0b7221f00?}, {0x25f5200?, 0xc000544380?}, {0x35e94028?, 0xc00010f8c0?}, 0x2f?)
beacon-chain/sync/rpc_chunked_response.go:73 +0x4b fp=0xc0b0deb848 sp=0xc0b0deb808 pc=0x155296b
github.com/prysmaticlabs/prysm/v3/beacon-chain/sync.SendBeaconBlocksByRangeRequest({0x25f17b8, 0xc0bb0e34d0}, {0x25f5200?, 0xc000544380?}, {0x336f0e80?, 0xc00010f8c0}, {0xc069e3dbc0, 0x27}, 0xc0af7acc40, 0x0)
beacon-chain/sync/rpc_send_request.go:53 +0x325 fp=0xc0b0deb970 sp=0xc0b0deb848 pc=0x15577a5
github.com/prysmaticlabs/prysm/v3/beacon-chain/sync/initial-sync.(*blocksFetcher).requestBlocks(0xc008cb7ae0, {0x25f17b8, 0xc0bb0e34d0}, 0xc0af7acc40, {0xc069e3dbc0, 0x27})
beacon-chain/sync/initial-sync/blocks_fetcher.go:333 +0x67a fp=0xc0b0debbd0 sp=0xc0b0deb970 pc=0x162b21a
github.com/prysmaticlabs/prysm/v3/beacon-chain/sync/initial-sync.(*blocksFetcher).fetchBlocksFromPeer(0xc008cb7ae0, {0x25f17b8?, 0xc0a97b1680?}, 0x569d8c, 0x40, {0xc015e4d800, 0xf, 0x2d})
beacon-chain/sync/initial-sync/blocks_fetcher.go:295 +0x248 fp=0xc0b0debe48 sp=0xc0b0debbd0 pc=0x162a7c8
github.com/prysmaticlabs/prysm/v3/beacon-chain/sync/initial-sync.(*blocksFetcher).handleRequest(0xc008cb7ae0, {0x25f1710?, 0xc0090c4b40?}, 0x569d8c, 0x40)
beacon-chain/sync/initial-sync/blocks_fetcher.go:275 +0x3a6 fp=0xc0b0debf30 sp=0xc0b0debe48 pc=0x162a426
github.com/prysmaticlabs/prysm/v3/beacon-chain/sync/initial-sync.(*blocksFetcher).loop.func3()
beacon-chain/sync/initial-sync/blocks_fetcher.go:216 +0xc5 fp=0xc0b0debfe0 sp=0xc0b0debf30 pc=0x1629b65
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0b0debfe8 sp=0xc0b0debfe0 pc=0x471141
created by github.com/prysmaticlabs/prysm/v3/beacon-chain/sync/initial-sync.(*blocksFetcher).loop
beacon-chain/sync/initial-sync/blocks_fetcher.go:212 +0x11b
goroutine 1891598860 [select, 28 minutes]:
runtime.gopark(0xc06ef3db40?, 0x3?, 0xa0?, 0x17?, 0xc06ef3db12?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc06ef3d998 sp=0xc06ef3d978 pc=0x441376
runtime.selectgo(0xc06ef3db40, 0xc06ef3db0c, 0x0?, 0x0, 0x2f?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc06ef3dad8 sp=0xc06ef3d998 pc=0x450e7c
github.com/libp2p/go-mplex.(*Stream).waitForData(0xc02868f110)
external/com_github_libp2p_go_mplex/stream.go:70 +0xba fp=0xc06ef3db80 sp=0xc06ef3dad8 pc=0x142ce3a
github.com/libp2p/go-mplex.(*Stream).Read(0xc02868f110, {0xc06858e000, 0x1000, 0x1000})
external/com_github_libp2p_go_mplex/stream.go:117 +0x65 fp=0xc06ef3dc08 sp=0xc06ef3db80 pc=0x142d165
github.com/libp2p/go-libp2p/p2p/muxer/mplex.(*stream).Read(0x0?, {0xc06858e000?, 0xc06ef3dcb8?, 0x4194b3?})
external/com_github_libp2p_go_libp2p/p2p/muxer/mplex/stream.go:17 +0x1e fp=0xc06ef3dc50 sp=0xc06ef3dc08 pc=0x142e7de
github.com/libp2p/go-libp2p/p2p/net/swarm.(*Stream).Read(0xc0bc9d1480, {0xc06858e000?, 0x20301e3?, 0x128fdb758?})
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_stream.go:55 +0x36 fp=0xc06ef3dcc8 sp=0xc06ef3dc50 pc=0x11f23d6
bufio.(*Reader).fill(0xc077dc1620)
GOROOT/src/bufio/bufio.go:106 +0xff fp=0xc06ef3dd00 sp=0xc06ef3dcc8 pc=0x59c67f
bufio.(*Reader).ReadByte(0xc077dc1620)
GOROOT/src/bufio/bufio.go:265 +0x2c fp=0xc06ef3dd20 sp=0xc06ef3dd00 pc=0x59ce4c
github.com/multiformats/go-varint.ReadUvarint({0x25db120, 0xc077dc1620})
external/com_github_multiformats_go_varint/varint.go:80 +0x5a fp=0xc06ef3dd68 sp=0xc06ef3dd20 pc=0xf8cb7a
github.com/libp2p/go-msgio/protoio.(*uvarintReader).ReadMsg(0xc066d5eec0, {0x25ebfa0, 0xc078e1c000})
external/com_github_libp2p_go_msgio/protoio/uvarint_reader.go:70 +0x85 fp=0xc06ef3ddf0 sp=0xc06ef3dd68 pc=0x102c1c5
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream(0xc0171c1c00, {0x2601940, 0xc0bc9d1480})
external/com_github_libp2p_go_libp2p_pubsub/comm.go:66 +0x30d fp=0xc06ef3df50 sp=0xc06ef3ddf0 pc=0x138a68d
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream-fm({0x2601940?, 0xc0bc9d1480?})
<autogenerated>:1 +0x39 fp=0xc06ef3df78 sp=0xc06ef3df50 pc=0x13bbf39
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).SetStreamHandler.func1({0xc0bcaf0740, 0xe}, {0x30c03708?, 0xc0bc9d1480})
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:577 +0x76 fp=0xc06ef3dfb0 sp=0xc06ef3df78 pc=0x10ffb96
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler.func1()
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x36 fp=0xc06ef3dfe0 sp=0xc06ef3dfb0 pc=0x10fea76
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc06ef3dfe8 sp=0xc06ef3dfe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x74f
goroutine 1697069704 [select, 390 minutes]:
runtime.gopark(0xc018af7ee8?, 0x3?, 0x0?, 0x0?, 0xc018af7eba?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc018af7d08 sp=0xc018af7ce8 pc=0x441376
runtime.selectgo(0xc018af7ee8, 0xc018af7eb4, 0xc018af7ee0?, 0x0, 0x0?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc018af7e48 sp=0xc018af7d08 pc=0x450e7c
github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).loop(0xc02b1295e0, {0x25f1710, 0xc083c6c740}, 0xc04f79eec0?)
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:89 +0x105 fp=0xc018af7fb0 sp=0xc018af7e48 pc=0x10a0d65
github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).start.func1()
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:71 +0x32 fp=0xc018af7fe0 sp=0xc018af7fb0 pc=0x10a0c32
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc018af7fe8 sp=0xc018af7fe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).start
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:71 +0xf8
goroutine 966355277 [IO wait]:
runtime.gopark(0x0?, 0xc07ce04f18?, 0xc8?, 0x4f?, 0xc07ce04f48?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc02c09b8d0 sp=0xc02c09b8b0 pc=0x441376
runtime.netpollblock(0x16d9d9abc0e4139f?, 0x53f406a5?, 0x72?)
GOROOT/src/runtime/netpoll.go:526 +0xf7 fp=0xc02c09b908 sp=0xc02c09b8d0 pc=0x4372f7
internal/poll.runtime_pollWait(0x2e322b58, 0x72)
GOROOT/src/runtime/netpoll.go:305 +0x89 fp=0xc02c09b928 sp=0xc02c09b908 pc=0x46a409
internal/poll.(*pollDesc).wait(0x14?, 0x1000?, 0x0)
GOROOT/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc02c09b950 sp=0xc02c09b928 pc=0x4e9dd2
internal/poll.execIO(0xc07ce04f18, 0x23566d0)
GOROOT/src/internal/poll/fd_windows.go:175 +0xe5 fp=0xc02c09b9a8 sp=0xc02c09b950 pc=0x4eb405
internal/poll.(*FD).Read(0xc07ce04f00, {0xc02285e000, 0x1000, 0x1000})
GOROOT/src/internal/poll/fd_windows.go:441 +0x26b fp=0xc02c09ba38 sp=0xc02c09b9a8 pc=0x4ec28b
net.(*netFD).Read(0xc07ce04f00, {0xc02285e000?, 0xc03613b000?, 0x0?})
GOROOT/src/net/fd_posix.go:55 +0x29 fp=0xc02c09ba80 sp=0xc02c09ba38 pc=0x561ee9
net.(*conn).Read(0xc0aeac92e8, {0xc02285e000?, 0x0?, 0xc03613b000?})
GOROOT/src/net/net.go:183 +0x45 fp=0xc02c09bac8 sp=0xc02c09ba80 pc=0x57a145
bufio.(*Reader).Read(0xc03d09a5a0, {0xc01f946510, 0x2, 0xc02c09bb78?})
GOROOT/src/bufio/bufio.go:237 +0x1bb fp=0xc02c09bb00 sp=0xc02c09bac8 pc=0x59cc5b
io.ReadAtLeast({0x25db140, 0xc03d09a5a0}, {0xc01f946510, 0x2, 0x2}, 0x2)
GOROOT/src/io/io.go:332 +0x9a fp=0xc02c09bb48 sp=0xc02c09bb00 pc=0x4bba7a
io.ReadFull(...)
GOROOT/src/io/io.go:351
github.com/libp2p/go-libp2p/p2p/security/noise.(*secureSession).readNextInsecureMsgLen(0xc01f946480)
external/com_github_libp2p_go_libp2p/p2p/security/noise/rw.go:133 +0x3b fp=0xc02c09bb88 sp=0xc02c09bb48 pc=0x140f75b
github.com/libp2p/go-libp2p/p2p/security/noise.(*secureSession).Read(0xc01f946480, {0xc03613b000, 0x1000, 0x1000})
external/com_github_libp2p_go_libp2p/p2p/security/noise/rw.go:52 +0x22f fp=0xc02c09bc48 sp=0xc02c09bb88 pc=0x140edcf
bufio.(*Reader).fill(0xc00c31c300)
GOROOT/src/bufio/bufio.go:106 +0xff fp=0xc02c09bc80 sp=0xc02c09bc48 pc=0x59c67f
bufio.(*Reader).ReadByte(0xc00c31c300)
GOROOT/src/bufio/bufio.go:265 +0x2c fp=0xc02c09bca0 sp=0xc02c09bc80 pc=0x59ce4c
github.com/multiformats/go-varint.ReadUvarint({0x25db120, 0xc00c31c300})
external/com_github_multiformats_go_varint/varint.go:80 +0x5a fp=0xc02c09bce8 sp=0xc02c09bca0 pc=0xf8cb7a
github.com/libp2p/go-mplex.(*Multiplex).readNextHeader(0xc09656c420?)
external/com_github_libp2p_go_mplex/multiplex.go:566 +0x25 fp=0xc02c09bd08 sp=0xc02c09bce8 pc=0x142c625
github.com/libp2p/go-mplex.(*Multiplex).handleIncoming(0xc0152f12c0)
external/com_github_libp2p_go_mplex/multiplex.go:374 +0x146 fp=0xc02c09bfc8 sp=0xc02c09bd08 pc=0x142b526
github.com/libp2p/go-mplex.NewMultiplex.func1()
external/com_github_libp2p_go_mplex/multiplex.go:158 +0x26 fp=0xc02c09bfe0 sp=0xc02c09bfc8 pc=0x142a106
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc02c09bfe8 sp=0xc02c09bfe0 pc=0x471141
created by github.com/libp2p/go-mplex.NewMultiplex
external/com_github_libp2p_go_mplex/multiplex.go:158 +0x4f7
goroutine 1839053999 [select, 218 minutes]:
runtime.gopark(0xc02beb1ee8?, 0x3?, 0x0?, 0x0?, 0xc02beb1eba?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc02beb1d08 sp=0xc02beb1ce8 pc=0x441376
runtime.selectgo(0xc02beb1ee8, 0xc02beb1eb4, 0xc02beb1ee0?, 0x0, 0x0?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc02beb1e48 sp=0xc02beb1d08 pc=0x450e7c
github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).loop(0xc07862fe50, {0x25f1710, 0xc0769592c0}, 0xc04f79eec0?)
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:89 +0x105 fp=0xc02beb1fb0 sp=0xc02beb1e48 pc=0x10a0d65
github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).start.func1()
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:71 +0x32 fp=0xc02beb1fe0 sp=0xc02beb1fb0 pc=0x10a0c32
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc02beb1fe8 sp=0xc02beb1fe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/protocol/identify.(*peerHandler).start
external/com_github_libp2p_go_libp2p/p2p/protocol/identify/peer_loop.go:71 +0xf8
goroutine 1839053864 [select, 218 minutes]:
runtime.gopark(0xc03124df48?, 0x2?, 0x30?, 0xdd?, 0xc03124ded4?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc03124dd30 sp=0xc03124dd10 pc=0x441376
runtime.selectgo(0xc03124df48, 0xc03124ded0, 0xc0ae3bd7a0?, 0x0, 0xc0ad81c870?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc03124de70 sp=0xc03124dd30 pc=0x450e7c
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleSendingMessages(0x448165?, {0x25f1710, 0xc02f9b04c0}, {0x26018b0?, 0xc0a06c5140}, 0xc008caad20)
external/com_github_libp2p_go_libp2p_pubsub/comm.go:164 +0x305 fp=0xc03124dfa0 sp=0xc03124de70 pc=0x138b765
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewPeer.func1()
external/com_github_libp2p_go_libp2p_pubsub/comm.go:117 +0x3a fp=0xc03124dfe0 sp=0xc03124dfa0 pc=0x138b13a
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc03124dfe8 sp=0xc03124dfe0 pc=0x471141
created by github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewPeer
external/com_github_libp2p_go_libp2p_pubsub/comm.go:117 +0x32a
goroutine 1958494970 [select, 74 minutes]:
runtime.gopark(0xc00dca5f48?, 0x2?, 0x10?, 0x0?, 0xc00dca5ed4?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc00dca5d30 sp=0xc00dca5d10 pc=0x441376
runtime.selectgo(0xc00dca5f48, 0xc00dca5ed0, 0x0?, 0x0, 0xffffffffffffffff?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc00dca5e70 sp=0xc00dca5d30 pc=0x450e7c
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleSendingMessages(0x448165?, {0x25f1710, 0xc02f9b04c0}, {0x26018b0?, 0xc08ae0e160}, 0xc00b5640c0)
external/com_github_libp2p_go_libp2p_pubsub/comm.go:164 +0x305 fp=0xc00dca5fa0 sp=0xc00dca5e70 pc=0x138b765
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewPeer.func1()
external/com_github_libp2p_go_libp2p_pubsub/comm.go:117 +0x3a fp=0xc00dca5fe0 sp=0xc00dca5fa0 pc=0x138b13a
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc00dca5fe8 sp=0xc00dca5fe0 pc=0x471141
created by github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewPeer
external/com_github_libp2p_go_libp2p_pubsub/comm.go:117 +0x32a
goroutine 1525333114 [select, 113 minutes]:
runtime.gopark(0xc008d6db40?, 0x3?, 0x30?, 0xdb?, 0xc008d6db12?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc008d6d998 sp=0xc008d6d978 pc=0x441376
runtime.selectgo(0xc008d6db40, 0xc008d6db0c, 0x0?, 0x0, 0x2f?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc008d6dad8 sp=0xc008d6d998 pc=0x450e7c
github.com/libp2p/go-mplex.(*Stream).waitForData(0xc08c9b1450)
external/com_github_libp2p_go_mplex/stream.go:70 +0xba fp=0xc008d6db80 sp=0xc008d6dad8 pc=0x142ce3a
github.com/libp2p/go-mplex.(*Stream).Read(0xc08c9b1450, {0xc043427000, 0x1000, 0x1000})
external/com_github_libp2p_go_mplex/stream.go:117 +0x65 fp=0xc008d6dc08 sp=0xc008d6db80 pc=0x142d165
github.com/libp2p/go-libp2p/p2p/muxer/mplex.(*stream).Read(0xc008d6dc58?, {0xc043427000?, 0xc009e484e0?, 0x3?})
external/com_github_libp2p_go_libp2p/p2p/muxer/mplex/stream.go:17 +0x1e fp=0xc008d6dc50 sp=0xc008d6dc08 pc=0x142e7de
github.com/libp2p/go-libp2p/p2p/net/swarm.(*Stream).Read(0xc068833e80, {0xc043427000?, 0x20300cb?, 0x20?})
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_stream.go:55 +0x36 fp=0xc008d6dcc8 sp=0xc008d6dc50 pc=0x11f23d6
bufio.(*Reader).fill(0xc03bb87140)
GOROOT/src/bufio/bufio.go:106 +0xff fp=0xc008d6dd00 sp=0xc008d6dcc8 pc=0x59c67f
bufio.(*Reader).ReadByte(0xc03bb87140)
GOROOT/src/bufio/bufio.go:265 +0x2c fp=0xc008d6dd20 sp=0xc008d6dd00 pc=0x59ce4c
github.com/multiformats/go-varint.ReadUvarint({0x25db120, 0xc03bb87140})
external/com_github_multiformats_go_varint/varint.go:80 +0x5a fp=0xc008d6dd68 sp=0xc008d6dd20 pc=0xf8cb7a
github.com/libp2p/go-msgio/protoio.(*uvarintReader).ReadMsg(0xc085684d40, {0x25ebfa0, 0xc032c455e0})
external/com_github_libp2p_go_msgio/protoio/uvarint_reader.go:70 +0x85 fp=0xc008d6ddf0 sp=0xc008d6dd68 pc=0x102c1c5
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream(0xc0171c1c00, {0x2601940, 0xc068833e80})
external/com_github_libp2p_go_libp2p_pubsub/comm.go:66 +0x30d fp=0xc008d6df50 sp=0xc008d6ddf0 pc=0x138a68d
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream-fm({0x2601940?, 0xc068833e80?})
<autogenerated>:1 +0x39 fp=0xc008d6df78 sp=0xc008d6df50 pc=0x13bbf39
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).SetStreamHandler.func1({0xc0502ff700, 0xe}, {0x30c03708?, 0xc068833e80})
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:577 +0x76 fp=0xc008d6dfb0 sp=0xc008d6df78 pc=0x10ffb96
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler.func1()
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x36 fp=0xc008d6dfe0 sp=0xc008d6dfb0 pc=0x10fea76
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc008d6dfe8 sp=0xc008d6dfe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x74f
goroutine 1715081552 [runnable]:
runtime.gopark(0x0?, 0xc08b2e3918?, 0xc8?, 0x39?, 0xc08b2e3948?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc005f178d0 sp=0xc005f178b0 pc=0x441376
runtime.netpollblock(0xefbe0d5d27893dba?, 0xc69a6d09?, 0x91?)
GOROOT/src/runtime/netpoll.go:526 +0xf7 fp=0xc005f17908 sp=0xc005f178d0 pc=0x4372f7
internal/poll.runtime_pollWait(0x307352e0, 0x72)
GOROOT/src/runtime/netpoll.go:305 +0x89 fp=0xc005f17928 sp=0xc005f17908 pc=0x46a409
internal/poll.(*pollDesc).wait(0x8305?, 0x10000?, 0x0)
GOROOT/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc005f17950 sp=0xc005f17928 pc=0x4e9dd2
internal/poll.execIO(0xc08b2e3918, 0x23566d0)
GOROOT/src/internal/poll/fd_windows.go:175 +0xe5 fp=0xc005f179a8 sp=0xc005f17950 pc=0x4eb405
internal/poll.(*FD).Read(0xc08b2e3900, {0xc017e2c1be, 0x2ece, 0x9e42})
GOROOT/src/internal/poll/fd_windows.go:441 +0x26b fp=0xc005f17a38 sp=0xc005f179a8 pc=0x4ec28b
net.(*netFD).Read(0xc08b2e3900, {0xc017e2c1be?, 0x3?, 0xc005f17bfe?})
GOROOT/src/net/fd_posix.go:55 +0x29 fp=0xc005f17a80 sp=0xc005f17a38 pc=0x561ee9
net.(*conn).Read(0xc0ad7e6378, {0xc017e2c1be?, 0x1d09680?, 0xc016329938?})
GOROOT/src/net/net.go:183 +0x45 fp=0xc005f17ac8 sp=0xc005f17a80 pc=0x57a145
bufio.(*Reader).Read(0xc05526e0c0, {0xc017e2c1be, 0x2ece, 0xc076388790?})
GOROOT/src/bufio/bufio.go:223 +0x106 fp=0xc005f17b00 sp=0xc005f17ac8 pc=0x59cba6
io.ReadAtLeast({0x25db140, 0xc05526e0c0}, {0xc017e26000, 0x908c, 0x10000}, 0x908c)
GOROOT/src/io/io.go:332 +0x9a fp=0xc005f17b48 sp=0xc005f17b00 pc=0x4bba7a
io.ReadFull(...)
GOROOT/src/io/io.go:351
github.com/libp2p/go-libp2p/p2p/security/noise.(*secureSession).readNextMsgInsecure(0xc000198000?, {0xc017e26000?, 0x450553?, 0x400?})
external/com_github_libp2p_go_libp2p/p2p/security/noise/rw.go:147 +0x38 fp=0xc005f17b88 sp=0xc005f17b48 pc=0x140f7d8
github.com/libp2p/go-libp2p/p2p/security/noise.(*secureSession).Read(0xc01f8570e0, {0xc0851ad000, 0x1000, 0x1000})
external/com_github_libp2p_go_libp2p/p2p/security/noise/rw.go:75 +0x3d5 fp=0xc005f17c48 sp=0xc005f17b88 pc=0x140ef75
bufio.(*Reader).fill(0xc07eb2b920)
GOROOT/src/bufio/bufio.go:106 +0xff fp=0xc005f17c80 sp=0xc005f17c48 pc=0x59c67f
bufio.(*Reader).ReadByte(0xc07eb2b920)
GOROOT/src/bufio/bufio.go:265 +0x2c fp=0xc005f17ca0 sp=0xc005f17c80 pc=0x59ce4c
github.com/multiformats/go-varint.ReadUvarint({0x25db120, 0xc07eb2b920})
external/com_github_multiformats_go_varint/varint.go:80 +0x5a fp=0xc005f17ce8 sp=0xc005f17ca0 pc=0xf8cb7a
github.com/libp2p/go-mplex.(*Multiplex).readNextHeader(0xc005f17f78?)
external/com_github_libp2p_go_mplex/multiplex.go:566 +0x25 fp=0xc005f17d08 sp=0xc005f17ce8 pc=0x142c625
github.com/libp2p/go-mplex.(*Multiplex).handleIncoming(0xc0504a8f00)
external/com_github_libp2p_go_mplex/multiplex.go:374 +0x146 fp=0xc005f17fc8 sp=0xc005f17d08 pc=0x142b526
github.com/libp2p/go-mplex.NewMultiplex.func1()
external/com_github_libp2p_go_mplex/multiplex.go:158 +0x26 fp=0xc005f17fe0 sp=0xc005f17fc8 pc=0x142a106
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc005f17fe8 sp=0xc005f17fe0 pc=0x471141
created by github.com/libp2p/go-mplex.NewMultiplex
external/com_github_libp2p_go_mplex/multiplex.go:158 +0x4f7
goroutine 1457320625 [select]:
runtime.gopark(0xc0825f7ef8?, 0x2?, 0xa6?, 0xdb?, 0xc0825f7eec?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc0825f7d78 sp=0xc0825f7d58 pc=0x441376
runtime.selectgo(0xc0825f7ef8, 0xc0825f7ee8, 0x4420ab98?, 0x0, 0x17c668?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc0825f7eb8 sp=0xc0825f7d78 pc=0x450e7c
github.com/libp2p/go-mplex.(*Multiplex).Accept(...)
external/com_github_libp2p_go_mplex/multiplex.go:180
github.com/libp2p/go-libp2p/p2p/muxer/mplex.(*conn).AcceptStream(0xc01ec38460)
external/com_github_libp2p_go_libp2p/p2p/muxer/mplex/conn.go:39 +0x6c fp=0xc0825f7f28 sp=0xc0825f7eb8 pc=0x142e70c
github.com/libp2p/go-libp2p/p2p/net/upgrader.(*transportConn).AcceptStream(0xc00035efd0?)
<autogenerated>:1 +0x2a fp=0xc0825f7f40 sp=0xc0825f7f28 pc=0x11fbfea
github.com/libp2p/go-libp2p/p2p/net/swarm.(*Conn).start.func1()
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_conn.go:110 +0xae fp=0xc0825f7fe0 sp=0xc0825f7f40 pc=0x11ebcae
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0825f7fe8 sp=0xc0825f7fe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/net/swarm.(*Conn).start
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_conn.go:105 +0x56
goroutine 1361388252 [select, 771 minutes]:
runtime.gopark(0xc082b81b40?, 0x3?, 0xcd?, 0x97?, 0xc082b81b12?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc082b81998 sp=0xc082b81978 pc=0x441376
runtime.selectgo(0xc082b81b40, 0xc082b81b0c, 0x0?, 0x0, 0x3f?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc082b81ad8 sp=0xc082b81998 pc=0x450e7c
github.com/libp2p/go-mplex.(*Stream).waitForData(0xc026ca1930)
external/com_github_libp2p_go_mplex/stream.go:70 +0xba fp=0xc082b81b80 sp=0xc082b81ad8 pc=0x142ce3a
github.com/libp2p/go-mplex.(*Stream).Read(0xc026ca1930, {0xc0241b3000, 0x1000, 0x1000})
external/com_github_libp2p_go_mplex/stream.go:117 +0x65 fp=0xc082b81c08 sp=0xc082b81b80 pc=0x142d165
github.com/libp2p/go-libp2p/p2p/muxer/mplex.(*stream).Read(0xc082b81c58?, {0xc0241b3000?, 0xc009e484e0?, 0x3?})
external/com_github_libp2p_go_libp2p/p2p/muxer/mplex/stream.go:17 +0x1e fp=0xc082b81c50 sp=0xc082b81c08 pc=0x142e7de
github.com/libp2p/go-libp2p/p2p/net/swarm.(*Stream).Read(0xc07b9ae480, {0xc0241b3000?, 0x2030248?, 0x20?})
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_stream.go:55 +0x36 fp=0xc082b81cc8 sp=0xc082b81c50 pc=0x11f23d6
bufio.(*Reader).fill(0xc0719ae540)
GOROOT/src/bufio/bufio.go:106 +0xff fp=0xc082b81d00 sp=0xc082b81cc8 pc=0x59c67f
bufio.(*Reader).ReadByte(0xc0719ae540)
GOROOT/src/bufio/bufio.go:265 +0x2c fp=0xc082b81d20 sp=0xc082b81d00 pc=0x59ce4c
github.com/multiformats/go-varint.ReadUvarint({0x25db120, 0xc0719ae540})
external/com_github_multiformats_go_varint/varint.go:80 +0x5a fp=0xc082b81d68 sp=0xc082b81d20 pc=0xf8cb7a
github.com/libp2p/go-msgio/protoio.(*uvarintReader).ReadMsg(0xc07af16cc0, {0x25ebfa0, 0xc09213ee00})
external/com_github_libp2p_go_msgio/protoio/uvarint_reader.go:70 +0x85 fp=0xc082b81df0 sp=0xc082b81d68 pc=0x102c1c5
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream(0xc0171c1c00, {0x2601940, 0xc07b9ae480})
external/com_github_libp2p_go_libp2p_pubsub/comm.go:66 +0x30d fp=0xc082b81f50 sp=0xc082b81df0 pc=0x138a68d
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream-fm({0x2601940?, 0xc07b9ae480?})
<autogenerated>:1 +0x39 fp=0xc082b81f78 sp=0xc082b81f50 pc=0x13bbf39
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).SetStreamHandler.func1({0xc0631e8ef0, 0xe}, {0x30c03708?, 0xc07b9ae480})
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:577 +0x76 fp=0xc082b81fb0 sp=0xc082b81f78 pc=0x10ffb96
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler.func1()
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x36 fp=0xc082b81fe0 sp=0xc082b81fb0 pc=0x10fea76
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc082b81fe8 sp=0xc082b81fe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x74f
goroutine 101866157 [select]:
runtime.gopark(0xc0a0e45ef8?, 0x2?, 0xa6?, 0xdb?, 0xc0a0e45eec?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc0a0e45d78 sp=0xc0a0e45d58 pc=0x441376
runtime.selectgo(0xc0a0e45ef8, 0xc0a0e45ee8, 0x441f05d8?, 0x0, 0x17c668?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc0a0e45eb8 sp=0xc0a0e45d78 pc=0x450e7c
github.com/libp2p/go-mplex.(*Multiplex).Accept(...)
external/com_github_libp2p_go_mplex/multiplex.go:180
github.com/libp2p/go-libp2p/p2p/muxer/mplex.(*conn).AcceptStream(0xc021b18820)
external/com_github_libp2p_go_libp2p/p2p/muxer/mplex/conn.go:39 +0x6c fp=0xc0a0e45f28 sp=0xc0a0e45eb8 pc=0x142e70c
github.com/libp2p/go-libp2p/p2p/net/upgrader.(*transportConn).AcceptStream(0xc00035efd0?)
<autogenerated>:1 +0x2a fp=0xc0a0e45f40 sp=0xc0a0e45f28 pc=0x11fbfea
github.com/libp2p/go-libp2p/p2p/net/swarm.(*Conn).start.func1()
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_conn.go:110 +0xae fp=0xc0a0e45fe0 sp=0xc0a0e45f40 pc=0x11ebcae
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc0a0e45fe8 sp=0xc0a0e45fe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/net/swarm.(*Conn).start
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_conn.go:105 +0x56
goroutine 1958495158 [select, 14 minutes]:
runtime.gopark(0xc02d44db40?, 0x3?, 0xd2?, 0x78?, 0xc02d44db12?)
GOROOT/src/runtime/proc.go:363 +0xd6 fp=0xc02d44d998 sp=0xc02d44d978 pc=0x441376
runtime.selectgo(0xc02d44db40, 0xc02d44db0c, 0x0?, 0x0, 0x2f?, 0x1)
GOROOT/src/runtime/select.go:328 +0x7dc fp=0xc02d44dad8 sp=0xc02d44d998 pc=0x450e7c
github.com/libp2p/go-mplex.(*Stream).waitForData(0xc02f8ed1e0)
external/com_github_libp2p_go_mplex/stream.go:70 +0xba fp=0xc02d44db80 sp=0xc02d44dad8 pc=0x142ce3a
github.com/libp2p/go-mplex.(*Stream).Read(0xc02f8ed1e0, {0xc033808000, 0x1000, 0x1000})
external/com_github_libp2p_go_mplex/stream.go:117 +0x65 fp=0xc02d44dc08 sp=0xc02d44db80 pc=0x142d165
github.com/libp2p/go-libp2p/p2p/muxer/mplex.(*stream).Read(0xc02d44dc58?, {0xc033808000?, 0xc009e484e0?, 0x3?})
external/com_github_libp2p_go_libp2p/p2p/muxer/mplex/stream.go:17 +0x1e fp=0xc02d44dc50 sp=0xc02d44dc08 pc=0x142e7de
github.com/libp2p/go-libp2p/p2p/net/swarm.(*Stream).Read(0xc0bc566300, {0xc033808000?, 0x203025b?, 0x20?})
external/com_github_libp2p_go_libp2p/p2p/net/swarm/swarm_stream.go:55 +0x36 fp=0xc02d44dcc8 sp=0xc02d44dc50 pc=0x11f23d6
bufio.(*Reader).fill(0xc07ed933e0)
GOROOT/src/bufio/bufio.go:106 +0xff fp=0xc02d44dd00 sp=0xc02d44dcc8 pc=0x59c67f
bufio.(*Reader).ReadByte(0xc07ed933e0)
GOROOT/src/bufio/bufio.go:265 +0x2c fp=0xc02d44dd20 sp=0xc02d44dd00 pc=0x59ce4c
github.com/multiformats/go-varint.ReadUvarint({0x25db120, 0xc07ed933e0})
external/com_github_multiformats_go_varint/varint.go:80 +0x5a fp=0xc02d44dd68 sp=0xc02d44dd20 pc=0xf8cb7a
github.com/libp2p/go-msgio/protoio.(*uvarintReader).ReadMsg(0xc06202e7c0, {0x25ebfa0, 0xc096d019d0})
external/com_github_libp2p_go_msgio/protoio/uvarint_reader.go:70 +0x85 fp=0xc02d44ddf0 sp=0xc02d44dd68 pc=0x102c1c5
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream(0xc0171c1c00, {0x2601940, 0xc0bc566300})
external/com_github_libp2p_go_libp2p_pubsub/comm.go:66 +0x30d fp=0xc02d44df50 sp=0xc02d44ddf0 pc=0x138a68d
github.com/libp2p/go-libp2p-pubsub.(*PubSub).handleNewStream-fm({0x2601940?, 0xc0bc566300?})
<autogenerated>:1 +0x39 fp=0xc02d44df78 sp=0xc02d44df50 pc=0x13bbf39
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).SetStreamHandler.func1({0xc0020951d0, 0xe}, {0x30c03708?, 0xc0bc566300})
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:577 +0x76 fp=0xc02d44dfb0 sp=0xc02d44df78 pc=0x10ffb96
github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler.func1()
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x36 fp=0xc02d44dfe0 sp=0xc02d44dfb0 pc=0x10fea76
runtime.goexit()
src/runtime/asm_amd64.s:1594 +0x1 fp=0xc02d44dfe8 sp=0xc02d44dfe0 pc=0x471141
created by github.com/libp2p/go-libp2p/p2p/host/basic.(*BasicHost).newStreamHandler
external/com_github_libp2p_go_libp2p/p2p/host/basic/basic_host.go:418 +0x74f
ERROR FAILED
an error has occured, set PRYSM_AUTORESTART=1 to automatically restart
Geth output at time of crash looked like:
WARN [02-08|07:17:11.218] Ignoring already known beacon payload number=16,507,633 hash=2b85ad..6a10a7 age=1w3d11h
WARN [02-08|07:17:11.231] Ignoring already known beacon payload number=16,507,634 hash=a0e701..52933f age=1w3d11h
WARN [02-08|07:17:11.236] Ignoring already known beacon payload number=16,507,635 hash=972a7f..e2efd1 age=1w3d11h
WARN [02-08|07:17:11.242] Ignoring already known beacon payload number=16,507,636 hash=469e37..ce5d2a age=1w3d11h
WARN [02-08|07:17:11.245] Ignoring already known beacon payload number=16,507,637 hash=cc5ef4..47303f age=1w3d11h
WARN [02-08|07:17:11.250] Ignoring already known beacon payload number=16,507,638 hash=4ce03d..c3b93a age=1w3d11h
WARN [02-08|07:17:11.255] Ignoring already known beacon payload number=16,507,639 hash=98d76a..8644bc age=1w3d11h
WARN [02-08|07:17:11.261] Ignoring already known beacon payload number=16,507,640 hash=0aeee9..97c585 age=1w3d11h
WARN [02-08|07:17:11.265] Ignoring already known beacon payload number=16,507,641 hash=dff3e4..d8956f age=1w3d11h
WARN [02-08|07:17:11.271] Ignoring already known beacon payload number=16,507,642 hash=83beed..8dd9e5 age=1w3d11h
WARN [02-08|07:17:11.277] Ignoring already known beacon payload number=16,507,643 hash=23f7ee..6e41fd age=1w3d11h
WARN [02-08|07:17:11.284] Ignoring already known beacon payload number=16,507,644 hash=b3c9c9..f2b38e age=1w3d11h
INFO [02-08|07:17:11.518] Imported new potential chain segment blocks=1 txs=145 mgas=14.063 elapsed=228.221ms mgasps=61.620 number=16,507,645 hash=f20411..6a42ce age=1w3d11h dirty=1022.81MiB
INFO [02-08|07:17:11.744] Imported new potential chain segment blocks=1 txs=135 mgas=11.778 elapsed=219.313ms mgasps=53.704 number=16,507,646 hash=81f1a2..b14af0 age=1w3d11h dirty=1022.26MiB
INFO [02-08|07:17:11.984] Imported new potential chain segment blocks=1 txs=120 mgas=9.072 elapsed=234.886ms mgasps=38.621 number=16,507,647 hash=a27b02..e56b65 age=1w3d11h dirty=1022.30MiB
INFO [02-08|07:17:13.061] Imported new potential chain segment blocks=1 txs=123 mgas=29.062 elapsed=1.069s mgasps=27.183 number=16,507,648 hash=4c25d2..344d77 age=1w3d11h dirty=1022.79MiB
INFO [02-08|07:17:13.136] Imported new potential chain segment blocks=1 txs=39 mgas=4.191 elapsed=71.058ms mgasps=58.984 number=16,507,649 hash=663527..f63262 age=1w3d11h dirty=1021.86MiB
INFO [02-08|07:17:13.933] Imported new potential chain segment blocks=1 txs=231 mgas=29.775 elapsed=789.149ms mgasps=37.731 number=16,507,650 hash=6e917c..522d8b age=1w3d10h dirty=1023.63MiB
INFO [02-08|07:17:14.186] Imported new potential chain segment blocks=1 txs=125 mgas=14.274 elapsed=244.187ms mgasps=58.457 number=16,507,651 hash=b77373..e291ed age=1w3d10h dirty=1021.40MiB
INFO [02-08|07:17:15.130] Imported new potential chain segment blocks=1 txs=70 mgas=29.965 elapsed=939.812ms mgasps=31.884 number=16,507,652 hash=a44870..4e50cb age=1w3d10h dirty=1022.84MiB
INFO [02-08|07:17:15.495] Imported new potential chain segment blocks=1 txs=137 mgas=15.571 elapsed=358.275ms mgasps=43.461 number=16,507,653 hash=dc6b0a..fe5922 age=1w3d10h dirty=1022.75MiB
INFO [02-08|07:17:15.653] Imported new potential chain segment blocks=1 txs=106 mgas=8.915 elapsed=153.141ms mgasps=58.215 number=16,507,654 hash=96a1fc..401cab age=1w3d10h dirty=1021.83MiB
INFO [02-08|07:17:15.829] Imported new potential chain segment blocks=1 txs=112 mgas=9.388 elapsed=169.103ms mgasps=55.517 number=16,507,655 hash=a2d956..b0d5ae age=1w3d10h dirty=1021.87MiB
INFO [02-08|07:17:16.156] Imported new potential chain segment blocks=1 txs=195 mgas=22.580 elapsed=317.986ms mgasps=71.009 number=16,507,656 hash=441cb8..d9612b age=1w3d10h dirty=1022.40MiB
INFO [02-08|07:17:16.296] Imported new potential chain segment blocks=1 txs=120 mgas=10.252 elapsed=134.814ms mgasps=76.042 number=16,507,657 hash=ca3d82..1478ea age=1w3d10h dirty=1022.44MiB
INFO [02-08|07:17:16.549] Imported new potential chain segment blocks=1 txs=109 mgas=11.191 elapsed=248.301ms mgasps=45.070 number=16,507,658 hash=49de43..232043 age=1w3d10h dirty=1022.53MiB
INFO [02-08|07:17:16.807] Imported new potential chain segment blocks=1 txs=256 mgas=27.542 elapsed=243.295ms mgasps=113.203 number=16,507,659 hash=901a9b..3f750b age=1w3d10h dirty=1022.71MiB
INFO [02-08|07:17:16.927] Imported new potential chain segment blocks=1 txs=292 mgas=29.991 elapsed=114.612ms mgasps=261.671 number=16,507,660 hash=83bd9c..4134fc age=1w3d10h dirty=1022.43MiB
INFO [02-08|07:17:17.094] Imported new potential chain segment blocks=1 txs=306 mgas=29.973 elapsed=157.724ms mgasps=190.035 number=16,507,661 hash=9213b8..1164e1 age=1w3d10h dirty=1022.01MiB
INFO [02-08|07:17:17.514] Imported new potential chain segment blocks=1 txs=276 mgas=29.978 elapsed=112.170ms mgasps=267.258 number=16,507,662 hash=1a05ed..720157 age=1w3d10h dirty=1021.64MiB
INFO [02-08|07:17:17.706] Imported new potential chain segment blocks=1 txs=199 mgas=29.975 elapsed=186.878ms mgasps=160.400 number=16,507,663 hash=e88eb0..509517 age=1w3d10h dirty=1021.38MiB
INFO [02-08|07:17:17.842] Imported new potential chain segment blocks=1 txs=213 mgas=29.980 elapsed=130.853ms mgasps=229.112 number=16,507,664 hash=50371e..8a1fd4 age=1w3d10h dirty=1021.67MiB
INFO [02-08|07:17:17.946] Imported new potential chain segment blocks=1 txs=141 mgas=29.991 elapsed=99.856ms mgasps=300.345 number=16,507,665 hash=9b7af9..39b6e3 age=1w3d10h dirty=1021.57MiB
INFO [02-08|07:17:18.116] Imported new potential chain segment blocks=1 txs=248 mgas=29.993 elapsed=164.863ms mgasps=181.927 number=16,507,666 hash=738979..993a5e age=1w3d10h dirty=1021.29MiB
INFO [02-08|07:17:18.349] Imported new potential chain segment blocks=1 txs=263 mgas=29.981 elapsed=223.878ms mgasps=133.918 number=16,507,667 hash=bc6eaa..977375 age=1w3d10h dirty=1021.50MiB
INFO [02-08|07:17:18.717] Imported new potential chain segment blocks=1 txs=770 mgas=29.987 elapsed=354.730ms mgasps=84.536 number=16,507,668 hash=bc85e5..6d6f5e age=1w3d10h dirty=1022.45MiB
INFO [02-08|07:17:18.857] Imported new potential chain segment blocks=1 txs=76 mgas=12.319 elapsed=129.121ms mgasps=95.406 number=16,507,669 hash=9f5455..26c8a0 age=1w3d10h dirty=1022.25MiB
INFO [02-08|07:17:18.959] Imported new potential chain segment blocks=1 txs=66 mgas=4.398 elapsed=99.428ms mgasps=44.235 number=16,507,670 hash=ac5a40..305a09 age=1w3d10h dirty=1021.60MiB
INFO [02-08|07:17:19.122] Imported new potential chain segment blocks=1 txs=100 mgas=6.690 elapsed=158.116ms mgasps=42.310 number=16,507,671 hash=8b8c87..69ebea age=1w3d10h dirty=1021.09MiB
INFO [02-08|07:17:19.240] Imported new potential chain segment blocks=1 txs=106 mgas=6.139 elapsed=111.244ms mgasps=55.184 number=16,507,672 hash=3567db..c86007 age=1w3d10h dirty=1020.70MiB
INFO [02-08|07:17:19.326] Extend chain add=64 number=16,507,672 hash=3567db..c86007
INFO [02-08|07:17:19.511] Chain head was updated number=16,507,672 hash=3567db..c86007 root=8d1dc3..5858c6 elapsed=184.8211ms age=1w3d10h
INFO [02-08|07:17:25.434] Imported new potential chain segment blocks=1 txs=141 mgas=13.318 elapsed=260.740ms mgasps=51.077 number=16,507,673 hash=95fc88..4e9b08 age=1w3d10h dirty=1020.98MiB
INFO [02-08|07:17:25.603] Imported new potential chain segment blocks=1 txs=120 mgas=8.090 elapsed=162.392ms mgasps=49.818 number=16,507,674 hash=eef59f..1c1baa age=1w3d10h dirty=1020.89MiB
INFO [02-08|07:17:25.784] Imported new potential chain segment blocks=1 txs=105 mgas=8.326 elapsed=176.073ms mgasps=47.285 number=16,507,675 hash=0ecfba..611175 age=1w3d10h dirty=1020.87MiB
INFO [02-08|07:17:25.972] Imported new potential chain segment blocks=1 txs=147 mgas=10.279 elapsed=182.686ms mgasps=56.265 number=16,507,676 hash=d54c21..2dd171 age=1w3d10h dirty=1019.88MiB
INFO [02-08|07:17:26.145] Imported new potential chain segment blocks=1 txs=116 mgas=8.223 elapsed=167.125ms mgasps=49.201 number=16,507,677 hash=1a53d8..16dce0 age=1w3d10h dirty=1019.78MiB
INFO [02-08|07:17:27.003] Imported new potential chain segment blocks=1 txs=178 mgas=14.979 elapsed=835.961ms mgasps=17.918 number=16,507,678 hash=6c4ae2..3c3a64 age=1w3d10h dirty=1020.09MiB
INFO [02-08|07:17:27.220] Imported new potential chain segment blocks=1 txs=149 mgas=12.912 elapsed=210.808ms mgasps=61.250 number=16,507,679 hash=0371ec..9a5db5 age=1w3d10h dirty=1020.56MiB
INFO [02-08|07:17:27.378] Imported new potential chain segment blocks=1 txs=88 mgas=5.202 elapsed=153.965ms mgasps=33.785 number=16,507,680 hash=3f5538..d4d849 age=1w3d10h dirty=1019.29MiB
INFO [02-08|07:17:27.561] Imported new potential chain segment blocks=1 txs=92 mgas=7.187 elapsed=178.682ms mgasps=40.223 number=16,507,681 hash=0c6713..7f156d age=1w3d10h dirty=1019.17MiB
INFO [02-08|07:17:27.865] Imported new potential chain segment blocks=1 txs=232 mgas=22.711 elapsed=291.826ms mgasps=77.823 number=16,507,682 hash=196d05..fd3b34 age=1w3d10h dirty=1020.14MiB
INFO [02-08|07:17:28.055] Imported new potential chain segment blocks=1 txs=85 mgas=8.786 elapsed=184.801ms mgasps=47.545 number=16,507,683 hash=5f7879..900bb2 age=1w3d10h dirty=1020.24MiB
INFO [02-08|07:17:28.275] Imported new potential chain segment blocks=1 txs=114 mgas=9.442 elapsed=210.994ms mgasps=44.750 number=16,507,684 hash=dfb36d..5d91d1 age=1w3d10h dirty=1019.55MiB
INFO [02-08|07:17:28.473] Imported new potential chain segment blocks=1 txs=246 mgas=15.433 elapsed=192.435ms mgasps=80.199 number=16,507,685 hash=5e4f2d..f35571 age=1w3d10h dirty=1020.69MiB
INFO [02-08|07:17:28.654] Imported new potential chain segment blocks=1 txs=106 mgas=10.347 elapsed=174.167ms mgasps=59.410 number=16,507,686 hash=e87880..1939c9 age=1w3d10h dirty=1019.82MiB
INFO [02-08|07:17:28.909] Imported new potential chain segment blocks=1 txs=198 mgas=19.000 elapsed=241.998ms mgasps=78.511 number=16,507,687 hash=bc4316..4a4295 age=1w3d10h dirty=1020.31MiB
INFO [02-08|07:17:29.150] Imported new potential chain segment blocks=1 txs=112 mgas=14.666 elapsed=228.039ms mgasps=64.315 number=16,507,688 hash=2353ab..f79594 age=1w3d10h dirty=1020.19MiB
INFO [02-08|07:17:29.396] Imported new potential chain segment blocks=1 txs=112 mgas=9.345 elapsed=239.393ms mgasps=39.037 number=16,507,689 hash=5328ec..7d56fb age=1w3d10h dirty=1020.50MiB
INFO [02-08|07:17:29.562] Imported new potential chain segment blocks=1 txs=99 mgas=9.333 elapsed=161.810ms mgasps=57.678 number=16,507,690 hash=ac49d7..519e76 age=1w3d10h dirty=1020.39MiB
INFO [02-08|07:17:29.765] Imported new potential chain segment blocks=1 txs=142 mgas=12.718 elapsed=196.196ms mgasps=64.824 number=16,507,691 hash=580112..e46007 age=1w3d10h dirty=1019.84MiB
INFO [02-08|07:17:29.981] Imported new potential chain segment blocks=1 txs=150 mgas=15.343 elapsed=207.230ms mgasps=74.039 number=16,507,692 hash=ffa345..a8f094 age=1w3d10h dirty=1019.72MiB
INFO [02-08|07:17:30.192] Imported new potential chain segment blocks=1 txs=128 mgas=11.647 elapsed=203.861ms mgasps=57.133 number=16,507,693 hash=4444fd..152291 age=1w3d10h dirty=1019.65MiB
INFO [02-08|07:17:30.762] Imported new potential chain segment blocks=1 txs=113 mgas=12.223 elapsed=246.575ms mgasps=49.570 number=16,507,694 hash=51a964..02a40f age=1w3d10h dirty=1019.60MiB
INFO [02-08|07:17:31.001] Imported new potential chain segment blocks=1 txs=123 mgas=17.779 elapsed=226.709ms mgasps=78.422 number=16,507,695 hash=1f10a7..f1ab59 age=1w3d10h dirty=1019.44MiB
INFO [02-08|07:17:31.174] Imported new potential chain segment blocks=1 txs=116 mgas=9.371 elapsed=169.316ms mgasps=55.345 number=16,507,696 hash=7eebe6..bb1b64 age=1w3d10h dirty=1019.22MiB
INFO [02-08|07:17:31.342] Imported new potential chain segment blocks=1 txs=104 mgas=10.518 elapsed=160.209ms mgasps=65.654 number=16,507,697 hash=8b7613..e5d386 age=1w3d10h dirty=1019.24MiB
INFO [02-08|07:17:31.398] Imported new potential chain segment blocks=1 txs=27 mgas=2.224 elapsed=52.649ms mgasps=42.236 number=16,507,698 hash=af134e..344871 age=1w3d10h dirty=1017.62MiB
INFO [02-08|07:17:31.912] Imported new potential chain segment blocks=1 txs=252 mgas=25.307 elapsed=505.490ms mgasps=50.064 number=16,507,699 hash=debb97..07d582 age=1w3d10h dirty=1019.16MiB
INFO [02-08|07:17:32.144] Imported new potential chain segment blocks=1 txs=141 mgas=12.526 elapsed=223.117ms mgasps=56.141 number=16,507,700 hash=270936..229f6d age=1w3d10h dirty=1019.22MiB
INFO [02-08|07:17:32.434] Imported new potential chain segment blocks=1 txs=101 mgas=9.565 elapsed=285.587ms mgasps=33.492 number=16,507,701 hash=71fc93..9fa3ad age=1w3d10h dirty=1019.11MiB
INFO [02-08|07:17:32.686] Imported new potential chain segment blocks=1 txs=121 mgas=13.754 elapsed=244.777ms mgasps=56.189 number=16,507,702 hash=b9fbbf..7d4296 age=1w3d10h dirty=1019.53MiB
INFO [02-08|07:17:32.883] Imported new potential chain segment blocks=1 txs=117 mgas=10.229 elapsed=191.727ms mgasps=53.354 number=16,507,703 hash=965887..fcf7db age=1w3d10h dirty=1019.72MiB
INFO [02-08|07:17:33.131] Imported new potential chain segment blocks=1 txs=148 mgas=19.247 elapsed=241.204ms mgasps=79.797 number=16,507,704 hash=e68737..e12635 age=1w3d10h dirty=1019.99MiB
INFO [02-08|07:17:33.356] Imported new potential chain segment blocks=1 txs=254 mgas=21.860 elapsed=203.027ms mgasps=107.672 number=16,507,705 hash=0451e4..ddbc20 age=1w3d10h dirty=1020.71MiB
INFO [02-08|07:17:33.640] Imported new potential chain segment blocks=1 txs=175 mgas=17.573 elapsed=276.684ms mgasps=63.512 number=16,507,706 hash=25c40a..8caf44 age=1w3d10h dirty=1021.05MiB
INFO [02-08|07:17:33.823] Imported new potential chain segment blocks=1 txs=122 mgas=12.257 elapsed=176.621ms mgasps=69.395 number=16,507,707 hash=ac0ef2..2365c5 age=1w3d10h dirty=1021.16MiB
INFO [02-08|07:17:34.083] Imported new potential chain segment blocks=1 txs=212 mgas=29.949 elapsed=248.560ms mgasps=120.490 number=16,507,708 hash=779425..f5efc6 age=1w3d10h dirty=1021.72MiB
INFO [02-08|07:17:34.326] Imported new potential chain segment blocks=1 txs=205 mgas=21.290 elapsed=234.889ms mgasps=90.638 number=16,507,709 hash=f05450..b6c4ef age=1w3d10h dirty=1021.96MiB
INFO [02-08|07:17:34.520] Imported new potential chain segment blocks=1 txs=270 mgas=28.164 elapsed=181.466ms mgasps=155.205 number=16,507,710 hash=cacaf9..c4dc53 age=1w3d10h dirty=1022.66MiB
INFO [02-08|07:17:34.677] Imported new potential chain segment blocks=1 txs=317 mgas=29.982 elapsed=148.880ms mgasps=201.380 number=16,507,711 hash=74db51..3212a3 age=1w3d10h dirty=1023.70MiB
INFO [02-08|07:17:34.837] Imported new potential chain segment blocks=1 txs=283 mgas=29.990 elapsed=154.611ms mgasps=193.972 number=16,507,712 hash=9fe470..f72370 age=1w3d10h dirty=1020.89MiB
INFO [02-08|07:17:35.308] Imported new potential chain segment blocks=1 txs=207 mgas=29.950 elapsed=464.316ms mgasps=64.504 number=16,507,713 hash=50e11f..4c7ef1 age=1w3d10h dirty=1021.54MiB
INFO [02-08|07:17:35.563] Imported new potential chain segment blocks=1 txs=256 mgas=13.223 elapsed=247.818ms mgasps=53.356 number=16,507,714 hash=2ee906..eabaf4 age=1w3d10h dirty=1021.13MiB
INFO [02-08|07:17:35.800] Imported new potential chain segment blocks=1 txs=217 mgas=12.839 elapsed=231.089ms mgasps=55.558 number=16,507,715 hash=f625c8..94a93d age=1w3d10h dirty=1021.69MiB
INFO [02-08|07:17:36.020] Imported new potential chain segment blocks=1 txs=132 mgas=9.857 elapsed=211.180ms mgasps=46.674 number=16,507,716 hash=c425ae..55944b age=1w3d10h dirty=1021.38MiB
INFO [02-08|07:17:36.128] Imported new potential chain segment blocks=1 txs=106 mgas=7.215 elapsed=104.314ms mgasps=69.166 number=16,507,717 hash=27981c..7546df age=1w3d10h dirty=1021.25MiB
INFO [02-08|07:17:36.329] Imported new potential chain segment blocks=1 txs=177 mgas=14.365 elapsed=194.357ms mgasps=73.908 number=16,507,718 hash=71940a..f386e3 age=1w3d10h dirty=1021.51MiB
INFO [02-08|07:17:36.573] Imported new potential chain segment blocks=1 txs=106 mgas=9.540 elapsed=238.817ms mgasps=39.948 number=16,507,719 hash=ea1a1e..5bed88 age=1w3d10h dirty=1021.60MiB
INFO [02-08|07:17:36.740] Imported new potential chain segment blocks=1 txs=126 mgas=11.352 elapsed=163.663ms mgasps=69.362 number=16,507,720 hash=969a99..43f721 age=1w3d10h dirty=1021.70MiB
INFO [02-08|07:17:36.956] Imported new potential chain segment blocks=1 txs=121 mgas=15.868 elapsed=205.713ms mgasps=77.135 number=16,507,721 hash=ebac0b..5187a8 age=1w3d10h dirty=1021.83MiB
INFO [02-08|07:17:37.123] Imported new potential chain segment blocks=1 txs=107 mgas=8.173 elapsed=161.175ms mgasps=50.707 number=16,507,722 hash=0d4604..1dc053 age=1w3d10h dirty=1021.65MiB
INFO [02-08|07:17:37.268] Imported new potential chain segment blocks=1 txs=94 mgas=8.806 elapsed=141.352ms mgasps=62.296 number=16,507,723 hash=138044..4495d4 age=1w3d10h dirty=1022.51MiB
INFO [02-08|07:17:37.607] Imported new potential chain segment blocks=1 txs=176 mgas=17.204 elapsed=330.735ms mgasps=52.018 number=16,507,724 hash=278afa..87c4be age=1w3d10h dirty=1021.67MiB
WARN [02-08|07:18:10.989] Previously seen beacon client is offline. Please ensure it is operational to follow the chain!
WARN [02-08|07:23:11.062] Previously seen beacon client is offline. Please ensure it is operational to follow the chain!
WARN [02-08|07:28:11.158] Previously seen beacon client is offline. Please ensure it is operational to follow the chain!
WARN [02-08|07:33:11.237] Previously seen beacon client is offline. Please ensure it is operational to follow the chain!
WARN [02-08|07:38:11.320] Previously seen beacon client is offline. Please ensure it is operational to follow the chain!
WARN [02-08|07:43:11.398] Previously seen beacon client is offline. Please ensure it is operational to follow the chain!
The crash is again from processing blocks around the 28/01/2023, which I don't think in coincidence considering this is how the issue started back on the 28th.
If there is anything else useful I can provide let me know.
Thanks for pasting this @cosmicnet. Unfortunately without the full stack trace and source of the panic, I can't help much with it. The fact that it failed again at the same possible set of blocks as earlier might be indicative of a hardware issue. When you restart prysm, is it able to process the blocks it couldn't previously ?
If you are stuck, you can run prysm with checkpoint sync on a fresh db and you should be online and active in a few minutes https://docs.prylabs.network/docs/prysm-usage/checkpoint-sync
I find it incredibly unlikely that the HW works fine for over 5 million slots then has an issue. From the output I get the impression prysm has a memory leak.
Since restart, geth and prysm appear to be working:
[2023-02-08 13:32:39] INFO initial-sync: Processing block batch of size 62 starting from 0x0237f612... 5681343/5753261 - estimated time remaining 1h16m6s blocksPerSecond=15.8 peers=46
[2023-02-08 13:32:45] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: client is closed: received an undefined ee error
[2023-02-08 13:32:53] INFO initial-sync: Processing block batch of size 62 starting from 0x0237f612... 5681343/5753262 - estimated time remaining 1h35m30s blocksPerSecond=12.6 peers=46
[2023-02-08 13:33:00] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: client is closed: received an undefined ee error
[2023-02-08 13:33:07] INFO initial-sync: Processing block batch of size 62 starting from 0x0237f612... 5681343/5753263 - estimated time remaining 3h13m20s blocksPerSecond=6.2 peers=45
[2023-02-08 13:33:15] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: client is closed: received an undefined ee error
[2023-02-08 13:33:16] INFO p2p: Peer summary activePeers=43 inbound=0 outbound=42
[2023-02-08 13:33:20] INFO initial-sync: Processing block batch of size 62 starting from 0x0237f612... 5681343/5753264 - estimated time remaining 3h13m20s blocksPerSecond=6.2 peers=47
If I were to guess, all these retries of block batches are leaking and build up to an eventual crash. I can't see that they current block batch system is optimal. At the least it is very wasteful.
got an unexpected error in JSON-RPC response: client is closed
This error indicates that prysm can't connect with geth, which is why the batch fails. It is possible for it to be an issue with memory, but without the full original error it is hard to know so. If your node is processing blocks fine now, then it should be good enough. Let us know if you see any other issues while waiting for it to sync up.
I keep seeing things like this:
[2023-02-08 13:36:45] INFO initial-sync: Processing block batch of size 64 starting from 0x7f442adf... 5681791/5753281 - estimated time remaining 53m47s blocksPerSecond=22.1 peers=44
[2023-02-08 13:36:45] WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root: 0xc7fd24fbb4550ef4f4d34d3654b3f3d93c153abac04332274f1979ca6e28e6cd (in processBatchedBlocks, slot=5681791)
[2023-02-08 13:36:53] INFO initial-sync: Processing block batch of size 63 starting from 0xad8f8849... 5681407/5753282 - estimated time remaining 54m4s blocksPerSecond=22.1 peers=46
[2023-02-08 13:37:00] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: client is closed: received an undefined ee error
[2023-02-08 13:37:13] INFO initial-sync: Processing block batch of size 63 starting from 0xad8f8849... 5681407/5753284 - estimated time remaining 6h20m18s blocksPerSecond=3.1 peers=45
[2023-02-08 13:37:16] INFO p2p: Peer summary activePeers=43 inbound=0 outbound=43
[2023-02-08 13:37:24] INFO initial-sync: Processing block batch of size 64 starting from 0x635b37cb... 5681471/5753285 - estimated time remaining 3h8m29s blocksPerSecond=6.3 peers=46
[2023-02-08 13:37:30] WARN initial-sync: Skip processing batched blocks error=could not process block in batch: got an unexpected error in JSON-RPC response: client is closed: received an undefined ee error
[2023-02-08 13:37:30] INFO initial-sync: Processing block batch of size 64 starting from 0xc91cf52c... 5681535/5753285 - estimated time remaining 2h5m13s blocksPerSecond=9.6 peers=45
INFO [02-08|13:35:09.134] Imported new potential chain segment blocks=1 txs=143 mgas=16.346 elapsed=245.216ms mgasps=66.658 number=16,512,940 hash=553b2d..3ea642 age=1w2d23h dirty=1022.37MiB
INFO [02-08|13:35:09.232] Extend chain add=62 number=16,512,940 hash=553b2d..3ea642
INFO [02-08|13:35:09.424] Chain head was updated number=16,512,940 hash=553b2d..3ea642 root=c6878d..e9294e elapsed=191.9977ms age=1w2d23h
WARN [02-08|13:35:43.063] Previously seen beacon client is offline. Please ensure it is operational to follow the chain!
INFO [02-08|13:36:35.685] Imported new potential chain segment blocks=1 txs=167 mgas=16.788 elapsed=207.472ms mgasps=80.917 number=16,512,941 hash=a0843d..65d7ed age=1w2d23h dirty=1022.46MiB
INFO [02-08|13:36:35.888] Imported new potential chain segment blocks=1 txs=116 mgas=13.819 elapsed=195.281ms mgasps=70.763 number=16,512,942 hash=c580ea..d948e7 age=1w2d23h dirty=1022.73MiB
When prysm finally gets to a block batch it can process (between a lot of WARN initial-sync: Skip processing batched blocks error=beacon node doesn't have a parent in db with root) it often loses the RPC connection.
My system is Win10, AMD Ryzen Threadripper PRO 3945WX 12 core, 256GB ECC RAM.
That is not normal, it appears that the ipc connection with your geth node is not very stable. You could try http with jwt-auth instead and see if it helps. The obvious downside that it requires more work to set prysm and geth to run that way compared to ipc.
Just from watching the logs, I get the impression prysm is blocking as it tries to process the blocks, the RPC connection times out, then gets re-established later. I really don't get the impression from watching it that the issue is on geths side.
IPC should be much faster, so I can't see that adding the overhead of http will help.
I'm hoping that when it catches up enough to stop attempting batches out of sequence that the communication issue will go away.
It's caught up now and seems to be back to normal. As I suspected, the RPC communication issue has disappeared now that it's just doing a block at a time rather than the batches.
I really think the batch processing needs to be improved.