erigon icon indicating copy to clipboard operation
erigon copied to clipboard

Erigon stuck at block 18799999

Open fr4nc32c0 opened this issue 1 year ago • 1 comments

System information

Erigon version: ./erigon --version

erigon version 2.58.0-dev-e38c424b

OS & Version: Windows/Linux/OSX

Linux Ubuntu

Erigon Command (with flags/config):

./build/bin/erigon --datadir /opt/eth --http --http.addr="0.0.0.0" --http.port="8545" --http.vhosts="" --http.corsdomain="" --http.api="eth,admin,debug,net,trace,web3,erigon,ots" --ws

Expected behaviour

Real time syncing of blocks

Actual behaviour

stuck at block 18799999

Backtrace

root@eth:~/eth/erigon# ./build/bin/erigon --datadir /opt/eth --http --http.addr="0.0.0.0" --http.port="8545" --http.vhosts="" --http.corsdomain="" --http.api="eth,admin,debug,net,trace,web3,erigon,ots" --ws INFO[03-02|15:14:52.556] logging to file system log dir=/opt/eth/logs file prefix=erigon log level=info json=false INFO[03-02|15:14:52.556] Build info git_branch=devel git_tag=v2.54.0-329-ge38c424b1 git_commit=e38c424b1540fdd173217732fa6d517bd2a1f01f INFO[03-02|15:14:52.556] Starting Erigon on Ethereum mainnet... INFO[03-02|15:14:52.558] Maximum peer count ETH=100 total=100 INFO[03-02|15:14:52.558] starting HTTP APIs port=8545 APIs=eth,admin,debug,net,trace,web3,erigon,ots INFO[03-02|15:14:52.559] torrent verbosity level=WRN INFO[03-02|15:14:54.663] Set global gas cap cap=50000000 INFO[03-02|15:14:54.734] [Downloader] Running with ipv6-enabled=true ipv4-enabled=true download.rate=16mb upload.rate=4mb INFO[03-02|15:14:54.734] Opening Database label=chaindata path=/opt/eth/chaindata INFO[03-02|15:14:54.746] [db] open lable=chaindata sizeLimit=12TB pageSize=8192 INFO[03-02|15:14:54.747] Initialised chain configuration config="{ChainID: 1, Homestead: 1150000, DAO: 1920000, Tangerine Whistle: 2463000, Spurious Dragon: 2675000, Byzantium: 4370000, Constantinople: 7280000, Petersburg: 7280000, Istanbul: 9069000, Muir Glacier: 9200000, Berlin: 12244000, London: 12965000, Arrow Glacier: 13773000, Gray Glacier: 15050000, Terminal Total Difficulty: 58750000000000000000000, Merge Netsplit: , Shanghai: 1681338455, Cancun: , Prague: , Engine: ethash}" genesis=0xd4e56740f876aef8c010b86a40d5f56745a118d0906a34e69aec8c0db1cb8fa3 INFO[03-02|15:15:26.052] Initialising Ethereum protocol network=1 INFO[03-02|15:15:26.052] Disk storage enabled for ethash DAGs dir=/opt/eth/ethash-dags count=2 INFO[03-02|15:15:26.062] Starting private RPC server on=127.0.0.1:9090 INFO[03-02|15:15:26.062] new subscription to logs established INFO[03-02|15:15:26.063] rpc filters: subscribing to Erigon events INFO[03-02|15:15:26.063] New txs subscriber joined INFO[03-02|15:15:26.063] new subscription to newHeaders established INFO[03-02|15:15:26.064] Reading JWT secret path=/opt/eth/jwt.hex INFO[03-02|15:15:26.065] HTTP endpoint opened for Engine API url=127.0.0.1:8551 ws=true ws.compression=true INFO[03-02|15:15:26.065] JsonRpc endpoint opened ws=true ws.compression=true grpc=false websocket.url=[::]:8546 http.url=[::]:8545 INFO[03-02|15:15:26.066] [txpool] Started WARN[03-02|15:15:26.071] NAT ExternalIP resolution has failed, try to pass a different --nat option err="no UPnP or NAT-PMP router discovered" INFO[03-02|15:15:26.074] Started P2P networking version=67 self=enode://371a850803150941e0b66fbf3ca19487f65a9ca269708f235ceada25548f6ce7dedb2e565e51fa30f12b6af3bc7cb58077cc8e8ce78cb7b0798bde572a68b1a4@127.0.0.1:30304 name=erigon/v2.58.0-dev-e38c424b/linux-amd64/go1.21.6 INFO[03-02|15:15:26.074] [1/12 Snapshots] Fetching torrent files metadata WARN[03-02|15:15:26.075] NAT ExternalIP resolution has failed, try to pass a different --nat option err="no UPnP or NAT-PMP router discovered" INFO[03-02|15:15:26.080] Started P2P networking version=68 self=enode://371a850803150941e0b66fbf3ca19487f65a9ca269708f235ceada25548f6ce7dedb2e565e51fa30f12b6af3bc7cb58077cc8e8ce78cb7b0798bde572a68b1a4@127.0.0.1:30303 name=erigon/v2.58.0-dev-e38c424b/linux-amd64/go1.21.6 INFO[03-02|15:15:32.359] [snapshots:download] Blocks Stat blocks=18800k indices=18800k alloc=4.0GB sys=4.4GB INFO[03-02|15:15:32.363] [snapshots] Prune Blocks to=18709000 limit=100

fr4nc32c0 avatar Mar 02 '24 15:03 fr4nc32c0

--internalcl

AskAlexSharov avatar Mar 04 '24 06:03 AskAlexSharov

We need to add a periodic warning into the logs when Erigon is used w/o Caplin (--internalcl) and no external CL is connected.

yperbasis avatar Apr 10 '24 09:04 yperbasis

@AskAlexSharov i added it 2 days ago and this are the logs: INFO[04-10|10:01:25.371] P2P app=caplin peers=3 INFO[04-10|10:01:40.785] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=3 snapshots=0 reconnected=false INFO[04-10|10:01:54.107] [p2p] GoodPeers eth67=1 eth66=1 INFO[04-10|10:01:54.144] [txpool] stat pending=0 baseFee=0 queued=0 alloc=3.6GB sys=7.1GB INFO[04-10|10:02:10.785] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=3 snapshots=0 reconnected=false INFO[04-10|10:02:25.371] P2P app=caplin peers=3 INFO[04-10|10:02:40.784] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=3 snapshots=0 reconnected=false INFO[04-10|10:03:10.784] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=3 snapshots=0 reconnected=false INFO[04-10|10:03:25.371] P2P app=caplin peers=3 INFO[04-10|10:03:40.785] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:04:10.784] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=3 snapshots=0 reconnected=false INFO[04-10|10:04:25.372] P2P app=caplin peers=3 INFO[04-10|10:04:40.784] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=3 snapshots=0 reconnected=false INFO[04-10|10:04:54.107] [p2p] GoodPeers eth66=1 eth67=1 INFO[04-10|10:04:54.144] [txpool] stat pending=0 baseFee=0 queued=0 alloc=3.7GB sys=7.1GB INFO[04-10|10:05:10.785] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=5 snapshots=0 reconnected=false INFO[04-10|10:05:25.371] P2P app=caplin peers=5 INFO[04-10|10:05:40.784] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:06:10.785] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:06:25.371] P2P app=caplin peers=4 INFO[04-10|10:06:40.784] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=5 snapshots=0 reconnected=false INFO[04-10|10:07:10.784] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:07:25.372] P2P app=caplin peers=4 INFO[04-10|10:07:40.784] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:07:54.107] [p2p] GoodPeers eth67=1 eth68=1 eth66=2 INFO[04-10|10:07:54.145] [txpool] stat pending=0 baseFee=0 queued=238 alloc=3.6GB sys=7.1GB INFO[04-10|10:08:10.785] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:08:25.371] P2P app=caplin peers=4 INFO[04-10|10:08:40.784] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:09:10.784] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:09:25.371] P2P app=caplin peers=4 INFO[04-10|10:09:40.784] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:10:10.785] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:10:25.370] P2P app=caplin peers=4 INFO[04-10|10:10:40.785] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:10:54.106] [p2p] GoodPeers eth68=1 eth66=1 eth67=1 INFO[04-10|10:10:54.144] [txpool] stat pending=0 baseFee=0 queued=238 alloc=3.7GB sys=7.1GB INFO[04-10|10:11:10.784] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:11:25.371] P2P app=caplin peers=4 INFO[04-10|10:11:40.785] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:12:10.784] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:12:25.370] P2P app=caplin peers=4 INFO[04-10|10:12:40.784] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:13:10.784] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:13:25.370] P2P app=caplin peers=4 INFO[04-10|10:13:40.785] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:13:54.107] [p2p] GoodPeers eth68=1 eth67=2 eth66=1 INFO[04-10|10:13:54.144] [txpool] stat pending=0 baseFee=0 queued=238 alloc=3.6GB sys=7.1GB INFO[04-10|10:14:10.784] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=4 snapshots=0 reconnected=false INFO[04-10|10:14:25.371] P2P app=caplin peers=5 INFO[04-10|10:14:40.785] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=5 snapshots=0 reconnected=false INFO[04-10|10:15:10.784] Downloading History app=caplin stage=DownloadHistoricalBlocks slot=8826336 blockNumber=0 blk/sec=0.0 mbps/sec=0.0000 peers=5 snapshots=0 reconnected=false INFO[04-10|10:15:25.371] P2P app=caplin peers=5

this is my startup config: ./build/bin/erigon --internalcl --datadir /opt/eth --http --http.addr="0.0.0.0" --http.port="8545" --http.vhosts="" --http.corsdomain="" --http.api="eth,admin,debug,net,trace,web3,erigon,ots" --ws

fr4nc32c0 avatar Apr 10 '24 10:04 fr4nc32c0

I had this issue and i just wait for 3 days, then my node be synced.

qafariamirhossein avatar Apr 22 '24 13:04 qafariamirhossein

We need to add a periodic warning into the logs when Erigon is used w/o Caplin (--internalcl) and no external CL is connected.

+1

damjankuznar avatar May 28 '24 06:05 damjankuznar