3.0.0-alpha3 version failed to sync

[insider89]

System information

Erigon version: 3.0.0-alpha3

OS & Version: Linux(k8s cluster 1.29)

Commit hash: https://github.com/erigontech/erigon/commit/92d8c174cd5a86ed813c1cbef9c6649d3245b70e

Erigon Command (with flags/config):

   - --chain=bor-mainnet
    - --txpool.nolocals
    - --db.pagesize=16k
    - --private.api.addr=0.0.0.0:9090
    - --nat=extip:167.235.115.91
    - --authrpc.vhosts=*
    - --authrpc.jwtsecret=/home/erigon/.local/share/erigon/jwtsecret
    - --authrpc.addr=0.0.0.0
    - --datadir=/home/erigon/.local/share/erigon
    - --db.size.limit=15TB
    - --metrics
    - --port=30843
    - --p2p.allowed-ports=30843
    - --p2p.allowed-ports=30844
    - --p2p.allowed-ports=30845
    - --metrics.addr=0.0.0.0
    - --metrics.port=6060
    - --torrent.download.rate=1000mb
    - --http.api=admin,net,eth,erigon,web3,net,debug,trace,txpool,engine,ots
    - --http.addr=0.0.0.0
    - --http.vhosts=*
    - --http.corsdomain=*
    - --rpc.batch.limit=1000
    - --bodies.cache=5G
    - --ws
    - --db.read.concurrency=1024
    - --rpc.batch.concurrency=64
    - --txpool.pricelimit=30000000000
    - --bor.milestone=false
    - --bor.heimdall=http://polygon-heimdall-rpc:1317/
    - --log.dir.path=/home/erigon/.local/share/erigon/logs

Consensus Layer:

Consensus Layer Command (with flags/config):

Chain/Network: Polygon

Expected behaviour

After upgrade from 3.0.0-alpha2 to 3.0.0-alpha3, it should continue to sync.

Actual behaviour

Failed to sync with error:

[INFO] [09-13|07:46:39.239] [3/9 BorHeimdall] StateSync Progress     progress=59926337 lastSpanID=9647 lastCheckpointId=0 lastMilestoneId=0 lastStateSyncEventID=2940018 total records=2241 sync-events=2m0.668279174s sync-event-fetch=1m40.151707076s snaps=52.628439221s snap-init=1.562040692s waypoints=0s process time=2m40.003504448s
[INFO] [09-13|07:46:43.261] [dbg] BlockReader(idxMax=59929999,segMax=59929999).HeaderByNumber(blk=59930000) -> not found in db 
[EROR] [09-13|07:46:43.261] Staged Sync                              err="[3/9 BorHeimdall] header not found: 59930000"
[INFO] [09-13|07:46:44.154] [3/9 BorHeimdall] Processing spans...    from=9337 to=9647
[INFO] [09-13|07:46:54.098] [3/9 BorHeimdall] Processing sync events... from=59751000 to=61738832

Steps to reproduce the behaviour

Upgrade from 3.0.0-alpha2 to 3.0.0-alpha3 and run on k8s cluster.

Backtrace

[backtrace]

[AskAlexSharov]

try rm -rf chaindata if it will not help - try switch to main branch

[Giulio2002]

I say, we need more logs, can you paste the content of <datadir>/logs/erigon.log to pastebin?

[insider89]

I've removed all directories and sync started from scratch. I'll add more information if I have the issue again.

[insider89]

It has been synced successfully from scratch.

[insider89]

Have an error even after sync from scratch. Tried 2 times: https://pastebin.com/DCLbqVXw

[AskAlexSharov]

We will release alpha5 soon, then you can: switch to alpha5 and rm -rf chaindata seems it fixed there

[AskAlexSharov]

closing for now. feel free to re-open if need.