Bad Block Error in diffsync, pipecommit, syncmode snap

[haliliceylan]

System information

Geth version: geth v1.1.16 OS & Version: Linux (full node) Ubuntu

Expected behaviour

no bad block error

Actual behaviour

bad block error occurs

Steps to reproduce the behaviour

start geth with, --syncmode snap --snapshot=true --cache.preimages --diffsync --pipecommit then you will get bad block error.

I deleted these parameters and only started with "--snapshot=false" and I got back 1000 blocks with debug.setHead. I synced within 1-2 minutes. Then I added the "--snapshot=true" parameter and left it to sync for 12 hours. No bad block errors occurred during this time also snapshot generating is done. After 12 hours, when I opened the old parameters again, I got a bad block error again and it say "generating snapshot..."

i can not turn on again snap, pipecommit and diffsync

Backtrace

There are three logs in different timestamp

first error in --syncmode snap --snapshot=true --cache.preimages --diffsync --pipecommit

https://gist.github.com/haliliceylan/f3598e737e077d266e16b469d1346b52 (i can not paste into issue because of body is too long error.

[KutkovetskyiVolodymyr]

same

[Aento]

same

[cosinlink]

try to remove --diffsync

[dandavid3000]

I have the same issue. It happens a lot today

Error: invalid receipt root hash (remote: abfba3604551657a09aea298a05a3c800ce1b2df7338bd4a8baff50b3cb1f962 local: 146a28b0aaeedf2dfe810d97f976a9af9a94c169a36537341ae81098a158343b)
##############################
 
INFO [10-30|00:38:08.214] Deep froze chain segment                 blocks=25 elapsed=4.246ms     number=22,516,799 hash=83c666..88119b
INFO [10-30|00:38:09.277] Imported new chain segment               blocks=1  txs=102   mgas=13.106  elapsed=117.855ms   mgasps=111.207  number=22,606,800 hash=6301ed..2d4430 dirty=0.00B
INFO [10-30|00:38:11.905] Imported new chain segment               blocks=1  txs=57    mgas=8.501   elapsed=113.324ms   mgasps=75.010   number=22,606,801 hash=e8ecbe..67ace0 dirty=0.00B
INFO [10-30|00:38:11.918] Submitted transaction                    hash=0x651286996eefb2d4180faabdb5f266ea92a5f41ab5ed0c59848cca69f2dc13de from=0x4cb6F0ef0Eeb503f8065AF1A6E6D5DD46197d3d9 nonce=22482 recipient=0x10ED43C718714eb63d5aA57B78B54704E256024E value=0                   x-forward-ip=nil
INFO [10-30|00:38:14.964] Imported new chain segment               blocks=1  txs=80    mgas=9.607   elapsed=141.780ms   mgasps=67.760   number=22,606,802 hash=02ad7e..f0ad83 dirty=0.00B
ERROR[10-30|00:38:17.566] validate state failed                    error="invalid receipt root hash (remote: abfba3604551657a09aea298a05a3c800ce1b2df7338bd4a8baff50b3cb1f962 local: 146a28b0aaeedf2dfe810d97f976a9af9a94c169a36537341ae81098a158343b)"
INFO [10-30|00:38:17.569] Skip duplicated bad block                number=22,606,793 hash=213b26..d9ff7b
ERROR[10-30|00:38:17.571] 
########## BAD BLOCK #########
Chain config: {ChainID: 56 Homestead: 0 DAO: <nil> DAOSupport: false EIP150: 0 EIP155: 0 EIP158: 0 Byzantium: 0 Constantinople: 0 Petersburg: 0 Istanbul: 0, Muir Glacier: 0, Ramanujan: 0, Niels: 0, MirrorSync: 5184000, Bruno: 13082000, Berlin: <nil>, YOLO v3: <nil>, CatalystBlock: <nil>, London: <nil>, ArrowGlacier: <nil>, MergeFork:<nil>, Euler: 18907621, Gibbs: <nil>, Nano: 21962149, Moran: 22107423, Engine: parlia}

Number: 22606793
Hash: 0x213b26831a7f5b29d77233f49f6ae83e1e1186e88ae412f4d35293dd98d9ff7b
	 0: cumulative: 15860 gas: 15860 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x7dbd12327d66be44b8dd6b0016395d620c80a604dbe066e3d3c6128500c7fa50 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 1: cumulative: 56671 gas: 40811 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xd3b433de7ade23fb021b6d9384a6a6cc7dd3d45256a5b7b26da4a948e94629c0 logs: [0xc002b23600] bloom: 00000080000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000080000000000000000000000000000000000000000000000008000000000000010000100000000000000000000000000000000000000000000000000000000000000000000000000010000008000100000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000000000000000002000000000000000800000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 2: cumulative: 85202 gas: 28531 contract: 0x0000000000000000000000000000000000000000 status: 0 tx: 0xc396aec65e7fc33430978b0588eb36c8f98a72eff651311a4cb01242046dcbeb logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: