Base mainnet node issues after upgrading to 1.8.4

[rromic]

trafficstars

Describe the bug

Hello there!

From last Thursday/Friday after we did the upgrade of reth to 1.8.4 with op-node version 1.14.3 the node at some point started to lag behind the tip. The setup is on GKE using n4-highmem-16 (120GB of memory and 16 vCPU) instance with Hyperdisk balanced Persistent disks.

Before reth version 1.8.4, we were on 1.8.3 version, and node was able to catch the tip after processing all pipeline stages which usually took around 3 hours.

Reth configuration is as follows - "node" - "-vvv" - "--chain=base" - "--rollup.disable-tx-pool-gossip" - "--rollup.sequencer-http=$(ROLLUP_SEQUENCER_HTTP)" - "--config=/data/reth.toml" - "--datadir=/data" - "--http" - "--http.addr=0.0.0.0" - "--http.port=$(RPC_PORT)" - "--http.corsdomain=*" - "--http.api=debug,eth,net,trace,txpool,web3,rpc,reth,ots,flashbots" - "--ws" - "--ws.addr=0.0.0.0" - "--ws.port=$(WS_PORT)" - "--ws.origins=*" - "--ws.api=debug,eth,net,trace,txpool,web3,rpc,reth,ots,flashbots" - "--authrpc.addr=0.0.0.0" - "--authrpc.port=$(AUTH_RPC_PORT)" - "--authrpc.jwtsecret=/data/jwt.txt" - "--port=$(P2P_PORT)" - "--metrics=0.0.0.0:$(METRICS_PORT)" - "--discovery.port=$(P2P_PORT)" - "--engine.persistence-threshold=10" - "--engine.memory-block-buffer-target=10"

op-node configuration is as follows exec op-node \ --l1=$L1_ETHEREUM_MAINNET \ --l1.beacon=$L1_BEACON_MAINNET \ --network=$NETWORK \ --l1.max-concurrency=100 \ --l1.rpc-max-batch-size=100 \ --l1.trustrpc \ --verifier.l1-confs=4 \ --l2=http://localhost:$AUTH_RPC_PORT \ --l2.skip-sync-start-check=true \ --l2.enginekind=reth \ --l2.jwt-secret=/data/jwt.txt \ --rpc.addr=0.0.0.0 \ --rpc.port=$RPC_PORT \ --p2p.bootnodes=enr:-J24QNz9lbrKbN4iSmmjtnr7SjUMk4zB7f1krHZcTZx-JRKZd0kA2gjufUROD6T3sOWDVDnFJRvqBBo62zuF-hYCohOGAYiOoEyEgmlkgnY0gmlwhAPniryHb3BzdGFja4OFQgCJc2VjcDI1NmsxoQKNVFlCxh_B-716tTs-h1vMzZkSs1FTu_OYTNjgufplG4N0Y3CCJAaDdWRwgiQG,enr:-J24QH-f1wt99sfpHy4c0QJM-NfmsIfmlLAMMcgZCUEgKG_BBYFc6FwYgaMJMQN5dsRBJApIok0jFn-9CS842lGpLmqGAYiOoDRAgmlkgnY0gmlwhLhIgb2Hb3BzdGFja4OFQgCJc2VjcDI1NmsxoQJ9FTIv8B9myn1MWaC_2lJ-sMoeCDkusCsk4BYHjjCq04N0Y3CCJAaDdWRwgiQG,enr:-J24QDXyyxvQYsd0yfsN0cRr1lZ1N11zGTplMNlW4xNEc7LkPXh0NAJ9iSOVdRO95GPYAIc6xmyoCCG6_0JxdL3a0zaGAYiOoAjFgmlkgnY0gmlwhAPckbGHb3BzdGFja4OFQgCJc2VjcDI1NmsxoQJwoS7tzwxqXSyFL7g0JM-KWVbgvjfB8JA__T7yY_cYboN0Y3CCJAaDdWRwgiQG,enr:-J24QHmGyBwUZXIcsGYMaUqGGSl4CFdx9Tozu-vQCn5bHIQbR7On7dZbU61vYvfrJr30t0iahSqhc64J46MnUO2JvQaGAYiOoCKKgmlkgnY0gmlwhAPnCzSHb3BzdGFja4OFQgCJc2VjcDI1NmsxoQINc4fSijfbNIiGhcgvwjsjxVFJHUstK9L1T8OTKUjgloN0Y3CCJAaDdWRwgiQG,enr:-J24QG3ypT4xSu0gjb5PABCmVxZqBjVw9ca7pvsI8jl4KATYAnxBmfkaIuEqy9sKvDHKuNCsy57WwK9wTt2aQgcaDDyGAYiOoGAXgmlkgnY0gmlwhDbGmZaHb3BzdGFja4OFQgCJc2VjcDI1NmsxoQIeAK_--tcLEiu7HvoUlbV52MspE0uCocsx1f_rYvRenIN0Y3CCJAaDdWRwgiQG \ --p2p.nat=true \ --p2p.listen.tcp=$P2P_PORT \ --p2p.listen.udp=$P2P_UDP_PORT \ --p2p.listen.ip=0.0.0.0 \ --rollup.load-protocol-versions=true \ --syncmode=execution-layer \ --metrics.enabled=true \ --metrics.addr=0.0.0.0 \ --metrics.port=$METRICS_PORT

We also tried with latest op-node 1.16.1 with reth 1.9.1 but nothing helped.

In both cases (with 1.8.4 and 1.9.1 reth) the pipeline_stages are taking much longer then before -> cannot say if related to the version or just because its behind the top around 120000s.

Stage pipeline_stages logs:

1762766512039 2025-11-10T09:21:52.039Z 2025-11-10T09:21:52.039381Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37939913 target=37986706 stage_progress=99.70% 1762766512039 2025-11-10T09:21:52.039Z 2025-11-10T09:21:52.039419Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37939913 target=37986706 1762766512039 2025-11-10T09:21:52.039Z 2025-11-10T09:21:52.039428Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37939913 target=37986706 1762767175622 2025-11-10T09:32:55.622Z 2025-11-10T09:32:55.622298Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37942259 target=37986706 stage_progress=99.71% 1762767175622 2025-11-10T09:32:55.622Z 2025-11-10T09:32:55.622337Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37942259 target=37986706 1762767175622 2025-11-10T09:32:55.622Z 2025-11-10T09:32:55.622346Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37942259 target=37986706 1762767796604 2025-11-10T09:43:16.604Z 2025-11-10T09:43:16.604149Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37944482 target=37986706 stage_progress=99.73% 1762767796604 2025-11-10T09:43:16.604Z 2025-11-10T09:43:16.604176Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37944482 target=37986706 1762767796604 2025-11-10T09:43:16.604Z 2025-11-10T09:43:16.604237Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37944482 target=37986706 1762768375692 2025-11-10T09:52:55.692Z 2025-11-10T09:52:55.692740Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37946714 target=37986706 stage_progress=99.74% 1762768375692 2025-11-10T09:52:55.692Z 2025-11-10T09:52:55.692776Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37946714 target=37986706 1762768375692 2025-11-10T09:52:55.692Z 2025-11-10T09:52:55.692783Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37946714 target=37986706 1762768846657 2025-11-10T10:00:46.657Z 2025-11-10T10:00:46.657248Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37949201 target=37986706 stage_progress=99.76% 1762768846657 2025-11-10T10:00:46.657Z 2025-11-10T10:00:46.657276Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37949201 target=37986706 1762768846657 2025-11-10T10:00:46.657Z 2025-11-10T10:00:46.657282Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37949201 target=37986706 1762769332607 2025-11-10T10:08:52.607Z 2025-11-10T10:08:52.607638Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37951699 target=37986706 stage_progress=99.77% 1762769332607 2025-11-10T10:08:52.607Z 2025-11-10T10:08:52.607673Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37951699 target=37986706 1762769332607 2025-11-10T10:08:52.607Z 2025-11-10T10:08:52.607681Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37951699 target=37986706 1762769780350 2025-11-10T10:16:20.350Z 2025-11-10T10:16:20.350676Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37953921 target=37986706 stage_progress=99.79% 1762769780350 2025-11-10T10:16:20.350Z 2025-11-10T10:16:20.350714Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37953921 target=37986706 1762769780350 2025-11-10T10:16:20.350Z 2025-11-10T10:16:20.350724Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37953921 target=37986706 1762770210429 2025-11-10T10:23:30.429Z 2025-11-10T10:23:30.429766Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37956033 target=37986706 stage_progress=99.80% 1762770210429 2025-11-10T10:23:30.429Z 2025-11-10T10:23:30.429800Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37956033 target=37986706 1762770210429 2025-11-10T10:23:30.429Z 2025-11-10T10:23:30.429808Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37956033 target=37986706 1762770645311 2025-11-10T10:30:45.311Z 2025-11-10T10:30:45.311823Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37958248 target=37986706 stage_progress=99.82% 1762770645311 2025-11-10T10:30:45.311Z 2025-11-10T10:30:45.311855Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37958248 target=37986706 1762770645311 2025-11-10T10:30:45.311Z 2025-11-10T10:30:45.311868Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37958248 target=37986706 1762771043547 2025-11-10T10:37:23.547Z 2025-11-10T10:37:23.547094Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37960522 target=37986706 stage_progress=99.83% 1762771043547 2025-11-10T10:37:23.547Z 2025-11-10T10:37:23.547127Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37960522 target=37986706 1762771043547 2025-11-10T10:37:23.547Z 2025-11-10T10:37:23.547141Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37960522 target=37986706 1762771450994 2025-11-10T10:44:10.994Z 2025-11-10T10:44:10.994414Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37962891 target=37986706 stage_progress=99.84% 1762771450994 2025-11-10T10:44:10.994Z 2025-11-10T10:44:10.994449Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37962891 target=37986706 1762771450994 2025-11-10T10:44:10.994Z 2025-11-10T10:44:10.994494Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37962891 target=37986706 1762771848932 2025-11-10T10:50:48.932Z 2025-11-10T10:50:48.932603Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37965259 target=37986706 stage_progress=99.86% 1762771848932 2025-11-10T10:50:48.932Z 2025-11-10T10:50:48.932639Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37965259 target=37986706 1762771848932 2025-11-10T10:50:48.932Z 2025-11-10T10:50:48.932648Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37965259 target=37986706 1762772262063 2025-11-10T10:57:42.063Z 2025-11-10T10:57:42.063707Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37967755 target=37986706 stage_progress=99.87% 1762772262063 2025-11-10T10:57:42.063Z 2025-11-10T10:57:42.063742Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37967755 target=37986706 1762772262063 2025-11-10T10:57:42.063Z 2025-11-10T10:57:42.063749Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37967755 target=37986706 1762772658880 2025-11-10T11:04:18.880Z 2025-11-10T11:04:18.880791Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37970182 target=37986706 stage_progress=99.89% 1762772658880 2025-11-10T11:04:18.880Z 2025-11-10T11:04:18.880824Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37970182 target=37986706 1762772658880 2025-11-10T11:04:18.880Z 2025-11-10T11:04:18.880831Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37970182 target=37986706 1762773044164 2025-11-10T11:10:44.164Z 2025-11-10T11:10:44.163998Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37972422 target=37986706 stage_progress=99.90% 1762773044164 2025-11-10T11:10:44.164Z 2025-11-10T11:10:44.164028Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37972422 target=37986706 1762773044164 2025-11-10T11:10:44.164Z 2025-11-10T11:10:44.164036Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37972422 target=37986706 1762773425552 2025-11-10T11:17:05.552Z 2025-11-10T11:17:05.552207Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37974605 target=37986706 stage_progress=99.92% 1762773425552 2025-11-10T11:17:05.552Z 2025-11-10T11:17:05.552245Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37974605 target=37986706 1762773425552 2025-11-10T11:17:05.552Z 2025-11-10T11:17:05.552253Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37974605 target=37986706 1762773819301 2025-11-10T11:23:39.301Z 2025-11-10T11:23:39.301729Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37976919 target=37986706 stage_progress=99.93% 1762773819301 2025-11-10T11:23:39.301Z 2025-11-10T11:23:39.301759Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37976919 target=37986706 1762773819301 2025-11-10T11:23:39.301Z 2025-11-10T11:23:39.301806Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37976919 target=37986706 1762774216918 2025-11-10T11:30:16.918Z 2025-11-10T11:30:16.918582Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37979204 target=37986706 stage_progress=99.95% 1762774216918 2025-11-10T11:30:16.918Z 2025-11-10T11:30:16.918612Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37979204 target=37986706 1762774216918 2025-11-10T11:30:16.918Z 2025-11-10T11:30:16.918700Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37979204 target=37986706 1762774637872 2025-11-10T11:37:17.872Z 2025-11-10T11:37:17.872830Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37981560 target=37986706 stage_progress=99.96% 1762774637872 2025-11-10T11:37:17.872Z 2025-11-10T11:37:17.872865Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37981560 target=37986706 1762774637873 2025-11-10T11:37:17.873Z 2025-11-10T11:37:17.872873Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37981560 target=37986706 1762775066357 2025-11-10T11:44:26.357Z 2025-11-10T11:44:26.357686Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37983998 target=37986706 stage_progress=99.98% 1762775066357 2025-11-10T11:44:26.357Z 2025-11-10T11:44:26.357718Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37983998 target=37986706 1762775066357 2025-11-10T11:44:26.357Z 2025-11-10T11:44:26.357727Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37983998 target=37986706 1762775511058 2025-11-10T11:51:51.058Z 2025-11-10T11:51:51.058141Z INFO Committed stage progress pipeline_stages=5/13 stage=Execution checkpoint=37986508 target=37986706 stage_progress=99.99% 1762775511058 2025-11-10T11:51:51.058Z 2025-11-10T11:51:51.058172Z INFO Preparing stage pipeline_stages=5/13 stage=Execution checkpoint=37986508 target=37986706 1762775511058 2025-11-10T11:51:51.058Z 2025-11-10T11:51:51.058178Z INFO Executing stage pipeline_stages=5/13 stage=Execution checkpoint=37986508 target=37986706 1762775554882 2025-11-10T11:52:34.882Z 2025-11-10T11:52:34.882587Z INFO Finished stage pipeline_stages=5/13 stage=Execution checkpoint=37986706 target=37986706 stage_progress=100.00% 1762775554882 2025-11-10T11:52:34.882Z 2025-11-10T11:52:34.882614Z INFO Preparing stage pipeline_stages=6/13 stage=MerkleUnwind checkpoint=37930759 target=37986706 1762775554882 2025-11-10T11:52:34.882Z 2025-11-10T11:52:34.882624Z INFO Executing stage pipeline_stages=6/13 stage=MerkleUnwind checkpoint=37930759 target=37986706 1762775554884 2025-11-10T11:52:34.884Z 2025-11-10T11:52:34.884104Z INFO Finished stage pipeline_stages=6/13 stage=MerkleUnwind checkpoint=37986706 target=37986706 1762775554884 2025-11-10T11:52:34.884Z 2025-11-10T11:52:34.884127Z INFO Preparing stage pipeline_stages=7/13 stage=AccountHashing checkpoint=37930759 target=37986706 1762775554884 2025-11-10T11:52:34.884Z 2025-11-10T11:52:34.884133Z INFO Executing stage pipeline_stages=7/13 stage=AccountHashing checkpoint=37930759 target=37986706 1762776220383 2025-11-10T12:03:40.383Z 2025-11-10T12:03:40.383046Z INFO Finished stage pipeline_stages=7/13 stage=AccountHashing checkpoint=37986706 target=37986706 stage_progress=100.00% 1762776220383 2025-11-10T12:03:40.383Z 2025-11-10T12:03:40.383074Z INFO Preparing stage pipeline_stages=8/13 stage=StorageHashing checkpoint=37930759 target=37986706 1762776220383 2025-11-10T12:03:40.383Z 2025-11-10T12:03:40.383081Z INFO Executing stage pipeline_stages=8/13 stage=StorageHashing checkpoint=37930759 target=37986706 1762783749565 2025-11-10T14:09:09.565Z 2025-11-10T14:09:09.565377Z INFO Finished stage pipeline_stages=8/13 stage=StorageHashing checkpoint=37986706 target=37986706 stage_progress=100.00% 1762783749565 2025-11-10T14:09:09.565Z 2025-11-10T14:09:09.565413Z INFO Preparing stage pipeline_stages=9/13 stage=MerkleExecute checkpoint=37930759 target=37986706 1762783749565 2025-11-10T14:09:09.565Z 2025-11-10T14:09:09.565517Z INFO Executing stage pipeline_stages=9/13 stage=MerkleExecute checkpoint=37930759 target=37986706

We also tried with following configurations: reth: - node - -vvv - --chain=base - --rollup.disable-tx-pool-gossip - --rollup.sequencer-http=$(ROLLUP_SEQUENCER_HTTP) - --config=/data/reth.toml - --ipcpath=/data/reth.ipc - --datadir=/data - --http - --http.addr=0.0.0.0 - --http.port=$(RPC_PORT) - --http.corsdomain=* - --http.api=debug,eth,net,trace,txpool,web3,rpc,reth,ots,flashbots - --ws - --ws.addr=0.0.0.0 - --ws.port=$(WS_PORT) - --ws.origins=* - --ws.api=debug,eth,net,trace,txpool,web3,rpc,reth,ots,flashbots - --authrpc.addr=0.0.0.0 - --authrpc.port=$(AUTH_RPC_PORT) - --authrpc.jwtsecret=/data/jwt.txt - --port=$(P2P_PORT) - --metrics=0.0.0.0:$(METRICS_PORT) - --discovery.port=$(P2P_PORT) - --engine.persistence-threshold=10 - --engine.memory-block-buffer-target=10

op-node:

memory_95_percent=$(($MEMORY_LIMITS_MB * 95 / 100)) export GOMEMLIMIT=${memory_95_percent}MiB exec op-node \ --l1=$L1_ETHEREUM_MAINNET \ --l1.beacon=$L1_BEACON_MAINNET \ --network=$NETWORK \ --l1.max-concurrency=500 \ --l1.rpc-max-batch-size=500 \ --l1.trustrpc \ --l1.rpckind=erigon \ --verifier.l1-confs=4 \ --l2=http://localhost:$AUTH_RPC_PORT \ --l2.skip-sync-start-check=true \ --l2.enginekind=reth \ --l2.jwt-secret=/data/jwt.txt \ --rpc.addr=0.0.0.0 \ --rpc.port=$RPC_PORT \ --p2p.bootnodes=enr:-J24QNz9lbrKbN4iSmmjtnr7SjUMk4zB7f1krHZcTZx-JRKZd0kA2gjufUROD6T3sOWDVDnFJRvqBBo62zuF-hYCohOGAYiOoEyEgmlkgnY0gmlwhAPniryHb3BzdGFja4OFQgCJc2VjcDI1NmsxoQKNVFlCxh_B-716tTs-h1vMzZkSs1FTu_OYTNjgufplG4N0Y3CCJAaDdWRwgiQG,enr:-J24QH-f1wt99sfpHy4c0QJM-NfmsIfmlLAMMcgZCUEgKG_BBYFc6FwYgaMJMQN5dsRBJApIok0jFn-9CS842lGpLmqGAYiOoDRAgmlkgnY0gmlwhLhIgb2Hb3BzdGFja4OFQgCJc2VjcDI1NmsxoQJ9FTIv8B9myn1MWaC_2lJ-sMoeCDkusCsk4BYHjjCq04N0Y3CCJAaDdWRwgiQG,enr:-J24QDXyyxvQYsd0yfsN0cRr1lZ1N11zGTplMNlW4xNEc7LkPXh0NAJ9iSOVdRO95GPYAIc6xmyoCCG6_0JxdL3a0zaGAYiOoAjFgmlkgnY0gmlwhAPckbGHb3BzdGFja4OFQgCJc2VjcDI1NmsxoQJwoS7tzwxqXSyFL7g0JM-KWVbgvjfB8JA__T7yY_cYboN0Y3CCJAaDdWRwgiQG,enr:-J24QHmGyBwUZXIcsGYMaUqGGSl4CFdx9Tozu-vQCn5bHIQbR7On7dZbU61vYvfrJr30t0iahSqhc64J46MnUO2JvQaGAYiOoCKKgmlkgnY0gmlwhAPnCzSHb3BzdGFja4OFQgCJc2VjcDI1NmsxoQINc4fSijfbNIiGhcgvwjsjxVFJHUstK9L1T8OTKUjgloN0Y3CCJAaDdWRwgiQG,enr:-J24QG3ypT4xSu0gjb5PABCmVxZqBjVw9ca7pvsI8jl4KATYAnxBmfkaIuEqy9sKvDHKuNCsy57WwK9wTt2aQgcaDDyGAYiOoGAXgmlkgnY0gmlwhDbGmZaHb3BzdGFja4OFQgCJc2VjcDI1NmsxoQIeAK_--tcLEiu7HvoUlbV52MspE0uCocsx1f_rYvRenIN0Y3CCJAaDdWRwgiQG \ --p2p.nat=true \ --p2p.listen.tcp=$P2P_PORT \ --p2p.listen.udp=$P2P_UDP_PORT \ --p2p.listen.ip=0.0.0.0 \ --rollup.load-protocol-versions=true \ --syncmode=execution-layer \ --metrics.enabled=true \ --metrics.addr=0.0.0.0 \ --metrics.port=$METRICS_PORT

but no changes, pipeline_stages are performing slow as well (taking 6-10 hours)...

From disk IOPS it dropped significantly and never returned to the same levels...

Do you have any recommendations and suggestions what might be wrong or what to check more?

Steps to reproduce

After the upgrade of reth to 1.8.4 we stopped the pod to create a daily snapshot but after that it never got on the tip, just started to lagging -> no additional changes to configuration or infrastructure.

Later we downgraded to 1.8.3 but so far no luck as well, since the pipeline_stages are taking too long and node is just keep lagging behind the tip

Node logs

Platform(s)

No response

Container Type

Docker, Kubernetes

What version/commit are you on?

1.8.4

What database version are you on?

2

Which chain / network are you on?

base mainnet

What type of node are you running?

Archive (default)

What prune config do you use, if any?

No response

If you've built Reth from source, provide the full command you used

No response

Code of Conduct

• [x] I agree to follow the Code of Conduct