aligned_layer icon indicating copy to clipboard operation
aligned_layer copied to clipboard

Error exec 'make ethereum_package_start'

Open coldstar1993 opened this issue 1 month ago • 1 comments

I exec the commands below:

git clone https://github.com/yetanotherco/aligned_layer
cd aligned_layer
git checkout staging
make deps
make ethereum_package_start   // !!error happen here!!

I pasted partial error logs here for your reference:

Printing a message
Successfully added 3 EL participants

Printing a message
Launching CL network

Adding service with name 'cl-1-lighthouse-reth' and image 'ethpandaops/lighthouse:stable'
There was an error executing Starlark code
An error occurred executing instruction (number 33) at github.com/ethpandaops/ethereum-package/src/cl/lighthouse/lighthouse_launcher.star[86:38]:
  add_service(name="cl-1-lighthouse-reth", config=ServiceConfig(image="ethpandaops/lighthouse:stable", ports={"http": PortSpec(number=4000, transport_protocol="TCP", application_protocol="http"), "metrics": PortSpec(number=5054, transport_protocol="TCP", application_protocol="http"), "quic-discovery": PortSpec(number=58803, transport_protocol="UDP", application_protocol=""), "tcp-discovery": PortSpec(number=58800, transport_protocol="TCP", application_protocol=""), "udp-discovery": PortSpec(number=58800, transport_protocol="UDP", application_protocol="")}, public_ports={"http": PortSpec(number=58801, transport_protocol="TCP", application_protocol="http"), "metrics": PortSpec(number=58802, transport_protocol="TCP", application_protocol="http"), "quic-discovery": PortSpec(number=58803, transport_protocol="UDP", application_protocol=""), "tcp-discovery": PortSpec(number=58800, transport_protocol="TCP", application_protocol=""), "udp-discovery": PortSpec(number=58800, transport_protocol="UDP", application_protocol="")}, files={"/jwt": "jwt_file", "/network-configs": "el_cl_genesis_data"}, cmd=["lighthouse", "beacon_node", "--debug-level=info", "--datadir=/data/lighthouse/beacon-data", "--listen-address=0.0.0.0", "--port=58800", "--http", "--http-address=0.0.0.0", "--http-port=4000", "--disable-packet-filter", "--execution-endpoints=http://{{kurtosis:021a04cfb6784103930bfb3d55ba7b52:ip_address.runtime_value}}:8551", "--jwt-secrets=/jwt/jwtsecret", "--suggested-fee-recipient=0x8943545177806ED17B9F23F0a21ee5948eCaa776", "--disable-enr-auto-update", "--enr-address=KURTOSIS_IP_ADDR_PLACEHOLDER", "--enr-tcp-port=58800", "--enr-udp-port=58800", "--enr-quic-port=58803", "--quic-port=58803", "--metrics", "--metrics-address=0.0.0.0", "--metrics-allow-origin=*", "--metrics-port=5054", "--enable-private-discovery", "--testnet-dir=/network-configs"], env_vars={"RUST_BACKTRACE": "full"}, private_ip_address_placeholder="KURTOSIS_IP_ADDR_PLACEHOLDER", ready_conditions=ReadyCondition(recipe=GetHttpRequestRecipe(port_id="http", endpoint="/eth/v1/node/health"), field="code", assertion="IN", target_value=[200, 206], timeout="15m"), labels={"ethereum-package.client": "lighthouse", "ethereum-package.client-image": "ethpandaops-lighthouse_stable", "ethereum-package.client-type": "beacon", "ethereum-package.connected-client": "reth", "ethereum-package.sha256": ""}, tolerations=[], node_selectors={}))
  Caused by: Unexpected error occurred starting service 'cl-1-lighthouse-reth'
  Caused by: An error occurred waiting for all TCP and UDP ports to be open for service 'cl-1-lighthouse-reth' with private IP '172.16.0.14'; this is usually due to a misconfiguration in the service itself, so here are the logs:
  == SERVICE 'cl-1-lighthouse-reth' LOGS ===================================
  Nov 09 02:54:48.356 INFO  Lighthouse started                            version: "Lighthouse/v8.0.0-e3ee7fe"
  Nov 09 02:54:48.356 INFO  Configured network                            network_name: "custom (/network-configs)"
  Nov 09 02:54:48.358 INFO  Data directory initialised                    datadir: /data/lighthouse/beacon-data
  Nov 09 02:54:48.358 WARN  Discv5 packet filter is disabled
  Nov 09 02:54:48.359 INFO  Deposit contract                              deploy_block: 0, address: 0x00000000219ab540356cbb839cbe05303d7705fa
  Nov 09 02:54:48.365 INFO  Blob DB initialized                           path: "/data/lighthouse/beacon-data/beacon/blobs_db", oldest_blob_slot: Some(Slot(0)), oldest_data_column_slot: None
  Nov 09 02:54:51.782 INFO  Starting from known genesis state
  Nov 09 02:54:51.784 INFO  Block production enabled
  Nov 09 02:54:51.785 CRIT  Failed to start beacon node                   reason: "Failed to build beacon chain: Head block not found in store"
  Nov 09 02:54:51.785 INFO  Internal shutdown received
  Nov 09 02:54:51.785 INFO  Shutting down..                               reason: Failure("Failed to start beacon node")
  Failed to start beacon node

  == FINISHED SERVICE 'cl-1-lighthouse-reth' LOGS ===================================
  Caused by: An error occurred while waiting for all TCP and UDP ports to be open
  Caused by: Unsuccessful ports check for IP '172.16.0.14' and port spec '{privatePortSpec:0xc000666b10}', even after '240' retries with '500' milliseconds in between retries. Timeout '2m0s' has been reached
  Caused by: An error occurred while calling network address '172.16.0.14:5054' with port protocol 'TCP' and using time out '200ms'
  Caused by: dial tcp 172.16.0.14:5054: i/o timeout

Error encountered running Starlark code.

⭐ us on GitHub - https://github.com/kurtosis-tech/kurtosis
INFO[2025-11-09T04:56:48+02:00] ================================================
INFO[2025-11-09T04:56:48+02:00] ||          Created enclave: aligned          ||
INFO[2025-11-09T04:56:48+02:00] ================================================
Name:            aligned
UUID:            9a156e301444
Status:          RUNNING
Creation Time:   Sun, 09 Nov 2025 04:54:33 EET
Flags:

========================================= Files Artifacts =========================================
UUID           Name
396247b5f4a7   1-lighthouse-reth-0-31
cb599a905cc6   2-lighthouse-reth-32-63
8087a1657a4d   3-lighthouse-reth-64-95
109c84a6eb2c   el_cl_genesis_data
0241f059a55e   final-genesis-timestamp
24605b95d88b   genesis-el-cl-env-file
603b0e1215be   genesis_validators_root
84e2c1603ff1   jwt_file
ac8c3ed87b1d   keymanager_file
e12032cd5c5b   prysm-password

========================================== User Services ==========================================
UUID           Name                                             Ports                                        Status
67524318794f   el-1-reth-lighthouse                             engine-rpc: 8551/tcp -> 127.0.0.1:8543       RUNNING
                                                                metrics: 9001/tcp -> http://127.0.0.1:8544
                                                                rpc: 8545/tcp -> 127.0.0.1:8545
                                                                tcp-discovery: 8542/tcp -> 127.0.0.1:8542
                                                                udp-discovery: 8542/udp
                                                                ws: 8546/tcp -> 127.0.0.1:8546
555e15f5cd63   el-2-reth-lighthouse                             engine-rpc: 8551/tcp -> 127.0.0.1:8549       RUNNING
                                                                metrics: 9001/tcp -> http://127.0.0.1:8550
                                                                rpc: 8545/tcp -> 127.0.0.1:8551
                                                                tcp-discovery: 8548/tcp -> 127.0.0.1:8548
                                                                udp-discovery: 8548/udp
                                                                ws: 8546/tcp -> 127.0.0.1:8552
1fd119c8f7c2   el-3-reth-lighthouse                             engine-rpc: 8551/tcp -> 127.0.0.1:8555       RUNNING
                                                                metrics: 9001/tcp -> http://127.0.0.1:8556
                                                                rpc: 8545/tcp -> 127.0.0.1:8557
                                                                tcp-discovery: 8554/tcp -> 127.0.0.1:8554
                                                                udp-discovery: 8554/udp
                                                                ws: 8546/tcp -> 127.0.0.1:8558
955a4b02a34d   validator-key-generation-cl-validator-keystore   <none>                                       RUNNING

make: *** [Makefile:1571: ethereum_package_start] Error 1

As you can see in logs, Lighthouse service failed to startup due to the root cause: "Failed to build beacon chain: Head block not found in store".

coldstar1993 avatar Nov 09 '25 04:11 coldstar1993

after debugging, the private network startup successfully after I commented preset: minimal in the network-params.yaml. The default configuration of preset:minimal clashes with the custom network parameters, like 'seconds_per_slot', 'genesis_delay', etc.

but will it cause any potential impact?

coldstar1993 avatar Nov 09 '25 13:11 coldstar1993

Solved in #2172

MarcosNicolau avatar Dec 03 '25 21:12 MarcosNicolau