bug: node operators having issues with peers and seeds from this repo

[jcstein]

From our docs: https://docs.celestia.org/how-to-guides/consensus-node#set-up-the-p2p-networks users are directed to get seeds and peers from this repository. Users are reporting "we’re running into some issues—it keeps trying to connect to peers endlessly without success."

We wanted to ask how up-to-date the files linked in this section of the docs are: https://docs.celestia.org/how-to-guides/consensus-node#set-up-the-p2p-networks. These are the ones that get loaded into the config using the commands provided there. As we understand it, the node initially tries to connect to the network through the seeds specified in the config.

Here's the log output:

9:36AM INF service start impl="Peer{MConn{189.1.170.86:43656} a5aea3c6eca68159404ebdedce8f74a59cab1c7d out}" module=p2p msg={} peer={"id":"a5aea3c6eca68159404ebdedce8f74a59cab1c7d","ip":"189.1.170.86","port":43656}
9:36AM INF service start impl=MConn{189.1.170.86:43656} module=p2p msg={} peer={"id":"a5aea3c6eca68159404ebdedce8f74a59cab1c7d","ip":"189.1.170.86","port":43656}
9:36AM INF Connection is closed @ recvRoutine (likely by the other side) conn={"Logger":{}} module=p2p peer={"id":"a5aea3c6eca68159404ebdedce8f74a59cab1c7d","ip":"189.1.170.86","port":43656}
9:36AM INF service stop impl={"Logger":{}} module=p2p msg={} peer={"id":"a5aea3c6eca68159404ebdedce8f74a59cab1c7d","ip":"189.1.170.86","port":43656}
9:36AM ERR Stopping peer for error err=EOF module=p2p peer={"Data":{},"Logger":{}}
9:36AM INF service stop impl={"Data":{},"Logger":{}} module=p2p msg={} peer={"id":"a5aea3c6eca68159404ebdedce8f74a59cab1c7d","ip":"189.1.170.86","port":43656}
9:37AM INF Saving AddrBook to file book=/mainnet/config/addrbook.json module=p2p size=1088
9:37AM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=8 numToDial=2
9:37AM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=8 numToDial=2
9:38AM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=8 numToDial=2
9:38AM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=8 numToDial=2
9:39AM INF Saving AddrBook to file book=/mainnet/config/addrbook.json module=p2p size=1088
9:39AM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=8 numToDial=2
9:39AM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=8 numToDial=2
9:39AM INF service start impl="Peer{MConn{138.201.63.38:26756} 372f0ee5553cf34fc5cf9fc6294f42b09048fb1b out}" module=p2p msg={} peer={"id":"372f0ee5553cf34fc5cf9fc6294f42b09048fb1b","ip":"138.201.63.38","port":26756}
9:39AM INF service start impl=MConn{138.201.63.38:26756} module=p2p msg={} peer={"id":"372f0ee5553cf34fc5cf9fc6294f42b09048fb1b","ip":"138.201.63.38","port":26756}
9:39AM INF Connection is closed @ recvRoutine (likely by the other side) conn={"Logger":{}} module=p2p peer={"id":"372f0ee5553cf34fc5cf9fc6294f42b09048fb1b","ip":"138.201.63.38","port":26756}
9:39AM INF service stop impl={"Logger":{}} module=p2p msg={} peer={"id":"372f0ee5553cf34fc5cf9fc6294f42b09048fb1b","ip":"138.201.63.38","port":26756}
9:39AM ERR Stopping peer for error err=EOF module=p2p peer={"Data":{},"Logger":{}}
9:39AM INF service stop impl={"Data":{},"Logger":{}} module=p2p msg={} peer={"id":"372f0ee5553cf34fc5cf9fc6294f42b09048fb1b","ip":"138.201.63.38","port":26756}
9:40AM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=8 numToDial=2
9:40AM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=8 numToDial=2

also issues on arabica/mainnet:

indexed block events height=2913737 module=txindex
2:53PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=4 numToDial=6
2:53PM INF We need more addresses. Sending pexRequest to random peer module=pex peer={"Data":{},"Logger":{}}
2:53PM INF No addresses to dial. Falling back to seeds module=pex
2:53PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=4 numToDial=6
2:53PM INF We need more addresses. Sending pexRequest to random peer module=pex peer={"Data":{},"Logger":{}}
2:53PM INF No addresses to dial. Falling back to seeds module=pex
2:54PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=4 numToDial=6
2:54PM INF We need more addresses. Sending pexRequest to random peer module=pex peer={"Data":{},"Logger":{}}
2:54PM INF No addresses to dial. Falling back to seeds module=pex
2:54PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=4 numToDial=6
2:54PM INF Saving AddrBook to file book=/home/config/addrbook.json module=p2p size=4
2:54PM INF We need more addresses. Sending pexRequest to random peer module=pex peer={"Data":{},"Logger":{}}

How to reproduce on celestia-app v3.4.2

Here’s what we are doing:

1. celestia-appd init "node-name" --chain-id celestia --home /mainnet
2. celestia-appd download-genesis celestia —home /mainnet

SEEDS=$(curl -sL https://raw.githubusercontent.com/celestiaorg/networks/master/celestia/seeds.txt | tr '\n' ',')
echo $SEEDS
sed -i.bak -e "s/^seeds *=.*/seeds = \"$SEEDS\"/" /mainnet/config/config.toml

4. In app.toml changed flag pruning = "default"
5. In config.toml indexer = "kv"
6. changed laddr = "tcp://0.0.0.0:26656"
7. celestia-appd start --v2-upgrade-height 2371495 —home /mainnet