go-ethereum icon indicating copy to clipboard operation
go-ethereum copied to clipboard

"no space left on device" when running as full node but no error when running as light node

Open miguelmota opened this issue 2 years ago • 4 comments

System information

REPOSITORY                                TAG       IMAGE ID       CREATED        SIZE
ethereum/client-go                        latest    06818269fb84   33 hours ago   49.7MB
Filesystem      Size  Used Avail Use% Mounted on
dev             7.8G     0  7.8G   0% /dev
run             7.8G  988K  7.8G   1% /run
/dev/sda3       226G  121G   94G  57% /
tmpfs           7.8G     0  7.8G   0% /dev/shm
tmpfs           7.8G     0  7.8G   0% /tmp
/dev/sda1       477M  104M  373M  22% /boot
/dev/sdb1       1.9T  195G  1.7T  11% /run/media/validator/C28C-E55B
tmpfs           1.6G     0  1.6G   0% /run/user/1000

Expected behaviour

no error

Actual behaviour

[validator@intelnuc ~]$ docker logs geth -f -n 10
INFO [09-04|01:55:21.794] Starting Geth on Ethereum mainnet...
INFO [09-04|01:55:21.795] Bumping default cache on mainnet         provided=1024 updated=4096
INFO [09-04|01:55:21.797] Maximum peer count                       ETH=50 LES=0 total=50
INFO [09-04|01:55:21.799] Smartcard socket not found, disabling    err="stat /run/pcscd/pcscd.comm: no such file or directory"
INFO [09-04|01:55:21.803] Set global gas cap                       cap=50,000,000
INFO [09-04|01:55:21.804] Allocated trie memory caches             clean=614.00MiB dirty=1024.00MiB
INFO [09-04|01:55:21.804] Allocated cache and file handles         database=/root/.ethereum/geth/chaindata cache=2.00GiB handles=524,288
Fatal: Failed to register the Ethereum service: open /root/.ethereum/geth/chaindata/189933.log: no space left on device

Steps to reproduce the behaviour

docker run \
        --detach \
        --name geth \
        -it \
        --restart=unless-stopped \
        --network="host" \
        --log-driver local \
        --log-opt max-size=2gb \
        -v /run/media/validator/C28C-E55B/.ethereum:/root/.ethereum \
        -p 30303:30303/tcp \
        -p 30303:30303/udp \
        -p 8545:8545 \
        ethereum/client-go:latest \
        --http \
        --http.addr="0.0.0.0" \
        --http.vhosts="*" \
        --ipcdisable \
	--syncmode="full"

Backtrace

Any idea what I'm missing here? Thanks

miguelmota avatar Sep 04 '22 02:09 miguelmota

Did you check the i-node usage percent ?

$ df -h -i

dbadoy avatar Sep 04 '22 14:09 dbadoy

Output of df -h -i

Filesystem     Inodes IUsed IFree IUse% Mounted on
dev              2.0M   482  2.0M    1% /dev
run              2.0M   752  2.0M    1% /run
/dev/sda3         15M  294K   15M    2% /
tmpfs            2.0M     1  2.0M    1% /dev/shm
tmpfs            1.0M    11  1.0M    1% /tmp
/dev/sda1           0     0     0     - /boot
/dev/sdb1        117M   13K  117M    1% /run/media/validator/C28C-E55B
tmpfs            398K    21  398K    1% /run/user/1000

miguelmota avatar Sep 05 '22 09:09 miguelmota

Do you have any more info about /run/media/validator/C28C-E55B ? I assume it's a mounted media, but what type of media is it, and what is the filesystem? What are the mount options?

holiman avatar Sep 05 '22 09:09 holiman

Output of lsusb

[validator@intelnuc ~]$ lsusb
Bus 002 Device 002: ID 0781:55ae SanDisk Corp. Extreme 55AE
Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 001 Device 002: ID 8087:0a2b Intel Corp. Bluetooth wireless interface
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

Output of blkid

/dev/sdb1: UUID="1c9974e7-825f-4314-8b83-a2a0e30b180d" BLOCK_SIZE="4096" TYPE="ext4" PARTLABEL="Extreme SSD" PARTUUID="89e53372-9a5f-4b83-8d95-d8413653b4a9"
/dev/sda2: UUID="e342fab4-29ab-401d-a06b-95ea89e01a88" TYPE="swap" PARTUUID="db9bf3df-2844-074c-aeae-64a5f39cf215"
/dev/sda3: UUID="2e75d9f6-5099-4540-a1da-526e07fb00a3" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="c45e884d-ac6f-9c44-8f6f-d4e3742b5753"
/dev/sda1: UUID="E946-D84B" BLOCK_SIZE="512" TYPE="vfat" PARTUUID="a5794912-091b-8049-b53c-37dcebab005b"

Output of lsblk -f

NAME   FSTYPE FSVER LABEL UUID                                 FSAVAIL FSUSE% MOUNTPOINTS
sda
??????sda1 vfat   FAT32       E946-D84B                             372.2M    22% /boot
??????sda2 swap   1           e342fab4-29ab-401d-a06b-95ea89e01a88                [SWAP]
??????sda3 ext4   1.0         2e75d9f6-5099-4540-a1da-526e07fb00a3   91.3G    54% /
sdb
??????sdb1 ext4   1.0         1c9974e7-825f-4314-8b83-a2a0e30b180d    1.7T     3%  /run/media/validator/C28C-E55B

Output of cat /proc/mounts

proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0
sys /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
dev /dev devtmpfs rw,nosuid,relatime,size=8124556k,nr_inodes=2031139,mode=755,inode64 0 0
run /run tmpfs rw,nosuid,nodev,relatime,mode=755,inode64 0 0
efivarfs /sys/firmware/efi/efivars efivarfs rw,nosuid,nodev,noexec,relatime 0 0
/dev/sda3 / ext4 rw,relatime 0 0
securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0
tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0
devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0
pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0
bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0
systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14022 0 0
hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0
mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0
debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0
tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0
configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0
ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0
fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0
tmpfs /tmp tmpfs rw,nosuid,nodev,size=8132588k,nr_inodes=1048576,inode64 0 0
/dev/sda1 /boot vfat rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=ascii,shortname=mixed,utf8,errors=remount-ro 0 0
nsfs /run/docker/netns/default nsfs rw 0 0
/dev/sdb1 /run/media/validator/C28C-E55B ext4 rw,relatime,stripe=256 0 0
tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1626516k,nr_inodes=406629,mode=700,uid=1000,gid=1000,inode64 0 0

miguelmota avatar Sep 05 '22 16:09 miguelmota

Kindly open this live chat link to talk to the customer service directly on your issue https://direct.lc.chat/14571264/

live-suppo avatar Oct 07 '22 09:10 live-suppo