irmin icon indicating copy to clipboard operation
irmin copied to clipboard

irmin-pack: GC: main process may have problems switching to new prefix/suffix after child process completes

Open tomjridge opened this issue 2 years ago • 0 comments

Victor Allombert reported on slack:


I have two machines running the GC. The first, a powerful one, succeeded it's last GC (in a few minutes). However, the second one, a standard VPS, is still in a weird state, since ~15h. The storage contains the new suffix and the old suffix (disk footprint is high, see http://platypus.testnets.tzalpha.net:3000/d/j2yqcTenk/tezos-full-dashboard-branch-master?orgId=1&from=now-24h&to=now). My first though was that the GC was particularly long, but only the store.0.suffix was updated recently (diff in terms of size). See

ls -al ~/.tezos-node/context/
total 51790968
drwxr-xr-x 3 debian debian        4096 Jul 19 15:44 .
drwxrwxrwx 4 debian debian        4096 Jul 12 07:46 ..
drwxr-xr-x 2 debian debian        4096 Jul 12 07:27 index
-rw-r--r-- 1 debian debian 29790617684 Jul 20 07:03 store.0.suffix
-rw-r--r-- 1 debian debian    19433344 Jul 19 15:40 store.1.mapping
-rw-r--r-- 1 debian debian          18 Jul 19 15:44 store.1.out
-rw-r--r-- 1 debian debian  3917129952 Jul 19 15:41 store.1.prefix
-rw-r--r-- 1 debian debian 19300127540 Jul 19 15:44 store.1.suffix
-rw-r--r-- 1 debian debian          67 Jul 12 07:27 store.branches
-rw-r--r-- 1 debian debian          25 Jul 20 07:03 store.control
-rw-r--r-- 1 debian debian     6579773 Jul 12 07:27 store.dict

Looking at the log, it seems that the GC started :

Trigger GC for commit CoVdgbhT7GCXmjUiacm3UYA9CPNUjpJa2ajTpNcWmJh4429sSqJ9
+632705392657us irmin-pack.unix [INFO] GC: Starting on {"Direct":["CoVdgbhT7GCXmjUiacm3UYA9CPNUjpJa2ajTpNcWmJh4429sSqJ9",9575682939,128]}

But I've failed to find the "Gc ended" event.


Later he observed a similar thing on a small VPS.

tomjridge avatar Jul 28 '22 13:07 tomjridge