lightningnetwork
count of routings decrease after some time and only and restart helps
Background
Its hard to describe that issue. If my node runs a longer time without restarts, the amount of routings decreases slowly. After an restart of the node or lnd the routing events are much higher than normal. This effect does not happen by chance, but is reproducible. I can manily increase my routings by periodically restarting my node. But that should not be the solution.
This chart should show that effect and I think there is no need to explain on which day I restarted my node.
I can provide many of similar charts that show the same behave.
What is the best attempt to find something in the lnd.log that is maybe related to this issue. I see nothing that looks like an error or somthing else.
Your environment
LND v0.14.3-beta Bitcoin v22.0.0 Ubuntu 22.04 LTS
Steps to reproduce
Wait some days, routing events are becoming less and less. Restart LND and I have more routings in a few hours then in the last couple auf days.
Expected behaviour
I'm not here to complain about lnd, I'm looking for clues what may be causing this behavior. But I have no idea where to start looking.
Hi @kieselbert when you see the routing volume go down, do you also see any uptick on the number of inactive channels on your node? Also, you might want to update to the latest version of LND (0.15.1) and see if you get similar behaviour.
Hi @saubyk no i always have a look on inactive channels, but that number is always the same (1-3, mostly the same Nodes that are unstable). By the way my node has slightly more than 100 channels, the inactive ones have no effect at all. Hm i could update, but I would like to avoid the "restart to announce new channels"-bug.
Hm i could update, but I would like to avoid the "restart to announce new channels"-bug.
It might be worthwhile to wait for 0.15.2 to come out, which will fix the issue. Shouldn't be too long.
Hey, I am on 15.1 and had no forwards for 24h. The node was up for 6 days. I decided to restart the node and had 10 Forwards in the first 30 minutes after the restart.
@saubyk I beleave it is hard to reproduce for you. Do you have any recommendations what we should log, respectively what we should search the logfile for?
Issue is still present in 0.15.1 I want to add the detail that in the period when the routing decrease, the routing attempts are still there. I observe that with lntop and can see that the routing "requests" are still happen in the same frequent. But most of them failed (without a detail statement). I observed that lntop shows more and more rounting attempts with the amount of zero (0). This zero routing attempts does not happen after a restart.
@saubyk After a long journey, we found that the circuitbreaker causes the problem and it seems that LinkFailEvents aren't considered in cb probably.
https://github.com/lightningequipment/circuitbreaker/issues/9
yep, I think the CB caused that issue.
Okay, good to know. Closing the issue then as confirmed to be caused by Circuit Breaker in two cases.