lightning
lightning copied to clipboard
ElementsProject
A peer stuck in 'CHANNELD_AWAITING_LOCKIN' when bitcoind returns error before broadcast
I wanted to increase capacity (originally 2M) of a peer. I had another 2M channel to another peer that rarely used. So I closed both of them to combine the balance for the peer that I wanted to increase the channel. On RTL, as soon as I saw my onchain balance became 3951732 sats, I reopened a new channel to the same peer. I got a weird error from RTL complaining about not enough fee which is impossible, I thought, because I reopened with the capacity of 3.9M and there should be at least 51732 to cover the fee. So I switch to command line to fund the channel one more time and I got:
{ "code": -1, "message": "Peer already CHANNELD_AWAITING_LOCKIN", "data": { "id": "03afa7a8196dbca763ee6f9a34b634a7adc03f154e5d6979fe654db5606b5fb2b1", "method": "fundchannel_start" } }
Now, it's been more than 6 hours while mempool is empty, so I believe this must be a bug. And on RTL, it's still saying my onchain balance is 3.9M. Here's is the detail of the peer:
{ "peers": [ { "id": "03d607f3e69fd032524a867b288216bfab263b6eaee4e07783799a6fe69bb84fac", "connected": false, "channels": [ { "state": "ONCHAIN", "scratch_txid": "90d1f10a8212446656b08086072f9d4d8eb65116efb6e224aba2120d947ed524", "last_tx_fee": "804000msat", "last_tx_fee_msat": "804000msat", "feerate": { "perkw": 1502, "perkb": 6008 }, "owner": "onchaind", "short_channel_id": "698637x2323x1", "direction": 0, "channel_id": "11cf8f9145e604ea450f1b7426836278316dcf819c4310e03f5142394fbcd50a", "funding_txid": "0bd5bc4f3942513fe010439c81cf6d3178628326741b0f45ea04e645918fcf11", "close_to_addr": "bc1qehx7z7jzjvwrk4a7jjk56f84xnntpgsdwq8yud", "close_to": "0014cdcde17a42931c3b57be94ad4d24f534e6b0a20d", "private": false, "opener": "local", "closer": "local", "features": [ "option_static_remotekey" ], "funding_allocation_msat": { "03d607f3e69fd032524a867b288216bfab263b6eaee4e07783799a6fe69bb84fac": 0, "020d1617e27ac022395352f2b3774969593d3d6ddff6fb117d820a9dda8da45217": 2000000000 }, "funding_msat": { "03d607f3e69fd032524a867b288216bfab263b6eaee4e07783799a6fe69bb84fac": "0msat", "020d1617e27ac022395352f2b3774969593d3d6ddff6fb117d820a9dda8da45217": "2000000000msat" }, "funding": { "local_msat": "2000000000msat", "remote_msat": "0msat" }, "msatoshi_to_us": 1925261642, "to_us_msat": "1925261642msat", "msatoshi_to_us_min": 1861659431, "min_to_us_msat": "1861659431msat", "msatoshi_to_us_max": 2000000000, "max_to_us_msat": "2000000000msat", "msatoshi_total": 2000000000, "total_msat": "2000000000msat", "fee_base_msat": "888msat", "fee_proportional_millionths": 14, "dust_limit_satoshis": 546, "dust_limit_msat": "546000msat", "max_htlc_value_in_flight_msat": 18446744073709551615, "max_total_htlc_in_msat": "18446744073709551615msat", "their_channel_reserve_satoshis": 20000, "their_reserve_msat": "20000000msat", "our_channel_reserve_satoshis": 20000, "our_reserve_msat": "20000000msat", "spendable_msatoshi": 1902053642, "spendable_msat": "1902053642msat", "receivable_msatoshi": 54738358, "receivable_msat": "54738358msat", "htlc_minimum_msat": 0, "minimum_htlc_in_msat": "0msat", "their_to_self_delay": 144, "our_to_self_delay": 240, "max_accepted_htlcs": 30, "state_changes": [ { "timestamp": "2021-09-02T05:15:40.589Z", "old_state": "CHANNELD_AWAITING_LOCKIN", "new_state": "CHANNELD_NORMAL", "cause": "user", "message": "Lockin complete" }, { "timestamp": "2021-09-18T04:49:00.100Z", "old_state": "CHANNELD_NORMAL", "new_state": "CHANNELD_SHUTTING_DOWN", "cause": "user", "message": "User or plugin invoked close command" }, { "timestamp": "2021-09-18T04:49:00.739Z", "old_state": "CHANNELD_SHUTTING_DOWN", "new_state": "CLOSINGD_SIGEXCHANGE", "cause": "user", "message": "Start closingd" }, { "timestamp": "2021-09-18T04:49:02.176Z", "old_state": "CLOSINGD_SIGEXCHANGE", "new_state": "CLOSINGD_COMPLETE", "cause": "user", "message": "Closing complete" }, { "timestamp": "2021-09-18T05:18:46.164Z", "old_state": "CLOSINGD_COMPLETE", "new_state": "FUNDING_SPEND_SEEN", "cause": "user", "message": "Onchain funding spend" }, { "timestamp": "2021-09-18T05:18:46.241Z", "old_state": "FUNDING_SPEND_SEEN", "new_state": "ONCHAIN", "cause": "user", "message": "Onchain init reply" } ], "status": [ "CHANNELD_NORMAL:Reconnected, and reestablished.", "CLOSINGD_SIGEXCHANGE:We agreed on a closing fee of 803 satoshi for tx:90d1f10a8212446656b08086072f9d4d8eb65116efb6e224aba2120d947ed524", "ONCHAIN:Tracking mutual close transaction", "ONCHAIN:All outputs resolved: waiting 45 more blocks before forgetting channel" ], "in_payments_offered": 6, "in_msatoshi_offered": 113618412, "in_offered_msat": "113618412msat", "in_payments_fulfilled": 6, "in_msatoshi_fulfilled": 113618412, "in_fulfilled_msat": "113618412msat", "out_payments_offered": 6, "out_msatoshi_offered": 288838543, "out_offered_msat": "288838543msat", "out_payments_fulfilled": 4, "out_msatoshi_fulfilled": 188356770, "out_fulfilled_msat": "188356770msat", "htlcs": [] } ] } ] }
Looks like it's stuck in a wrong state. Is there a way I can fix the state so that I can try to reopen to channel to the peer again ?
What do your c-lightning listfunds say? can post it?
P.S'. You should obscure the txid, scriptpubkey, address, amount_msat, value
P.S'': Can format your json with the code formatting in github editor?
{
"outputs": [
{
"txid": "ooo",
"output": 0,
"value": -99,
"amount_msat": "ooo",
"scriptpubkey": "ooo",
"address": "ooo",
"status": "confirmed",
"blockheight": 700442,
"reserved": false
},
{
"txid": "ooo",
"output": 0,
"value": -99,
"amount_msat": "ooo",
"scriptpubkey": "ooo",
"address": "ooo",
"status": "confirmed",
"blockheight": 700895,
"reserved": false
},
{
"txid": "ooo",
"output": 1,
"value": -99,
"amount_msat": "ooo",
"scriptpubkey": "ooo",
"address": "ooo",
"status": "confirmed",
"blockheight": 701048,
"reserved": false
},
{
"txid": "ooo",
"output": 1,
"value": -99,
"amount_msat": "ooo",
"scriptpubkey": "ooo,
"address": "ooo",
"status": "confirmed",
"blockheight": 701048,
"reserved": false
}
],
"channels": [
{
"peer_id": "03c5528c628681aa17ab9e117aa3ee6f06c750dfb17df758ecabcd68f1567ad8c1",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "693879x460x0",
"channel_sat": 1713905,
"our_amount_msat": "1713905000msat",
"channel_total_sat": 2000000,
"amount_msat": "ooo",
"funding_txid": "dcc8e854a91aed719523d51d2b6d8faa8d7a7ec44a975bff12f2f943ddb65cc3",
"funding_output": 0
},
{
"peer_id": "037ba466e8b48d6c70755552851d38c6e28c1f2030ce03e2592465af838f397cfc",
"connected": false,
"state": "CHANNELD_NORMAL",
"short_channel_id": "693984x2132x0",
"channel_sat": 91691,
"our_amount_msat": "91691000msat",
"channel_total_sat": 1000000,
"amount_msat": "ooo",
"funding_txid": "c92d6bc121edfec4f6fe6f3f39c6770c5c02cb5dca67bb20dde6b1a03417647f",
"funding_output": 0
},
{
"peer_id": "02a381890be4604846090419ff3e7a6d53c2bd690862fd2df646bb9cdde5f25b92",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "693994x1001x1",
"channel_sat": 499900,
"our_amount_msat": "499900000msat",
"channel_total_sat": 1000000,
"amount_msat": "ooo",
"funding_txid": "e03a78f628ab9a700697897ea1c8fee8782cb87854f128a662131c0fe4c79cec",
"funding_output": 1
},
{
"peer_id": "0326f998ac3aa5d1dc517b467005ba31909ace9454d40f2fd895f98d9c2ec34491",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "694218x1020x1",
"channel_sat": 208215,
"our_amount_msat": "208215000msat",
"channel_total_sat": 501000,
"amount_msat": "ooo",
"funding_txid": "153beae5cf379d53e2d7d1c2a08518ebd48784cebf284f8599fe02779b01bac2",
"funding_output": 1
},
{
"peer_id": "022e9d43e9ca90ab8817f3581c0a34db186d83a1a6837ed61d6b08a06f79909ed8",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "694499x2772x0",
"channel_sat": 1955194,
"our_amount_msat": "1955194000msat",
"channel_total_sat": 2000000,
"amount_msat": "ooo",
"funding_txid": "5b033fc649db5be0fedfd8950cfa070fbc2673e99bc461d4fa70ee060c4dbe00",
"funding_output": 0
},
{
"peer_id": "02d006ecbe96e20769f58e90fe14d29d53d2f7cbdbda74e24be029f46b2169f63a",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "694560x1225x0",
"channel_sat": 593761,
"our_amount_msat": "593761000msat",
"channel_total_sat": 2000000,
"amount_msat": "ooo",
"funding_txid": "7722f900ee8ab9092a1c2befcf3bef7d7ae6c6a4d02115fcb55cef82a0f54661",
"funding_output": 0
},
{
"peer_id": "02ad48b7dbd3c299fac738a053855792c803168b72368aae479a29665408bf6fa4",
"connected": false,
"state": "CHANNELD_NORMAL",
"short_channel_id": "694576x369x1",
"channel_sat": 296176,
"our_amount_msat": "296176000msat",
"channel_total_sat": 1000000,
"amount_msat": "ooo",
"funding_txid": "4fe576f4fc5a83828c6f52b29fd969e344a936a1ba1a1af6bcfcd3deb450461d",
"funding_output": 1
},
{
"peer_id": "03b2d5c9409d42e0b13abfc23cd3908a6cec05fadf602dc4e98b1a714528289437",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "694611x548x1",
"channel_sat": 768782,
"our_amount_msat": "768782000msat",
"channel_total_sat": 1000000,
"amount_msat": "ooo",
"funding_txid": "e6036f605a6c809d4d4ccaec2e48dc433ba902bf48e9bdf2fb50d56ba679acc7",
"funding_output": 1
},
{
"peer_id": "02a7724cf8815d185d292b413349fe3df3b577871c8eb29803f379409eea53adc4",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "694682x1524x1",
"channel_sat": 115232,
"our_amount_msat": "115232000msat",
"channel_total_sat": 1000000,
"amount_msat": "ooo",
"funding_txid": "359a8fe2cf246414fc9a3b15753e8ca6a5aad32615b4c6910fb81f40bf0bbae6",
"funding_output": 1
},
{
"peer_id": "026c795878725bed713c36511857ecb67557516376174fbb8c8c54e117f02d8143",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "694699x2009x0",
"channel_sat": 410778,
"our_amount_msat": "410778000msat",
"channel_total_sat": 1000000,
"amount_msat": "ooo",
"funding_txid": "b4ad4e5cf53647a9b7cb861d87f3306bce2077ece8f4769930ea75b0305f6ec2",
"funding_output": 0
},
{
"peer_id": "03ef1f35c48695828f614ac685fd5eead1005641cac453ed31052b0ef6cb959a60",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "695626x748x0",
"channel_sat": 1476259,
"our_amount_msat": "1476259000msat",
"channel_total_sat": 4000000,
"amount_msat": "ooo",
"funding_txid": "d4c4a1c4929cbfefe57098e113c8e177de99bcdcc424f5822078f434b383c4ef",
"funding_output": 0
},
{
"peer_id": "024465103d65bf86c5799b7178ef55d6f189b8d13f3c4cfb6a7a96ef2ee46b8427",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "695627x1556x1",
"channel_sat": 1117636,
"our_amount_msat": "1117636000msat",
"channel_total_sat": 4000000,
"amount_msat": "ooo",
"funding_txid": "8ac51279770cea380fb33717e43692e4dfeb71eb14923519739a7484648581a2",
"funding_output": 1
},
{
"peer_id": "0298efb4ee7ec9a4a8d145314799df8441b901588772ca0d20b82179a2993afad8",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "695651x1268x0",
"channel_sat": 2926225,
"our_amount_msat": "2926225000msat",
"channel_total_sat": 3000000,
"amount_msat": "ooo",
"funding_txid": "ab73efc6faa44dfc8daf7856bbef22fc345a432ea2016f8327fd3e9850217af0",
"funding_output": 0
},
{
"peer_id": "031c7ecff228dfe6054307ee49c8616998af5f8d4436f13c07d211aeb6c0ec87f7",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "695651x1283x0",
"channel_sat": 1085652,
"our_amount_msat": "1085652000msat",
"channel_total_sat": 3000000,
"amount_msat": "ooo",
"funding_txid": "ed0ebb242266668988284b839c855e0d64d47cfe6737880f6ec74e672881245d",
"funding_output": 0
},
{
"peer_id": "02cca6c5c966fcf61d121e3a70e03a1cd9eeeea024b26ea666ce974d43b242e636",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "695897x324x2",
"channel_sat": 1953609,
"our_amount_msat": "1953609000msat",
"channel_total_sat": 2002168,
"amount_msat": "ooo",
"funding_txid": "db8a438932fe4ec800d130cfc665dd97c9c24bcd2f87bba070e8f3ecfeaf7574",
"funding_output": 2
},
{
"peer_id": "02dde1de894345d7167db18ff92266fa7302ae018fbea3b12948b3a50cf253f6db",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "695993x486x0",
"channel_sat": 1968773,
"our_amount_msat": "1968773000msat",
"channel_total_sat": 2008668,
"amount_msat": "ooo",
"funding_txid": "4dcff420e98f86cba05ff05759ee95bb9305aec9296608fc29681b1e4c403352",
"funding_output": 0
},
{
"peer_id": "0337da8acf3ebe6e8b8a5a7faa3526e69478c74b77b80bae2af54102065a2d5a74",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "697758x1504x1",
"channel_sat": 1870036,
"our_amount_msat": "1870036000msat",
"channel_total_sat": 1900000,
"amount_msat": "ooo",
"funding_txid": "4a94e072b7a7ab77c67d7b937b991e03e3441f6053240e2a03dcce97118d9682",
"funding_output": 1
},
{
"peer_id": "03cb52519abc5261c14d3621981498e14ef1920afd92006e00276658b05dd91ec8",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "697998x346x0",
"channel_sat": 946139,
"our_amount_msat": "946139000msat",
"channel_total_sat": 1900000,
"amount_msat": "ooo",
"funding_txid": "3257db10137082ad95b02dd32351ba5cc29904c2af641bf97f394f93dccf96b4",
"funding_output": 0
},
{
"peer_id": "0298f6074a454a1f5345cb2a7c6f9fce206cd0bf675d177cdbf0ca7508dd28852f",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "698358x1302x0",
"channel_sat": 1287610,
"our_amount_msat": "1287610000msat",
"channel_total_sat": 1500000,
"amount_msat": "ooo",
"funding_txid": "7d87baa15ee6103245ea276b38f7381438595a26671e05aaa75f6dc3199c1a60",
"funding_output": 0
},
{
"peer_id": "03afa7a8196dbca763ee6f9a34b634a7adc03f154e5d6979fe654db5606b5fb2b1",
"connected": true,
"state": "CHANNELD_AWAITING_LOCKIN",
"channel_sat": 3900000,
"our_amount_msat": "3900000000msat",
"channel_total_sat": 3900000,
"amount_msat": "ooo",
"funding_txid": "ec1378cbfb9b2590dff1ee408e50cbaa284275599ea301e42c7eb931c86b5908",
"funding_output": 0
},
{
"peer_id": "03271338633d2d37b285dae4df40b413d8c6c791fbee7797bc5dc70812196d7d5c",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "699413x2019x0",
"channel_sat": 1977963,
"our_amount_msat": "1977963000msat",
"channel_total_sat": 2000000,
"amount_msat": "ooo",
"funding_txid": "4b7c546643817d64e813f3ca44dd5d10383a789bb8d061a4547b36e189189d99",
"funding_output": 0
},
{
"peer_id": "03c92af60f63a9a86dcda008dbe78204ebc6349cb5bd11db9d03420a7eefd4d067",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "699709x1458x2",
"channel_sat": 500000,
"our_amount_msat": "500000000msat",
"channel_total_sat": 500000,
"amount_msat": "ooo",
"funding_txid": "dbbc3782f03def92187aa541f5479fbb8198bb450acf307c3d07a346ee897178",
"funding_output": 2
},
{
"peer_id": "03864ef025fde8fb587d989186ce6a4a186895ee44a926bfc370e2c366597a3f8f",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "699709x1458x0",
"channel_sat": 226772,
"our_amount_msat": "226772000msat",
"channel_total_sat": 2000000,
"amount_msat": "ooo",
"funding_txid": "dbbc3782f03def92187aa541f5479fbb8198bb450acf307c3d07a346ee897178",
"funding_output": 0
},
{
"peer_id": "02657eef544b02f5b8f3ee799d3584d08c2b7140c1c2db6b02f9c4da272a51008d",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "699853x1533x1",
"channel_sat": 1045953,
"our_amount_msat": "1045953000msat",
"channel_total_sat": 2000000,
"amount_msat": "ooo",
"funding_txid": "6e892ecb237dd5b31625476569e39243c199ddbb2da02e7255afdd918f0a3fee",
"funding_output": 1
},
{
"peer_id": "034db20d789e55a48e6dd1a47745bd4065313fac7a1fad21c50ba230cacd58d088",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "699911x1337x0",
"channel_sat": 1330834,
"our_amount_msat": "1330834000msat",
"channel_total_sat": 2000000,
"amount_msat": "ooo",
"funding_txid": "964424d6a9343af9f43861d0ec73a604140e9dc13593ed783af04f2a128423a1",
"funding_output": 0
},
{
"peer_id": "03f3297397c8f5f685a562847611e20d15f56d6aaabc4d808a6e04e631dea6e612",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "700073x768x0",
"channel_sat": 476078,
"our_amount_msat": "476078000msat",
"channel_total_sat": 2000000,
"amount_msat": "ooo",
"funding_txid": "66c1c0b04e7966d2a5f773ba400265432662ced6b15f188d583facd77139f6dc",
"funding_output": 0
},
{
"peer_id": "03d6e0e8648e23a3636641869aa48fc3888771f480169a8404f5fda7bdabfc2609",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "700126x1338x1",
"channel_sat": 529568,
"our_amount_msat": "529568000msat",
"channel_total_sat": 1000000,
"amount_msat": "ooo",
"funding_txid": "279fe7edce1d8a610b9a7249f1f297d310b4cf6ecc3ce612738147d705c96e21",
"funding_output": 1
},
{
"peer_id": "026c2683f3a85822cbb262baaed39d3985cbe3b8e9838135edef7cab7776a1df0e",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "700163x2385x1",
"channel_sat": 1371707,
"our_amount_msat": "1371707000msat",
"channel_total_sat": 1400000,
"amount_msat": "ooo",
"funding_txid": "c50d0814dfacedeb289bb15ad10f4f06eb2292547345561b105998a66b10f12b",
"funding_output": 1
},
{
"peer_id": "03d12a7e9352a9e6f103bc20236f930016b8ba50697d2a2b91a50a7223d66dc12d",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "700398x859x1",
"channel_sat": 1000001,
"our_amount_msat": "1000001000msat",
"channel_total_sat": 2000000,
"amount_msat": "ooo",
"funding_txid": "6d6a2d371ab725b4a7a772b5e1173f809e82dfde9c886809a820fd33959599af",
"funding_output": 1
},
{
"peer_id": "03f5bb3357850195630f3a16fd2745049992a930185d5469c848d863cf51baf0d0",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "700435x675x0",
"channel_sat": 999999,
"our_amount_msat": "999999000msat",
"channel_total_sat": 2000000,
"amount_msat": "ooo",
"funding_txid": "0417a098fbe0d9de527a956e538320a9076168f10b0845e6e7366dbb2449d6f9",
"funding_output": 0
},
{
"peer_id": "032a92db7e04eb45b4943512c58e9f613e1c8f886e78b5e7a6c7fca2fb1ffa43c5",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "700435x675x2",
"channel_sat": 1287162,
"our_amount_msat": "1287162000msat",
"channel_total_sat": 2000000,
"amount_msat": "ooo",
"funding_txid": "0417a098fbe0d9de527a956e538320a9076168f10b0845e6e7366dbb2449d6f9",
"funding_output": 2
},
{
"peer_id": "0337579aadc81356ed7f32587565e4c2a7f8d1561be8cc3bd976cbc6a409a4a71b",
"connected": true,
"state": "CHANNELD_NORMAL",
"short_channel_id": "700442x800x1",
"channel_sat": 4699870,
"our_amount_msat": "4699870000msat",
"channel_total_sat": 4900000,
"amount_msat": "ooo",
"funding_txid": "7b2b36562806c45b1a4b1aea4b3b248c28ac45432f66d682f495de7f01f042cd",
"funding_output": 1
}
]
}
Sorry, I figured out how it happended. Few days ago, I misconfigured "minrelayfee" in bitcoind to be "100" instead of "0.000001" which caused clightning failed to broadcast with this message "Error broadcasting transaction: error code: -26\nerror message:\nmin relay fee not met, 403 < 3990000000. ". However, this put the peer in the wrong state and I won't be able to open channel to that peer again. I suspect that when bitcoind returns whatever error before broadcast, it will mess up c-lightning like this.