Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

crash of CLN (plugin-bcli killed) repetedly and channels permanently blocked on SHUTTING_DOWN or AWAIT_LOCKIN #7970

Open
svpi11 opened this issue Dec 30, 2024 · 3 comments
Open

crash of CLN (plugin-bcli killed) repetedly and channels permanently blocked on SHUTTING_DOWN or AWAIT_LOCKIN #7970

svpi11 opened this issue Dec 30, 2024 · 3 comments

Comments

@svpi11
Copy link

svpi11 commented Dec 30, 2024 •
edited
Loading

Hello everyone,

I am in a strange situation since some months now (around last October).
My node have been running CLN implementation fine for 2/3 years now, with some channels (4 or 5 max) opened permanently.

But now, two problems appears. Two of my channels seems to be permanently blocked as SHUTTING_DOWN, and impossible to connect to their peers. Moreover, I opened two other channels, that seems permanently AWAIT_LOCK.
I have just one channel working perfectly.

Looking at the logs, there is also obviously a problem: I see a lot of messages concerning a connection to a peer:

2024-12-30T17:42:01.415Z DEBUG plugin clnrest:Notification{'disconnect'{'id':'029b3d3497db86eb682f81493856d11622cac3b9bef21391c9ddfd366f9829061f'}}
2024-12-30T17:42:01.415Z DEBUG 023ead0d4228df4e93cf80ec32aecebc6032b46427d5ad987bdb820664ae5ffc2b-connectd: peer_out WIRE_WARNING
2024-12-30T17:42:01.538Z DEBUG connectd: maybe_free_peer freeing peer!
2024-12-30T17:42:01.911Z DEBUG 029b3d3497db86eb682f81493856d11622cac3b9bef21391c9ddfd366f9829061f-connectd: Failed connected out: Unable to connect, no address known for peer
2024-12-30T17:42:01.911Z DEBUG 029b3d3497db86eb682f81493856d11622cac3b9bef21391c9ddfd366f9829061f-connectd: Will try reconnect in 300 seconds
2024-12-30T17:42:02.695Z DEBUG 037659a0ac8eb3b8d0a720114efc861d3a940382dcfa1403746b4f8f6b2e8810ba-connectd: Failed connected out: Unable to connect, no address known for peer
2024-12-30T17:42:02.695Z DEBUG 037659a0ac8eb3b8d0a720114efc861d3a940382dcfa1403746b4f8f6b2e8810ba-connectd: Will try reconnect in 300 seconds

Also, here is the crash that happen very often:

2024-12-28T19:49:41.075Z DEBUG 029b3d3497db86eb682f81493856d11622cac3b9bef21391c9ddfd366f9829061f-connectd: Will try reconnect in 300 seconds
2024-12-28T19:49:41.075Z DEBUG 029b3d3497db86eb682f81493856d11622cac3b9bef21391c9ddfd366f9829061f-connectd: Failed connected out: Unable to connect, no address known for peer
2024-12-28T19:49:41.075Z DEBUG 029b3d3497db86eb682f81493856d11622cac3b9bef21391c9ddfd366f9829061f-connectd: Will try reconnect in 300 seconds
2024-12-28T19:49:41.075Z DEBUG 029b3d3497db86eb682f81493856d11622cac3b9bef21391c9ddfd366f9829061f-connectd: Failed connected out: Unable to connect, no address known for peer
2024-12-28T19:49:41.075Z DEBUG 029b3d3497db86eb682f81493856d11622cac3b9bef21391c9ddfd366f9829061f-connectd: Will try reconnect in 300 seconds
2024-12-28T19:49:41.091Z UNUSUAL plugin-bcli: bitcoin-cli: finished bitcoin-cli -rpcclienttimeout=60 getblockhash 876782 (149455 ms)
2024-12-28T19:49:41.096Z UNUSUAL plugin-bcli: bitcoin-cli -rpcclienttimeout=60 getblockhash 876782 exited with status 1
2024-12-28T19:49:41.102Z UNUSUAL plugin-bcli: bitcoin-cli: finished bitcoin-cli -rpcclienttimeout=60 getmempoolinfo (149656 ms)
2024-12-28T19:49:41.108Z UNUSUAL lightningd: Unable to estimate any fees
2024-12-28T19:49:41.115Z UNUSUAL plugin-bcli: bitcoin-cli: finished bitcoin-cli -rpcclienttimeout=60 getblockhash 876782 (181929 ms)
2024-12-28T19:49:41.121Z BROKEN plugin-bcli: bitcoin-cli -rpcclienttimeout=60 getblockhash 876782 exited 1 (after 1 other errors) 'error: timeout on transient error: Could not connect to the server 127.0.0.1:8332 (error code 0 - "timeout reached")\n\nMake sure the bitcoind server is running and that you are connecting to the correct RPC port.\nUse "bitcoin-cli -help" for more info.\n'; we have been retrying command for --bitcoin-retry-timeout=60 seconds; bitcoind setup or our --bitcoin-* configs broken?
2024-12-28T19:49:41.127Z INFO plugin-bcli: Killing plugin: exited during normal operation
2024-12-28T19:49:41.155Z BROKEN lightningd: The Bitcoin backend died.
2024-12-28T19:49:58.502Z BROKEN lightningd: FATAL SIGNAL 6 (version v24.11.1-modded)
2024-12-28T19:49:59.383Z BROKEN lightningd: backtrace: common/daemon.c:38 (send_backtrace) 0xaaaae7ac589b
2024-12-28T19:49:59.589Z BROKEN lightningd: backtrace: common/daemon.c:75 (crashdump) 0xaaaae7ac58fb
2024-12-28T19:49:59.732Z BROKEN lightningd: backtrace: (null):0 ((null)) 0xffffac97e7df
2024-12-28T19:49:59.732Z BROKEN lightningd: backtrace: (null):0 ((null)) 0xffffac587628
2024-12-28T19:49:59.732Z BROKEN lightningd: backtrace: (null):0 ((null)) 0xffffac53cb3b
2024-12-28T19:49:59.732Z BROKEN lightningd: backtrace: (null):0 ((null)) 0xffffac527dff
2024-12-28T19:49:59.760Z BROKEN lightningd: backtrace: lightningd/log.c:1043 (fatal_vfmt) 0xaaaae7a67eff
2024-12-28T19:49:59.895Z BROKEN lightningd: backtrace: lightningd/log.c:1053 (fatal) 0xaaaae7a67f93
2024-12-28T19:49:59.958Z BROKEN lightningd: backtrace: lightningd/bitcoind.c:36 (bitcoin_destructor) 0xaaaae7a38f73
2024-12-28T19:50:00.495Z BROKEN lightningd: backtrace: ccan/ccan/tal/tal.c:246 (notify) 0xaaaae7bbcd47
2024-12-28T19:50:03.188Z BROKEN lightningd: backtrace: ccan/ccan/tal/tal.c:437 (del_tree) 0xaaaae7bbce2f
2024-12-28T19:50:10.477Z BROKEN lightningd: backtrace: ccan/ccan/tal/tal.c:532 (tal_free) 0xaaaae7bbd47b
2024-12-28T19:50:12.107Z BROKEN lightningd: backtrace: lightningd/plugin.c:459 (plugin_kill) 0xaaaae7a8f783
2024-12-28T19:50:25.587Z BROKEN lightningd: backtrace: lightningd/plugin.c:890 (plugin_conn_finish) 0xaaaae7a8faa7
2024-12-28T19:50:27.275Z BROKEN lightningd: backtrace: ccan/ccan/io/poll.c:246 (destroy_conn) 0xaaaae7bb14f3
2024-12-28T19:50:28.497Z BROKEN lightningd: backtrace: ccan/ccan/io/poll.c:252 (destroy_conn_close_fd) 0xaaaae7bb151f
2024-12-28T19:50:37.926Z BROKEN lightningd: backtrace: ccan/ccan/tal/tal.c:246 (notify) 0xaaaae7bbcd47
2024-12-28T19:50:37.987Z BROKEN lightningd: backtrace: ccan/ccan/tal/tal.c:437 (del_tree) 0xaaaae7bbce2f
2024-12-28T19:50:37.992Z BROKEN lightningd: backtrace: ccan/ccan/tal/tal.c:532 (tal_free) 0xaaaae7bbd47b
2024-12-28T19:50:37.992Z BROKEN lightningd: backtrace: ccan/ccan/io/io.c:496 (io_close) 0xaaaae7bafc2f
2024-12-28T19:50:37.992Z BROKEN lightningd: backtrace: ccan/ccan/io/io.c:415 (do_plan) 0xaaaae7bafcfb
2024-12-28T19:50:37.992Z BROKEN lightningd: backtrace: ccan/ccan/io/io.c:439 (io_ready) 0xaaaae7bafd6b
2024-12-28T19:50:37.992Z BROKEN lightningd: backtrace: ccan/ccan/io/poll.c:455 (io_loop) 0xaaaae7bb1c97
2024-12-28T19:50:37.997Z BROKEN lightningd: backtrace: lightningd/io_loop_with_timers.c:22 (io_loop_with_timers) 0xaaaae7a5f39f
2024-12-28T19:50:37.997Z BROKEN lightningd: backtrace: lightningd/lightningd.c:1484 (main) 0xaaaae7a6529f
2024-12-28T19:50:37.997Z BROKEN lightningd: backtrace: (null):0 ((null)) 0xffffac5284c3
2024-12-28T19:50:37.997Z BROKEN lightningd: backtrace: (null):0 ((null)) 0xffffac528597
2024-12-28T19:50:37.997Z BROKEN lightningd: backtrace: (null):0 ((null)) 0xaaaae7a378af
2024-12-28T19:50:37.997Z BROKEN lightningd: backtrace: (null):0 ((null)) 0xffffffffffffffff

Here is my summars (plugin) status outpout:

address=(private)@ip.ip.ip.ip:9735
num_utxos=4
utxo_amount=0.02521572 BTC
num_channels=3
num_connected=3
num_gossipers=0
avail_out=0.00990000 BTC
avail_in=0.00000000 BTC
fees_collected=0.00000000 BTC
channels_flags=P:private O:offline
OUT_SATS | IN_SATS | SCID | MAX_HTLC | FLAG | BASE | PPM | ALIAS | PEER_ID | UPTIME | HTLCS | STATE
-----------+-----------+---------------+----------+------+------+-----+------------------+--------------------------------------------------------------------+--------+-------+---------------
0 | 1,000,000 | 1x1x1 | 0 | [PO] | 0 | 10 | NO_ALIAS_SET | 029b3d3497db86eb682f814938........| 0% | 0 | SHUTTING_DOWN
0 | 1,000,000 | 1x1x1 | 0 | [PO] | 0 | 10 | NO_ALIAS_SET | 037659a0ac8eb3b8d0a720114e.........| 0% | 0 | SHUTTING_DOWN
1,000,000 | 0 | 875922x1551x0 | 990,000 | [] | 0 | 10 | NODE_GOSSIP_MISS | 023ead0d4228df4e93cf80ec32........ | 42% | 0 | OK
1,000,000 | 0 | PENDING | 990,000 | [] | 0 | 10 | NODE_GOSSIP_MISS | 023ead0d4228df4e93cf80ec32aeceb........ | 42% | 0 | AWAIT_LOCK
1,000,000 | 0 | PENDING | 990,000 | [__] | 0 | 10 | NODE_GOSSIP_MISS | 02b705ad9fff5b30e69dd3810d10037.......... | 56% | 0 | AWAIT_LOCK

And here is the listfunds command outpout:

{
"outputs": [
{
"txid": "7b97adce1745fetc....",
"output": 1,
"amount_msat": 268526000,
"scriptpubkey": "00146c65faf55c674b6d9a05304eb3db5632a026643b",
"address": "bc1qd3jl4a2uva9ketc....",
"status": "confirmed",
"blockheight": 784127,
"reserved": false
},
{
"txid": "32b4552bb97f63d7c9e52......",
"output": 1,
"amount_msat": 833716000,
"scriptpubkey": "5120514a74d0c35ede171a16e7676042bdf2e9f87ce5d61b26b6da4b906ee20220ec",
"address": "bc1p2998f5xrtm......;",
"status": "confirmed",
"blockheight": 842509,
"reserved": false
},
{
"txid": "de72a11db37d00e2652........",
"output": 2,
"amount_msat": 497087000,
"scriptpubkey": "0020485f398187036cea6f57937ee923d678b4ecd50b30312384a14f96bfba40511c",
"address": "bc1qfp0nnqv8qdk......",
"status": "confirmed",
"blockheight": 867276,
"reserved": false
},
{
"txid": "b44a05d2ab2cb7e23117aa6cdd75e9......;",
"output": 1,
"amount_msat": 922243000,
"scriptpubkey": "51209b8b6e68f2d7d9e821c083df7c3f2af99a8acfd0af6059096060e8e0ef403800",
"address": "bc1pnw9ku68j6lv7sgwqs00hc0...........f",
"status": "confirmed",
"blockheight": 875922,
"reserved": false
}
],
"channels": [
{
"peer_id": "029b3d3497db86eb682f814938.........;",
"connected": false,
"state": "CHANNELD_SHUTTING_DOWN",
"channel_id": "8281fd3504fbefcae253c2234f3dfb..........",
"short_channel_id": "1x1x1",
"our_amount_msat": 0,
"amount_msat": 1000000000,
"funding_txid": "8a3f5318fd3e013bfbfdc5d393..........",
"funding_output": 0
},
{
"peer_id": "037659a0ac8eb3b8d0a.........",
"connected": false,
"state": "CHANNELD_SHUTTING_DOWN",
"channel_id": "6ae90f22860f4779ded8b20664e858............",
"short_channel_id": "1x1x1",
"our_amount_msat": 0,
"amount_msat": 1000000000,
"funding_txid": "330723bedf8a300ff545ee4b4.........",
"funding_output": 0
},
{
"peer_id": "023ead0d4228df4e93cf80ec32aec............",
"connected": true,
"state": "CHANNELD_AWAITING_LOCKIN",
"channel_id": "f75b819c8fd3df82076e436e128...........",
"our_amount_msat": 1000000000,
"amount_msat": 1000000000,
"funding_txid": "6b69594ed7cee9e1fce72b8dd4...............",
"funding_output": 0
},
{
"peer_id": "023ead0d4228df4e93cf80ec32aecebc603..............",
"connected": true,
"state": "CHANNELD_NORMAL",
"channel_id": "97e9cbea3fa1d0ac73d81a852e1844983............",
"short_channel_id": "875922x1551x0",
"our_amount_msat": 1000000000,
"amount_msat": 1000000000,
"funding_txid": "b44a05d2ab2cb7e23117aa6cdd75e............",
"funding_output": 0
},
{
"peer_id": "02b705ad9fff5b30e69dd3810d10............",
"connected": true,
"state": "CHANNELD_AWAITING_LOCKIN",
"channel_id": "b82488daae859eb3d............",
"our_amount_msat": 1000000000,
"amount_msat": 1000000000,
"funding_txid": "95ca15ef689cba065............",
"funding_output": 0
}
]
}

Thanks a lot, and I hope I will find a solution to this problem in 2025 💯
@hMsats
Copy link
Contributor

hMsats commented Dec 31, 2024 •
edited
Loading

Because of the:

2024-12-28T19:49:41.096Z UNUSUAL plugin-bcli: bitcoin-cli -rpcclienttimeout=60 getblockhash 876782 exited with status 1

you could try to put: bitcoin-rpcclienttimeout=900 in the CLN config and see if it helps.

@svpi11
Copy link
Author

svpi11 commented Jan 4, 2025

Sadly it didn't change anything to my problem... Moreover, the channels are still blocked !

@frbitten
Copy link

I'm having the same issue after I updated to version 24.11.
Lightningd is restarted due to the error until at some point it can no longer recover and the machine needs to be restarted for bitcoind and lightningd to come back.

My channels are not moving, I don't know if it's a problem or due to constant drops and loss of connections.

Sometimes it seems like it's something to do with bitcoind's gRPC communication.

2025-01-21T06:13:25.535Z UNUSUAL plugin-bookkeeper: topic 'utxo_deposit' is not a known notification topic
2025-01-21T06:13:25.535Z UNUSUAL plugin-bookkeeper: topic 'utxo_spend' is not a known notification topic
2025-01-21T06:18:24.073Z INFO    plugin-bcli: bitcoin-cli initialized and connected to bitcoind.
2025-01-21T06:24:06.445Z INFO    plugin-clnrest: REST server running at https://0.0.0.0:3010
2025-01-21T06:24:15.688Z INFO    lightningd: --------------------------------------------------
2025-01-21T06:24:15.688Z INFO    lightningd: Server started with public key 02b2cd123845a62821ca65ac3910cb37c33ccc1297b6d1001a01b8e1e48c35d0e2, alias Green V>
2025-01-21T06:35:02.437Z UNUSUAL lightningd: Bad gossip order: could not find channel 775665x1781x1 for peer's channel update
2025-01-21T06:37:27.041Z INFO    029efe15ef5f0fcc2fdd6b910405e78056b28c9b64e1feff5f13b8dce307e67cad-channeld-chan#18: Peer connection lost
2025-01-21T06:37:27.041Z INFO    029efe15ef5f0fcc2fdd6b910405e78056b28c9b64e1feff5f13b8dce307e67cad-chan#18: Peer transient failure in CHANNELD_NORMAL: chann>
2025-01-21T06:53:46.689Z UNUSUAL lightningd: Bad gossip order: could not find channel 782836x730x1 for peer's channel update
2025-01-21T07:00:09.820Z UNUSUAL plugin-bcli: bitcoin-cli: finished bitcoin-cli -datadir=/hdd/bitcoin -rpcclienttimeout=60 -rpcconnect=127.0.0.1 -rpcport=833>
2025-01-21T07:00:09.822Z UNUSUAL plugin-bcli: bitcoin-cli: finished bitcoin-cli -datadir=/hdd/bitcoin -rpcclienttimeout=60 -rpcconnect=127.0.0.1 -rpcport=833>
2025-01-21T07:11:08.778Z UNUSUAL lightningd: Bad gossip order: could not find channel 709642x899x1 for peer's channel update
2025-01-21T07:11:08.778Z UNUSUAL lightningd: Bad gossip order: could not find channel 710457x2394x1 for peer's channel update
2025-01-21T07:11:08.778Z UNUSUAL lightningd: Bad gossip order: could not find channel 711477x1060x0 for peer's channel update
2025-01-21T07:11:08.778Z UNUSUAL lightningd: Bad gossip order: could not find channel 718529x1733x0 for peer's channel update
2025-01-21T07:11:08.778Z UNUSUAL lightningd: Bad gossip order: could not find channel 718534x872x0 for peer's channel update
2025-01-21T07:11:08.778Z UNUSUAL lightningd: Bad gossip order: could not find channel 719032x2252x0 for peer's channel update
2025-01-21T07:11:08.779Z UNUSUAL lightningd: Bad gossip order: could not find channel 720249x2546x0 for peer's channel update
2025-01-21T07:11:08.779Z UNUSUAL lightningd: Bad gossip order: could not find channel 722975x101x1 for peer's channel update
2025-01-21T07:11:08.779Z UNUSUAL lightningd: Bad gossip order: could not find channel 729773x908x0 for peer's channel update
2025-01-21T07:11:08.779Z UNUSUAL lightningd: Bad gossip order: could not find channel 731894x1784x1 for peer's channel update
2025-01-21T07:11:08.779Z UNUSUAL lightningd: Bad gossip order: could not find channel 732320x2011x1 for peer's channel update
2025-01-21T07:11:08.779Z UNUSUAL lightningd: Bad gossip order: could not find channel 732740x1332x0 for peer's channel update
2025-01-21T07:11:08.779Z UNUSUAL lightningd: Bad gossip order: could not find channel 733109x1131x0 for peer's channel update
2025-01-21T07:11:08.780Z UNUSUAL lightningd: Bad gossip order: could not find channel 734418x2085x1 for peer's channel update
2025-01-21T07:11:59.267Z UNUSUAL lightningd: Bad gossip order: could not find channel 718529x1733x0 for peer's channel update
2025-01-21T07:11:59.267Z UNUSUAL lightningd: Bad gossip order: could not find channel 718534x872x0 for peer's channel update
2025-01-21T07:11:59.880Z UNUSUAL lightningd: Bad gossip order: could not find channel 719032x2252x0 for peer's channel update
2025-01-21T07:12:00.129Z UNUSUAL lightningd: Bad gossip order: could not find channel 720249x2546x0 for peer's channel update
2025-01-21T07:12:00.246Z UNUSUAL lightningd: Bad gossip order: could not find channel 722975x101x1 for peer's channel update
2025-01-21T07:12:00.342Z UNUSUAL lightningd: Bad gossip order: could not find channel 729773x908x0 for peer's channel update
2025-01-21T07:12:00.384Z UNUSUAL lightningd: Bad gossip order: could not find channel 731894x1784x1 for peer's channel update
2025-01-21T07:12:00.405Z UNUSUAL lightningd: Bad gossip order: could not find channel 732320x2011x1 for peer's channel update
2025-01-21T07:12:00.504Z UNUSUAL lightningd: Bad gossip order: could not find channel 732740x1332x0 for peer's channel update
2025-01-21T07:12:00.504Z UNUSUAL lightningd: Bad gossip order: could not find channel 733109x1131x0 for peer's channel update
2025-01-21T07:12:00.504Z UNUSUAL lightningd: Bad gossip order: could not find channel 734418x2085x1 for peer's channel update
2025-01-21T07:12:00.504Z UNUSUAL lightningd: Bad gossip order: could not find channel 737008x743x1 for peer's channel update
2025-01-21T07:12:00.504Z UNUSUAL lightningd: Bad gossip order: could not find channel 737417x2381x0 for peer's channel update
2025-01-21T07:12:00.504Z UNUSUAL lightningd: Bad gossip order: could not find channel 738180x828x1 for peer's channel update
2025-01-21T07:12:00.504Z UNUSUAL lightningd: Bad gossip order: could not find channel 738527x494x1 for peer's channel update
2025-01-21T07:12:00.504Z UNUSUAL lightningd: Bad gossip order: could not find channel 739024x3101x0 for peer's channel update
2025-01-21T07:12:00.504Z UNUSUAL lightningd: Bad gossip order: could not find channel 739740x1962x1 for peer's channel update
2025-01-21T07:12:00.504Z UNUSUAL lightningd: Bad gossip order: could not find channel 740106x2509x0 for peer's channel update
2025-01-21T07:12:00.504Z UNUSUAL lightningd: Bad gossip order: could not find channel 740107x387x0 for peer's channel update
2025-01-21T07:12:00.518Z UNUSUAL lightningd: Bad gossip order: could not find channel 746011x2246x3 for peer's channel update
2025-01-21T07:12:00.525Z UNUSUAL lightningd: Bad gossip order: could not find channel 748577x2067x0 for peer's channel update
2025-01-21T07:17:07.779Z INFO    023ef61f179d401434cdb44cd392d06e1bbeeb4eba66097d87aaf5e1232b7a5506-channeld-chan#143: Peer connection lost
2025-01-21T07:17:07.779Z INFO    023ef61f179d401434cdb44cd392d06e1bbeeb4eba66097d87aaf5e1232b7a5506-chan#143: Peer transient failure in CHANNELD_NORMAL: chan>
2025-01-21T07:34:24.775Z UNUSUAL plugin-bcli: bitcoin-cli: finished bitcoin-cli -datadir=/hdd/bitcoin -rpcclienttimeout=60 -rpcconnect=127.0.0.1 -rpcport=833>
2025-01-21T07:34:24.776Z UNUSUAL plugin-bcli: bitcoin-cli -datadir=/hdd/bitcoin -rpcclienttimeout=60 -rpcconnect=127.0.0.1 -rpcport=8332 -rpcuser=... -stdinr>
2025-01-21T07:34:42.325Z UNUSUAL plugin-bcli: bitcoin-cli: finished bitcoin-cli -datadir=/hdd/bitcoin -rpcclienttimeout=60 -rpcconnect=127.0.0.1 -rpcport=833>
2025-01-21T07:34:42.326Z UNUSUAL lightningd: Unable to estimate any fees
2025-01-21T07:34:44.910Z UNUSUAL plugin-bcli: bitcoin-cli: finished bitcoin-cli -datadir=/hdd/bitcoin -rpcclienttimeout=60 -rpcconnect=127.0.0.1 -rpcport=833>
2025-01-21T07:39:54.315Z UNUSUAL plugin-bcli: bitcoin-cli: finished bitcoin-cli -datadir=/hdd/bitcoin -rpcclienttimeout=60 -rpcconnect=127.0.0.1 -rpcport=833>
2025-01-21T07:39:54.318Z UNUSUAL plugin-bcli: bitcoin-cli: finished bitcoin-cli -datadir=/hdd/bitcoin -rpcclienttimeout=60 -rpcconnect=127.0.0.1 -rpcport=833>
2025-01-21T07:44:45.277Z UNUSUAL plugin-bcli: bitcoin-cli: finished bitcoin-cli -datadir=/hdd/bitcoin -rpcclienttimeout=60 -rpcconnect=127.0.0.1 -rpcport=833>
2025-01-21T07:44:45.286Z UNUSUAL plugin-bcli: bitcoin-cli -datadir=/hdd/bitcoin -rpcclienttimeout=60 -rpcconnect=127.0.0.1 -rpcport=8332 -rpcuser=... -stdinr>
2025-01-21T07:44:45.288Z UNUSUAL plugin-bcli: bitcoin-cli: finished bitcoin-cli -datadir=/hdd/bitcoin -rpcclienttimeout=60 -rpcconnect=127.0.0.1 -rpcport=833>
2025-01-21T07:44:45.290Z UNUSUAL lightningd: Unable to estimate any fees
2025-01-21T07:45:45.379Z UNUSUAL plugin-bcli: bitcoin-cli: finished bitcoin-cli -datadir=/hdd/bitcoin -rpcclienttimeout=60 -rpcconnect=127.0.0.1 -rpcport=833>
2025-01-21T07:45:45.382Z **BROKEN** plugin-bcli: bitcoin-cli -datadir=/hdd/bitcoin -rpcclienttimeout=60 -rpcconnect=127.0.0.1 -rpcport=8332 -rpcuser=... -std>
2025-01-21T07:45:45.384Z INFO    plugin-bcli: Killing plugin: exited during normal operation
2025-01-21T07:45:45.384Z **BROKEN** lightningd: The Bitcoin backend died.
2025-01-21T07:45:45.431Z **BROKEN** lightningd: FATAL SIGNAL 6 (version v24.11.1)
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: common/daemon.c:38 (send_backtrace) 0x63e6b4bc05cb
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: common/daemon.c:75 (crashdump) 0x63e6b4bc061a
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: (null):0 ((null)) 0x7f3710e4531f
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: (null):0 ((null)) 0x7f3710e9eb1c
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: (null):0 ((null)) 0x7f3710e4526d
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: (null):0 ((null)) 0x7f3710e288fe
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: lightningd/log.c:1043 (fatal_vfmt) 0x63e6b4b6af0a
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: lightningd/log.c:1053 (fatal) 0x63e6b4b6afa9
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: lightningd/bitcoind.c:36 (bitcoin_destructor) 0x63e6b4b3d4e8
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: ccan/ccan/tal/tal.c:246 (notify) 0x63e6b4d39892
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: ccan/ccan/tal/tal.c:437 (del_tree) 0x63e6b4d3996a
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: ccan/ccan/tal/tal.c:532 (tal_free) 0x63e6b4d39eb8
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: lightningd/plugin.c:459 (plugin_kill) 0x63e6b4b8f646
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: lightningd/plugin.c:890 (plugin_conn_finish) 0x63e6b4b8f984
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: ccan/ccan/io/poll.c:246 (destroy_conn) 0x63e6b4d2f6d4
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: ccan/ccan/io/poll.c:252 (destroy_conn_close_fd) 0x63e6b4d2f6fa
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: ccan/ccan/tal/tal.c:246 (notify) 0x63e6b4d39892
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: ccan/ccan/tal/tal.c:437 (del_tree) 0x63e6b4d3996a
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: ccan/ccan/tal/tal.c:532 (tal_free) 0x63e6b4d39eb8
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: ccan/ccan/io/io.c:496 (io_close) 0x63e6b4d2e28a
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: ccan/ccan/io/io.c:415 (do_plan) 0x63e6b4d2e326
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: ccan/ccan/io/io.c:439 (io_ready) 0x63e6b4d2e38b
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: ccan/ccan/io/poll.c:455 (io_loop) 0x63e6b4d2fcfd
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: lightningd/io_loop_with_timers.c:22 (io_loop_with_timers) 0x63e6b4b62cea
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: lightningd/lightningd.c:1484 (main) 0x63e6b4b686a5
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: (null):0 ((null)) 0x7f3710e2a1c9
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: (null):0 ((null)) 0x7f3710e2a28a
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: (null):0 ((null)) 0x63e6b4b3be54
2025-01-21T07:45:45.431Z **BROKEN** lightningd: backtrace: (null):0 ((null)) 0xffffffffffffffff

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@frbitten @svpi11 @hMsats