Skip to content
This repository has been archived by the owner on Mar 28, 2023. It is now read-only.

Server crash due to websocket timeout #2097

Open
jlopp opened this issue Jul 29, 2020 · 9 comments
Open

Server crash due to websocket timeout #2097

jlopp opened this issue Jul 29, 2020 · 9 comments
Labels
BlockBook bug multiwallet

Comments

@jlopp
Copy link

jlopp commented Jul 29, 2020

We had a crash of OpenBazaar Server v0.14.3; the final message printed to the console was:

2020/07/22 13:15:37 no response from peer

The tail end of ob.log:

2020-07-29 13:26:11.319 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 918026: 000000000187f12c4a17306fbfa555624f8d6a5d3aada55c42144bf9a9bfb7de
2020-07-29 13:27:34.106 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 918027: 00000000016df1caf39b0ffe975d62577c187706f5767f893ae1d06cbb79901d
2020-07-29 13:27:34.681 [DEBUG] [recordAgingNotifier/PerformTask] notifications created/records updated: dispute: 0/0, sales: 0/0, purchaseTimeout: 0/0, purchaseExpire: 0/0
2020-07-29 13:28:33.035 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 918028: 00000000020e3e6cc650b5c13d099995963ab3b23ceea3d6b53f6813ebe055c9
2020-07-29 13:28:52.621 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 918029: 0000000000bac0f697c8a71ba3b4e00c3c815d0789f32c3528e318649cd1b876
2020-07-29 13:30:38.472 [CRITICAL] [client/setupListeners] error after retrying: websocket reconnection timeout (btc.blockbook.api.openbazaar.org)
@jlopp
Copy link
Author

jlopp commented Aug 6, 2020

Looks like infrastructure instability is causing crashes more regularly now. Seems like this should just pause any OB activity rather than crash the daemon. Maybe you could also point to other publicly available blockbook servers hosted by other organizations?

2020-08-06 06:58:50.295 [INFO] [WalletService/processIncomingBlock] received new Litecoin block at height 1889950: cdb0c8c67b6125845c5ec191a0c09e46c99fac09d0c0805ec74d066872426071
2020-08-06 06:59:23.393 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 926896: 0000000000ebfae40b06cc7eb3ca8d56925eeda68dbbc79ca8527592419646e2
2020-08-06 06:59:42.177 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 926897: 00000000017b3f5922d46b682b0ae7642e2069c2d8021eef05024e588fe0c1c9
2020-08-06 07:01:26.695 [INFO] [WalletService/processIncomingBlock] received new Bitcoin Cash block at height 647130: 00000000000000000008b3d78b95dbff7fa388a38d946c678a4aa0adffe79a2d
2020-08-06 07:02:19.606 [CRITICAL] [client/setupListeners] error after retrying: websocket reconnection timeout (btc.blockbook.api.openbazaar.org)

@hoffmabc
Copy link
Member

hoffmabc commented Aug 6, 2020

Thanks for the report @jlopp. @szollo do you have any idea why we're having continued instability?

@szollo
Copy link
Member

szollo commented Aug 6, 2020

Thanks for the report @jlopp.

We recently migrated to a newer version of BlockBook along with a newer architecture that combines full nodes + BlockBook API on one box, and started having issues with the BTC instances as a result.

We're looking into fixing both issues - making the code more resilient to disconnections and the infrastructure more reliable. Will update here.

@szollo
Copy link
Member

szollo commented Aug 10, 2020

I couldn't replicate this issue.

I left a couple Dockerised ob-go stores running, one with the same reported version (v0.14.3) pointing at our dev replica of prod that often switches itself off, but ob-go didn't crash at any point.

What I did notice however, is that the retry logic seems to be broken - BTC hasn't even retried connecting since the 7th, so this is clearly a separate bug we need to look into (seems it's been raised already as #1520).

@jlopp do you have more verbose logs? It would be helpful if you could start the daemon with the -v flag and send us logs if it happens again.

Also was this version compiled by yourself, or did you download our binaries?

@jlopp
Copy link
Author

jlopp commented Aug 10, 2020 •
edited
Loading

@szollo I'm running the amd64 binary; not seeing a verbose logging option. -v just prints the version and exits

@szollo
Copy link
Member

szollo commented Aug 10, 2020

@jlopp sorry, I mean openbazaar-go start -v. That enables verbose logging.

@jlopp
Copy link
Author

jlopp commented Aug 10, 2020

Gotcha; running with verbose logging and will update if it crashes again. Might be a few weeks or more...

@jlopp
Copy link
Author

jlopp commented Aug 18, 2020 •
edited
Loading

Got another crash with verbose logging but not seeing anything particularly interesting...

tail -n 100 logs/*.log
==> logs/api.log <==
Accept-Encoding: gzip, deflate, br
Accept-Language: en-US
Connection: keep-alive
Sec-Fetch-Mode: cors
Sec-Fetch-Site: cross-site
User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) OpenBazaarDesktopClient/2.3.8 Chrome/76.0.3809.88 Electron/6.0.0 Safari/537.36

2020-03-04 18:40:37.251 [DEBUG] [api/ServeHTTP] GET /wallet/estimatefee/BTC?feeLevel=NORMAL&amount=1356800 HTTP/1.1
Host: 127.0.0.1:4002
Accept: */*
Accept-Encoding: gzip, deflate, br
Accept-Language: en-US
Connection: keep-alive
Sec-Fetch-Mode: cors
Sec-Fetch-Site: cross-site
User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) OpenBazaarDesktopClient/2.3.8 Chrome/76.0.3809.88 Electron/6.0.0 Safari/537.36

2020-03-04 18:40:41.025 [DEBUG] [api/ServeHTTP] GET /wallet/estimatefee/BTC?feeLevel=NORMAL&amount=1356700 HTTP/1.1
Host: 127.0.0.1:4002
Accept: */*
Accept-Encoding: gzip, deflate, br
Accept-Language: en-US
Connection: keep-alive
Sec-Fetch-Mode: cors
Sec-Fetch-Site: cross-site
User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) OpenBazaarDesktopClient/2.3.8 Chrome/76.0.3809.88 Electron/6.0.0 Safari/537.36

2020-03-04 18:40:44.943 [DEBUG] [api/ServeHTTP] GET /wallet/estimatefee/BTC?feeLevel=NORMAL&amount=1356600 HTTP/1.1
Host: 127.0.0.1:4002
Accept: */*
Accept-Encoding: gzip, deflate, br
Accept-Language: en-US
Connection: keep-alive
Sec-Fetch-Mode: cors
Sec-Fetch-Site: cross-site
User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) OpenBazaarDesktopClient/2.3.8 Chrome/76.0.3809.88 Electron/6.0.0 Safari/537.36

2020-03-04 18:40:52.221 [DEBUG] [api/ServeHTTP] POST /wallet/spend/ HTTP/1.1
Host: 127.0.0.1:4002
Accept: application/json, text/javascript, */*; q=0.01
Accept-Encoding: gzip, deflate, br
Accept-Language: en-US
Connection: keep-alive
Content-Length: 110
Content-Type: application/json
Origin: file://
Sec-Fetch-Mode: cors
Sec-Fetch-Site: cross-site
User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) OpenBazaarDesktopClient/2.3.8 Chrome/76.0.3809.88 Electron/6.0.0 Safari/537.36

2020-03-04 18:41:06.757 [DEBUG] [api/ServeHTTP] GET /wallet/transactions/BTC?limit=25 HTTP/1.1
Host: 127.0.0.1:4002
Accept: application/json, text/javascript, */*; q=0.01
Accept-Encoding: gzip, deflate, br
Accept-Language: en-US
Connection: keep-alive
Sec-Fetch-Mode: cors
Sec-Fetch-Site: cross-site
User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) OpenBazaarDesktopClient/2.3.8 Chrome/76.0.3809.88 Electron/6.0.0 Safari/537.36

2020-03-04 18:43:17.143 [DEBUG] [api/ServeHTTP] GET /ob/exchangerates/BTC HTTP/1.1
Host: 127.0.0.1:4002
Accept: */*
Accept-Encoding: gzip, deflate, br
Accept-Language: en-US
Connection: keep-alive
Sec-Fetch-Mode: cors
Sec-Fetch-Site: cross-site
User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) OpenBazaarDesktopClient/2.3.8 Chrome/76.0.3809.88 Electron/6.0.0 Safari/537.36

2020-03-04 18:48:17.481 [DEBUG] [api/ServeHTTP] GET /ob/exchangerates/BTC HTTP/1.1
Host: 127.0.0.1:4002
Accept: */*
Accept-Encoding: gzip, deflate, br
Accept-Language: en-US
Connection: keep-alive
Sec-Fetch-Mode: cors
Sec-Fetch-Site: cross-site
User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) OpenBazaarDesktopClient/2.3.8 Chrome/76.0.3809.88 Electron/6.0.0 Safari/537.36

2020-03-04 18:53:17.778 [DEBUG] [api/ServeHTTP] GET /ob/exchangerates/BTC HTTP/1.1
Host: 127.0.0.1:4002
Accept: */*
Accept-Encoding: gzip, deflate, br
Accept-Language: en-US
Connection: keep-alive
Sec-Fetch-Mode: cors
Sec-Fetch-Site: cross-site
User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) OpenBazaarDesktopClient/2.3.8 Chrome/76.0.3809.88 Electron/6.0.0 Safari/537.36

2020-03-04 18:58:18.073 [DEBUG] [api/ServeHTTP] GET /ob/exchangerates/BTC HTTP/1.1
Host: 127.0.0.1:4002
Accept: */*
Accept-Encoding: gzip, deflate, br
Accept-Language: en-US
Connection: keep-alive
Sec-Fetch-Mode: cors
Sec-Fetch-Site: cross-site
User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) OpenBazaarDesktopClient/2.3.8 Chrome/76.0.3809.88 Electron/6.0.0 Safari/537.36


==> logs/bitcoin.log <==
14:42:44.893 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000002098a29fc0da6758dfade28299d3099fc85bec195be27d, len request queue: 39
14:42:44.952 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000002098a29fc0da6758dfade28299d3099fc85bec195be27d at height 566721
14:42:44.953 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 00000000000000000007044d8462430e3ed3fd9a3edb52cd13155ca6ba941680, len request queue: 38
14:42:44.954 [DEBUG] [bitcoin/handleTxMsg] Tx 5e83d158573a02f44fc1cb04bdbad15b6c83540098eb16f80b3b5d3c21f72f66 from Peer1 had no hits, filter false positive.
14:42:45.015 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 00000000000000000007044d8462430e3ed3fd9a3edb52cd13155ca6ba941680 at height 566722
14:42:45.017 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000001d53e351160731420f41ac49d6ef258e55651190e92db6, len request queue: 37
14:42:45.017 [DEBUG] [bitcoin/handleTxMsg] Tx 1a1543a2f8072e15db73cb5a728725a9715782dc93094aa06cb5a34c678be0cd from Peer1 had no hits, filter false positive.
14:42:45.089 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000001d53e351160731420f41ac49d6ef258e55651190e92db6 at height 566723
14:42:45.089 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000000f7c00034e6610d86fdf8a4b08de1476b0db3e94ec6975, len request queue: 36
14:42:45.131 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000000f7c00034e6610d86fdf8a4b08de1476b0db3e94ec6975 at height 566724
14:42:45.133 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 00000000000000000026686cbf75107bc4037850b3d6d8b542a308033739b14b, len request queue: 35
14:42:45.174 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 00000000000000000026686cbf75107bc4037850b3d6d8b542a308033739b14b at height 566725
14:42:45.176 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000000a5c062af141868ac2985b3c92d46ca16c9ff67c8a3767, len request queue: 34
14:42:45.239 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000000a5c062af141868ac2985b3c92d46ca16c9ff67c8a3767 at height 566726
14:42:45.239 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 000000000000000000123e74bfcff3aca56e1727c7b6054fdbd69610bac57c11, len request queue: 33
14:42:45.240 [DEBUG] [bitcoin/handleTxMsg] Tx 84d12bfb25cde85ad8214e16c1fc0c29886b891a624729b220b831b24b5d4d16 from Peer1 had no hits, filter false positive.
14:42:45.240 [DEBUG] [bitcoin/handleTxMsg] Tx 42d8a193a727ac7d14a49aac73c487bb5317e14dec44201485d08f91144542d8 from Peer1 had no hits, filter false positive.
14:42:45.258 [DEBUG] [bitcoin/handleTxMsg] Tx 1c89bdea6084d41bf827412095a1a560cd12502036d68146d0b30e588b67ddfa from Peer1 had no hits, filter false positive.
14:42:45.258 [DEBUG] [bitcoin/handleTxMsg] Tx fb60968460a728a031643df11c6510e8010c857bf0d54bd04b0a82dc01e8a6d5 from Peer1 had no hits, filter false positive.
14:42:45.271 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 000000000000000000123e74bfcff3aca56e1727c7b6054fdbd69610bac57c11 at height 566727
14:42:45.271 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000001bb03659f4ffb0f55978c962066dbce6149d1e301e006b, len request queue: 32
14:42:45.315 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000001bb03659f4ffb0f55978c962066dbce6149d1e301e006b at height 566728
14:42:45.315 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000000f8b5932e75c448e99bd845cd4870a70ce801eff57e0c8, len request queue: 31
14:42:45.360 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000000f8b5932e75c448e99bd845cd4870a70ce801eff57e0c8 at height 566729
14:42:45.360 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 00000000000000000018bf7db15f7c9752832f47c63e07fe78645cb6c784e266, len request queue: 30
14:42:45.360 [DEBUG] [bitcoin/handleTxMsg] Tx e9913bc2c667a19dad9c07cced67b2b846e55aae9d18e168b13b87a76e8d1655 from Peer1 had no hits, filter false positive.
14:42:45.401 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 00000000000000000018bf7db15f7c9752832f47c63e07fe78645cb6c784e266 at height 566730
14:42:45.401 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 000000000000000000061b31f5c567fa3380ceaa9a3476472046665167d3101b, len request queue: 29
14:42:45.436 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 000000000000000000061b31f5c567fa3380ceaa9a3476472046665167d3101b at height 566731
14:42:45.436 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000000c2e25aed17463621249eedaaf05c71fa57376b1e10ea9, len request queue: 28
14:42:45.484 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000000c2e25aed17463621249eedaaf05c71fa57376b1e10ea9 at height 566732
14:42:45.484 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 00000000000000000011e679fba9fd3078263eaf54bfda6b57ac524685274312, len request queue: 27
14:42:45.487 [DEBUG] [bitcoin/handleTxMsg] Tx 3171a1494737726c7765d9a0c00a87b2121ce12cf3b69bec87aa8a40cf7b429e from Peer1 had no hits, filter false positive.
14:42:46.385 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 00000000000000000011e679fba9fd3078263eaf54bfda6b57ac524685274312 at height 566733
14:42:46.387 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000000d310bbaecfea4a38dd09d5409175b8dc57c0cd83de3ad, len request queue: 26
14:42:46.445 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000000d310bbaecfea4a38dd09d5409175b8dc57c0cd83de3ad at height 566734
14:42:46.445 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 000000000000000000278d38b7012a96f2d95c0e9052e0cd87d291425658b756, len request queue: 25
14:42:46.519 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 000000000000000000278d38b7012a96f2d95c0e9052e0cd87d291425658b756 at height 566735
14:42:46.519 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 00000000000000000009bdfa0baac3f50be056b7b0daa1a5d8b846121df10a55, len request queue: 24
14:42:46.519 [DEBUG] [bitcoin/handleTxMsg] Tx c8779c9fd362f3d386203dcfeb0ec3b2a3e7fc4855c493bf737712074cb58927 from Peer1 had no hits, filter false positive.
14:42:46.577 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 00000000000000000009bdfa0baac3f50be056b7b0daa1a5d8b846121df10a55 at height 566736
14:42:46.577 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000000f3b3d8bbb6e59178c0a7c08e0ee89189b2ff7bc945923, len request queue: 23
14:42:46.642 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000000f3b3d8bbb6e59178c0a7c08e0ee89189b2ff7bc945923 at height 566737
14:42:46.642 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000000723a996c4e39ee95a390b2a7b15a155b2daa7d1321dab, len request queue: 22
14:42:46.722 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000000723a996c4e39ee95a390b2a7b15a155b2daa7d1321dab at height 566738
14:42:46.722 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 000000000000000000253b255985146399b6570a6350c82b6ccbe72630958748, len request queue: 21
14:42:46.790 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 000000000000000000253b255985146399b6570a6350c82b6ccbe72630958748 at height 566739
14:42:46.790 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 00000000000000000012546c6d4dbe82a0ec4014f7680a6a57131de4bd5fcb82, len request queue: 20
14:42:46.791 [DEBUG] [bitcoin/handleTxMsg] Tx e6216ae5f260972e8646561bd7e2bb71978fe47769af0c7e7de418a9f435b84b from Peer1 had no hits, filter false positive.
14:42:46.848 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 00000000000000000012546c6d4dbe82a0ec4014f7680a6a57131de4bd5fcb82 at height 566740
14:42:46.848 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000001c9c35727b650f332b5f7d58f2162092e112f6fd039bc1, len request queue: 19
14:42:46.899 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000001c9c35727b650f332b5f7d58f2162092e112f6fd039bc1 at height 566741
14:42:46.901 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 00000000000000000026f5f976caa01e2a39afb0beffee0f0fddc800a8cc45f9, len request queue: 18
14:42:46.906 [DEBUG] [bitcoin/handleTxMsg] Tx bb24a0e5bf3920a945c7e18beca04cb9d19d7e4a93a4a4dbf286ac8e76979805 from Peer1 had no hits, filter false positive.
14:42:46.946 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 00000000000000000026f5f976caa01e2a39afb0beffee0f0fddc800a8cc45f9 at height 566742
14:42:46.946 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000001f5f3e77047c9b80e64224897095e3d383832733e4e133, len request queue: 17
14:42:47.005 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000001f5f3e77047c9b80e64224897095e3d383832733e4e133 at height 566743
14:42:47.005 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000001e0a7f52d7e548ed2653280992fd200ccca9f5d0d2c169, len request queue: 16
14:42:47.006 [DEBUG] [bitcoin/handleTxMsg] Tx f03dd7cc320447d795b5e6dfa8abb23920f1e44e15661cb95e4909514c878850 from Peer1 had no hits, filter false positive.
14:42:47.023 [DEBUG] [bitcoin/handleTxMsg] Tx b6894066cf1b4c8ce1c8f5f6098965910dfe534c35ec54f1aefce6ee6a0dd116 from Peer1 had no hits, filter false positive.
14:42:47.024 [DEBUG] [bitcoin/handleTxMsg] Tx 50c71f36ea7a2f78451f1119a2b130a1838b0506090a9ba2076a218839731ea9 from Peer1 had no hits, filter false positive.
14:42:47.050 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000001e0a7f52d7e548ed2653280992fd200ccca9f5d0d2c169 at height 566744
14:42:47.050 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 00000000000000000001178dda27d69461acb804b5246269c4e7fbb1ae5033dd, len request queue: 15
14:42:47.053 [DEBUG] [bitcoin/handleTxMsg] Tx 5c816501a8a0d1c1bedf43cf03b17079c6629bfe5abf66d53a550cfbb7ae88c9 from Peer1 had no hits, filter false positive.
14:42:47.053 [DEBUG] [bitcoin/handleTxMsg] Tx 556694e5e2c4dd1b9c94bcf23c032f71024915cf97366c5bf5070a2a0eea852a from Peer1 had no hits, filter false positive.
14:42:47.107 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 00000000000000000001178dda27d69461acb804b5246269c4e7fbb1ae5033dd at height 566745
14:42:47.107 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000000fde4664f235c15f079b604f804dd3fa4feb57e2f08786, len request queue: 14
14:42:47.153 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000000fde4664f235c15f079b604f804dd3fa4feb57e2f08786 at height 566746
14:42:47.153 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 00000000000000000004d0a4335d9a8a2d4238c3bf7a1048336f9b67450314b0, len request queue: 13
14:42:47.184 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 00000000000000000004d0a4335d9a8a2d4238c3bf7a1048336f9b67450314b0 at height 566747
14:42:47.184 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000001ce00b633aaa140abc5973e2928ae1f00e664c4f1a0168, len request queue: 12
14:42:47.243 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000001ce00b633aaa140abc5973e2928ae1f00e664c4f1a0168 at height 566748
14:42:47.243 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000001cc636802c59782795014e2ee9df1d564740f94b3c537f, len request queue: 11
14:42:47.275 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000001cc636802c59782795014e2ee9df1d564740f94b3c537f at height 566749
14:42:47.286 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 00000000000000000027d2d35b18d13e86217a8dfa4bdf10111917291cd5a675, len request queue: 10
14:42:47.371 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 00000000000000000027d2d35b18d13e86217a8dfa4bdf10111917291cd5a675 at height 566750
14:42:47.371 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 000000000000000000132492532f3a2a8081ac764e149d842879a2c46eb78b0e, len request queue: 9
14:42:47.372 [DEBUG] [bitcoin/handleTxMsg] Tx 77a61065e0356631f7089a5704c34a83b8fcad853cd1d0edc83e440e525c000e from Peer1 had no hits, filter false positive.
14:42:47.429 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 000000000000000000132492532f3a2a8081ac764e149d842879a2c46eb78b0e at height 566751
14:42:47.430 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 00000000000000000000c0fe091dc1cb9baee404c523d030cbc9e6ce0e8b6f23, len request queue: 8
14:42:47.431 [DEBUG] [bitcoin/handleTxMsg] Tx a867309edcadbce799589e8f4788df5e49b8ac2d18db74e4bfdb5d6944f44722 from Peer1 had no hits, filter false positive.
14:42:47.488 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 00000000000000000000c0fe091dc1cb9baee404c523d030cbc9e6ce0e8b6f23 at height 566752
14:42:47.488 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 000000000000000000233e44e79fd37eb50a1b3811f09fec8f30194c40931544, len request queue: 7
14:42:47.531 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 000000000000000000233e44e79fd37eb50a1b3811f09fec8f30194c40931544 at height 566753
14:42:47.532 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000002067e2826b83aca9cdcc02884220103515ea121e4f0d9c, len request queue: 6
14:42:47.582 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000002067e2826b83aca9cdcc02884220103515ea121e4f0d9c at height 566754
14:42:47.584 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 00000000000000000013e3a5387b877422984f869d1046c5ac3abcece1881f69, len request queue: 5
14:42:47.639 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 00000000000000000013e3a5387b877422984f869d1046c5ac3abcece1881f69 at height 566755
14:42:47.639 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000002c979b693506377123d75901768bd6a781f51effa8fb3d, len request queue: 4
14:42:47.695 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000002c979b693506377123d75901768bd6a781f51effa8fb3d at height 566756
14:42:47.695 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 00000000000000000022059b0728fb8d29bdd78bb37222b2dddd00bab9c8cc76, len request queue: 3
14:42:47.776 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 00000000000000000022059b0728fb8d29bdd78bb37222b2dddd00bab9c8cc76 at height 566757
14:42:47.776 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 000000000000000000240cb936f93000e5e808044fcf1e6c7c0c83c98a179cd8, len request queue: 2
14:42:47.777 [DEBUG] [bitcoin/handleTxMsg] Tx 319303d5bba097bae5f21e51c40fd774f25239596f6e63700e496d9657790000 from Peer1 had no hits, filter false positive.
14:42:47.849 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 000000000000000000240cb936f93000e5e808044fcf1e6c7c0c83c98a179cd8 at height 566758
14:42:47.849 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 0000000000000000002e553f431493e9387dfacdcd82390b2bacc7c3ad963321, len request queue: 1
14:42:47.902 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 0000000000000000002e553f431493e9387dfacdcd82390b2bacc7c3ad963321 at height 566759
14:42:47.902 [DEBUG] [bitcoin/handleMerkleBlockMsg] Requesting block 000000000000000000132b16efbd0c357520e45a9ae6de25faa9ddb1d133cb21, len request queue: 0
14:42:47.943 [INFO] [bitcoin/handleMerkleBlockMsg] Received merkle block 000000000000000000132b16efbd0c357520e45a9ae6de25faa9ddb1d133cb21 at height 566760
14:43:43.608 [INFO] [bitcoin/Close] Disconnecting from peers and shutting down

==> logs/ipfs.log <==
{"id":71399559,"level":5,"message":"\u003cpeer.ID Qm*n7mPkc\u003e handleGetValue looking into ds","module":"dht","time":"2020-08-18T00:00:29.639648804Z"}

{"id":71399560,"level":5,"message":"\u003cpeer.ID Qm*n7mPkc\u003e handleGetValue looking into ds GOT []","module":"dht","time":"2020-08-18T00:00:29.639698372Z"}

{"id":71399561,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*gNQuYp\u003e'","module":"dht","time":"2020-08-18T00:00:29.639836565Z"}

{"id":71399562,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*MYiYJm\u003e'","module":"dht","time":"2020-08-18T00:00:29.639849832Z"}

{"id":71399563,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*XkJTGL\u003e'","module":"dht","time":"2020-08-18T00:00:29.639860283Z"}

{"id":71399564,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*M92EGQ\u003e'","module":"dht","time":"2020-08-18T00:00:29.639871036Z"}

{"id":71399565,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*RQBCsn\u003e'","module":"dht","time":"2020-08-18T00:00:29.63988593Z"}

{"id":71399566,"level":2,"message":"no addresses on peer being sent!\n\t\t\t\t\t[local:\u003cpeer.ID Qm*n7mPkc\u003e]\n\t\t\t\t\t[sending:\u003cpeer.ID Qm*RQBCsn\u003e]\n\t\t\t\t\t[remote:\u003cpeer.ID Qm*CodEym\u003e]","module":"dht","time":"2020-08-18T00:00:29.639898708Z"}

{"id":71399567,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*rzozsX\u003e'","module":"dht","time":"2020-08-18T00:00:29.639915346Z"}

{"id":71399568,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*W4Ht5X\u003e'","module":"dht","time":"2020-08-18T00:00:29.639925869Z"}

{"id":71399569,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*WJjMkD\u003e'","module":"dht","time":"2020-08-18T00:00:29.639937156Z"}

{"id":71399570,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*7sJmUy\u003e'","module":"dht","time":"2020-08-18T00:00:29.639947486Z"}

{"id":71399571,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*RQHMVd\u003e'","module":"dht","time":"2020-08-18T00:00:29.639960931Z"}

{"id":71399572,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*NSeCNm\u003e'","module":"dht","time":"2020-08-18T00:00:29.639978571Z"}

{"id":71399573,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*JE1WBy\u003e'","module":"dht","time":"2020-08-18T00:00:29.639989326Z"}

{"id":71399574,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*zBiXBf\u003e'","module":"dht","time":"2020-08-18T00:00:29.640011798Z"}

{"id":71399575,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*RYeSkY\u003e'","module":"dht","time":"2020-08-18T00:00:29.640021997Z"}

{"id":71399576,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*N3fzRw\u003e'","module":"dht","time":"2020-08-18T00:00:29.640033271Z"}

{"id":71399577,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*nnWB24\u003e'","module":"dht","time":"2020-08-18T00:00:29.640052109Z"}

{"id":71399578,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*jZwDii\u003e'","module":"dht","time":"2020-08-18T00:00:29.640063196Z"}

{"id":71399579,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*9X2gYZ\u003e'","module":"dht","time":"2020-08-18T00:00:29.640073015Z"}

{"id":71399580,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*panxwG\u003e'","module":"dht","time":"2020-08-18T00:00:29.640083428Z"}

{"id":71399581,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*1hWJC5\u003e'","module":"dht","time":"2020-08-18T00:00:29.640093496Z"}

{"id":71399582,"level":5,"message":"\u003cpeer.ID Qm*n7mPkc\u003e handleGetProviders(\u003cpeer.ID Qm*bCnPWC\u003e, QmZkxFH8pQRNAagTdaGDfGTU65AxmBuhFtgCHup7zs3yGH):  begin","module":"dht","time":"2020-08-18T00:00:29.793297763Z"}

{"id":71399583,"level":5,"message":"\u003cpeer.ID Qm*n7mPkc\u003e handleGetProviders(\u003cpeer.ID Qm*bCnPWC\u003e, QmZkxFH8pQRNAagTdaGDfGTU65AxmBuhFtgCHup7zs3yGH):  have 20 closer peers: [{\u003cpeer.ID Qm*zBiXBf\u003e [/ip4/127.0.0.1/tcp/4001 /ip6/::1/tcp/9005/ws /ip6/::1/tcp/4001 /ip4/177.33.33.100/tcp/10061 /ip4/177.33.33.100/tcp/16332 /ip4/127.0.0.1/tcp/9005/ws /ip4/192.168.0.52/tcp/9005/ws /ip4/192.168.0.52/tcp/4001 /ip4/177.33.33.100/tcp/43123]} {\u003cpeer.ID Qm*JE1WBy\u003e [/ip4/185.141.27.245/tcp/9005/ws /ip4/185.141.27.245/tcp/4001 /ip6/::1/tcp/4001 /ip4/127.0.0.1/tcp/4001 /ip6/::1/tcp/9005/ws /ip6/2a04:dd00:13:3::2/tcp/4001 /ip4/127.0.0.2/tcp/9005/ws /ip4/127.0.0.2/tcp/4001 /ip4/127.0.0.1/tcp/9005/ws /ip6/2a04:dd00:13:3::2/tcp/9005/ws]} {\u003cpeer.ID Qm*7sJmUy\u003e [/ip4/192.168.0.15/tcp/4001 /ip4/10.66.138.132/tcp/4001 /ip4/10.66.138.132/tcp/9005/ws /ip6/::1/tcp/9005/ws /ip6/::1/tcp/4001 /ip4/127.0.0.1/tcp/4001 /ip4/127.0.0.1/tcp/9005/ws /ip4/192.168.0.15/tcp/9005/ws /ip4/37.120.201.119/tcp/10664]} {\u003cpeer.ID Qm*RQHMVd\u003e [/ip6/2003:c8:cf1e:3900:5c95:3a6b:6c9e:f74b/tcp/4001 /ip6/::1/tcp/4001 /ip6/2003:c8:cf1e:3900:5c95:3a6b:6c9e:f74b/tcp/9005/ws /ip4/10.41.0.154/tcp/4001 /ip6/2001:db8:123::1098/tcp/4001 /ip4/51.158.144.32/tcp/4001 /ip4/127.0.0.1/tcp/9005/ws /ip6/2003:c8:cf1e:3900:28af:599a:183c:b180/tcp/9005/ws /ip6/2001:db8:123::1098/tcp/9005/ws /ip4/192.168.178.54/tcp/9005/ws /ip6/::1/tcp/9005/ws /ip4/10.41.0.154/tcp/9005/ws /ip4/192.168.178.54/tcp/4001 /ip6/2003:c8:cf1e:3900:28af:599a:183c:b180/tcp/4001 /ip4/127.0.0.1/tcp/4001]} {\u003cpeer.ID Qm*NSeCNm\u003e [/ip4/192.168.0.174/tcp/4001 /ip4/10.8.0.2/tcp/4001 /ip4/185.82.126.153/tcp/4001 /ip6/::1/tcp/9005/ws /ip4/127.0.0.1/tcp/9005/ws /ip4/10.8.0.2/tcp/9005/ws /ip6/::1/tcp/4001 /ip4/127.0.0.1/tcp/4001 /ip4/192.168.0.174/tcp/9005/ws /ip4/95.158.14.249/tcp/30719 /ip4/95.158.14.249/tcp/29824]} {\u003cpeer.ID Qm*nnWB24\u003e [/ip4/192.168.0.20/tcp/9005/ws /ip6/::1/tcp/4001 /ip4/127.0.0.1/tcp/4001 /ip4/193.32.249.166/tcp/20722 /ip4/192.168.0.20/tcp/4001 /ip4/10.67.104.223/tcp/9005/ws /ip6/::1/tcp/9005/ws /ip4/193.32.249.166/tcp/4001 /ip4/10.67.104.223/tcp/4001 /ip4/127.0.0.1/tcp/9005/ws]} {\u003cpeer.ID Qm*N3fzRw\u003e [/ip4/127.0.0.1/tcp/4001 /ip6/::1/tcp/4001 /ip6/2a02:8070:63ac:5000:6492:839e:3469:374e/tcp/4001 /ip6/2a02:8070:63ac:5000:f9ad:6b7a:e73:d664/tcp/9005/ws /ip4/127.0.0.1/tcp/9005/ws /ip4/192.168.178.23/tcp/4001 /ip4/192.168.178.23/tcp/9005/ws /ip6/::1/tcp/9005/ws /ip6/2a02:8070:63ac:5000:c8a:83d:29df:df32/tcp/9005/ws /ip4/5.56.190.245/tcp/4001 /ip6/2a02:8070:63ac:5000:c8a:83d:29df:df32/tcp/4001 /ip6/2a02:8070:63ac:5000:f9ad:6b7a:e73:d664/tcp/4001 /ip6/2a02:8070:63ac:5000:6492:839e:3469:374e/tcp/9005/ws]} {\u003cpeer.ID Qm*9X2gYZ\u003e [/onion/353e3x2i4rufkm4i:4003]} {\u003cpeer.ID Qm*jZwDii\u003e [/ip4/172.19.0.2/tcp/4001 /ip4/138.68.10.227/tcp/1024 /ip4/172.19.0.2/tcp/9005/ws /ip4/127.0.0.1/tcp/9005/ws /ip4/127.0.0.1/tcp/4001]} {\u003cpeer.ID Qm*RYeSkY\u003e [/ip4/192.168.2.13/tcp/44307 /ip4/127.0.0.1/tcp/4001 /ip6/::1/tcp/4001 /ip6/::1/tcp/9005/ws /ip4/192.168.86.84/tcp/4001 /ip4/127.0.0.1/tcp/9005/ws /ip4/192.168.2.13/tcp/20543 /ip4/192.168.2.13/tcp/18552 /ip4/184.146.205.34/tcp/4001 /ip4/192.168.86.84/tcp/9005/ws]} {\u003cpeer.ID Qm*gpvjBm\u003e [/ip4/67.190.202.191/tcp/4003 /ip4/169.254.112.41/tcp/4003 /ip4/169.254.162.156/tcp/9007/ws /ip4/67.190.202.191/tcp/35084 /ip4/10.0.75.1/tcp/4003 /ip4/192.168.11.113/tcp/9007/ws /ip4/169.254.162.156/tcp/4003 /ip4/169.254.110.157/tcp/4003 /ip6/::1/tcp/9007/ws /ip4/169.254.190.194/tcp/4003 /ip4/192.168.0.249/tcp/4003 /ip4/169.254.190.194/tcp/9007/ws /ip4/192.168.0.249/tcp/9007/ws /ip4/169.254.110.157/tcp/9007/ws /ip4/127.0.0.1/tcp/9007/ws /ip4/67.190.202.191/tcp/46885 /ip4/192.168.11.113/tcp/4003 /ip4/10.0.75.1/tcp/9007/ws /ip4/169.254.112.41/tcp/9007/ws /ip4/127.0.0.1/tcp/4003 /ip6/::1/tcp/4003]} {\u003cpeer.ID Qm*9Ykp61\u003e [/ip6/fd00::1/tcp/9005/ws /ip4/127.0.0.1/tcp/9005/ws /ip4/192.168.1.124/tcp/9005/ws /ip4/84.17.39.198/tcp/4001 /ip4/127.0.0.1/tcp/4001 /ip6/::1/tcp/9005/ws /ip4/10.6.0.40/tcp/4001 /ip4/10.8.1.9/tcp/9005/ws /ip4/192.168.1.124/tcp/4001 /ip4/10.8.1.9/tcp/4001 /ip6/::1/tcp/4001 /ip6/fd00::1/tcp/4001 /ip4/10.6.0.40/tcp/9005/ws]} {\u003cpeer.ID Qm*panxwG\u003e [/ip4/127.0.0.1/tcp/9005/ws /ip6/::1/tcp/9005/ws /ip4/127.0.0.1/tcp/4001 /ip4/192.168.0.211/tcp/9005/ws /ip4/10.2.10.6/tcp/4001 /ip6/::1/tcp/4001 /ip4/10.2.10.6/tcp/9005/ws /ip4/192.168.0.211/tcp/4001 /ip4/199.229.249.149/tcp/4001]} {\u003cpeer.ID Qm*1hWJC5\u003e [/ip4/127.0.0.1/tcp/4801 /ip4/172.18.0.9/tcp/9805/ws /ip4/161.35.176.131/tcp/4801 /ip4/127.0.0.1/tcp/9805/ws /ip4/172.18.0.9/tcp/4801]} {\u003cpeer.ID Qm*32zf3Y\u003e [/ip6/::1/tcp/4001 /ip4/127.0.0.1/tcp/4001 /ip4/192.168.141.121/tcp/9005/ws /ip4/206.123.119.235/tcp/9005/ws /ip4/127.0.0.1/tcp/9005/ws /ip4/206.123.119.234/tcp/4001 /ip4/206.123.119.235/tcp/4001 /ip6/::1/tcp/9005/ws /ip4/206.123.119.234/tcp/9005/ws /ip4/192.168.141.121/tcp/4001 /ip4/206.123.119.234/tcp/42270]} {\u003cpeer.ID Qm*Gdfdaq\u003e [/ip6/fd00:f81d:f6d:e312:5d49:f439:576:cad7/tcp/9005/ws /ip6/fd00:f81d:f6d:e311:5d49:f439:576:cad7/tcp/4001 /ip6/fd00:f81d:f6d:e312:500:e2f6:d14b:1e79/tcp/4001 /ip6/fd00:f81d:f6d:e312:5d49:f439:576:cad7/tcp/4001 /ip6/fd00:f81d:f6d:e311:500:e2f6:d14b:1e79/tcp/4001 /ip6/fd00:f81d:f6d:e311:d50:3e07:9aae:e870/tcp/4001 /ip6/fd00:f81d:f6d:e311:d50:3e07:9aae:e870/tcp/9005/ws /ip4/24.64.92.115/tcp/4001 /ip4/127.0.0.1/tcp/9005/ws /ip6/fd00:f81d:f6d:e311:e100:2332:d347:bcbb/tcp/9005/ws /ip6/fd00:f81d:f6d:e311:e100:2332:d347:bcbb/tcp/4001 /ip4/24.64.92.115/tcp/53483 /ip4/192.168.0.29/tcp/9005/ws /ip4/24.64.92.115/tcp/11742 /ip6/fd00:f81d:f6d:e312:500:e2f6:d14b:1e79/tcp/9005/ws /ip4/192.168.0.29/tcp/4001 /ip4/127.0.0.1/tcp/4001 /ip6/fd00:f81d:f6d:e311:5d49:f439:576:cad7/tcp/9005/ws /ip6/fd00:f81d:f6d:e311:500:e2f6:d14b:1e79/tcp/9005/ws /ip6/::1/tcp/9005/ws /ip6/::1/tcp/4001]} {\u003cpeer.ID Qm*9pM4Hq\u003e [/ip6/2600:8800:5880:480:8d37:927f:3763:ebc8/tcp/4001 /ip4/68.105.142.144/tcp/5780 /ip4/192.168.1.181/tcp/4001 /ip4/169.254.16.125/tcp/4001 /ip6/::1/tcp/9005/ws /ip4/172.17.209.1/tcp/4001 /ip4/169.254.36.50/tcp/4001 /ip4/169.254.16.125/tcp/9005/ws /ip4/169.254.36.50/tcp/9005/ws /ip4/192.168.1.181/tcp/9005/ws /ip4/127.0.0.1/tcp/4001 /ip6/2600:8800:5880:480:8d37:927f:3763:ebc8/tcp/9005/ws /ip4/172.17.209.1/tcp/9005/ws /ip4/192.168.1.90/tcp/4001 /ip4/192.168.1.90/tcp/9005/ws /ip6/2600:8800:5880:480:5541:e3d:dcba:9707/tcp/9005/ws /ip4/127.0.0.1/tcp/9005/ws /ip6/::1/tcp/4001 /ip6/2600:8800:5880:480:5541:e3d:dcba:9707/tcp/4001]} {\u003cpeer.ID Qm*7myXun\u003e [/ip4/45.77.136.131/tcp/4001 /ip6/::1/tcp/9005/ws /ip4/127.0.0.1/tcp/4001 /ip6/::1/tcp/4001 /ip4/127.0.0.1/tcp/9005/ws /ip4/45.77.136.131/tcp/9005/ws]} {\u003cpeer.ID Qm*5zm7jr\u003e [/ip4/172.18.0.11/tcp/4501 /ip4/172.18.0.11/tcp/9505/ws /ip4/161.35.176.131/tcp/4501 /ip4/127.0.0.1/tcp/9505/ws /ip4/127.0.0.1/tcp/4501]} {\u003cpeer.ID Qm*masekt\u003e [/ip4/127.0.0.1/tcp/4001 /ip4/157.230.59.219/tcp/4001 /ip4/172.18.0.2/tcp/4001 /ip4/172.18.0.2/tcp/9005/ws /ip4/127.0.0.1/tcp/9005/ws]}]","module":"dht","time":"2020-08-18T00:00:29.793568577Z"}

{"id":71399584,"level":5,"message":"\u003cpeer.ID Qm*n7mPkc\u003e handleGetProviders(\u003cpeer.ID Qm*bCnPWC\u003e, QmZkxFH8pQRNAagTdaGDfGTU65AxmBuhFtgCHup7zs3yGH):  end","module":"dht","time":"2020-08-18T00:00:29.793864624Z"}

{"id":71399585,"level":5,"message":"\u003cpeer.ID Qm*n7mPkc\u003e handleGetValue for key: /ipns/\u0012 \ufffdҊ\ufffd,\ufffdF\ufffdZM\ufffd-\ufffd\u0013\ufffd\ufffd\ufffd\ufffd\ufffd$0\r\ufffdx\ufffd\ufffdyK|\u001a\t`","module":"dht","time":"2020-08-18T00:00:30.22373031Z"}

{"id":71399586,"level":5,"message":"\u003cpeer.ID Qm*n7mPkc\u003e handleGetValue looking into ds","module":"dht","time":"2020-08-18T00:00:30.223798285Z"}

{"id":71399587,"level":5,"message":"\u003cpeer.ID Qm*n7mPkc\u003e handleGetValue looking into ds GOT []","module":"dht","time":"2020-08-18T00:00:30.223867027Z"}

{"id":71399588,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*rzozsX\u003e'","module":"dht","time":"2020-08-18T00:00:30.224024206Z"}

{"id":71399589,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*W4Ht5X\u003e'","module":"dht","time":"2020-08-18T00:00:30.224038285Z"}

{"id":71399590,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*WJjMkD\u003e'","module":"dht","time":"2020-08-18T00:00:30.224050074Z"}

{"id":71399591,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*M92EGQ\u003e'","module":"dht","time":"2020-08-18T00:00:30.224060312Z"}

{"id":71399592,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*RQBCsn\u003e'","module":"dht","time":"2020-08-18T00:00:30.22407406Z"}

{"id":71399593,"level":2,"message":"no addresses on peer being sent!\n\t\t\t\t\t[local:\u003cpeer.ID Qm*n7mPkc\u003e]\n\t\t\t\t\t[sending:\u003cpeer.ID Qm*RQBCsn\u003e]\n\t\t\t\t\t[remote:\u003cpeer.ID Qm*gdXEfZ\u003e]","module":"dht","time":"2020-08-18T00:00:30.224088634Z"}

{"id":71399594,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*gNQuYp\u003e'","module":"dht","time":"2020-08-18T00:00:30.22410541Z"}

{"id":71399595,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*MYiYJm\u003e'","module":"dht","time":"2020-08-18T00:00:30.224115371Z"}

{"id":71399596,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*XkJTGL\u003e'","module":"dht","time":"2020-08-18T00:00:30.224125261Z"}

{"id":71399597,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*jZwDii\u003e'","module":"dht","time":"2020-08-18T00:00:30.224135167Z"}

{"id":71399598,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*9X2gYZ\u003e'","module":"dht","time":"2020-08-18T00:00:30.224145541Z"}

{"id":71399599,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*N3fzRw\u003e'","module":"dht","time":"2020-08-18T00:00:30.224162631Z"}

{"id":71399600,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*nnWB24\u003e'","module":"dht","time":"2020-08-18T00:00:30.224174254Z"}

{"id":71399601,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*RYeSkY\u003e'","module":"dht","time":"2020-08-18T00:00:30.224199811Z"}

{"id":71399602,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*JE1WBy\u003e'","module":"dht","time":"2020-08-18T00:00:30.224210182Z"}

{"id":71399603,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*zBiXBf\u003e'","module":"dht","time":"2020-08-18T00:00:30.224221814Z"}

{"id":71399604,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*RQHMVd\u003e'","module":"dht","time":"2020-08-18T00:00:30.224249257Z"}

{"id":71399605,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*NSeCNm\u003e'","module":"dht","time":"2020-08-18T00:00:30.224260257Z"}

{"id":71399606,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*7sJmUy\u003e'","module":"dht","time":"2020-08-18T00:00:30.22427301Z"}

{"id":71399607,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*7myXun\u003e'","module":"dht","time":"2020-08-18T00:00:30.22428337Z"}

{"id":71399608,"level":5,"message":"handleGetValue returning closer peer: '\u003cpeer.ID Qm*Gdfdaq\u003e'","module":"dht","time":"2020-08-18T00:00:30.224293046Z"}


==> logs/ob.log <==
2020-08-17 22:23:36.304 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940228: 0000000001f13f83cc800e5835eaf7c3bcd726b22492bfda10f2d12bf596eff0
2020-08-17 22:23:56.911 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940229: 0000000002aba83836736fe0204984b8f637188a288a8fb5637e08bb6c8b52f3
2020-08-17 22:25:25.214 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940230: 00000000010a538ef12b33e50b1ad53db5f71a95b652c053094fda5f32ae7f6d
2020-08-17 22:26:36.761 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940231: 0000000001cbd050c588f5d8c6af59e9e2a7eb89db669fe2f79380bba971411e
2020-08-17 22:27:26.494 [DEBUG] [recordAgingNotifier/PerformTask] notifications created/records updated: purchaseExpire: 0/0, dispute: 0/0, sales: 0/0, purchaseTimeout: 0/0
2020-08-17 22:27:40.730 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940232: 0000000001f378fcf33d416757a889633045c4e176f5db8eaac0dbd24833eee2
2020-08-17 22:28:33.124 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940233: 000000000098ededb420ecd5f226d852a7bf7786697416ec96174950e877303a
2020-08-17 22:28:50.403 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940234: 00000000006efb0983fb6bc6c0050f6c605a32e5e5ebd2dc91588235bb4bb4d8
2020-08-17 22:36:30.462 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940235: 00000000017b8fcb260ebd6b627c367c5e04716b384cc7dd10e6e3391d740ee9
2020-08-17 22:37:26.197 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940236: 0000000000d83553375aa0723260800215559ec8d9c18cb141c024166af75054
2020-08-17 22:37:26.494 [DEBUG] [recordAgingNotifier/PerformTask] notifications created/records updated: sales: 0/0, purchaseTimeout: 0/0, purchaseExpire: 0/0, dispute: 0/0
2020-08-17 22:40:33.411 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940237: 00000000001d4508a5bc41057d1f154134adf5175dd7f3570288e55e014ccd89
2020-08-17 22:40:40.884 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940238: 000000000158c67f2c734119e7f9d0027b5f2d25e734154f02a80f3f62890fed
2020-08-17 22:42:20.934 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940239: 0000000002217ad483532433349d782174a150364f8479dab42047e9c6c72c03
2020-08-17 22:43:13.210 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940240: 0000000001f7262c0a5b5d926bd091370311db8fcc0fae540690a4e526a7dba7
2020-08-17 22:47:26.494 [DEBUG] [recordAgingNotifier/PerformTask] notifications created/records updated: sales: 0/0, purchaseTimeout: 0/0, purchaseExpire: 0/0, dispute: 0/0
2020-08-17 22:48:07.707 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940241: 0000000001f66b064a11cda1e67eb7147cedf8ebc92dd9687014aaa931ee8bdc
2020-08-17 22:48:16.795 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940242: 0000000001d475d775da7e3a1a60ce5c6b5c443e223dcf6f770da73a8dabbba5
2020-08-17 22:49:57.422 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940243: 0000000000e60654958de1d6a73a49d26fb6e269b80e81318d030bf749f37032
2020-08-17 22:50:21.029 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940244: 000000000034bffca99c1cb2c8d6a4dee71b76ad4678364b94ffa688e2830b19
2020-08-17 22:50:48.337 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940245: 00000000001718ca971b5bffb9b633566792e25cee11e921bf0e9333b3716792
2020-08-17 22:51:10.529 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940246: 00000000029c3f38a849da38b7989e4c89e8c32542b0ad818dbe4310f36b01d0
2020-08-17 22:51:21.660 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940247: 0000000000d894b70a7386dfab762bd2a9d15f69e3072ad0ea9dfe74c9b352b2
2020-08-17 22:54:16.428 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940248: 000000000223f47c74317d3e49e4c8588db2ca26dbd039d6a5437a8f6d4a14a9
2020-08-17 22:57:02.878 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940249: 000000000134ae16fbfa12a7495ada2c73eeb0f3060286e4874c40cc996a1b97
2020-08-17 22:57:26.502 [DEBUG] [recordAgingNotifier/PerformTask] notifications created/records updated: sales: 0/0, purchaseTimeout: 0/0, purchaseExpire: 0/0, dispute: 0/0
2020-08-17 22:58:12.574 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940250: 00000000027ebe57d656eb6fb6e1645ed289b604e93ab892ac597aae5bf571b5
2020-08-17 22:58:47.504 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940251: 00000000015e5a0d69dd5ad0c1a1264f6896af9e630efce93a8ed10a79db8304
2020-08-17 22:58:52.248 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940252: 0000000001b6ec9174a425baa25162bacf9beb475641be64128196e6eb2fc909
2020-08-17 22:59:13.592 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940253: 0000000001d40d022f4a8328ec4a366c47ff711b17ca4b04e84df9e173b263a8
2020-08-17 23:00:10.643 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940254: 000000000006f18b1a925a68b4dac61d042cc52923569097b665b497604ca13d
2020-08-17 23:02:06.354 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940255: 000000000126f7392ac4fb566e3c79b4007bb5c1fc317d4a0d1002e116a17e51
2020-08-17 23:02:14.447 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940256: 000000000207ded016e64337e8ee98be6befe4c592759f4d3708023a97016a86
2020-08-17 23:03:15.119 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940257: 00000000015d2edaaaa46bc61ef769698a1d54f4ba131a93e6b03825f7f42bc0
2020-08-17 23:04:00.468 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940258: 0000000001a416b2d2ab97571b2fc1c39f6c9dea8a3104d6ca5efad56ed523c2
2020-08-17 23:04:47.783 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940259: 0000000000fb7b20b4dde5fd1b20ff5a0d94c81257197d6f18d827104af06fc8
2020-08-17 23:05:09.227 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940260: 0000000000c00060f1625d9a8b4db25342e109e03997d2d2b1d4d7d4394bfa4b
2020-08-17 23:06:50.690 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940261: 00000000020455a45447beef161fb6a06b6796ec349e5374233ab485d6a88769
2020-08-17 23:07:26.494 [DEBUG] [recordAgingNotifier/PerformTask] notifications created/records updated: sales: 0/0, purchaseTimeout: 0/0, purchaseExpire: 0/0, dispute: 0/0
2020-08-17 23:07:27.967 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940262: 00000000026f940679aeb23d78738972494235a2f3b6ff6ccd04ca66339430f3
2020-08-17 23:08:00.220 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940263: 0000000001211474d23445ac3bca3776e684a3bf9c88bf066ff20e5b3c549d5e
2020-08-17 23:11:54.702 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940264: 0000000001cfa6872ee3f484f4274614db82700398ab7d9ced1df5efeada2a1f
2020-08-17 23:15:01.039 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940265: 000000000065c9984a1754a08d30d388ce0e5a22e844d4e98673f2d161172b15
2020-08-17 23:15:39.355 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940266: 0000000001d4e9a9a00855cb611b05a8bda521ea5bf30cb7463cc1c08bd3a324
2020-08-17 23:15:51.718 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940267: 000000000177e0506935a8f29c8aece1b2b859c38e33704f010d7706b1b80c38
2020-08-17 23:17:00.811 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940268: 0000000000b5a9428c1074dd699a5a6410baf6c817d906f34287129f3e981326
2020-08-17 23:17:26.543 [DEBUG] [recordAgingNotifier/PerformTask] notifications created/records updated: sales: 0/0, purchaseTimeout: 0/0, purchaseExpire: 0/0, dispute: 0/0
2020-08-17 23:18:04.253 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940269: 0000000000628c922de94fa461991e6e395b5d3ed7371f38a9401f8a4ef151cd
2020-08-17 23:18:24.030 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940270: 0000000001a7e90ff0c343f29482f763e3b04f36fb15b53b5eb675a643832852
2020-08-17 23:18:28.678 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940271: 0000000001784528d5e71e4baf577833b0d2b9850ff131fb00e69f2d66094245
2020-08-17 23:19:41.063 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940272: 0000000001c95d2cbe00516a83a5e8a87b044a08f84717dd2e66f354cd95df93
2020-08-17 23:20:00.973 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940273: 00000000016a21fa0adb99d242d56bed609e30734d69940fea20b1067d5dbb26
2020-08-17 23:21:27.217 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940274: 00000000014eaea7ce2a49ec9c981fcc3952a3ecb5fbaa0f496cb72a6e46276e
2020-08-17 23:21:53.637 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940275: 0000000000b852dfa97d87578229fccb219f5ee8f72cf866319edfc4ddd91398
2020-08-17 23:22:13.128 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940276: 00000000011912f5bba4e6f0460a77571445866e892cac8ba3bfdf3e537ce5df
2020-08-17 23:23:03.087 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940277: 0000000000b7c638d13e7ed674d8a2b52f6c2fec2fc15948823d3d7b0bf41569
2020-08-17 23:23:55.076 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940278: 0000000001016b8e535c946a47c3d37c3812abf05402ca77f4205a6adb56a2c0
2020-08-17 23:24:58.039 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940279: 000000000028a408c2a47e7b70debbc64bf41fa17a3b07357953b2134826aba8
2020-08-17 23:27:16.793 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940280: 00000000004b5072c39a556944594a67ac1d4986f4765409eb4d702d5ca9998c
2020-08-17 23:27:26.495 [DEBUG] [recordAgingNotifier/PerformTask] notifications created/records updated: dispute: 0/0, sales: 0/0, purchaseTimeout: 0/0, purchaseExpire: 0/0
2020-08-17 23:27:43.157 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940281: 0000000000d95cc772050b50aeb2325e7997a1e12292e205606e83161fcd1e1b
2020-08-17 23:28:28.477 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940282: 000000000214ed900527cbd72b83a1dff80c5c1c4d37bf86e261f31ad240df43
2020-08-17 23:29:19.774 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940283: 0000000000a3d17044bc36b3cd5a1244b4b4de4cb2fe849d523b3c9142d78ab8
2020-08-17 23:33:22.116 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940284: 0000000001d08d2874b6067579b4643be4eac23cd8b94b9a4810c5264631d562
2020-08-17 23:34:37.468 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940285: 00000000004de1d87448d80e57d2c06c077f8d2e6524806f457a64ba62735c94
2020-08-17 23:37:26.494 [DEBUG] [recordAgingNotifier/PerformTask] notifications created/records updated: dispute: 0/0, sales: 0/0, purchaseTimeout: 0/0, purchaseExpire: 0/0
2020-08-17 23:37:41.952 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940286: 000000000048720ab814c6116b1529d019f6bd44434d556a9f495cd23eff75ff
2020-08-17 23:38:07.717 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940287: 0000000000ea2a4233b82abc66b22ba82607cd9ffb72253c5344ae4f096e91f4
2020-08-17 23:41:01.139 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 0: 
2020-08-17 23:41:01.139 [WARNING] [WalletService/processIncomingBlock] Zcash chain reorg detected: rescanning wallet
2020-08-17 23:41:01.139 [DEBUG] [WalletService/UpdateState] updating Zcash chain state
2020-08-17 23:41:01.139 [DEBUG] [pool/func1] (https://zec.blockbook.api.openbazaar.org/api) request best block info
2020-08-17 23:41:01.180 [DEBUG] [WalletService/UpdateState] Zcash chain height: 940288
2020-08-17 23:41:01.183 [DEBUG] [WalletService/syncTxs] querying for Zcash transactions
2020-08-17 23:41:01.183 [DEBUG] [WalletService/syncUtxos] querying for Zcash utxos
2020-08-17 23:41:01.184 [DEBUG] [pool/func1] (https://zec.blockbook.api.openbazaar.org/api) request transactions for (40) addrs
2020-08-17 23:41:01.184 [DEBUG] [pool/func1] 	addrs requested: t1h9x9tecVUJFiAreCV4G43XiERFHYrRKgi,t1T1THZhfTRfeBUrqmG9gfr5jELhHWAfQtv,t1NjGwihFDmwtoqmGTWc8fVXheEZbwMovhi,t1Zp7d3H6wJuyS7ZTCzHCUgiPSBHonihm7j,t1UFJnA43Q5oAmCj9NmqJfxFn8s9yMKLqjS,t1J83VTCvs5Y4TqAN8xCDv523oJ6qXivHzV,t1Mri3xE2nkAqoDjK1egwcnmD4hgu1pgfMY,t1bA3o7Giv7dAyEiRe8W96YfD8SZiQd1u69,t1JmXwsSH3Nx9YaWXswKidApBDcGp9TnhtQ,t1Wu6oYwNTBRxjvSnpva5dzHv2tSAFX1sUy,t1KBDdJz73WStyE561ggSM94WequbqZbLXp,t1L3wyVtA61X8jTecRV3RbA3mG5unpeZjVe,t1Tkgd1mtpe22TKfx5bQRWQzSH4vdJDeUBV,t1PNT6nci6y7YkdYQn4eMQGsAGSqhA6Y2G7,t1gghURU4tKpjHyNZDWmzMkR8h7FEd6uAZ4,t1dceao1spctcWfEt3Pdfx7KV9rxPaVsdmZ,t1X7VndMkmBVDqZz12EWfMP4jm8sJrYcbV2,t1J4DxphQ8DBeWZQgWHh9s1L7PMzpSSsren,t1cT9XxsXUgMUswVYj7EQg2EXYk3YoNuGsg,t1WXaP9V3Ajxhb5v2Xa6g2wYN4ztvn6GDdW,t1T8UMbRxb8zC9EeQZewB87bHMQCxKqb3SM,t1Nb7inUpkoZKb9bzC1iWt5AdciuQyGDy8k,t1UDCGnyrEUSRHuzCytg4dEQBBGXKuVE6u9,t1QtupmqGdbCsG8mq7cKpXJRoPmPFA13npv,t1VnxKKqmu3kdLvDNUQ9hpv7grr9vWyowdS,t1YrovBRXUswd82RPyyrGrHLLxe8bDqw19D,t1fdz9dCjULL6zGceMpvW4VfS4fWTvZZB1v,t1cCG8XMroWbmQJame8mD3BMsDqM5QVUW35,t1eCnS3YNUhN6XxxLEPbGMvjC8J8ifGdMsT,t1UbfGNByrh9udeAVBvLMEE3iVDS4BaninT,t1R6wNqhUyDMSZdzox25KSoYJ2ysNTrFffs,t1h66hYLTAp1PPwyGw9sC6zdmKNt8VfuERQ,t1h8bTGzh1VT7eL868sJqn7nqLZBLafkh7H,t1b38ripJ68UbBnAe2gpa1htkkxo5Xcohok,t1LqP74e3RnwrBXxzrLsX5cR4KvDGp9aVP1,t1YQ8uCTsDPBUDMThJuzMFBKve1cYgKMJGX,t1XkogAXoPxKi3oU8ejhc1b88tz14PLX3L2,t1bFrGXCtZ9owfmEvjy9uX85oMZjQqh7g2w,t1eyqhJZVt8sqTJUXLdi3eav397MEesrSe2,t1JDCZLAzRk3LV4G9PcKk2urJK8eBb1ZJ87
2020-08-17 23:41:01.184 [DEBUG] [pool/func1] (https://zec.blockbook.api.openbazaar.org/api) request utxos for (40) addrs
2020-08-17 23:41:01.184 [DEBUG] [pool/func1] 	addrs requested: t1R6wNqhUyDMSZdzox25KSoYJ2ysNTrFffs,t1h66hYLTAp1PPwyGw9sC6zdmKNt8VfuERQ,t1h8bTGzh1VT7eL868sJqn7nqLZBLafkh7H,t1eCnS3YNUhN6XxxLEPbGMvjC8J8ifGdMsT,t1UbfGNByrh9udeAVBvLMEE3iVDS4BaninT,t1LqP74e3RnwrBXxzrLsX5cR4KvDGp9aVP1,t1YQ8uCTsDPBUDMThJuzMFBKve1cYgKMJGX,t1b38ripJ68UbBnAe2gpa1htkkxo5Xcohok,t1bFrGXCtZ9owfmEvjy9uX85oMZjQqh7g2w,t1eyqhJZVt8sqTJUXLdi3eav397MEesrSe2,t1JDCZLAzRk3LV4G9PcKk2urJK8eBb1ZJ87,t1XkogAXoPxKi3oU8ejhc1b88tz14PLX3L2,t1J83VTCvs5Y4TqAN8xCDv523oJ6qXivHzV,t1Mri3xE2nkAqoDjK1egwcnmD4hgu1pgfMY,t1bA3o7Giv7dAyEiRe8W96YfD8SZiQd1u69,t1h9x9tecVUJFiAreCV4G43XiERFHYrRKgi,t1T1THZhfTRfeBUrqmG9gfr5jELhHWAfQtv,t1NjGwihFDmwtoqmGTWc8fVXheEZbwMovhi,t1Zp7d3H6wJuyS7ZTCzHCUgiPSBHonihm7j,t1UFJnA43Q5oAmCj9NmqJfxFn8s9yMKLqjS,t1JmXwsSH3Nx9YaWXswKidApBDcGp9TnhtQ,t1KBDdJz73WStyE561ggSM94WequbqZbLXp,t1L3wyVtA61X8jTecRV3RbA3mG5unpeZjVe,t1Wu6oYwNTBRxjvSnpva5dzHv2tSAFX1sUy,t1PNT6nci6y7YkdYQn4eMQGsAGSqhA6Y2G7,t1gghURU4tKpjHyNZDWmzMkR8h7FEd6uAZ4,t1dceao1spctcWfEt3Pdfx7KV9rxPaVsdmZ,t1Tkgd1mtpe22TKfx5bQRWQzSH4vdJDeUBV,t1Nb7inUpkoZKb9bzC1iWt5AdciuQyGDy8k,t1UDCGnyrEUSRHuzCytg4dEQBBGXKuVE6u9,t1QtupmqGdbCsG8mq7cKpXJRoPmPFA13npv,t1X7VndMkmBVDqZz12EWfMP4jm8sJrYcbV2,t1J4DxphQ8DBeWZQgWHh9s1L7PMzpSSsren,t1cT9XxsXUgMUswVYj7EQg2EXYk3YoNuGsg,t1WXaP9V3Ajxhb5v2Xa6g2wYN4ztvn6GDdW,t1T8UMbRxb8zC9EeQZewB87bHMQCxKqb3SM,t1YrovBRXUswd82RPyyrGrHLLxe8bDqw19D,t1fdz9dCjULL6zGceMpvW4VfS4fWTvZZB1v,t1cCG8XMroWbmQJame8mD3BMsDqM5QVUW35,t1VnxKKqmu3kdLvDNUQ9hpv7grr9vWyowdS
2020-08-17 23:41:01.498 [DEBUG] [WalletService/syncTxs] downloaded 0 Zcash transactions
2020-08-17 23:41:01.732 [DEBUG] [WalletService/syncUtxos] downloaded 0 Zcash utxos
2020-08-17 23:42:41.853 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940289: 00000000017f1d9c08e866f6973e82c370a84c8d7e7fc034a3894a307e904ed1
2020-08-17 23:43:02.771 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940290: 0000000000817c6c537d0b4056208569e024ddc371495503b95ade68f1f1f06d
2020-08-17 23:44:59.182 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940291: 000000000003ec190689ad19dd6beddfd21463f807ef67f3e09256ed4b597e25
2020-08-17 23:45:08.487 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940292: 000000000015ec7b045010a02d2bffb97dad45b776154238d2ae1c206b707e94
2020-08-17 23:46:41.208 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940293: 000000000125ed1887cb5e54c1ce596f7ce3a236800a37210cc52cb48b54fadb
2020-08-17 23:47:26.495 [DEBUG] [recordAgingNotifier/PerformTask] notifications created/records updated: sales: 0/0, purchaseTimeout: 0/0, purchaseExpire: 0/0, dispute: 0/0
2020-08-17 23:49:07.942 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940294: 0000000002679f3e22240b7235961d45b95324ded380426a5264bf30e41b72f4
2020-08-17 23:51:05.576 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940295: 0000000000a23ad71b1846f4e259e8fde654f98f714590f78a6fc2352bcd82b8
2020-08-17 23:51:35.124 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940296: 0000000002181585cb46405dff4f33042a0d845343301c6682342df04d0df8f4
2020-08-17 23:52:15.293 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940297: 00000000013674731d297e98128a72f645c329c5eba634f0a74f04f6fb5be82b
2020-08-17 23:53:10.092 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940298: 00000000011e57ea08c483fbb89829164a24a3eea4bc0373d0952f608fd6333f
2020-08-17 23:57:26.502 [DEBUG] [recordAgingNotifier/PerformTask] notifications created/records updated: purchaseTimeout: 0/0, purchaseExpire: 0/0, dispute: 0/0, sales: 0/0
2020-08-17 23:58:43.032 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940299: 0000000000d410e222d365784d0f005c6439599018261043bc2c05a4b10ed10e
2020-08-17 23:59:05.792 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940300: 00000000003be07d2d4f14325464cdd363552fcd5681f249d8f36f7621bef9aa
2020-08-17 23:59:07.707 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940301: 00000000020ef15b8bc6cc5d9004b43c3365b85dcd47d837b13cd71fd6cb8976
2020-08-17 23:59:23.364 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940302: 00000000026f75e6904a0c46e9b72790c47f6484a8b77412e3bf5291c6bb9780
2020-08-18 00:00:15.450 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940303: 000000000207031b574b0f782d09d998eb092dec93d74e1f444565e7544ebb75
2020-08-18 00:00:20.395 [INFO] [WalletService/processIncomingBlock] received new Zcash block at height 940304: 0000000001a5699532cf80a13c7eae66c77114cd00ee85ae8d98abcf0bb1c69d
2020-08-18 00:00:30.234 [CRITICAL] [client/setupListeners] error after retrying: websocket reconnection timeout (btc.blockbook.api.openbazaar.org)

@szollo
Copy link
Member

szollo commented Aug 18, 2020

Thanks for the logs @jlopp.

As we're not seeing this behaviour on the Dockerised builds of the same version I can only conclude there's an build discrepancy between our Docker images and our binaries. I'm testing this theory now and running the binary the same way you're doing, rather than the Dockerised version of it.

In order to fix this now, you might be better off using our Docker images (docker run -it -v $current_ob_dir:/var/lib/store openbazaar/server:v0.14.3 start -d /var/lib/store, if you want to continue running your current version, where $current_ob_dir is where your current OB data directory is and /var/lib/store is the directory mounted on the container).

In the meantime I'm keeping this open as we figure out what the issue is with the binaries and how to fix it.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
BlockBook bug multiwallet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@hoffmabc @jlopp @szollo