-
Notifications
You must be signed in to change notification settings - Fork 562
Closed
Labels
bugtype bugtype bug
Description
Search before asking
- I had searched in the issues and found no similar issues.
Version
We were running on test with 2.12.1
+ #3047 + #3061
E20250803 09:11:53.714233 139623546201664 redis_connection.cc:110] [connection] Going to remove the client: 127.0.0.1:54549, while encounter error: Connection reset by peer, SSL Error: error:00000000:lib(0)::reason(0)
E20250803 10:30:12.468891 139623504238144 replication.cc:180] Fatal error encountered, WAL iterator is discrete, some seq might be lost, sequence 465907582 expected, but got 465925769
E20250803 12:20:12.239719 139623243707968 replication.cc:180] Fatal error encountered, WAL iterator is discrete, some seq might be lost, sequence 496763511 expected, but got 496771469
E20250803 13:20:12.841936 139623243707968 replication.cc:180] Fatal error encountered, WAL iterator is discrete, some seq might be lost, sequence 514094241 expected, but got 514102200
E20250803 14:20:12.635324 139623243707968 replication.cc:180] Fatal error encountered, WAL iterator is discrete, some seq might be lost, sequence 531497261 expected, but got 531506354
E20250803 15:00:12.795350 139623504238144 replication.cc:180] Fatal error encountered, WAL iterator is discrete, some seq might be lost, sequence 542936338 expected, but got 542953399
E20250803 15:00:48.842797 139623678342720 redis_connection.cc:110] [connection] Going to remove the client: 10.14.24.143:19425, while encounter error: Connection reset by peer, SSL Error: error:00000000:lib(0)::reason(0)
E20250803 15:00:48.846916 139623726577216 redis_connection.cc:110] [connection] Going to remove the client: 10.14.24.143:19441, while encounter error: Connection reset by peer, SSL Error: error:00000000:lib(0)::reason(0)
E20250803 15:00:48.848751 139623678342720 redis_connection.cc:110] [connection] Going to remove the client: 10.14.24.143:19497, while encounter error: Connection reset by peer, SSL Error: error:00000000:lib(0)::reason(0)
E20250803 15:00:48.849250 139623640593984 redis_connection.cc:110] [connection] Going to remove the client: 10.14.24.143:19509, while encounter error: Connection reset by peer, SSL Error: error:00000000:lib(0)::reason(0)
E20250803 15:00:48.849287 139623537808960 redis_connection.cc:110] [connection] Going to remove the client: 10.14.24.143:19491, while encounter error: Connection reset by peer, SSL Error: error:00000000:lib(0)::reason(0)
E20250803 15:00:48.849267 139623690917440 redis_connection.cc:110] [connection] Going to remove the client: 10.14.24.143:19477, while encounter error: Connection reset by peer, SSL Error: error:00000000:lib(0)::reason(0)
E20250803 15:00:48.849365 139623690917440 redis_connection.cc:110] [connection] Going to remove the client: 10.14.24.143:19431, while encounter error: Connection reset by peer, SSL Error: error:00000000:lib(0)::reason(0)
E20250803 15:00:48.849389 139623690917440 redis_connection.cc:110] [connection] Going to remove the client: 10.14.24.143:19453, while encounter error: Connection reset by peer, SSL Error: error:00000000:lib(0)::reason(0)
E20250803 15:00:48.850467 139623546201664 redis_connection.cc:110] [connection] Going to remove the client: 10.14.24.143:19817, while encounter error: Connection reset by peer, SSL Error: error:00000000:lib(0)::reason(0)
E20250803 15:00:48.850498 139623554594368 redis_connection.cc:110] [connection] Going to remove the client: 10.14.24.143:19463, while encounter error: Connection reset by peer, SSL Error: error:00000000:lib(0)::reason(0)
E20250803 15:00:48.851300 139623640593984 redis_connection.cc:110] [connection] Going to remove the client: 10.14.24.143:19519, while encounter error: Connection reset by peer, SSL Error: error:00000000:lib(0)::reason(0)
E20250803 15:00:48.852291 139623554594368 redis_connection.cc:110] [connection] Going to remove the client: 10.14.24.143:19511, while encounter error: Connection reset by peer, SSL Error: error:00000000:lib(0)::reason(0)
E20250803 15:00:48.854088 139623632201280 redis_connection.cc:110] [connection] Going to remove the client: 10.14.24.143:19561, while encounter error: Connection reset by peer, SSL Error: error:00000000:lib(0)::reason(0)
E20250803 15:00:48.854109 139623690917440 redis_connection.cc:110] [connection] Going to remove the client: 10.14.24.143:19479, while encounter error: Connection reset by peer, SSL Error: error:00000000:lib(0)::reason(0)
E20250803 15:00:48.854556 139623537808960 redis_connection.cc:110] [connection] Going to remove the client: 10.14.24.143:19555, while encounter error: Connection reset by peer, SSL Error: error:00000000:lib(0)::reason(0)
E20250803 15:00:48.854608 139623678342720 redis_connection.cc:110] [connection] Going to remove the client: 10.14.24.143:19529, while encounter error: Connection reset by peer, SSL Error: error:00000000:lib(0)::reason(0)
E20250803 15:00:48.854673 139623678342720 signal_util.h:33] Ooops! Apache Kvrocks version 2.12.1 (commit 034f1c9c) got signal: Segmentation fault (11)
E20250803 15:00:49.486161 139623678342720 signal_util.h:35] Stack trace (most recent call first):
#0 0x0000562b57c640b0 in SegvHandler at /root/kvrocks/kvrocks/build/kvrocks
#1 0x00007efcb41b151f in __sigaction at /lib/x86_64-linux-gnu/libc.so.6
#2 0x0000562b586912c5 in evbuffer_add at /root/kvrocks/kvrocks/build/kvrocks
#3 0x0000562b57f4fe2a in FeedSlaveThread::readCallback(bufferevent*, void*) [clone .constprop.0] at /root/kvrocks/kvrocks/build/kvrocks
#4 0x0000562b5869acc1 in bufferevent_run_deferred_callbacks_unlocked at bufferevent.c
#5 0x0000562b586a32c3 in event_process_active_single_queue at event.c
#6 0x0000562b586a39be in event_process_active at event.c
#7 0x0000562b586a582f in event_base_loop.constprop.0 at event.c
#8 0x0000562b57eaadcd in std::thread::_State_impl<std::thread::_Invoker<std::tuple<util::CreateThread<WorkerThread::Start()::{lambda()#1}>(char const*, WorkerThread::Start()::{lambda()#1})::{lambda()#1}> > >::_M_run() at /root/kvrocks/kvrocks/build/kvrocks
#9 0x0000562b588bbe03 in execute_native_thread_routine at thread.o
#10 0x00007efcb4203ac2 in pthread_condattr_setpshared at /lib/x86_64-linux-gnu/libc.so.6
#11 0x00007efcb429584f in __xmknodat at /lib/x86_64-linux-gnu/libc.so.6
E20250803 15:00:49.486265 139623678342720 signal_util.h:36] It would be greatly appreciated if you could submit this crash to https://github.com/apache/kvrocks/issues along with the stacktrace above, logs and any relevant information.
Segmentation fault
I will debug this.
Minimal reproduce step
call SET+WAIT
continuously for a long time like 6 hours
What did you expect to see?
no segfault
What did you see instead?
segfault
Anything Else?
No response
Are you willing to submit a PR?
- I'm willing to submit a PR!
Metadata
Metadata
Assignees
Labels
bugtype bugtype bug