Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](write)revert comparePostings due to write core #195

Merged
merged 1 commit into from
Mar 7, 2024

Conversation

qidaye
Copy link
Contributor

@qidaye qidaye commented Mar 7, 2024

revert #156
core stack trace

I0000 00:00:00.000000 3433156 vlog_is_on.cc:197] RAW: Set VLOG level for "*" to 10
*** Query id: 0-0 ***
*** tablet id: 0 ***
*** Aborted at 1708977071 (unix time) try "date -d @1708977071" if you are using GNU date ***
*** Current BE git commitID: 003a815b63 ***
*** SIGSEGV unknown detail explain (@0x0) received by PID 3433156 (TID 2446483 OR 0x7f0e53c8b640) from PID 0; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zcp/repo_center/doris_release/doris/be/src/common/signal_handler.h:417
 1# os::Linux::chained_handler(int, siginfo*, void*) in /app/java/jdk/jre/lib/amd64/server/libjvm.so
 2# JVM_handle_linux_signal in /app/java/jdk/jre/lib/amd64/server/libjvm.so
 3# signalHandler(int, siginfo*, void*) in /app/java/jdk/jre/lib/amd64/server/libjvm.so
 4# 0x00007F4667BB0520 in /lib/x86_64-linux-gnu/libc.so.6
 5# lucene::index::SDocumentsWriter<char>::ThreadState::quickSort(lucene::index::SDocumentsWriter<char>::Posting**, int, int) at /home/zcp/repo_center/doris_release/doris/be/src/clucene/src/core/CLucene/index/SDocumentWriter.cpp:771
 6# lucene::index::SDocumentsWriter<char>::ThreadState::FieldData::sortPostings() at /home/zcp/repo_center/doris_release/doris/be/src/clucene/src/core/CLucene/index/SDocumentWriter.h:289
 7# lucene::index::SDocumentsWriter<char>::appendPostings(lucene::util::ArrayBase<lucene::index::SDocumentsWriter<char>::ThreadState::FieldData*>*, lucene::index::STermInfosWriter<char>*, lucene::store::IndexOutput*, lucene::store::IndexOutput*) in /app/doris/doris/be/lib/doris_be
 8# lucene::index::SDocumentsWriter<char>::writeSegment(std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >&) at /home/zcp/repo_center/doris_release/doris/be/src/clucene/src/core/CLucene/index/SDocumentWriter.cpp:1019
 9# lucene::index::SDocumentsWriter<char>::flush(bool) at /home/zcp/repo_center/doris_release/doris/be/src/clucene/src/core/CLucene/index/SDocumentWriter.cpp:1319
10# lucene::index::IndexWriter::doFlush(bool) in /app/doris/doris/be/lib/doris_be
11# lucene::index::IndexWriter::flush(bool, bool) at /home/zcp/repo_center/doris_release/doris/be/src/clucene/src/core/CLucene/index/IndexWriter.cpp:1936
12# lucene::index::IndexWriter::closeInternal(bool) at /home/zcp/repo_center/doris_release/doris/be/src/clucene/src/core/CLucene/index/IndexWriter.cpp:536
13# lucene::index::IndexWriter::close(bool) at /home/zcp/repo_center/doris_release/doris/be/src/clucene/src/core/CLucene/index/IndexWriter.cpp:516
14# doris::segment_v2::InvertedIndexColumnWriterImpl<(doris::FieldType)26>::close() at /home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_v2/inverted_index_writer.cpp:108
15# doris::segment_v2::InvertedIndexColumnWriterImpl<(doris::FieldType)26>::finish() at /home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_v2/inverted_index_writer.cpp:548
16# doris::segment_v2::ScalarColumnWriter::write_inverted_index() in /app/doris/doris/be/lib/doris_be
17# doris::segment_v2::SegmentWriter::finalize_columns_index(unsigned long*) at /home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_v2/segment_writer.cpp:944
18# doris::segment_v2::SegmentWriter::finalize(unsigned long*, unsigned long*) at /home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_v2/segment_writer.cpp:985
19# doris::BetaRowsetWriter::_flush_segment_writer(std::unique_ptr<doris::segment_v2::SegmentWriter, std::default_delete<doris::segment_v2::SegmentWriter> >*, long*) at /home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/beta_rowset_writer.cpp:764
20# doris::BetaRowsetWriter::flush_single_memtable(doris::vectorized::Block const*, long*, doris::FlushContext const*) at /home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/beta_rowset_writer.cpp:481
21# doris::MemTable::_do_flush() at /home/zcp/repo_center/doris_release/doris/be/src/olap/memtable.cpp:538
22# doris::MemTable::flush() at /home/zcp/repo_center/doris_release/doris/be/src/olap/memtable.cpp:501
23# doris::FlushToken::_flush_memtable(doris::MemTable*, long) at /home/zcp/repo_center/doris_release/doris/be/src/olap/memtable_flush_executor.cpp:119
24# doris::MemtableFlushTask::run() at /home/zcp/repo_center/doris_release/doris/be/src/olap/memtable_flush_executor.cpp:55
25# doris::ThreadPool::dispatch_thread() in /app/doris/doris/be/lib/doris_be
26# doris::Thread::supervise_thread(void*) at /home/zcp/repo_center/doris_release/doris/be/src/util/thread.cpp:499
27# 0x00007F4667C02AC3 in /lib/x86_64-linux-gnu/libc.so.6
28# 0x00007F4667C94A40 in /lib/x86_64-linux-gnu/libc.so.6

@qidaye qidaye merged commit 5e4b4ca into apache:clucene-2.0 Mar 7, 2024
3 of 4 checks passed
@qidaye qidaye deleted the revert_posting_comparison_opt branch March 7, 2024 06:13
qidaye added a commit to qidaye/doris-thirdparty that referenced this pull request Mar 12, 2024
qidaye added a commit that referenced this pull request Mar 12, 2024
* [fix](write)revert comparePostings due to write core (#195)

revert #156

* [fix](index compaction)Remove INT32_MAX out of destPostingQueues (#198)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant