Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ACHE server crashes while stopping crawler using API GET /stopCrawl #113

Open
aecio opened this issue Aug 3, 2017 · 0 comments
Open

ACHE server crashes while stopping crawler using API GET /stopCrawl #113

aecio opened this issue Aug 3, 2017 · 0 comments
Labels
Milestone

Comments

@aecio
Copy link
Member

aecio commented Aug 3, 2017

Error happens in the underlying RocksDB database. Sample stacktrace:

[2017-07-25 18:58:19,745] INFO [AsyncCrawler] (LinkStorage.java:75) - Shutting down FrontierManager...
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x000000012e9582fc, pid=45877, tid=0x0000000000015717
#
# JRE version: Java(TM) SE Runtime Environment (8.0_121-b13) (build 1.8.0_121-b13)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.121-b13 mixed mode bsd-amd64 compressed oops)
# Problematic frame:
# C  [librocksdbjni201119282549468333.jnilib+0x16d2fc]  _ZN7rocksdb15BlockBasedTable20NewDataBlockIteratorEPNS0_3RepERKNS_11ReadOptionsERKNS_5SliceEPNS_9BlockIterE+0x7c
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# An error report file with more information is saved as:
# ~/ache/hs_err_pid45877.log
Compiled method (nm)  174607 2102     n 0       org.rocksdb.RocksIterator::next0 (native)
 total in heap  [0x000000011c8c37d0,0x000000011c8c3af8] = 808
 relocation     [0x000000011c8c38f8,0x000000011c8c3938] = 64
 main code      [0x000000011c8c3940,0x000000011c8c3af0] = 432
 oops           [0x000000011c8c3af0,0x000000011c8c3af8] = 8
[2017-07-25 18:58:19,786] INFO [AsyncCrawler] (LinkStorage.java:77) - done.
[2017-07-25 18:58:19,790] INFO [AsyncCrawler] (AsyncCrawler.java:112) - Shutdown finished.
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
Abort trap: 6
@aecio aecio added the bug label Aug 3, 2017
@aecio aecio added this to the 0.10 milestone Nov 20, 2017
@aecio aecio modified the milestones: 0.10, next Feb 1, 2018
aecio added a commit that referenced this issue Apr 23, 2019
Before closing the RocksDB database, first all open iterators
are closed before closing the main database to avoid an
inconsistent state with invalid databaset iterators.

Related to issue #113.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant