SearchBigFile

Utility in Java to search big file (tested with 400MB and 1GB+ log/text file)

• For complete codebase in one refer branch complete-code
• For the feature of favourite buttons and tagging in files and searches refer branch with-fav-in-recent
• This branch master is targeted to have separate modules as UI and Core
• Below modules are the dependencies for this project
  • Core-Parent module https://github.com/svermaji/Core-Parent
  • Core module https://github.com/svermaji/Core
  • UI module https://github.com/svermaji/SwingUI

Author Information

• Name: Shailendra Verma
• Email: [email protected]
• Blogs: https://sv-technical.blogspot.com/

Test Results - with ByteBuffer implementation!!

• File size [3GB], type [Text], lines processed [59999997] and pattern find [0] times, time taken [37sec]
• File size [1GB], type [Text], lines processed [19499809] and pattern find [0] times, time taken [16sec]
• Supports file of more size but time increases
• For file less than 1GB BufferedReader will be used

Test Results - with BufferedReader implementation!!

• File size [1GB], type [Text], lines processed [13147027] and pattern find [1094] times, time taken [8sec]
• Supports file till 1GB only

Description

• Pom.xml versions:
  • 1.0 - Contains all search feature from initial release till colors implemented
  • 2.0 - Implemented wrapping, style attributes and support long text in one line
    • Added theme support and key bindings
  • 3.0 - Planned to have multi file search support
• Update for mixed algo depending on file size.
• Now multi tab is supported.
• Font size can be applied to application when used on high resolution machine.
• Tooltip will have custom color and font.
• Program stores the last searched file and search string.
• Support search as you type
• Clipboard support via menu
• Memory indicator added to application, and can be used to free memory
• If file to search/read does not exist then user has choice to remove it from recent entry
• User can lock screen with a password and change password
• Added export button and cleanup button for old exports.
• Clipboard popup will appear to set file name.
• Fonts/Colors will change only if window is active.
• Application can be colored with highlight color for background and text.
• Theme color comes on hover of tool buttons.
• Drag n Drop file to set it in search text field.
• Use F3/Shift-F3 to search text.
• User can press Ctrl+F from anywhere to go to search box and hit enter to make Search.
• Settings menu added to set change color of highlights and fonts for message bar automatically.
• Added all occurrences table to search occurrences quicker with highlighted text.
  • No occurrences' message also present.
  • All occurrences table is inside split pane to resize it any time.
  • Multiple colors available for match, selected and selected background.
  • Color combination can be seen in the tooltip of each menu item.
• Tabs present for help and results.
• Help button text color changes to different colors every 10 sec.
• Help can be seen in the browser with button click.
• After 'Read' operation is performed Search pattern box can be used to find any string in existing result.
• At start of program detail help will be displayed.
• Warning and Info indicator will change font every 10 min. Font details will be in the tooltip.
• In file path and search text box auto-complete feature is supported.
• In case of hang, program tries to stop forcefully after 50 sec.
• Controls to increase/decrease font size.
• Shows number of lines processed till time while searching or reading.
• Controls to next/previous occurrences.
• A warning indicator is shown and show the occurrences so far in case if there are too many matches.
• An indicator showing present font size of file contents pane.
• File can be chosen by file chooser.
• Controls to go first or last line.
• ESC key can be used to hide inner-frame.
• Match case and whole word search options are available.
• Search button action will result only matched strings lines with highlighted background.
• Line number will be displayed in blue at the start of line to match with an original file.
• Summary will be displayed in title bar with file size, time taken and number of occurrences matched.
• Another feature added to read last N (100-5000) lines of a file along with the highlight of search pattern
• Recently searched files and search-patterns will be stored with shortcuts.
• Additional filtering is provided to search among recent lists
• Application displays warning if search runs for too long or too many search occurrences
• Tooltip provided for maximum controls.
• Validations applied as and when needed.

Images of different stages of development/features since day 1

• Application Present Image
  

• First cut
  

• Colored screen
  

• Locked screen
  

• Change password screen
  

• Test result on 1GB file with Buffered Reader
  

• Test result on 1GB file improved
  

• Test result on 1GB old
  

• Information indicator
  

• The warning indicator
  

• Error indicator
  

• Controls menu
  

• Auto complete
  

• Help Tab
  

• If no occurrence found
  

• Recent Menu
  

• Filter recent values
  

• Settings -> Fonts menu
  

• Settings -> Highlight menu