SearchBigFile

Utility in Java to search big file (tested with 400MB and 1GB+ log/text file)

For complete codebase in one refer branch complete-code

For the feature of favourite buttons and tagging in files and searches refer branch with-fav-in-recent

This branch master is targeted to have separate modules as UI and Core

Below modules are the dependencies for this project

Core-Parent module https://github.com/svermaji/Core-Parent

Core module https://github.com/svermaji/Core

UI module https://github.com/svermaji/SwingUI

Author Information

Name: Shailendra Verma
Email: [email protected]
Blogs: https://sv-technical.blogspot.com/

Test Results - with ByteBuffer implementation!!

File size [3GB], type [Text], lines processed [59999997] and pattern find [0] times, time taken [37sec]
File size [1GB], type [Text], lines processed [19499809] and pattern find [0] times, time taken [16sec]
Supports file of more size but time increases
For file less than 1GB BufferedReader will be used

Test Results - with BufferedReader implementation!!

File size [1GB], type [Text], lines processed [13147027] and pattern find [1094] times, time taken [8sec]
Supports file till 1GB only

Description

Pom.xml versions:
- 1.0 - Contains all search feature from initial release till colors implemented
- 2.0 - Implemented wrapping, style attributes and support long text in one line
  - Added theme support and key bindings
- 3.0 - Planned to have multi file search support
Update for mixed algo depending on file size.
Now multi tab is supported.
Font size can be applied to application when used on high resolution machine.
Tooltip will have custom color and font.
Program stores the last searched file and search string.
Support search as you type
Clipboard support via menu
Memory indicator added to application, and can be used to free memory
If file to search/read does not exist then user has choice to remove it from recent entry
User can lock screen with a password and change password
Added export button and cleanup button for old exports.
Clipboard popup will appear to set file name.
Fonts/Colors will change only if window is active.
Application can be colored with highlight color for background and text.
Theme color comes on hover of tool buttons.
Drag n Drop file to set it in search text field.
Use F3/Shift-F3 to search text.
User can press Ctrl+F from anywhere to go to search box and hit enter to make Search.
Settings menu added to set change color of highlights and fonts for message bar automatically.
Added all occurrences table to search occurrences quicker with highlighted text.
- No occurrences' message also present.
- All occurrences table is inside split pane to resize it any time.
- Multiple colors available for match, selected and selected background.
- Color combination can be seen in the tooltip of each menu item.
Tabs present for help and results.
Help button text color changes to different colors every 10 sec.
Help can be seen in the browser with button click.
After 'Read' operation is performed Search pattern box can be used to find any string in existing result.
At start of program detail help will be displayed.
Warning and Info indicator will change font every 10 min. Font details will be in the tooltip.
In file path and search text box auto-complete feature is supported.
In case of hang, program tries to stop forcefully after 50 sec.
Controls to increase/decrease font size.
Shows number of lines processed till time while searching or reading.
Controls to next/previous occurrences.
A warning indicator is shown and show the occurrences so far in case if there are too many matches.
An indicator showing present font size of file contents pane.
File can be chosen by file chooser.
Controls to go first or last line.
ESC key can be used to hide inner-frame.
Match case and whole word search options are available.
Search button action will result only matched strings lines with highlighted background.
Line number will be displayed in blue at the start of line to match with an original file.
Summary will be displayed in title bar with file size, time taken and number of occurrences matched.
Another feature added to read last N (100-5000) lines of a file along with the highlight of search pattern
Recently searched files and search-patterns will be stored with shortcuts.
Additional filtering is provided to search among recent lists
Application displays warning if search runs for too long or too many search occurrences
Tooltip provided for maximum controls.
Validations applied as and when needed.