Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FileCopy based bootstrap] Added changes for filestore implementation #2990

Open
wants to merge 6 commits into
base: master
Choose a base branch
from
Open

[FileCopy based bootstrap] Added changes for filestore implementation #2990

wants to merge 6 commits into from
+1,286 −20

Conversation

piyujai
Copy link
Contributor

@piyujai piyujai commented Jan 22, 2025 •
edited
Loading

Implemented FileStore for FileCopy based replication

Key Changes

  • FileStoreException.java: New exception class FileStoreException for handling file store errors.
  • FileCopyConfig.java: Configuration parameters for file copy operations, such as parallel partition hydration count, number of file copy threads, file chunk timeout, and data flush interval.
  • FileInfo.java: New class FileInfo to store file metadata (file name and file size).
  • LogInfo.java: New class LogInfo to manage log information, including sealed segments, index segments, and bloom filters.
  • AmbryServer.java: Updated server configuration to include the new FileCopyConfig.

Testing Details:

  • FileStoreTest.java: Added tests to verify the functionality of the new filestore implementation.
  • Chunk Read Support: Verified the support for chunk read in the filestore.
  • JavaDocs and Comments: Included JavaDocs and comments to ensure code clarity and maintainability.
  • Existing integration and unit tests successful.

@piyujai piyujai force-pushed the filestore_implementation branch 5 times, most recently from f4ef4c7 to eaa73d2 Compare January 28, 2025 12:56
@piyujai piyujai force-pushed the filestore_implementation branch from eaa73d2 to a8a0427 Compare February 12, 2025 06:45
@piyujai piyujai force-pushed the filestore_implementation branch from d7b6dd1 to b44a273 Compare February 12, 2025 23:52
@piyujai piyujai force-pushed the filestore_implementation branch 2 times, most recently from 0e4fc01 to 0b93349 Compare February 13, 2025 10:49
@piyujai piyujai changed the title Added changes for filestore implementation for FileCopy [FileCopy based bootstrap] Added changes for filestore implementation Feb 13, 2025
@piyujai piyujai marked this pull request as ready for review February 13, 2025 11:00
@piyujai piyujai force-pushed the filestore_implementation branch from 0b93349 to 25cdc87 Compare February 13, 2025 11:32
@piyujai piyujai force-pushed the filestore_implementation branch from 25cdc87 to 8f4d5d8 Compare February 13, 2025 11:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@piyujai