Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: tool to analyze backlog files in persistence #208

Merged
merged 12 commits into from
Apr 28, 2023
Merged

feat: tool to analyze backlog files in persistence #208

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
7fc41a8
feat: utility to deserialize backup/persistence
de-sh Apr 21, 2023
01c294a
feat: non-destructive read of backups
de-sh Apr 21, 2023
28160a1
feat: calculate byte size and data rate
de-sh Apr 21, 2023
00c2b54
feat: print as a table
de-sh Apr 21, 2023
a979d46
feat: make table output human friendly units
de-sh Apr 21, 2023
3d4e6a6
feat: suggestions by @tekjar
de-sh Apr 21, 2023
d2a9193
feat: include aggregated values
de-sh Apr 21, 2023
fed5cf5
fix: note message_rate
de-sh Apr 21, 2023
0c58f88
fix: unnecessary columns in aggregate table
de-sh Apr 21, 2023
7122d07
feat: 256MB default max_packet_size
de-sh Apr 26, 2023
172f400
fix: print error in case of blank persistence
de-sh Apr 26, 2023
8df7fd4
refactor: clippy suggestions
de-sh Apr 26, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion Cargo.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,9 +7,10 @@ members = [
"disk",
]
exclude = [
"tools/deserialize-backup",
"tools/simulator",
"tools/tunshell",
"tools/utils",
"tools/simulator",
]

[profile.dev]
Expand Down
8 changes: 8 additions & 0 deletions disk/src/lib.rs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,8 @@ pub struct Storage {
current_read_file: BytesMut,
/// id of file being read, delete it on read completion
current_read_file_id: Option<u64>,
/// run through persistence without deleting files
pub non_destructive_read: bool,
}

impl Storage {
Expand All @@ -52,6 +54,7 @@ impl Storage {
current_write_file: BytesMut::with_capacity(max_file_size * 2),
current_read_file: BytesMut::with_capacity(max_file_size * 2),
current_read_file_id: None,
non_destructive_read: false,
})
}

Expand All @@ -77,8 +80,13 @@ impl Storage {

/// Removes a file with provided id
fn remove(&self, id: u64) -> Result<(), Error> {
if self.non_destructive_read {
return Ok(());
}

let path = self.get_read_file_path(id)?;
fs::remove_file(path)?;

Ok(())
}

Expand Down
Loading