Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for File Monitoring in MetricsHub #419

Open
NassimBtk opened this issue Sep 18, 2024 · 0 comments
Open

Support for File Monitoring in MetricsHub #419

NassimBtk opened this issue Sep 18, 2024 · 0 comments
Assignees
Labels
documentation Improvements or additions to documentation enhancement New feature or request

Comments

@NassimBtk
Copy link
Member

NassimBtk commented Sep 18, 2024

Summary

Add support for monitoring specific files and their metadata (e.g., size, last accessed time, modification time) in MetricsHub. The new feature should allow users to collect metrics about specific files.

Proposed Solution

Introduce a new "file" source in MetricsHub that:

  • Supports monitoring file metadata (e.g., size, last accessed time, modification time, creation time).
  • Allows filtering of files based on user-defined criteria (e.g., most recent file, file name pattern, etc.).
  • Optionally, provide support through extensions like SSH, WMI, and WinRM to enable cross-platform support (Linux, Windows, Darwin).

Metrics to be Reported

file.size: The size of the file in bytes.
file.atime: Time since the file was last accessed, in seconds since Epoch.
file.mtime: Time since the file was last modified, in seconds since Epoch.
file.ctime: Time since the file's metadata (e.g., permissions) was last changed, in seconds since Epoch.
file.count: The number of files that match the specified pattern or criteria.
file.lines: Total number of lines in the file. This metric helps monitor file growth, particularly for logs.
file.keywords: Customizable count of user-defined or connector-defined keywords (e.g., "ERROR", "WARNING", "SUCCESS", "TIMEOUT", "EXCEPTION"). This provides flexibility for the user to track specific log events or patterns. This is helpful for detecting failures in log files or system output files.
file.io{direction="read|write"}: Total bytes read or written to the file.
Resource attributes like file.name and file.path.

@NassimBtk NassimBtk added documentation Improvements or additions to documentation enhancement New feature or request labels Sep 23, 2024
@iguitton iguitton self-assigned this Oct 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants