Add new endpoint /metrics with relevant system monitoring metrics

[rosswhitfield]

Description of the changes

Ref 7060: [WebMon] Add new endpoint /metrics with relevant system monitoring metrics

This add new "metrics" app that will return data in json useful for monitoring. The is an endpoint that returns all the data or you can request specific data. All timestamps will be ISO8601.

To test, start up webmon with docker compose.

Then after logging end you can visit

• http://localhost/metrics/ (for all the data at once)
• http://localhost/metrics/workflow_diagnostics/ (for workflow diagnostics)
• http://localhost/metrics/postprocessing_diagnostics/ (for postprocessing diagnostics)
• http://localhost/metrics/instrument_status/ (for instrument status)
• http://localhost/metrics/run_statuses/ (return the count of the current reduction statuses for all the run started in the last hour)
• http://localhost/metrics/run_statuses/{n}/ (return the count of the current reduction statuses for all the run started in the n minutes, e.g. http://localhost/metrics/run_statuses/525600/ will return the last year)

Should look something like

Anything else I should include?

Check all that apply:

• updated documentation
• Source added/refactored
• Added unit tests
• Added integration tests
• (If applicable) Verified that manual tests requiring the /SNS and /HFIR filesystems pass without fail

References:

• Links to IBM EWM items:
• Links to related issues or pull requests:

Manual test for the reviewer

(Instructions for testing here)

Check list for the reviewer

• best software practices
  • clearly named variables (better to be verbose in variable names)
  • code comments explaining the intent of code blocks
• All the tests are passing
• The documentation is up to date
• code comments added when explaining intent

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 86.31579% with 13 lines in your changes missing coverage. Please review.

Project coverage is 77.51%. Comparing base (793af07) to head (c766206).
Report is 3 commits behind head on next.

Files with missing lines	Patch %	Lines
src/webmon_app/reporting/metrics/views.py	67.74%	10 Missing ⚠️
src/webmon_app/reporting/metrics/view_util.py	96.29%	2 Missing ⚠️
src/webmon_app/reporting/dasmon/view_util.py	75.00%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             next     #186      +/-   ##
==========================================
+ Coverage   77.33%   77.51%   +0.17%     
==========================================
  Files          51       54       +3     
  Lines        4611     4700      +89     
==========================================
+ Hits         3566     3643      +77     
- Misses       1045     1057      +12     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[backmari]

Tested locally and the /metrics/ endpoint and related views under it work as expected.

[backmari]

Tested locally that the status unknown appears in the metrics.