[Operations] How to better visualize OpenSearch-Project status?

[peternied]

Is your feature request related to a problem? Please describe

During the weekly operations meeting, there has been an ongoing question- how do we know if we are on track or not? Using release issues is focused on individual releases and there can be as many as 3 active release actions happening at once. Getting a good 'feel' for the project health doesn't have strong mechanisms

Describe the solution you'd like

There should be a place where the OpenSearch project can visualize projects and critical metrics about them. Number of stale issues/PRs. How many issues are untriaged. How many outstanding release specific issues are still unresolved.

Additional health metrics could include community engagement, incoming issue rate, or time since last release.

[peternied]

I build a tool to generate badges off of https://shields.io/, called opensearch-build-badger through a GitHub action. Maybe this can be built-up to be part of our monitoring mechanisms.

Here is a snippet of the output, see the project for a full visualization.

---

Release Readiness

Repo	Triage	1.3	2.3	3.0
OpenSearch
OpenSearch-Dashboards
alerting

[bbarani]

[Triage] @peternied Thanks you for this great idea. We will look in to adding this feature soon.

[peternied]

Discussed this more with @anasalkouz we came up with a list of items that would be useful to add to project readme, then we can see about operationalizing the output. I'll play around with workflows that can accomplish this

• untriaged issues
• inactive over X days issues
• inactive over X days pull requests
• security issues
• code coverage
• Next Major issue count
• Next Minor issue count

[bbarani]

Thanks @peternied. I am currently planning to use it for 2.4.0 release issue - [RELEASE] Release version 2.4.0

[gaiksaya]

Moving to opensearch-metrics repo under project health category.
cc: @prudhvigodithi

[prudhvigodithi]

[Triage]
Hey @peternied we have lot of data about the OpenSearch-Project in the metrics dashboard, it should cover majority of the points you mentioned. The repo README shows the list of available status metrics, Please check the OpenSearch Project Insights, OpenSearch Ops Metrics dashboards for more details.

Thank you
@getsaurabh02 @dblock

[prudhvigodithi]

Closing this issue, feel-free to re-open or create a new one for new metric (to better visualize the OpenSearch Project status) if required.
Thanks