[Backport 2.x] [Tiered Caching] Expose a dynamic setting to disable/enable disk cache

[sgup432]

Description

Backport #13373

Related Issues

N/A

Check List

• New functionality includes testing.
  • All tests pass
• New functionality has been documented.
  • New functionality has javadoc added
• Failing checks are inspected and point to the corresponding known issue(s) (See: Troubleshooting Failing Builds)
• Commits are signed per the DCO using --signoff
• Commit changes are listed out in CHANGELOG.md file (See: Changelog)
• Public documentation issue/PR created

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[sgup432]

@sohami

[github-actions]

❌ Gradle check result for 93bfc5f: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

[sohami]

❌ Gradle check result for 93bfc5f: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Known Flaky Test: #13045

[github-actions]

❌ Gradle check result for 93bfc5f: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

[sohami]

❌ Gradle check result for 93bfc5f: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Known Flaky Test: #13106

[github-actions]

❌ Gradle check result for 93bfc5f: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

[sohami]

❌ Gradle check result for 93bfc5f: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Known Flaky Test:
#12639
#2440

[github-actions]

❕ Gradle check result for 93bfc5f: UNSTABLE

• TEST FAILURES:

      1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=indices.get_field_mapping/20_missing_field/Return empty object if field doesn't exist, but index does}

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[codecov]

Codecov Report

Attention: Patch coverage is 93.33333% with 3 lines in your changes are missing coverage. Please review.

Project coverage is 71.04%. Comparing base (0dd892c) to head (93bfc5f).
Report is 192 commits behind head on 2.x.

Files	Patch %	Lines
...search/cache/common/tier/TieredSpilloverCache.java	94.11%	2 Missing ⚠️
.../cache/common/tier/TieredSpilloverCachePlugin.java	80.00%	0 Missing and 1 partial ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##                2.x   #13403      +/-   ##
============================================
- Coverage     71.28%   71.04%   -0.24%     
- Complexity    60145    60701     +556     
============================================
  Files          4957     5013      +56     
  Lines        282799   285879    +3080     
  Branches      41409    41792     +383     
============================================
+ Hits         201591   203117    +1526     
- Misses        64189    65621    +1432     
- Partials      17019    17141     +122     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.