Tracking: [CLI] Testing posture improvements | Phase 2

[iliapolo]

Overview

As part of the build and release process, we are running a set of CLI integration tests if any of the CLI code has changed.
These tests currently take 50+ min each and are frequently unstable. We are also missing unit tests where we could have them. In general our branches coverage percentages are comparatively low (68% as of 2024-10-29).

Second Phase of #31929

Implementation

We are addressing the shortfall through a number of improvements. See issues for details.

Issue list

• cli: automatic multi environment integration tests #32083
• cli: create patterns for cross-account integration tests #31934
• cli: permissions snapshot integration testing #32088
• cli: create patterns to test interactive commands #31933
• cli: pre-release integration test strategy for downstream tools (e.g. Amplify) #31932