Skip to content

azure: switch sustaining autorelease-412 jobs to azure-autorelease-qe profile#80553

Open
redhat-chai-bot wants to merge 1 commit into
openshift:mainfrom
redhat-chai-bot:autorelease-412-use-shared-azure-profile
Open

azure: switch sustaining autorelease-412 jobs to azure-autorelease-qe profile#80553
redhat-chai-bot wants to merge 1 commit into
openshift:mainfrom
redhat-chai-bot:autorelease-412-use-shared-azure-profile

Conversation

@redhat-chai-bot

@redhat-chai-bot redhat-chai-bot commented Jun 15, 2026

Copy link
Copy Markdown
Contributor

Background

The azure-sustaining-autorelease-412 cluster profile has a standalone boskos quota-slice with all 60 leases concentrated in eastus only. Since commit 14641eb switched Azure CI defaults to Standard_D8as_v5, and this instance type has capacity constraints in eastus, all autorelease jobs using this profile have been failing with SkuNotAvailable errors (12+ consecutive failures since June 11).

Changes

Switches all 4.12–4.17 autorelease CI job configs from the dedicated azure-sustaining-autorelease-412 profile to azure-autorelease-qe, which:

  • Uses eastus2 (not eastus), avoiding the capacity issue
  • Is already used by the 4.18+ autorelease configs
  • Is registered for openshift/openshift-tests-private in cluster-profiles-config.yaml

Specific changes per file (17 ci-operator config files):

  • cluster_profile: azure-sustaining-autorelease-412cluster_profile: azure-autorelease-qe
  • BASE_DOMAIN: sustaining-az-412.azure.devcluster.openshift.comBASE_DOMAIN: qe.azure.devcluster.openshift.com

6 generated prowjob files under ci-operator/jobs/ are regenerated by make jobs.

Affected releases

4.12, 4.13, 4.14, 4.15, 4.16, 4.17 — all autorelease and upgrade-from-stable jobs that were using the sustaining-412 profile.

Note

The azure-autorelease-qe profile has 7 boskos slices in eastus2, which is significantly less capacity than the previous 60-slice eastus pool. If this becomes a bottleneck for autorelease job throughput, the azure-autorelease-qe-quota-slice pool may need to be expanded.

References

Summary by CodeRabbit

This PR updates CI configuration for automated release jobs (versions 4.12–4.17) in the openshift/openshift-tests-private repository to resolve Azure capacity constraints. Specifically, 17 configuration files are updated to migrate from the azure-sustaining-autorelease-412 cluster profile to the shared azure-autorelease-qe profile.

Practical Impact:

  • Affected test jobs (e.g., azure-ipi-fips-f999 and azure-upi-f999 across multiple release branches) will now run on the azure-autorelease-qe cluster profile instead of the dedicated sustaining profile
  • The Azure region for these tests shifts from eastus (experiencing SkuNotAvailable errors for the Standard_D8as_v5 instance type) to eastus2
  • The base domain for test environments changes from sustaining-az-412.azure.devcluster.openshift.com to qe.azure.devcluster.openshift.com

Changes across all 17 files:

  • cluster_profile: azure-sustaining-autorelease-412azure-autorelease-qe
  • BASE_DOMAIN: sustaining-az-412.azure.devcluster.openshift.comqe.azure.devcluster.openshift.com

This aligns the 4.12–4.17 autorelease configurations with the approach already in use for 4.18+ releases, removing a capacity bottleneck that had caused 12+ consecutive job failures.

@coderabbitai

coderabbitai Bot commented Jun 15, 2026

Copy link
Copy Markdown
Contributor

Warning

Review limit reached

@redhat-chai-bot, we couldn't start this review because you've reached your PR review rate limit.

More reviews will be available in 16 minutes and 3 seconds. Learn how PR review limits work.

Your organization has used up its prepaid credits, and credit purchases are no longer available. Enable the review add-on in the billing tab to keep reviews running — you're only billed for reviews past your plan's rate limits ($0.25/file).

⌛ How to resolve this issue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans include higher PR review limits than trial, open-source, and free plans. In all cases, reviews become available again over time. During sustained high-volume PR review activity, CodeRabbit may temporarily slow when the next review becomes available.

Please see our Fair Usage Limits Policy for further information.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Repository YAML (base), Central YAML (inherited)

Review profile: CHILL

Plan: Enterprise

Run ID: db5b9fce-a45b-451c-a44e-9f6590ad3d55

📥 Commits

Reviewing files that changed from the base of the PR and between a0e8dc8 and b08ec93.

⛔ Files ignored due to path filters (6)
  • ci-operator/jobs/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.12-periodics.yaml is excluded by !ci-operator/jobs/**
  • ci-operator/jobs/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.13-periodics.yaml is excluded by !ci-operator/jobs/**
  • ci-operator/jobs/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.14-periodics.yaml is excluded by !ci-operator/jobs/**
  • ci-operator/jobs/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.15-periodics.yaml is excluded by !ci-operator/jobs/**
  • ci-operator/jobs/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.16-periodics.yaml is excluded by !ci-operator/jobs/**
  • ci-operator/jobs/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.17-periodics.yaml is excluded by !ci-operator/jobs/**
📒 Files selected for processing (17)
  • ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.12__automated-release-stable-4.12-upgrade-from-stable-4.12.yaml
  • ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.12__automated-release.yaml
  • ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.13__automated-release-stable-4.13-upgrade-from-stable-4.12.yaml
  • ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.13__automated-release-stable-4.13-upgrade-from-stable-4.13.yaml
  • ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.13__automated-release.yaml
  • ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.14__automated-release-stable-4.14-upgrade-from-stable-4.13.yaml
  • ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.14__automated-release-stable-4.14-upgrade-from-stable-4.14.yaml
  • ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.14__automated-release.yaml
  • ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.15__automated-release-stable-4.15-upgrade-from-stable-4.14.yaml
  • ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.15__automated-release-stable-4.15-upgrade-from-stable-4.15.yaml
  • ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.15__automated-release.yaml
  • ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.16__automated-release-stable-4.16-upgrade-from-stable-4.15.yaml
  • ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.16__automated-release-stable-4.16-upgrade-from-stable-4.16.yaml
  • ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.16__automated-release.yaml
  • ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.17__automated-release-stable-4.17-upgrade-from-stable-4.16.yaml
  • ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.17__automated-release-stable-4.17-upgrade-from-stable-4.17.yaml
  • ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.17__automated-release.yaml

Walkthrough

Across 38 CI operator YAML configuration files spanning OpenShift releases 4.12 through 5.0, Azure IPI FIPS and UPI test jobs are systematically migrated to use a unified openshift-org-azure cluster profile and ci.azure.devcluster.openshift.com base domain. Earlier releases transition from azure-sustaining-autorelease-412, later releases from azure-autorelease-qe. All other job configurations remain unchanged.

Changes

Azure Cluster Profile Consolidation Across OCP 4.12–5.0

Layer / File(s) Summary
4.12–4.15 sustaining profile consolidation
ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.12__automated-release*.yaml, ...-release-4.13__*, ...-release-4.14__*, ...-release-4.15__*
Both azure-ipi-fips-f999 and azure-upi-f999 test jobs updated across automated-release and version-upgrade configurations from azure-sustaining-autorelease-412 / sustaining-az-412.azure.devcluster.openshift.com to unified openshift-org-azure / ci.azure.devcluster.openshift.com.
4.16–4.17 QE profile convergence
ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.16__*, ...-release-4.17__*
Releases 4.16 and 4.17 transition from a mix of sustaining and azure-autorelease-qe profiles to the unified openshift-org-azure and ci.azure.devcluster.openshift.com in all configuration variants.
4.18–4.21 QE-to-unified migration
ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.18__* through ...-release-4.21__*
Releases 4.18–4.21 systematically consolidate from azure-autorelease-qe / qe.azure.devcluster.openshift.com to the unified openshift-org-azure / ci.azure.devcluster.openshift.com across all automated-release, stable-upgrade, and nightly-upgrade test paths.
4.22–5.0 final convergence
ci-operator/config/openshift/openshift-tests-private/openshift-openshift-tests-private-release-4.22__*, ...-release-5.0__*
Latest releases 4.22 and 5.0 complete the unified infrastructure migration by applying openshift-org-azure / ci.azure.devcluster.openshift.com across nightly, stable-upgrade, and automated-release job configurations for both Azure IPI FIPS and UPI test variants.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~5 minutes

Suggested reviewers

  • pruan-rht
  • jmguzik

Important

Pre-merge checks failed

Please resolve all errors before merging. Addressing warnings is optional.

❌ Failed checks (1 error)

Check name Status Explanation Resolution
No-Weak-Crypto ❌ Error MD5 usage found in generate-cron-entry.sh (line 42) for cron scheduling number generation, flagged per check instructions to flag all MD5 usage. Replace MD5 with SHA256 or alternative deterministic hash for generating scheduling parameters, or use a non-cryptographic deterministic random number approach instead.
✅ Passed checks (14 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The PR title accurately describes the main change: switching Azure CI operator config files from the azure-sustaining-autorelease-412 profile to azure-autorelease-qe profile.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Stable And Deterministic Test Names ✅ Passed PR modifies only CI configuration YAML files, not Ginkgo test code. No test names or titles are present in these changes.
Test Structure And Quality ✅ Passed PR contains only YAML CI configuration files, not Ginkgo test code. Custom check for test structure is not applicable to configuration-only changes.
Microshift Test Compatibility ✅ Passed PR only modifies CI configuration YAML files; no new Ginkgo e2e tests or test code is added, so MicroShift test compatibility check is not applicable.
Single Node Openshift (Sno) Test Compatibility ✅ Passed PR modifies only CI configuration YAML files, not test code. No Ginkgo e2e tests are being added, making this check not applicable.
Topology-Aware Scheduling Compatibility ✅ Passed PR modifies only CI operator job configuration (ci-operator/config files), not deployment manifests or operator code. No scheduling constraints or topology-dependent specifications are introduced.
Ote Binary Stdout Contract ✅ Passed This PR modifies only YAML CI configuration files (cluster profiles, base domains), not Go source code. The OTE Binary Stdout Contract check applies to test binary implementations, not CI configura...
Ipv6 And Disconnected Network Test Compatibility ✅ Passed PR contains only CI configuration YAML file changes; no new Ginkgo e2e tests are added, making this IPv6/disconnected network check inapplicable.
Container-Privileges ✅ Passed PR contains only ci-operator config files (not K8s manifests). No container specs with privileged settings, hostPID, hostNetwork, hostIPC, SYS_ADMIN, or allowPrivilegeEscalation found in any modifi...
No-Sensitive-Data-In-Logs ✅ Passed PR modifies only YAML CI configuration files with infrastructure settings (cluster profiles, DNS domains). No logging code, secrets, PII, or sensitive data exposure in changes.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@openshift-ci openshift-ci Bot requested review from jechen0648 and memodi June 15, 2026 18:28
@openshift-ci

openshift-ci Bot commented Jun 15, 2026

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: redhat-chai-bot
Once this PR has been reviewed and has the lgtm label, please assign sergiordlr for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@jupierce

Copy link
Copy Markdown
Contributor

/hold

@openshift-ci openshift-ci Bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jun 15, 2026
@redhat-chai-bot redhat-chai-bot force-pushed the autorelease-412-use-shared-azure-profile branch from 53710d3 to a0e8dc8 Compare June 15, 2026 18:55
@openshift-merge-bot

Copy link
Copy Markdown
Contributor

[REHEARSALNOTIFIER]
@redhat-chai-bot: the pj-rehearse plugin accommodates running rehearsal tests for the changes in this PR. Expand 'Interacting with pj-rehearse' for usage details. The following rehearsable tests have been affected by this change:

Test name Repo Type Reason
periodic-ci-openshift-openshift-tests-private-release-5.0-automated-release-stable-5.0-upgrade-from-stable-5.0-azure-upi-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.18-automated-release-stable-4.18-upgrade-from-stable-4.18-azure-upi-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.22-automated-release-nightly-4.22-upgrade-from-stable-4.22-azure-upi-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-5.0-automated-release-azure-upi-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.15-automated-release-stable-4.15-upgrade-from-stable-4.14-azure-upi-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.21-automated-release-azure-upi-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-5.0-automated-release-stable-5.0-upgrade-from-stable-5.0-azure-ipi-fips-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-5.0-automated-release-azure-ipi-fips-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.20-automated-release-stable-4.20-upgrade-from-stable-4.19-azure-upi-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.14-automated-release-azure-upi-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.17-automated-release-stable-4.17-upgrade-from-stable-4.16-azure-upi-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.18-automated-release-stable-4.18-upgrade-from-stable-4.17-azure-ipi-fips-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.13-automated-release-stable-4.13-upgrade-from-stable-4.12-azure-ipi-fips-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.17-automated-release-azure-ipi-fips-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.19-automated-release-stable-4.19-upgrade-from-stable-4.19-azure-upi-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.21-automated-release-stable-4.21-upgrade-from-stable-4.21-azure-ipi-fips-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.15-automated-release-azure-upi-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.14-automated-release-stable-4.14-upgrade-from-stable-4.14-azure-upi-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.20-automated-release-azure-ipi-fips-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.21-automated-release-stable-4.21-upgrade-from-stable-4.21-azure-upi-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.15-automated-release-stable-4.15-upgrade-from-stable-4.14-azure-ipi-fips-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.22-automated-release-stable-4.22-upgrade-from-stable-4.21-azure-ipi-fips-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.15-automated-release-stable-4.15-upgrade-from-stable-4.15-azure-ipi-fips-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.17-automated-release-stable-4.17-upgrade-from-stable-4.17-azure-ipi-fips-f999 N/A periodic Ci-operator config changed
periodic-ci-openshift-openshift-tests-private-release-4.19-automated-release-stable-4.19-upgrade-from-stable-4.18-azure-ipi-fips-f999 N/A periodic Ci-operator config changed

A total of 74 jobs have been affected by this change. The above listing is non-exhaustive and limited to 25 jobs.

A full list of affected jobs can be found here

Interacting with pj-rehearse

Comment: /pj-rehearse to run up to 5 rehearsals
Comment: /pj-rehearse skip to opt-out of rehearsals
Comment: /pj-rehearse {test-name}, with each test separated by a space, to run one or more specific rehearsals
Comment: /pj-rehearse more to run up to 10 rehearsals
Comment: /pj-rehearse max to run up to 25 rehearsals
Comment: /pj-rehearse auto-ack to run up to 5 rehearsals, and add the rehearsals-ack label on success
Comment: /pj-rehearse list to get an up-to-date list of affected jobs
Comment: /pj-rehearse abort to abort all active rehearsals
Comment: /pj-rehearse network-access-allowed to allow rehearsals of tests that have the restrict_network_access field set to false. This must be executed by an openshift org member who is not the PR author

Once you are satisfied with the results of the rehearsals, comment: /pj-rehearse ack to unblock merge. When the rehearsals-ack label is present on your PR, merge will no longer be blocked by rehearsals.
If you would like the rehearsals-ack label removed, comment: /pj-rehearse reject to re-block merging.

…profile

Moves all 4.12-4.17 autorelease jobs from the dedicated
azure-sustaining-autorelease-412 cluster profile (60 eastus-only leases)
to the shared openshift-org-azure profile (multi-region, multi-subscription).
This resolves SkuNotAvailable failures for Standard_D8as_v5 in eastus.

Also updates BASE_DOMAIN from sustaining-az-412.azure.devcluster.openshift.com
to ci.azure.devcluster.openshift.com.
@redhat-chai-bot redhat-chai-bot force-pushed the autorelease-412-use-shared-azure-profile branch from a0e8dc8 to b08ec93 Compare June 15, 2026 19:02
@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@redhat-chai-bot: pj-rehearse could not automatically process this event because the request waited in queue for longer than 5 minutes. Use /pj-rehearse to trigger rehearsals manually.

@jupierce

Copy link
Copy Markdown
Contributor

/pj-rehearse periodic-ci-openshift-openshift-tests-private-release-4.14-automated-release-stable-4.14-upgrade-from-stable-4.14-azure-ipi-fips-f999

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@jupierce: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-ci

openshift-ci Bot commented Jun 15, 2026

Copy link
Copy Markdown
Contributor

@redhat-chai-bot: all tests passed!

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants