OCPBUGS-44695: Port mirror registry to use Quay #4369

ggiguash · 2024-12-30T13:31:27Z

First part of the implementation is to reach feature parity with the current distribution registry.

Performance comparison

Performance comparison of the Distribution and Quay registries was performed on a c6g.metal host
Conclusion: TBD

Looks like Quay bootstrap is ~1m slower than the Distribution one.

Bootstrap

./test/bin/manage_composer_config.sh cleanup ; sudo rm -rf ./_output/test-images/mirror-registry/
time ./test/bin/mirror_registry.sh

Distribution: ~1m
Quay: ~2m

Builds

time bash -c '\
  ./test/bin/build_bootc_images.sh -l ./test/image-blueprints-bootc/layer1-base/ && \
  ./test/bin/build_bootc_images.sh -l ./test/image-blueprints-bootc/layer2-source'

Distribution: ~16m
Quay: ~17m

Bootstrap & Builds

./test/bin/manage_composer_config.sh cleanup ; sudo rm -rf ./_output/test-images/mirror-registry/
time bash -c '\
  ./test/bin/build_bootc_images.sh -l ./test/image-blueprints-bootc/layer1-base/ && \
  ./test/bin/build_bootc_images.sh -l ./test/image-blueprints-bootc/layer2-source'

Distribution: TBD
Quay: TBD

openshift-ci · 2024-12-30T13:31:30Z

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

openshift-ci · 2024-12-30T13:31:41Z

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: ggiguash

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

~~OWNERS~~ [ggiguash]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

openshift-ci-robot · 2024-12-30T13:31:53Z

@ggiguash: This pull request references Jira Issue OCPBUGS-44926, which is invalid:

expected the bug to target either version "4.19." or "openshift-4.19.", but it targets "4.18.0" instead

Comment /jira refresh to re-evaluate validity if changes to the Jira bug are made, or edit the title of this pull request to link to a different bug.

The bug has been updated to refer to the pull request using the external bug tracker.

In response to this:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

ggiguash · 2024-12-30T19:44:15Z

/test ?

openshift-ci · 2024-12-30T19:44:18Z

@ggiguash: The following commands are available to trigger required jobs:

/test e2e-aws-footprint-and-performance

/test e2e-aws-tests

/test e2e-aws-tests-arm

/test e2e-aws-tests-bootc

/test e2e-aws-tests-bootc-arm

/test e2e-aws-tests-bootc-periodic

/test e2e-aws-tests-bootc-periodic-arm

/test e2e-aws-tests-cache

/test e2e-aws-tests-cache-arm

/test e2e-aws-tests-periodic

/test e2e-aws-tests-periodic-arm

/test images

/test ocp-full-conformance-rhel-eus

/test ocp-full-conformance-serial-rhel-eus

/test test-rpm

/test test-unit

/test verify

The following commands are available to trigger optional jobs:

/test security

/test test-rebase

Use /test all to run the following jobs that were automatically triggered:

pull-ci-openshift-microshift-main-e2e-aws-tests

pull-ci-openshift-microshift-main-e2e-aws-tests-arm

pull-ci-openshift-microshift-main-e2e-aws-tests-bootc

pull-ci-openshift-microshift-main-e2e-aws-tests-bootc-arm

pull-ci-openshift-microshift-main-e2e-aws-tests-bootc-periodic

pull-ci-openshift-microshift-main-e2e-aws-tests-bootc-periodic-arm

pull-ci-openshift-microshift-main-e2e-aws-tests-periodic

pull-ci-openshift-microshift-main-e2e-aws-tests-periodic-arm

pull-ci-openshift-microshift-main-images

pull-ci-openshift-microshift-main-security

pull-ci-openshift-microshift-main-test-unit

pull-ci-openshift-microshift-main-verify

In response to this:

/test ?

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

ggiguash · 2024-12-30T19:45:12Z

/test e2e-aws-tests-bootc
/test e2e-aws-tests

openshift-ci-robot · 2024-12-31T07:00:04Z

@ggiguash: This pull request references Jira Issue OCPBUGS-44695, which is valid. The bug has been moved to the POST state.

3 validation(s) were run on this bug

bug is open, matching expected state (open)
bug target version (4.19.0) matches configured target version for branch (4.19.0)
bug is in the state ASSIGNED, which is one of the valid states (NEW, ASSIGNED, POST)

Requesting review from QA contact:
/cc @jogeo

The bug has been updated to refer to the pull request using the external bug tracker.

In response to this:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

ggiguash · 2024-12-31T07:15:40Z

/test e2e-aws-tests-bootc
/test e2e-aws-tests

ggiguash · 2024-12-31T09:08:16Z

/test e2e-aws-tests-bootc

ggiguash · 2024-12-31T09:37:35Z

/test e2e-aws-tests-bootc-arm

ggiguash · 2024-12-31T11:29:26Z

/test e2e-aws-tests-bootc
/test e2e-aws-tests-bootc-arm

ggiguash · 2024-12-31T14:38:01Z

/test e2e-aws-tests-bootc
/test e2e-aws-tests-bootc-arm

openshift-ci-robot · 2025-01-01T10:06:18Z

@ggiguash: This pull request references Jira Issue OCPBUGS-44695, which is valid.

3 validation(s) were run on this bug

bug is open, matching expected state (open)
bug target version (4.19.0) matches configured target version for branch (4.19.0)
bug is in the state POST, which is one of the valid states (NEW, ASSIGNED, POST)

Requesting review from QA contact:
/cc @jogeo

In response to this:

First part of the implementation is to reach feature parity with the current distribution registry.

Performance comparison of the Distribution and Quay registries performed on a c6g.metal host, using the following commands.
./test/bin/manage_composer_config.sh cleanup ; sudo rm -rf ./_output/test-images/mirror-registry/
time ./test/bin/mirror_registry.sh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

ggiguash · 2025-01-03T10:13:33Z

/test e2e-aws-tests-bootc
/test e2e-aws-tests-bootc-arm

ggiguash · 2025-01-03T12:28:15Z

/test e2e-aws-tests-bootc
/test e2e-aws-tests-bootc-arm

openshift-ci · 2025-01-03T17:15:28Z

@ggiguash: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/e2e-aws-tests-bootc-periodic	`ca6ef58`	link	true	`/test e2e-aws-tests-bootc-periodic`
ci/prow/verify	`ca6ef58`	link	true	`/test verify`
ci/prow/e2e-aws-tests-bootc	`ca6ef58`	link	true	`/test e2e-aws-tests-bootc`
ci/prow/e2e-aws-tests-bootc-periodic-arm	`ca6ef58`	link	true	`/test e2e-aws-tests-bootc-periodic-arm`

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Dec 30, 2024

openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Dec 30, 2024

openshift-ci-robot added jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. labels Dec 30, 2024

Port mirror registry to use Quay

ce49ff9

ggiguash force-pushed the quay_mirror_registry branch from cf6ff2a to ce49ff9 Compare December 30, 2024 17:03

ggiguash added 4 commits December 30, 2024 20:17

Fix bootc builds to use the new microshift organization in registry

191bcaa

Skip mirror registry setup if all containers are running

0f99455

Fix nginx process management to kill the current UID processes

713c61d

Fix kickstart references to point to microshift organization in registry

8508668

ggiguash changed the title ~~OCPBUGS-44926: Port mirror registry to use Quay~~ OCPBUGS-44695: Port mirror registry to use Quay Dec 31, 2024

openshift-ci-robot added jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. and removed jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. labels Dec 31, 2024

openshift-ci bot requested a review from jogeo December 31, 2024 07:00

Move pull secret creation to after template processing

1ae500d

Add pull secret when pushing images

ff37188

Include organization name in local mirror URL

e0cd1ee

Enable IPv6 support for Quay

4627a2a

ggiguash force-pushed the quay_mirror_registry branch from 30ed483 to 4627a2a Compare January 1, 2025 08:57

ggiguash added 2 commits January 1, 2025 14:04

Fix scenario script to correctly detect registry containers and nginx

750f85e

Fix scenario scripts to correctly reset registry URL

1f8ef94

ggiguash force-pushed the quay_mirror_registry branch from 31ba964 to 1f8ef94 Compare January 1, 2025 12:15

Use hypervisor host name for Quay SERVER_HOSTNAME setting

ca6ef58

ggiguash marked this pull request as ready for review January 3, 2025 15:41

openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jan 3, 2025

openshift-ci bot requested review from copejon and pacevedom January 3, 2025 15:42

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

OCPBUGS-44695: Port mirror registry to use Quay #4369

OCPBUGS-44695: Port mirror registry to use Quay #4369

ggiguash commented Dec 30, 2024 •

edited

Loading

openshift-ci bot commented Dec 30, 2024

openshift-ci bot commented Dec 30, 2024

openshift-ci-robot commented Dec 30, 2024

ggiguash commented Dec 30, 2024

openshift-ci bot commented Dec 30, 2024

ggiguash commented Dec 30, 2024

openshift-ci-robot commented Dec 31, 2024

ggiguash commented Dec 31, 2024

ggiguash commented Dec 31, 2024

ggiguash commented Dec 31, 2024

ggiguash commented Dec 31, 2024

ggiguash commented Dec 31, 2024

openshift-ci-robot commented Jan 1, 2025

ggiguash commented Jan 3, 2025

ggiguash commented Jan 3, 2025

openshift-ci bot commented Jan 3, 2025

OCPBUGS-44695: Port mirror registry to use Quay #4369

Are you sure you want to change the base?

OCPBUGS-44695: Port mirror registry to use Quay #4369

Conversation

ggiguash commented Dec 30, 2024 • edited Loading

Performance comparison

openshift-ci bot commented Dec 30, 2024

openshift-ci bot commented Dec 30, 2024

openshift-ci-robot commented Dec 30, 2024

ggiguash commented Dec 30, 2024

openshift-ci bot commented Dec 30, 2024

ggiguash commented Dec 30, 2024

openshift-ci-robot commented Dec 31, 2024

ggiguash commented Dec 31, 2024

ggiguash commented Dec 31, 2024

ggiguash commented Dec 31, 2024

ggiguash commented Dec 31, 2024

ggiguash commented Dec 31, 2024

openshift-ci-robot commented Jan 1, 2025

ggiguash commented Jan 3, 2025

ggiguash commented Jan 3, 2025

openshift-ci bot commented Jan 3, 2025

ggiguash commented Dec 30, 2024 •

edited

Loading