Skip to content

Conversation

rhmdnd
Copy link
Collaborator

@rhmdnd rhmdnd commented Sep 27, 2025

  • Update ocp4 assertion files
  • Update rhcos4 assertion files

The previous check names relied on an e2e test bundle, resulting in the
each check name being prefixed with `e2e`. This prefix needs to change
if you're calling the suite with different profile bundles, otherwise
the assertions won't match, even though you're using the same
profile.

This commit updates the assertion files so that we just use the default
profile bundle names, and then in the test suite we'll handle the
profile bundles so the one under test is always loaded using the default
names. This results in less tinkering when your testing locally, versus
CI running on PRs, versus periodic CI runs (they all use the same
assertion files, with the same check result names).
The previous check names relied on an e2e test bundle, resulting in the each
check name being prefixed with `e2e`. This prefix needs to change if you're
calling the suite with different profile bundles, otherwise the assertions
won't match, even though you're using the same profile.

This commit updates the assertion files so that we just use the default profile
bundle names, and then in the test suite we'll handle the profile bundles so
the one under test is always loaded using the default names. This results in
less tinkering when your testing locally, versus CI running on PRs, versus
periodic CI runs (they all use the same assertion files, with the same check
result names).
Copy link

openshift-ci bot commented Sep 27, 2025

@rhmdnd: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-aws-openshift-node-compliance c74624d link true /test e2e-aws-openshift-node-compliance

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@ggbecker
Copy link
Member

/packit retest-failed

@yuumasato
Copy link
Member

@rhmdnd -content-dir=$PWD is not working

 + pushd ocp4e2e
/go/src/github.com/ComplianceAsCode/content/ocp4e2e /go/src/github.com/ComplianceAsCode/content
+ go test . '-run=^TestNodeCompliance$' -test-type=node -content-image=registry.build10.ci.openshift.org/ci-op-7202tblm/pipeline@sha256:fec127f30ed6e3a0994154d5d4fd258d41069d6cb3746595cc3911998407e37e -content-directory=/go/src/github.com/ComplianceAsCode/content/ocp4e2e 

It might have to be -content-dir=../, because of pushd ocp4e2e

@jan-cerny jan-cerny added the OpenShift OpenShift product related. label Sep 30, 2025
@rhmdnd
Copy link
Collaborator Author

rhmdnd commented Sep 30, 2025

@rhmdnd -content-dir=$PWD is not working

 + pushd ocp4e2e
/go/src/github.com/ComplianceAsCode/content/ocp4e2e /go/src/github.com/ComplianceAsCode/content
+ go test . '-run=^TestNodeCompliance$' -test-type=node -content-image=registry.build10.ci.openshift.org/ci-op-7202tblm/pipeline@sha256:fec127f30ed6e3a0994154d5d4fd258d41069d6cb3746595cc3911998407e37e -content-directory=/go/src/github.com/ComplianceAsCode/content/ocp4e2e 

It might have to be -content-dir=../, because of pushd ocp4e2e

Fixed in openshift/release#69497

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
OpenShift OpenShift product related.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants