[pipelines] testing: config: update to RHOAI 2.16.0 rc2

[kpouget]

No description provided.

[openshift-ci]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from kpouget. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Details

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[topsail-bot]

Jenkins Job #1700

🔴 Test of 'rhoai test prepare_ci' failed after 00 hours 09 minutes 13 seconds. 🔴

• Link to the test results.

• Link to the reports index.

Test configuration:

# RHOAI: run pipelines test prepare_ci
PR_POSITIONAL_ARGS: gating_test
PR_POSITIONAL_ARG_0: pipelines-perf-ci
PR_POSITIONAL_ARG_1: gating_test

• Link to the Rebuild page.

Failure indicator:

/logs/artifacts/001_prepare_ci/000__prepare_cluster/001__install_rhoai/001__rhods__deploy_ods/FAILURE | [001__rhods__deploy_ods] ./run_toolbox.py from_config rhods deploy_ods --extra={} --> 2
/logs/artifacts/001_prepare_ci/000__prepare_cluster/001__install_rhoai/FAILURE | CalledProcessError: Command 'set -o errexit;set -o pipefail;set -o nounset;set -o errtrace;ARTIFACT_DIR="/logs/artifacts/001_prepare_ci/000__prepare_cluster/001__install_rhoai" ./run_toolbox.py from_config rhods deploy_ods --extra="{}"' returned non-zero exit status 2.
Traceback (most recent call last):
  File "/opt/topsail/src/projects/rhods/library/prepare_rhoai.py", line 54, in install
    run.run_toolbox_from_config("rhods", "deploy_ods")
  File "/opt/topsail/src/projects/core/library/run.py", line 49, in run_toolbox_from_config
    return run(f'{cmd_env} ./run_toolbox.py from_config {group} {command} {_dict_to_run_toolbox_args(kwargs)}', **run_kwargs)
  File "/opt/topsail/src/projects/core/library/run.py", line 105, in run
    proc = subprocess.run(command, **args)
  File "/usr/lib64/python3.9/subprocess.py", line 528, in run

[...]

[Test ran on the internal Perflab CI]

[topsail-bot]

Jenkins Job #1702

🔴 Test of 'rhoai test prepare_ci' failed after 00 hours 09 minutes 09 seconds. 🔴

• Link to the test results.

• Link to the reports index.

Test configuration:

# RHOAI: run pipelines test prepare_ci
PR_POSITIONAL_ARGS: gating_test
PR_POSITIONAL_ARG_0: pipelines-perf-ci
PR_POSITIONAL_ARG_1: gating_test

• Link to the Rebuild page.

Failure indicator:

/logs/artifacts/001_prepare_ci/000__prepare_cluster/001__install_rhoai/001__rhods__deploy_ods/FAILURE | [001__rhods__deploy_ods] ./run_toolbox.py from_config rhods deploy_ods --extra={} --> 2
/logs/artifacts/001_prepare_ci/000__prepare_cluster/001__install_rhoai/FAILURE | CalledProcessError: Command 'set -o errexit;set -o pipefail;set -o nounset;set -o errtrace;ARTIFACT_DIR="/logs/artifacts/001_prepare_ci/000__prepare_cluster/001__install_rhoai" ./run_toolbox.py from_config rhods deploy_ods --extra="{}"' returned non-zero exit status 2.
Traceback (most recent call last):
  File "/opt/topsail/src/projects/rhods/library/prepare_rhoai.py", line 54, in install
    run.run_toolbox_from_config("rhods", "deploy_ods")
  File "/opt/topsail/src/projects/core/library/run.py", line 49, in run_toolbox_from_config
    return run(f'{cmd_env} ./run_toolbox.py from_config {group} {command} {_dict_to_run_toolbox_args(kwargs)}', **run_kwargs)
  File "/opt/topsail/src/projects/core/library/run.py", line 105, in run
    proc = subprocess.run(command, **args)
  File "/usr/lib64/python3.9/subprocess.py", line 528, in run

[...]

[Test ran on the internal Perflab CI]

[topsail-bot]

Jenkins Job #1703

🔴 Test of 'rhoai test prepare_ci' failed after 00 hours 00 minutes 07 seconds. 🔴

• Link to the test results.

• Link to the reports index.

Test configuration:

# RHOAI: run pipelines test prepare_ci
PR_POSITIONAL_ARGS: gating_test
PR_POSITIONAL_ARG_0: pipelines-perf-ci
PR_POSITIONAL_ARG_1: gating_test

• Link to the Rebuild page.

Failure indicator: Empty. (See run.log)

[Test ran on the internal Perflab CI]

[topsail-bot]

Jenkins Job #1704

🔴 Test of 'rhoai test prepare_ci' failed after 00 hours 00 minutes 08 seconds. 🔴

• Link to the test results.

• Link to the reports index.

Test configuration:

# RHOAI: run pipelines test prepare_ci
PR_POSITIONAL_ARGS: gating_test
PR_POSITIONAL_ARG_0: pipelines-perf-ci
PR_POSITIONAL_ARG_1: gating_test

• Link to the Rebuild page.

Failure indicator: Empty. (See run.log)

[Test ran on the internal Perflab CI]

[topsail-bot]

Jenkins Job #1705

🔴 Test of 'rhoai test prepare_ci' failed after 00 hours 03 minutes 10 seconds. 🔴

• Link to the test results.

• Link to the reports index.

Test configuration:

# RHOAI: run pipelines test prepare_ci
PR_POSITIONAL_ARGS: gating_test
PR_POSITIONAL_ARG_0: pipelines-perf-ci
PR_POSITIONAL_ARG_1: gating_test

• Link to the Rebuild page.

Failure indicator:

/logs/artifacts/001_prepare_ci/000__prepare_cluster/000__prepare_driver/000__prepare_user_pods/002__cluster__build_push_image_topsail_pr-600/FAILURE | [002__cluster__build_push_image_topsail_pr-600] ./run_toolbox.py from_config cluster build_push_image --prefix=base_image --extra={} --> 2

[Test ran on the internal Perflab CI]

[topsail-bot]

Jenkins Job #1706

🟢 Test of 'rhoai test test_ci' succeeded after 01 hours 09 minutes 48 seconds. 🟢

• Link to the test results.

• Link to the reports index.

Test configuration:

# RHOAI: run pipelines test test_ci
PR_POSITIONAL_ARGS: gating_test
PR_POSITIONAL_ARG_0: pipelines-perf-ci
PR_POSITIONAL_ARG_1: gating_test

• Link to the Rebuild page.

[Test ran on the internal Perflab CI]

[kpouget]

@dagrayvid, can you have a look at this PR and let me know if you agree?
I updated a bit what you did to deploy RHOAI 2.16, basically to move the brew vs quay distinction inside the _setup_brew_registry, instead of having it in all of the components
We'll forget about it, so better have it in a single place, instead of spread everywhere!

[dagrayvid]

@kpouget looks good to me, thanks. One note, I don't think the setup.sh script currently handles switching back and forth between brew and quay because of how it checks whether the ICSP already exists, and whether the pull secret already contains an entry for a given repo.

So I need to follow up to make this script always has the same result whether it has already been run on the same cluster with different inputs.